vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #255
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.44t2721TeP', fmt=raw size=107374182412(finished: start all VMs, in 52.57 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 5e25b687-b1ad-48f6-ab82-4cfca4ba171019gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fhxw3m1wwps9svmc3rwamic3bwxrd6b2-nixos-system-gitlab-test/init regInfo=/nix/store/7wsf1si62xxw3al5j8h8fsi0dikr886b-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 484095611 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000808] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000875] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002732] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002743] Using GB pages for direct mapping73gitlab # [ 0.002808] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002816] ACPI: Early table checksum verification disabled75gitlab # [ 0.002818] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002822] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002826] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002833] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002835] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002836] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002838] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002839] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002841] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002842] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002842] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002843] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002843] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002844] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003079] No NUMA configuration found90gitlab # [ 0.003080] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003082] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005448] Zone ranges:93gitlab # [ 0.005449] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005450] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005452] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005453] Device empty97gitlab # [ 0.005453] Movable zone start for each node98gitlab # [ 0.005454] Early memory node ranges99gitlab # [ 0.005454] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005455] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005456] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005457] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005477] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005753] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115575] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116006] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116021] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116052] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116055] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116056] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116058] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116059] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116060] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116062] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116063] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116068] TSC deadline timer available117gitlab # [ 0.116072] CPU topo: Max. logical packages: 1118gitlab # [ 0.116073] CPU topo: Max. logical dies: 1119gitlab # [ 0.116074] CPU topo: Max. dies per package: 1120gitlab # [ 0.116077] CPU topo: Max. threads per core: 1121gitlab # [ 0.116078] CPU topo: Num. cores per package: 4122gitlab # [ 0.116078] CPU topo: Num. threads per package: 4123gitlab # [ 0.116078] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116102] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116118] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116121] kvm-guest: setup PV sched yield127gitlab # [ 0.116136] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116138] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116139] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116140] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116142] Booting paravirtualized kernel on KVM132gitlab # [ 0.116146] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.120587] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.122830] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.122878] kvm-guest: PV spinlocks enabled136gitlab # [ 0.122880] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.122882] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fhxw3m1wwps9svmc3rwamic3bwxrd6b2-nixos-system-gitlab-test/init regInfo=/nix/store/7wsf1si62xxw3al5j8h8fsi0dikr886b-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.122977] Unknown kernel command line parameters "regInfo=/nix/store/7wsf1si62xxw3al5j8h8fsi0dikr886b-closure-info/registration", will be passed to user space.139gitlab # [ 0.122990] random: crng init done140gitlab # [ 0.122991] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.131966] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.136335] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.136413] software IO TLB: area num 4.144gitlab # [ 0.211936] Fallback order for Node 0: 0145gitlab # [ 0.211943] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.211945] Policy zone: Normal147gitlab # [ 0.214520] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.224022] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.237763] allocated 12582912 bytes of page_ext150gitlab # [ 0.247999] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.248001] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.248832] Dynamic Preempt: lazy153gitlab # [ 0.249017] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.249017] rcu: RCU event tracing is enabled.155gitlab # [ 0.249018] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.249019] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.249020] Rude variant of Tasks RCU enabled.158gitlab # [ 0.249020] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.249021] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.249021] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.249047] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.249049] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.249050] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.253407] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.253695] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.253709] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.253833] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.257401] Console: colour VGA+ 80x25169gitlab # [ 0.257404] printk: legacy console [tty0] enabled170gitlab # [ 0.288227] printk: legacy console [ttyS0] enabled171gitlab # [ 0.395610] ACPI: Core revision 20250807172gitlab # [ 0.396604] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.398220] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.399277] x2apic enabled175gitlab # [ 0.400042] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.400980] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.402291] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.403813] kvm-guest: setup PV IPIs179gitlab # [ 0.405467] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.406566] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.408430] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.409517] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.411503] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.413427] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.414433] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.416428] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.418428] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.419427] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.420427] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.421427] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.422436] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.424222] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.425428] active return thunk: srso_alias_return_thunk194gitlab # [ 0.426452] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.427427] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.428428] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.429427] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.431275] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.432427] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.433427] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.434428] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.435428] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.436427] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.438250] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.439235] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.440188] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.470246] Freeing SMP alternatives memory: 44K208gitlab # [ 0.470973] pid_max: default: 32768 minimum: 301209gitlab # [ 0.471539] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.472529] landlock: Up and running.211gitlab # [ 0.473427] Yama: becoming mindful.212gitlab # [ 0.474589] LSM support for eBPF active213gitlab # [ 0.475506] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.476591] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.479530] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.480994] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.481434] ... version: 2218gitlab # [ 0.482194] ... bit width: 48219gitlab # [ 0.482429] ... generic counters: 6220gitlab # [ 0.483187] ... generic bitmap: 000000000000003f221gitlab # [ 0.483428] ... fixed-purpose counters: 0222gitlab # [ 0.484186] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.484429] ... value mask: 0000ffffffffffff224gitlab # [ 0.485371] ... max period: 00007fffffffffff225gitlab # [ 0.486169] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.486543] signal: max sigframe size: 3376227gitlab # [ 0.487343] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.488042] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.488653] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.493959] smp: Bringing up secondary CPUs ...231gitlab # [ 0.494842] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.495431] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.498528] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.500144] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.500949] Memory: 6011364K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.502429] devtmpfs: initialized237gitlab # [ 0.503341] x86/mm: Memory block size: 128MB238gitlab # [ 0.506599] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.507505] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.508514] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.509729] PM: RTC time: 07:37:37, date: 2026-08-23242gitlab # [ 0.513326] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.515913] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.516484] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.518554] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.519441] audit: initializing netlink subsys (disabled)247gitlab # [ 0.520448] audit: type=2000 audit(1787470657.254:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.520644] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.522429] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.523429] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.524429] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.525428] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.526442] cpuidle: using governor menu254gitlab # [ 0.528626] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.529666] PCI: Using configuration type 1 for base access256gitlab # [ 0.530430] PCI: Using configuration type 1 for extended access257gitlab # [ 0.531617] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.534495] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.535429] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.536429] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.537428] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.541640] ACPI: Added _OSI(Module Device)263gitlab # [ 0.543437] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.545435] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.552375] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.558670] ACPI: Interpreter enabled267gitlab # [ 0.559945] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.560430] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.561600] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.564436] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.568018] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.580882] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.583445] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.587727] acpiphp: Slot [3] registered275gitlab # [ 0.589491] acpiphp: Slot [4] registered276gitlab # [ 0.591485] acpiphp: Slot [5] registered277gitlab # [ 0.593507] acpiphp: Slot [6] registered278gitlab # [ 0.594486] acpiphp: Slot [7] registered279gitlab # [ 0.596473] acpiphp: Slot [8] registered280gitlab # [ 0.597471] acpiphp: Slot [9] registered281gitlab # [ 0.598495] acpiphp: Slot [10] registered282gitlab # [ 0.600474] acpiphp: Slot [11] registered283gitlab # [ 0.601472] acpiphp: Slot [12] registered284gitlab # [ 0.602499] acpiphp: Slot [13] registered285gitlab # [ 0.604474] acpiphp: Slot [14] registered286gitlab # [ 0.605470] acpiphp: Slot [15] registered287gitlab # [ 0.607471] acpiphp: Slot [16] registered288gitlab # [ 0.608504] acpiphp: Slot [17] registered289gitlab # [ 0.609472] acpiphp: Slot [18] registered290gitlab # [ 0.611471] acpiphp: Slot [19] registered291gitlab # [ 0.612471] acpiphp: Slot [20] registered292gitlab # [ 0.613490] acpiphp: Slot [21] registered293gitlab # [ 0.615473] acpiphp: Slot [22] registered294gitlab # [ 0.616222] acpiphp: Slot [23] registered295gitlab # [ 0.616448] acpiphp: Slot [24] registered296gitlab # [ 0.617204] acpiphp: Slot [25] registered297gitlab # [ 0.618450] acpiphp: Slot [26] registered298gitlab # [ 0.619222] acpiphp: Slot [27] registered299gitlab # [ 0.619458] acpiphp: Slot [28] registered300gitlab # [ 0.620193] acpiphp: Slot [29] registered301gitlab # [ 0.621449] acpiphp: Slot [30] registered302gitlab # [ 0.622199] acpiphp: Slot [31] registered303gitlab # [ 0.622456] PCI host bridge to bus 0000:00304gitlab # [ 0.623193] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.624434] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.625442] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.628438] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.631437] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.634466] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.637215] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.641760] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.646507] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.652502] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.655521] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.657434] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.659434] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.662434] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.664902] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.671651] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.676821] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.679967] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.682445] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.684879] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.701516] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.702482] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.703456] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.704947] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.707322] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.712465] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.713304] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.714147] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.726321] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.728711] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.732465] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.733299] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.735146] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.737504] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.741466] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.743059] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.744450] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.746650] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.750425] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.751249] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.752153] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.754690] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.758467] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.759307] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.760146] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.762522] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.767466] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.768306] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.769459] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.771829] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.777465] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.778311] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.779148] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.780306] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.783410] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.787394] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.788162] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.790548] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.794477] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.795310] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.796148] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.799436] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.803373] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.804035] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.804450] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.810602] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.811574] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.812560] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.813556] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.814501] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.816678] iommu: Default domain type: Translated375gitlab # [ 0.817430] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.818650] ACPI: bus type USB registered377gitlab # [ 0.819498] usbcore: registered new interface driver usbfs378gitlab # [ 0.820481] usbcore: registered new interface driver hub379gitlab # [ 0.821384] usbcore: registered new device driver usb380gitlab # [ 0.824378] NetLabel: Initializing381gitlab # [ 0.824859] NetLabel: domain hash size = 128382gitlab # [ 0.825429] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.826434] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.827320] PCI: Using ACPI for IRQ routing385gitlab # [ 0.828594] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.829350] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.829425] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.831431] vgaarb: loaded389gitlab # [ 0.832128] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.833429] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.839507] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.841472] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.842180] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.843595] pnp: PnP ACPI init395gitlab # [ 0.844692] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.853533] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.855104] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.856123] NET: Registered PF_INET protocol family399gitlab # [ 0.858232] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.875962] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.877469] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.878917] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.883034] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.884408] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.885601] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.886971] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.888413] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.889772] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.890738] NET: Registered PF_XDP protocol family410gitlab # [ 0.891599] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.892612] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.893618] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.894738] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.895912] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.897337] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.898351] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.900909] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.903473] PCI: CLS 0 bytes, default 64419gitlab # [ 0.904324] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.904893] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.905377] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.908085] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.928834] Initialise system trusted keyrings424gitlab # [ 0.929941] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.941192] Key type asymmetric registered426gitlab # [ 0.941951] Asymmetric key parser 'x509' registered427gitlab # [ 0.942882] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.944602] io scheduler mq-deadline registered429gitlab # [ 0.945416] io scheduler kyber registered430gitlab # [ 0.948363] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.949698] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.952207] Linux agpgart interface v0.103433gitlab # [ 0.953011] ACPI: bus type drm_connector registered434gitlab # [ 0.955509] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.956625] usbserial: USB Serial support registered for generic436gitlab # [ 0.957633] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.957633] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.959957] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.961392] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.962602] NET: Registered PF_INET6 protocol family441gitlab # [ 0.964314] Segment Routing with IPv6442gitlab # [ 0.965016] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.967197] IPI shorthand broadcast: enabled444gitlab # [ 0.971513] sched_clock: Marking stable (824011515, 146717034)->(989158962, -18430413)445gitlab # [ 0.973264] registered taskstats version 1446gitlab # [ 0.974345] Loading compiled-in X.509 certificates447gitlab # [ 0.983804] Demotion targets for Node 0: null448gitlab # [ 0.985000] Key type .fscrypt registered449gitlab # [ 0.985662] Key type fscrypt-provisioning registered450gitlab # [ 0.986611] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 0.987540] ima: Allocated hash algorithm: sha1452gitlab # [ 0.988369] ima: No architecture policies found453gitlab # [ 0.989450] PM: Magic number: 6:64:623454gitlab # [ 0.991053] RAS: Correctable Errors collector initialized.455gitlab # [ 0.995467] clk: Disabling unused clocks456gitlab # [ 0.996169] PM: genpd: Disabling unused power domains457gitlab # [ 1.189970] Freeing initrd memory: 29392K458gitlab # [ 1.199780] Freeing unused decrypted memory: 2028K459gitlab # [ 1.206097] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.208783] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.213497] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.217213] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.285161] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.286333] Run /init as init process465gitlab # [ 1.297683] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.318793] fuse: init (API version 7.45)467gitlab # [ 1.327240] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.334611] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.338326] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.375380] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.712244] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.752366] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.754485] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.756560] systemd[1]: Running in initrd.475gitlab # [ 1.758990] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.761797] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.871845] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.910596] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.921352] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.922529] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.923966] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.925147] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.926266] systemd[1]: Reached target Path Units.484gitlab # [ 1.927171] systemd[1]: Reached target Slice Units.485gitlab # [ 1.928079] systemd[1]: Reached target Swaps.486gitlab # [ 1.928894] systemd[1]: Reached target Timer Units.487gitlab # [ 1.929868] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.931087] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.932263] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.933299] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.934331] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.935310] systemd[1]: Reached target Socket Units.493gitlab # [ 1.937180] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.939230] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.941228] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.943917] systemd[1]: Starting Journal Service...497gitlab # [ 1.947967] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 1.948966] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 1.955800] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 1.961149] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 1.965588] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 1.980044] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 1.992241] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 1.992697] systemd-journald[91]: Collecting audit messages is disabled.505gitlab # [ 1.994332] netfs: FS-Cache loaded506gitlab # [ 1.997808] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 2.003033] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.006970] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.010912] 9pnet: Installing 9P2000 support510gitlab # [ 2.016032] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.017455] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.512gitlab # [ 2.019148] systemd[1]: Finished Load Kernel Module 9pnet_virtio.513gitlab # [ 2.021431] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.023134] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.515gitlab # [ 2.029810] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 2.033260] systemd[1]: Finished Apply Kernel Variables.517gitlab # [ 2.038916] systemd[1]: Started Journal Service.518gitlab # [ 1.892304] systemd-modules-load[93]: Using 4 probe threads519gitlab # [ 1.894127] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 1.895135] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 1.896061] systemd-modules-load[93]: Inserted module 'virtio_balloon'522gitlab # [ 1.900787] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.901688] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.902578] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.903287] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.904109] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.923041] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.931092] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 1.936134] systemd[1]: Finished Coldplug All udev Devices.530gitlab # [ 1.942077] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 1.942992] systemd[1]: Reached target System Initialization.532gitlab # [ 1.943744] systemd[1]: Reached target Basic System.533gitlab # [ 2.207131] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.219166] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)535gitlab # [ 2.221742] SCSI subsystem initialized536gitlab # [ 2.224910] virtio_blk virtio5: 4/0/0 default/read/poll queues537gitlab # [ 2.230936] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12538gitlab # [ 2.234015] serio: i8042 KBD port at 0x60,0x64 irq 1539gitlab # [ 2.234753] serio: i8042 AUX port at 0x60,0x64 irq 12540gitlab # [ 2.234961] virtio_blk virtio5: [vdb] 11830864 512-byte logical blocks (6.06 GB/5.64 GiB)541gitlab # [ 2.238214] uhci_hcd 0000:00:01.2: UHCI Host Controller542gitlab # [ 2.239294] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1543gitlab # [ 2.240950] uhci_hcd 0000:00:01.2: detected 2 ports544gitlab # [ 2.242517] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140545gitlab # [ 2.243866] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18546gitlab # [ 2.245061] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1547gitlab # [ 2.246213] usb usb1: Product: UHCI Host Controller548gitlab # [ 2.246986] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd549gitlab # [ 2.247696] usb usb1: SerialNumber: 0000:00:01.2550gitlab # [ 2.254624] hub 1-0:1.0: USB hub found551gitlab # [ 2.257084] hub 1-0:1.0: 2 ports detected552gitlab # [ 2.139740] systemd[1]: Starting Virtual Console Setup...553gitlab # [ 2.148485] (udev-worker)[128]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.554gitlab # [ 2.150730] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line.555gitlab # [ 2.152891] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.155718] systemd[1]: Found device /dev/disk/by-label/nixos.557gitlab # [ 2.156582] systemd[1]: Reached target Initrd Root Device.558gitlab # [ 2.305427] scsi host0: ata_piix559gitlab # [ 2.306436] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0560gitlab # [ 2.160253] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...561gitlab # [ 2.311848] scsi host1: ata_piix562gitlab # [ 2.312414] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0563gitlab # [ 2.313462] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0564gitlab # [ 2.168358] systemd[1]: Found device /dev/disk/by-label/nix-store.565gitlab # [ 2.169495] systemd-vconsole-setup[145]: Configuration of first virtual console was skipped, ignoring remaining ones.566gitlab # [ 2.171103] systemd[1]: Finished Virtual Console Setup.567gitlab # [ 2.180839] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.183472] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.472051] ata2: found unknown device (class 0)570gitlab # [ 2.473315] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.475597] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.480854] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.535947] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.565381] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.649537] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.652802] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.655616] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.657391] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.658997] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.693106] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.704624] usbcore: registered new interface driver usbhid582gitlab # [ 2.707217] usbhid: USB HID core driver583gitlab # [ 2.718337] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.722495] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.813660] systemd[1]: Mounting /sysroot...586gitlab # [ 3.116854] EXT4-fs (vda): mounted filesystem 5e25b687-b1ad-48f6-ab82-4cfca4ba1710 r/w with ordered data mode. Quota mode: none.587gitlab # [ 2.977296] systemd[1]: Mounted /sysroot.588gitlab # [ 2.978516] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 2.982285] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 2.984184] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 2.987898] systemd[1]: Mounting /sysroot/run...592gitlab # [ 2.989640] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 2.993853] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.001971] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.007861] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.010154] systemd[1]: Mounted /sysroot/run.597gitlab # [ 3.014121] systemd[1]: Starting rw-sysroot-nix-store.service...598gitlab # [ 3.021412] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.599gitlab # [ 3.170421] 9p: Installing v9fs 9p2000 file system support600gitlab # [ 3.024635] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...601gitlab # [ 3.026867] systemd[1]: Reloading...602gitlab # [ 3.175114] erofs (device vdb): mounted with root inode @ nid 128.603gitlab # [ 3.089431] systemd[1]: Reloading finished in 62 ms.604gitlab # [ 3.113747] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...605gitlab # [ 3.116576] systemd[1]: Mounted /sysroot/nix/.ro-store.606gitlab # [ 3.118448] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.120284] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.122217] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.124666] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.126709] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.129264] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.131329] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.133663] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.136285] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.142056] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.144302] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.814566] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.864708] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.866794] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.868833] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.870699] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.901493] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.904656] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.923385] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.925250] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.927602] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 3.968671] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 3.970665] systemd[1]: Stopped target Basic System.629gitlab # [ 3.972377] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 3.974188] systemd[1]: Stopped target Path Units.631gitlab # [ 3.975774] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 3.978570] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 3.980940] systemd[1]: Stopped target Slice Units.634gitlab # [ 3.984120] systemd[1]: Stopped target Socket Units.635gitlab # [ 3.986688] systemd[1]: Stopped target System Initialization.636gitlab # [ 3.988918] systemd[1]: Stopped target Swaps.637gitlab # [ 3.990793] systemd[1]: Stopped target Timer Units.638gitlab # [ 3.992434] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 3.994463] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 3.996429] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 3.999404] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.001185] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.004550] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.006433] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.008306] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.009878] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.012089] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.013628] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.016235] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.018398] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.020384] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.022061] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.023368] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.024497] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.025683] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.026656] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.027833] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.028982] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.029928] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.031121] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.032237] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.033441] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.034719] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.035824] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.037043] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.037944] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.038614] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.039344] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.040315] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.041120] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.042135] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.043079] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.043952] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.048665] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.049751] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.050549] systemd[1]: Reached target Switch Root.677gitlab # [ 4.051919] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.152798] initrd-nixos-activation-start[231]: booting system configuration /nix/store/fhxw3m1wwps9svmc3rwamic3bwxrd6b2-nixos-system-gitlab-test679gitlab # [ 4.194388] initrd-nixos-activation-start[231]: running activation script...680gitlab # [ 4.431475] initrd-nixos-activation-start[254]: setting up /etc...681gitlab # [ 4.513860] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.516448] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.518104] systemd[1]: Starting Switch Root...684gitlab # [ 4.548658] systemd[1]: Switching root.685gitlab # [ 4.755461] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.885968] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.262154] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.272029] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.273855] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.275786] systemd[1]: Detected first boot.691gitlab # [ 5.278334] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.423390] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.524113] systemd[1]: Applying preset policy.694gitlab # [ 5.646896] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.766968] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.768250] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.770566] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.772506] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.773877] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.775488] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.776403] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.777555] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.778609] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.779405] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.780181] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.780991] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.781693] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.782483] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.783344] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.784308] systemd[1]: Reached target Path Units.711gitlab # [ 5.785018] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.785779] systemd[1]: Reached target Slice Units.713gitlab # [ 5.786471] systemd[1]: Reached target Swaps.714gitlab # [ 5.787923] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.789858] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.791180] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.792778] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.793659] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.796047] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.797589] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.799413] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.800566] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.801652] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.802947] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.805698] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.806695] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.807528] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.810325] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.812503] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.814588] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.817576] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.829294] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.830285] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.835147] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.841545] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.843139] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.844784] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.860843] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.861748] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.865807] systemd[1]: Starting Journal Service...741gitlab # [ 5.867776] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.870116] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.873802] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.874691] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.885800] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.888844] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 5.889845] systemd[1]: Mounted Huge Pages File System.748gitlab # [ 5.890682] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 5.891773] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 5.892650] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 5.893975] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 5.895246] systemd[1]: modprobe@configfs.service: Deactivated successfully.753gitlab # [ 5.896617] systemd[1]: Finished Load Kernel Module configfs.754gitlab # [ 5.897696] systemd[1]: Mounted FUSE Control File System.755gitlab # [ 5.899958] EXT4-fs (vda): re-mounted 5e25b687-b1ad-48f6-ab82-4cfca4ba1710.756gitlab # [ 5.900315] systemd[1]: Mounting Kernel Configuration File System...757gitlab # [ 5.904143] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...758gitlab # [ 5.908630] systemd-journald[324]: Collecting audit messages is enabled.759gitlab # [ 5.909738] systemd[1]: Finished Remount Root and Kernel File Systems.760gitlab # [ 5.910953] systemd[1]: Listening on Disk Image Download Service Socket.761gitlab # [ 5.911910] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore762gitlab # [ 5.914878] systemd[1]: Starting Load/Save OS Random Seed...763gitlab # [ 5.915693] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 5.917274] loop: module loaded765gitlab # [ 5.922429] systemd[1]: Mounted Kernel Configuration File System.766gitlab # [ 5.923463] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.767gitlab # [ 5.780954] systemd[1]: Queued start job for default target Multi-User System.768gitlab # [ 5.782191] systemd[1]: Unnecessary job was removed for /dev/vdb.769gitlab # [ 5.928838] systemd[1]: Finished Load Kernel Modules.770gitlab # [ 5.783451] systemd[1]: systemd-journald.service: Deactivated successfully.771gitlab # [ 5.930569] systemd[1]: Started Journal Service.772gitlab # [ 5.785053] systemd-modules-load[325]: Using 3 probe threads773gitlab # [ 5.786291] systemd-modules-load[325]: Inserted module 'tls'774gitlab # [ 5.787295] systemd-modules-load[325]: Inserted module 'loop'775gitlab # [ 5.788522] systemd-oomd[326]: No swap; memory pressure usage will be degraded776gitlab # [ 5.790213] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.777gitlab # [ 5.791504] systemd[1]: Starting Firewall...778gitlab # [ 5.793409] systemd[1]: Starting Flush Journal to Persistent Storage...779gitlab # [ 5.806140] systemd[1]: Starting Apply Kernel Variables...780gitlab # [ 5.807860] systemd[1]: Starting Create Static Device Nodes in /dev...781gitlab # [ 5.811142] systemd[1]: Finished Load/Save OS Random Seed.782gitlab # [ 5.962899] systemd-journald[324]: Received client request to flush runtime journal.783gitlab # [ 5.857104] systemd[1]: Reached target First Boot Complete.784gitlab # [ 5.858399] systemd[1]: Finished Create Static Device Nodes in /dev.785gitlab # [ 5.859457] systemd[1]: Reached target Preparation for Local File Systems.786gitlab # [ 5.860926] systemd[1]: Starting Rule-based Manager for Device Events and Files...787gitlab # [ 5.862093] systemd[1]: Finished Apply Kernel Variables.788gitlab # [ 5.863093] systemd-udevd[357]: Using default interface naming scheme 'v261'.789gitlab # [ 5.863986] systemd[1]: Finished Flush Journal to Persistent Storage.790gitlab # [ 5.893307] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 5.909182] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 5.970923] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 5.982976] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.000290] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.003121] (udev-worker)[413]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.004355] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.005510] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.798gitlab # [ 6.015385] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.017907] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.019602] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.021818] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.024211] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.025689] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.219766] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.234799] ACPI: button: Power Button [PWRF]806gitlab # [ 6.235997] rtc_cmos 00:05: RTC can wake from S4807gitlab # [ 6.243190] rtc_cmos 00:05: registered as rtc0808gitlab # [ 6.244038] rtc_cmos 00:05: setting system clock to 2026-08-23T07:37:42 UTC (1787470662)809gitlab # [ 6.245903] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs810gitlab # [ 6.255306] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0811gitlab # [ 6.256792] Floppy drive(s): fd0 is 2.88M AMI BIOS812gitlab # [ 6.258075] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD813gitlab # [ 6.260807] systemd-journald[324]: Time jumped backwards, rotating.814gitlab # [ 6.265881] parport_pc 00:03: reported by Plug and Play ACPI815gitlab # [ 6.266061] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console816gitlab # [ 6.266180] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]817gitlab # [ 6.270799] FDC 0 is a S82078B818gitlab # [ 6.281101] Console: switching to colour dummy device 80x25819gitlab # [ 6.282623] [drm] Found bochs VGA, ID 0xb0c5.820gitlab # [ 6.282625] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.821gitlab # [ 6.284868] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic822gitlab # [ 6.285617] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0823gitlab # [ 6.297771] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5824gitlab # [ 6.297963] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6825gitlab # [ 6.299110] Console: switching to colour frame buffer device 160x50826gitlab # [ 6.302395] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device827gitlab # [ 6.156950] systemd[1]: Finished Firewall.828gitlab # [ 6.308880] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4829gitlab # [ 6.196291] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 6.208791] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 6.361882] ppdev: user-space parallel port driver832gitlab # [ 6.217111] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.234653] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.243085] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.835gitlab # [ 6.244516] systemd[1]: Stopped Virtual Console Setup.836gitlab # [ 6.394908] mousedev: PS/2 mouse device common for all mice837gitlab # [ 6.248368] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.321067] systemd-vconsole-setup[498]: Configuration of first virtual console was skipped, ignoring remaining ones.839gitlab # [ 6.323450] systemd[1]: Finished Virtual Console Setup.840gitlab # [ 6.478093] kvm_amd: TSC scaling supported841gitlab # [ 6.478555] kvm_amd: Nested Virtualization enabled842gitlab # [ 6.479095] kvm_amd: Nested Paging enabled843gitlab # [ 6.479493] kvm_amd: LBR virtualization supported844gitlab # [ 6.480010] kvm_amd: Virtual VMLOAD VMSAVE supported845gitlab # [ 6.480479] kvm_amd: Virtual GIF supported846gitlab # [ 6.480948] kvm_amd: Virtual NMI enabled847gitlab # [ 6.515540] EDAC MC: Ver: 3.0.0848gitlab # [ 6.625587] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.652791] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.655484] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.658669] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.663300] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.667391] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.669402] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.678603] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.680857] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.715429] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.718456] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.730734] systemd[1]: Finished Create System Files and Directories.860gitlab # [ 6.736084] systemd[1]: Starting Rebuild Journal Catalog...861gitlab # [ 6.738057] systemd[1]: Starting Record System Boot/Shutdown in UTMP...862gitlab # [ 6.753372] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.767281] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.768846] systemd[1]: Starting Update is Completed...865gitlab # [ 6.784475] systemd[1]: Finished Update is Completed.866gitlab # [ 6.855758] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.857987] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 7.063379] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 7.065535] systemd[1]: Reached target System Initialization.870gitlab # [ 7.067653] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 7.070170] systemd[1]: Started logrotate.timer.872gitlab # [ 7.071951] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 7.074324] systemd[1]: Reached target Timer Units.874gitlab # [ 7.076230] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 7.078450] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 7.080425] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 7.082433] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 7.085370] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 7.087635] systemd[1]: Reached target Socket Units.880gitlab # [ 7.089777] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 7.117863] dbus-broker-launch[582]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 7.121516] dbus-broker-launch[582]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.124286] dbus-broker-launch[582]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.130368] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.141296] dbus-broker-launch[582]: Ready886gitlab # [ 7.143943] systemd[1]: Reached target Basic System.887gitlab # [ 7.146789] systemd[1]: Started backdoor.service.888gitlab # [ 7.149708] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.152460] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.167141] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.172571] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.177282] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.182141] systemd[1]: Started Reset console on configuration changes.894gitlab # connecting to host...895gitlab # [ 7.194184] logrotate[587]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.896gitlab # [ 7.199570] logrotate[587]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf897gitlab # [ 7.200937] logrotate[587]: note: 'monthly' overrides previously specified 'weekly'898gitlab # [ 7.202885] logrotate[587]: Reading state from file: /var/lib/logrotate.status899gitlab # [ 7.204411] logrotate[587]: state file /var/lib/logrotate.status does not exist900gitlab # [ 7.205282] logrotate[587]: Allocating hash table for state file, size 64 entries901gitlab # [ 7.206492] logrotate[587]: Handling 4 logs902gitlab: Guest shell says: b'Spawning backdoor root shell...\n'903gitlab # [ 7.207395] logrotate[587]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab # [ 7.208395] logrotate[587]: considering log /var/log/btmp905gitlab # [ 7.209113] logrotate[587]: Creating new state906gitlab # [ 7.209992] logrotate[587]: Now: 2026-08-23 07:37907gitlab: connected to guest root shell908gitlab # [ 7.210598] logrotate[587]: Last rotated at 2026-08-23 07:00909gitlab: (connecting took 7.85 seconds)910gitlab # [ 7.211468] logrotate[587]: log does not need rotating (log has already been rotated)911gitlab: (finished: waiting for the VM to finish booting, in 7.85 seconds)912gitlab # [ 7.212762] logrotate[587]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed913gitlab # [ 7.213975] logrotate[587]: considering log /var/log/wtmp914gitlab # [ 7.215050] logrotate[587]: Creating new state915gitlab # [ 7.215947] logrotate[587]: Now: 2026-08-23 07:37916gitlab # [ 7.217068] logrotate[587]: Last rotated at 2026-08-23 07:00917gitlab # [ 7.218068] logrotate[587]: log does not need rotating (log has already been rotated)918gitlab # [ 7.219132] logrotate[587]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed919gitlab # [ 7.219730] logrotate[587]: switching euid from 0 to 165 and egid from 0 to 165 (pid 587)920gitlab # [ 7.220545] logrotate[587]: considering log /var/gitlab/state/log/*.log921gitlab # [ 7.221678] logrotate[587]: log /var/gitlab/state/log/*.log does not exist -- skipping922gitlab # [ 7.222758] logrotate[587]: Creating new state923gitlab # [ 7.223470] logrotate[587]: switching euid from 165 to 0 and egid from 165 to 0 (pid 587)924gitlab # [ 7.223883] logrotate[587]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed925gitlab # [ 7.224441] logrotate[587]: switching euid from 0 to 60 and egid from 0 to 60 (pid 587)926gitlab # [ 7.224852] logrotate[587]: considering log /var/log/nginx/*.log927gitlab # [ 7.225403] logrotate[587]: log /var/log/nginx/*.log does not exist -- skipping928gitlab # [ 7.225823] logrotate[587]: Creating new state929gitlab # [ 7.226383] logrotate[587]: not running postrotate script, since no logs were rotated930gitlab # [ 7.226826] logrotate[587]: switching euid from 60 to 0 and egid from 60 to 0 (pid 587)931gitlab # [ 7.227581] systemd[1]: Starting resolvconf update...932gitlab # [ 7.228348] nsncd[588]: Aug 23 07:37:43.608 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab # [ 7.228848] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 7.232424] systemd[1]: Finished Logrotate configuration check.935gitlab # [ 7.233700] systemd[1]: Finished Post-Boot Actions.936gitlab # [ 7.240902] systemd[1]: Finished Import lastlog data into lastlog2 database.937gitlab # [ 7.246434] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 7.247213] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 7.251613] systemd[1]: Starting User Login Management...940gitlab # [ 7.265858] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.267615] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.268263] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.268695] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.269194] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.271632] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.272249] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.272708] systemd[1]: nscd.service: Consumed 23ms CPU time over 101ms wall clock time, 7.3M memory peak, 5.5M read from disk.948gitlab # [ 7.275583] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.292391] nsncd[677]: Aug 23 07:37:43.694 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"950gitlab # [ 7.294365] systemd[1]: Started Name Service Cache Daemon (nsncd).951gitlab # [ 7.296653] systemd[1]: Finished resolvconf update.952gitlab # [ 7.297473] systemd[1]: Reached target Preparation for Network.953gitlab # [ 7.298315] systemd[1]: Reached target Host and Network Name Lookups.954gitlab # [ 7.299174] systemd[1]: Reached target User and Group Name Lookups.955gitlab # [ 7.300040] systemd[1]: Starting DHCP Client...956gitlab # [ 7.301216] systemd-logind[642]: New seat seat0.957gitlab # [ 7.302876] systemd[1]: Starting Address configuration of eth1...958gitlab # [ 7.305967] systemd-logind[642]: Watching system buttons on /dev/input/event2 (Power Button)959gitlab # [ 7.307123] systemd-logind[642]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)960gitlab # [ 7.308922] systemd-logind[642]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)961gitlab # [ 7.312338] systemd[1]: Starting Extra networking commands....962gitlab # [ 7.312961] systemd[1]: Started User Login Management.963gitlab # [ 7.316088] systemd[1]: Starting linger-users.service...964gitlab # [ 7.327249] network-addresses-eth1-start[702]: adding address 192.168.1.1/24... done965gitlab # [ 7.329194] systemd[1]: linger-users.service: Deactivated successfully.966gitlab # [ 7.329793] systemd[1]: Finished linger-users.service.967gitlab # [ 7.332893] network-addresses-eth1-start[702]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.338035] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.378075] dhcpcd[719]: dhcpcd-10.3.2 starting970gitlab # [ 7.379612] systemd[1]: Finished Extra networking commands..971gitlab # [ 7.380235] dhcpcd[769]: dev: loaded udev972gitlab # [ 7.381980] systemd[1]: Reached target Network.973gitlab # [ 7.384252] systemd[1]: Starting gitlab-workhorse.service...974gitlab # [ 7.385575] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.533905] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.534414] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.389463] systemd[1]: Starting PostgreSQL Server...978gitlab # [ 7.391591] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 7.394318] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.403113] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.408941] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.412246] systemd[1]: Started Getty on tty1.983gitlab # [ 7.412861] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.633442] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.642981] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.643943] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.645220] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.647018] cfg80211: failed to load regulatory.db989gitlab # [ 7.511242] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.511938] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.516671] systemd[1]: Started Nginx Web Server.992gitlab # [ 7.672966] 8021q: adding VLAN 0 to HW filter on device eth0993gitlab # [ 7.527978] dhcpcd[769]: eth0: waiting for carrier994gitlab # [ 7.528780] dhcpcd[769]: eth0: carrier acquired995gitlab # [ 7.530677] postgresql-pre-start[797]: The files belonging to this database system will be owned by user "postgres".996gitlab # [ 7.531676] postgresql-pre-start[797]: This user must also own the server process.997gitlab # [ 7.534552] dhcpcd[769]: DUID 00:01:00:01:32:1d:5f:c7:52:54:00:12:34:56998gitlab # [ 7.535252] dhcpcd[769]: eth0: IAID 00:12:34:56999gitlab # [ 7.535773] dhcpcd[769]: eth0: adding address fe80::5054:ff:fe12:34561000gitlab # [ 7.537260] redis-server[796]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1001gitlab # [ 7.537937] redis-server[796]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1002gitlab # [ 7.538501] redis-server[796]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=796, just started1003gitlab # [ 7.539038] redis-server[796]: Configuration loaded1004gitlab # [ 7.540609] redis[796]: monotonic clock: POSIX clock_gettime1005gitlab # [ 7.541162] postgresql-pre-start[797]: The database cluster will be initialized with locale "en_US.UTF-8".1006gitlab # [ 7.541569] postgresql-pre-start[797]: The default database encoding has accordingly been set to "UTF8".1007gitlab # [ 7.541746] postgresql-pre-start[797]: The default text search configuration will be set to "english".1008gitlab # [ 7.542095] postgresql-pre-start[797]: Data page checksums are enabled.1009gitlab # [ 7.542611] systemd[1]: Started Redis Server - redis-gitlab.1010gitlab # [ 7.543131] redis[796]: Running mode=standalone, port=0.1011gitlab # [ 7.544637] postgresql-pre-start[797]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1012gitlab # [ 7.544995] postgresql-pre-start[797]: creating subdirectories ... ok1013gitlab # [ 7.547608] postgresql-pre-start[797]: selecting dynamic shared memory implementation ... posix1014gitlab # [ 7.548171] redis[796]: Server initialized1015gitlab # [ 7.548617] redis[796]: Ready to accept connections unix1016gitlab # [ 7.549077] redis[796]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1017gitlab # [ 7.578983] dhcpcd[769]: eth0: soliciting a DHCP lease1018gitlab # [ 7.579641] postgresql-pre-start[797]: selecting default "max_connections" ... 1001019gitlab # [ 7.731892] NET: Registered PF_PACKET protocol family1020gitlab # [ 7.594608] dhcpcd[769]: eth0: offered 10.0.2.15 from 10.0.2.21021gitlab # [ 7.602799] dhcpcd[769]: eth0: probing address 10.0.2.15/241022gitlab # [ 7.625182] postgresql-pre-start[797]: selecting default "shared_buffers" ... 128MB1023gitlab # [ 7.877725] systemd[1]: Started gitlab-workhorse.service.1024gitlab # [ 8.008639] postgresql-pre-start[797]: selecting default time zone ... UTC1025gitlab # [ 8.010298] postgresql-pre-start[797]: creating configuration files ... ok1026gitlab # [ 8.079880] gitlab-workhorse[830]: time="2026-08-23T07:37:44Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41027gitlab # [ 8.084236] gitlab-workhorse[830]: time="2026-08-23T07:37:44Z" level=info msg="Using redis/go-redis"1028gitlab # [ 8.088385] gitlab-workhorse[830]: time="2026-08-23T07:37:44Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1029gitlab # [ 8.178252] postgresql-pre-start[797]: running bootstrap script ... ok1030gitlab # [ 8.589210] postgresql-pre-start[797]: performing post-bootstrap initialization ... ok1031gitlab # [ 8.827666] postgresql-pre-start[797]: syncing data to disk ... ok1032gitlab # [ 8.828729] postgresql-pre-start[797]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 8.829528] postgresql-pre-start[797]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 8.830270] postgresql-pre-start[797]: Success. You can now start the database server using:1035gitlab # [ 8.830955] postgresql-pre-start[797]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 8.928856] postgres[856]: [856] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 8.930080] postgres[856]: [856] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 8.930809] postgres[856]: [856] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 8.936985] postgres[856]: [856] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 8.953595] postgres[865]: [865] LOG: database system was shut down at 2026-08-23 07:37:44 GMT1041gitlab # [ 8.967827] postgres[856]: [856] LOG: database system is ready to accept connections1042gitlab # [ 8.974080] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 8.978477] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 9.194794] postgresql-setup-start[876]: CREATE DATABASE1045gitlab # [ 9.221599] postgresql-setup-start[885]: CREATE ROLE1046gitlab # [ 9.237158] postgresql-setup-start[887]: ALTER DATABASE1047gitlab # [ 9.263860] postgresql-setup-start[893]: CREATE ROLE1048gitlab # [ 9.265914] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 9.266623] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 9.269674] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 9.358812] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[883]: mkdir -p /var/gitlab/state/home/.ssh: OK1052gitlab # [ 9.361746] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[883]: chmod 700 /var/gitlab/state/home/.ssh: OK1053gitlab # [ 9.367393] gitlab-postgresql-start[901]: CREATE DATABASE1054gitlab # [ 9.394215] gitlab-postgresql-start[921]: CREATE EXTENSION1055gitlab # [ 9.401505] systemd[1]: Finished gitlab-config.service.1056gitlab # [ 9.403326] systemd[1]: Started gitaly.service.1057gitlab # [ 9.405680] systemd[1]: Starting gitlab-db-config.service...1058gitlab # [ 9.472228] gitlab-postgresql-start[927]: CREATE EXTENSION1059gitlab # [ 9.475782] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 9.479047] dhcpcd[769]: eth0: soliciting an IPv6 router1061gitlab # [ 9.480031] dhcpcd[769]: eth0: Router Advertisement from fe80::21062gitlab # [ 9.480990] dhcpcd[769]: eth0: adding address fec0::5054:ff:fe12:3456/641063gitlab # [ 9.481564] dhcpcd[769]: eth0: adding route to fec0::/641064gitlab # [ 9.482719] dhcpcd[769]: eth0: adding default route via fe80::21065gitlab # [ 9.943956] gitaly[930]: time="2026-08-23T07:37:46.346Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9301066gitlab # [ 9.944710] gitaly[930]: time="2026-08-23T07:37:46.346Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9301067gitlab # [ 9.945255] gitaly[930]: time="2026-08-23T07:37:46.346Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9301068gitlab # [ 9.945626] gitaly[930]: time="2026-08-23T07:37:46.346Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9301069gitlab # [ 9.948071] gitaly[930]: time="2026-08-23T07:37:46.346Z" level=info msg="Starting Gitaly" pid=930 version=1070gitlab # [ 10.109588] gitaly[930]: time="2026-08-23T07:37:46.512Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=165 pid=9301071gitlab # [ 10.110526] gitaly[930]: time="2026-08-23T07:37:46.512Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9301072gitlab # [ 10.110976] gitaly[930]: time="2026-08-23T07:37:46.512Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9301073gitlab # [ 10.111649] gitaly[930]: time="2026-08-23T07:37:46.512Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-930/git-exec-2376524010.d/git pid=9301074gitlab # [ 10.117297] gitaly[930]: time="2026-08-23T07:37:46.519Z" level=info msg="finished detecting git version" duration_ms=7 pid=9301075gitlab # [ 10.117950] gitaly[930]: time="2026-08-23T07:37:46.519Z" level=info msg="using Git version" pid=930 version=2.53.g1076gitlab # [ 10.120778] gitaly[930]: time="2026-08-23T07:37:46.523Z" level=info msg="clearing disk cache object folder" pid=930 storage=default1077gitlab # [ 10.121409] gitaly[930]: time="2026-08-23T07:37:46.523Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2777102350 pid=930 storage=default1078gitlab # [ 10.121797] gitaly[930]: time="2026-08-23T07:37:46.523Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2777102350 pid=930 storage=default1079gitlab # [ 10.122139] gitaly[930]: time="2026-08-23T07:37:46.523Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9301080gitlab # [ 10.122532] gitaly[930]: time="2026-08-23T07:37:46.523Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9301081gitlab # [ 10.122950] gitaly[930]: time="2026-08-23T07:37:46.523Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2777102350 clear_duration_ms=0 pid=930 storage=default1082gitlab # [ 10.162653] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9301083gitlab # [ 10.163143] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=info msg="counting repositories" pid=9301084gitlab # [ 10.163542] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=info msg="starting to count repositories" pid=930 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.163964] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=930 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.164579] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9301087gitlab # [ 10.164976] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=930 schema=unix1088gitlab # [ 10.165815] gitaly[930]: time="2026-08-23T07:37:46.565Z" level=info msg="listening at address" address=/run/gitaly/gitaly-930/sock.d/intern pid=930 schema=unix1089gitlab # [ 10.173094] gitaly[930]: time="2026-08-23T07:37:46.575Z" level=info msg="finished tempdir cleaner walk" pid=930 storage=default time_ms=101090gitlab # [ 10.174395] gitaly[930]: time="2026-08-23T07:37:46.577Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9301091gitlab # [ 10.175336] gitaly[930]: time="2026-08-23T07:37:46.577Z" level=info msg="Started Gitaly" duration_ms=231 pid=9301092gitlab # [ 10.176537] gitaly[930]: time="2026-08-23T07:37:46.579Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9301093gitlab # [ 10.178115] gitaly[930]: time="2026-08-23T07:37:46.579Z" level=info msg="maintenance: daily scheduled" pid=930 scheduled="2026-08-23 12:00:00 +0000 UTC"1094gitlab # [ 10.857437] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[933]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 10.857820] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[933]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 10.895651] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[933]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.067954] gitaly[930]: time="2026-08-23T07:37:48.469Z" level=info msg="License database preloaded" duration_ms=2123 pid=9301098gitlab # [ 12.652138] dhcpcd[769]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 12.654246] dhcpcd[769]: eth0: adding route to 10.0.2.0/241100gitlab # [ 12.655597] dhcpcd[769]: eth0: adding default route via 10.0.2.21101gitlab # [ 12.774676] systemd[1]: Started DHCP Client.1102gitlab # [ 12.776208] systemd[1]: Reached target Network is Online.1103gitlab # [ 40.423531] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[933]: W, [2026-08-23T07:38:16.825117 #933] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 42.624107] postgres[1312]: [1312] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 42.626942] postgres[1312]: [1312] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 42.629921] postgres[1312]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 42.632902] postgres[1312]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 42.635717] postgres[1312]: attidentity AS identity,1109gitlab # [ 42.637628] postgres[1312]: attgenerated as attgenerated1110gitlab # [ 42.639598] postgres[1312]: FROM pg_attribute a1111gitlab # [ 42.641237] postgres[1312]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 42.644141] postgres[1312]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 42.646295] postgres[1312]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 42.649489] postgres[1312]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 42.651680] postgres[1312]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 42.653757] postgres[1312]: ORDER BY a.attnum1117gitlab # [ 42.655356] postgres[1312]:1118gitlab # [ 45.966987] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1345]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 45.967748] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1345]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.139364] gitlab-workhorse[830]: time="2026-08-23T07:38:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.150058] gitlab-workhorse[830]: time="2026-08-23T07:38:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 61.058299] postgres[1420]: [1420] ERROR: relation "table_without_models" does not exist1123gitlab # [ 61.061063] postgres[1420]: [1420] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.159775] gitlab-workhorse[830]: time="2026-08-23T07:38:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 72.740505] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 72.743203] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 72.745507] systemd[1]: Starting gitlab.service...1128gitlab # [ 73.109391] bundle[1587]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 73.113992] bundle[1587]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 73.118330] bundle[1587]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 75.781972] sidekiq-cluster[1586]: {"severity":"INFO","time":"2026-08-23T07:38:52.167Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 75.889699] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.272Z","pid":1587,"message":"* Enabling systemd notification integration"}1133gitlab # [ 75.890726] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"Puma starting in cluster mode..."}1134gitlab # [ 75.891565] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 75.892228] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 75.892889] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Min threads: 0"}1137gitlab # [ 75.893688] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Max threads: 4"}1138gitlab # [ 75.894519] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Environment: production"}1139gitlab # [ 75.895229] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Master PID: 1587"}1140gitlab # [ 75.895901] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Workers: 2"}1141gitlab # [ 75.896662] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 75.897293] bundle[1587]: {"timestamp":"2026-08-23T07:38:52.291Z","pid":1587,"message":"* Preloading application"}1143gitlab # [ 78.168219] gitlab-workhorse[830]: time="2026-08-23T07:38:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 88.174284] gitlab-workhorse[830]: time="2026-08-23T07:39:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 98.181814] gitlab-workhorse[830]: time="2026-08-23T07:39:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 98.209754] bundle[1587]: W, [2026-08-23T07:39:14.611630 #1587] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 100.608167] sidekiq-cluster[1617]: 2026-08-23T07:39:17.009Z pid=1617 tid=wl5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1617, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434237440}1148gitlab # [ 100.780336] sidekiq-cluster[1617]: W, [2026-08-23T07:39:17.182747 #1617] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 100.821220] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:17.223Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 102.691275] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.092Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 102.692421] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.093Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 102.717280] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.119Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 102.721439] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.123Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 102.725878] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.128Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 102.730193] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.132Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 102.734702] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.137Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 102.738874] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.141Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 102.743144] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.145Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 102.749735] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.152Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 102.755115] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.157Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 102.760103] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.162Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 102.765333] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.167Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 102.774847] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.177Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 102.779988] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.182Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 102.784988] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.187Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 102.790380] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.192Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 102.796261] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.198Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 102.803804] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.206Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 102.825685] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.228Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 102.829433] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.231Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 102.833832] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.236Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 102.838080] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.240Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 102.842220] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.244Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 102.847539] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.250Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 102.852562] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.255Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 102.857700] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.260Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 102.862926] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.265Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 102.868278] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.270Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 102.873630] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.276Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 102.879060] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.281Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 102.884529] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.286Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 102.888976] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.291Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 102.894954] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.297Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 102.899984] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.302Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 102.905759] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.308Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 102.910564] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.313Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 102.915623] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.318Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 102.920195] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.322Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 102.925763] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.328Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 102.930269] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.332Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 102.934823] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.337Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 102.939693] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.342Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 102.944261] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.346Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 102.948800] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.351Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 102.953667] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.356Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 102.959172] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.361Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 102.964381] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.366Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 102.968970] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.371Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 102.974247] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.376Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 102.979525] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.382Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 102.984221] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.386Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 102.989220] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.391Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 102.994705] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.397Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 103.009183] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.411Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 103.018352] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.420Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 103.022776] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.425Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 103.030164] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.432Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 103.035965] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.438Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 103.042482] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.445Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 103.047526] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.449Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 103.053604] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.455Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 103.058942] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.461Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 103.064683] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.467Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 103.072078] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.474Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 103.078869] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.481Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 103.084232] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.486Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 103.088957] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.491Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 103.092826] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.495Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 103.097096] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.499Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 103.101367] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.503Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 103.147088] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.549Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 103.150335] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.552Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 103.153837] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.556Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 103.157485] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.560Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 103.160802] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.563Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 103.165077] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.567Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 103.167891] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.570Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 103.171357] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.573Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 103.174318] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.576Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 103.177593] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.580Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 103.180494] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.583Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 103.183390] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.585Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 103.186587] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.589Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 103.190368] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.592Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 103.193230] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.595Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 103.196121] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.598Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 103.198889] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.601Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 103.202474] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.605Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 103.205400] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.607Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 103.208549] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.611Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 103.211430] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.614Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 103.213940] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.616Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 103.216864] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.619Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 103.219353] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.621Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 103.222376] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.624Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 103.225314] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.627Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 103.228609] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.631Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 103.231581] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.634Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 103.234267] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.636Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 103.244246] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.646Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 103.246745] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.649Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 103.249270] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.651Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 103.252804] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.655Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 103.255760] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.658Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 103.258952] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.661Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 103.262787] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.665Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 103.267637] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.670Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 103.271121] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.673Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 103.275666] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.678Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 103.279759] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:19.682Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 108.191893] gitlab-workhorse[830]: time="2026-08-23T07:39:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 118.194745] gitlab-workhorse[830]: time="2026-08-23T07:39:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 127.695767] postgres[2055]: [2055] ERROR: relation "table_without_models" does not exist1264gitlab # [ 127.696926] postgres[2055]: [2055] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 128.196841] gitlab-workhorse[830]: time="2026-08-23T07:39:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1266gitlab # [ 128.897812] postgres[2066]: [2066] ERROR: relation "table_without_models" does not exist1267gitlab # [ 128.898861] postgres[2066]: [2066] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1268gitlab # [ 129.287565] sidekiq-cluster[1617]: InitializerConnections Query: SET client_min_messages TO 'warning'1269gitlab # [ 129.287935] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1270gitlab # [ 129.288486] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1271gitlab # [ 129.288936] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1272gitlab # [ 129.289497] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1273gitlab # [ 129.289903] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1274gitlab # [ 129.290507] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1275gitlab # [ 129.290918] sidekiq-cluster[1617]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1276gitlab # [ 129.296628] sidekiq-cluster[1617]: InitializerConnections Query: SET standard_conforming_strings = on1277gitlab # [ 129.297220] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1278gitlab # [ 129.297616] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1279gitlab # [ 129.298051] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1280gitlab # [ 129.298493] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1281gitlab # [ 129.298916] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1282gitlab # [ 129.299913] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1283gitlab # [ 129.300491] sidekiq-cluster[1617]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1284gitlab # [ 129.306147] sidekiq-cluster[1617]: InitializerConnections Query: SET intervalstyle = iso_86011285gitlab # [ 129.306719] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1286gitlab # [ 129.307174] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1287gitlab # [ 129.307574] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1288gitlab # [ 129.308179] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1289gitlab # [ 129.308583] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1290gitlab # [ 129.309025] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1291gitlab # [ 129.311717] sidekiq-cluster[1617]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1292gitlab # [ 129.338486] sidekiq-cluster[1617]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1293gitlab # [ 129.340479] sidekiq-cluster[1617]: FROM pg_type as t1294gitlab # [ 129.341124] sidekiq-cluster[1617]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1295gitlab # [ 129.342754] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1296gitlab # [ 129.343514] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1297gitlab # [ 129.343934] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1298gitlab # [ 129.344514] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1299gitlab # [ 129.344933] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1300gitlab # [ 129.345541] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1301gitlab # [ 129.345964] sidekiq-cluster[1617]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1302gitlab # [ 129.371348] sidekiq-cluster[1617]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1303gitlab # [ 129.371808] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1304gitlab # [ 129.372121] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1305gitlab # [ 129.372580] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1306gitlab # [ 129.373805] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1307gitlab # [ 129.374446] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1308gitlab # [ 129.374850] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1309gitlab # [ 129.375443] sidekiq-cluster[1617]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1310gitlab # [ 129.381559] sidekiq-cluster[1617]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'1311gitlab # [ 129.382035] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1312gitlab # [ 129.382492] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1313gitlab # [ 129.382940] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1314gitlab # [ 129.383527] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1315gitlab # [ 129.383948] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1316gitlab # [ 129.385597] sidekiq-cluster[1617]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1317gitlab # [ 129.386098] sidekiq-cluster[1617]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1318gitlab # [ 130.355848] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:46.757Z","message":"Booted Rails 7.2.3.1 application in production environment"}1319gitlab # [ 130.357361] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:46.758Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1320gitlab # [ 130.358704] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:46.758Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1321gitlab # [ 130.359998] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:46.758Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1322gitlab # [ 130.372135] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:46.774Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1323gitlab # [ 131.701308] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:48.103Z","message":"Cleaning working queues"}1324gitlab # [ 131.704966] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:48.104Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ff43cf76af2523a72bbbf085","created_at":"2026-08-23T07:38:48.772Z","trace_propagation_headers":{"sentry-trace":"a5ebbf1a41004f5faf761fb9de02e111-db44f35a98c74130","baggage":"sentry-trace_id=a5ebbf1a41004f5faf761fb9de02e111,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"3beef89dae2c169f3bab87216e7e851f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:38:48.778Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ff43cf76af2523a72bbbf085: start","job_status":"start","queue_duration_s":59.325248,"scheduling_latency_s":59.325294}1325gitlab # [ 131.769771] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.171Z","pid":1587,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1326gitlab # [ 131.771221] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.171Z","pid":1587,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1327gitlab # [ 131.774521] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.171Z","pid":1587,"message":"! #\u003cThread:0x00007b3139f65708 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1328gitlab # [ 131.776345] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.171Z","pid":1587,"message":"! #\u003cThread:0x00007b313a22b5f0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1329gitlab # [ 131.777380] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.171Z","pid":1587,"message":"Use Ctrl-C to stop"}1330gitlab # [ 131.778437] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.172Z","pid":1587,"message":"Sending status to systemd every 1.0 sec"}1331gitlab # [ 131.844939] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:39:48.247Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ff43cf76af2523a72bbbf085","created_at":"2026-08-23T07:38:48.772Z","trace_propagation_headers":{"sentry-trace":"a5ebbf1a41004f5faf761fb9de02e111-db44f35a98c74130","baggage":"sentry-trace_id=a5ebbf1a41004f5faf761fb9de02e111,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"3beef89dae2c169f3bab87216e7e851f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:38:48.778Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ff43cf76af2523a72bbbf085: done: 0.143023 sec","job_status":"done","queue_duration_s":59.325248,"scheduling_latency_s":59.325294,"redis_calls":24,"redis_duration_s":0.0046159999999999994,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002515,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.081001637,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.143023,"completed_at":"2026-08-23T07:39:48.247Z","load_balancing_strategy":"primary","db_duration_s":0.055036,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1332gitlab # [ 132.099842] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.502Z","pid":1587,"message":"- Worker 0 (PID: 2167) booted in 0.27s, phase: 0"}1333gitlab # [ 132.189881] bundle[1587]: {"timestamp":"2026-08-23T07:39:48.592Z","pid":1587,"message":"- Worker 1 (PID: 2171) booted in 0.3s, phase: 0"}1334gitlab # [ 132.194376] systemd[1]: Started gitlab.service.1335gitlab # [ 132.195289] systemd[1]: Reached target Common target for all GitLab services..1336gitlab # [ 132.198469] systemd[1]: Starting setup-gitlab.service...1337gitlab # [ 132.222443] setup-gitlab-start[2204]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1338gitlab # [ 134.609278] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:39:51 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23581339gitlab # [ 134.614285] setup-gitlab-start[2204]: + TOKEN=nixbot-test-token-of-20-chars1340gitlab # [ 134.616582] setup-gitlab-start[2204]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1341gitlab # [ 134.631349] runuser[2222]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1342gitlab # [ 134.998628] setup-gitlab-start[2223]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1343gitlab # [ 135.000152] setup-gitlab-start[2223]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1344gitlab # [ 135.001232] setup-gitlab-start[2223]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1345gitlab # [ 135.566612] setup-gitlab-start[2223]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1346gitlab # [ 135.568262] setup-gitlab-start[2223]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1347gitlab # [ 135.569650] setup-gitlab-start[2223]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1348gitlab # [ 147.572584] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:03.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"8842bf31cf267d3eb3b0363e","created_at":"2026-08-23T07:40:03.938Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99fb9ecfc62c716790d6fe1d75746d6a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:03.970Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-8842bf31cf267d3eb3b0363e: start","job_status":"start","queue_duration_s":0.002986,"scheduling_latency_s":0.003037}1349gitlab # [ 147.637380] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"8842bf31cf267d3eb3b0363e","created_at":"2026-08-23T07:40:03.938Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99fb9ecfc62c716790d6fe1d75746d6a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:03.970Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-8842bf31cf267d3eb3b0363e: done: 0.066137 sec","job_status":"done","queue_duration_s":0.002986,"scheduling_latency_s":0.003037,"redis_calls":10,"redis_duration_s":0.011639,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001536,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002348064,"duration_s":0.066137,"completed_at":"2026-08-23T07:40:04.039Z","load_balancing_strategy":"primary","db_duration_s":0.004858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 147.641920] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"479c77967637b398bf1c3fb8","created_at":"2026-08-23T07:40:03.980Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"86419c5cefe206cf907a70e8d2696093","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:03.998Z","job_size_bytes":3,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-479c77967637b398bf1c3fb8: start","job_status":"start","queue_duration_s":0.046043,"scheduling_latency_s":0.046078}1351gitlab # [ 147.660816] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.063Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"479c77967637b398bf1c3fb8","created_at":"2026-08-23T07:40:03.980Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"86419c5cefe206cf907a70e8d2696093","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:03.998Z","job_size_bytes":3,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-479c77967637b398bf1c3fb8: done: 0.019224 sec","job_status":"done","queue_duration_s":0.046043,"scheduling_latency_s":0.046078,"redis_calls":10,"redis_duration_s":0.001892,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229917,"duration_s":0.019224,"completed_at":"2026-08-23T07:40:04.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 147.744196] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"24d2ed066225929fb30346ed","created_at":"2026-08-23T07:40:04.024Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e130cf7b8b32f05b929485b6797af462","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:40:04.144Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-24d2ed066225929fb30346ed: start","job_status":"start","queue_duration_s":0.002133,"scheduling_latency_s":0.002194}1353gitlab # [ 147.769239] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.171Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1354gitlab # [ 147.788584] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"24d2ed066225929fb30346ed","created_at":"2026-08-23T07:40:04.024Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e130cf7b8b32f05b929485b6797af462","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:40:04.144Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-24d2ed066225929fb30346ed: done: 0.044308 sec","job_status":"done","queue_duration_s":0.002133,"scheduling_latency_s":0.002194,"redis_calls":10,"redis_duration_s":0.011549,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004159,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00559,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002410363,"duration_s":0.044308,"completed_at":"2026-08-23T07:40:04.190Z","load_balancing_strategy":"primary","db_duration_s":0.004363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 147.790672] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"18e0707f2a6165ee32c6644e","created_at":"2026-08-23T07:40:04.168Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1deb36847eafdd38321426e48087865","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.181Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-18e0707f2a6165ee32c6644e: start","job_status":"start","queue_duration_s":0.010918,"scheduling_latency_s":0.010953}1356gitlab # [ 148.260477] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"18e0707f2a6165ee32c6644e","created_at":"2026-08-23T07:40:04.168Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1deb36847eafdd38321426e48087865","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.181Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-18e0707f2a6165ee32c6644e: done: 0.469538 sec","job_status":"done","queue_duration_s":0.010918,"scheduling_latency_s":0.010953,"redis_calls":14,"redis_duration_s":0.007049,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001372,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003171,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.088,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.088,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.237944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000848711,"exclusive_lock_hold_duration_s":0.420695927,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.469538,"completed_at":"2026-08-23T07:40:04.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.22016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 148.331166] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"953077c59b01f7df306cbcdf","created_at":"2026-08-23T07:40:04.239Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f3231fcd67d3e17cef351e2e653e5d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.243Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-953077c59b01f7df306cbcdf: start","job_status":"start","queue_duration_s":0.490111,"scheduling_latency_s":0.490143}1358gitlab # [ 148.453288] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"953077c59b01f7df306cbcdf","created_at":"2026-08-23T07:40:04.239Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f3231fcd67d3e17cef351e2e653e5d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.243Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-953077c59b01f7df306cbcdf: done: 0.121472 sec","job_status":"done","queue_duration_s":0.490111,"scheduling_latency_s":0.490143,"redis_calls":12,"redis_duration_s":0.031454,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.018943,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004081,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001632889,"exclusive_lock_hold_duration_s":0.012521703,"duration_s":0.121472,"completed_at":"2026-08-23T07:40:04.854Z","load_balancing_strategy":"primary","db_duration_s":0.009247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 148.520122] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:04.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"31744952e87c812d6e7adce8","created_at":"2026-08-23T07:40:04.246Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.249Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-31744952e87c812d6e7adce8: start","job_status":"start","queue_duration_s":0.610003,"scheduling_latency_s":0.610039}1360gitlab # [ 148.646868] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"31744952e87c812d6e7adce8","created_at":"2026-08-23T07:40:04.246Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.249Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-31744952e87c812d6e7adce8: done: 0.188875 sec","job_status":"done","queue_duration_s":0.610003,"scheduling_latency_s":0.610039,"redis_calls":71,"redis_duration_s":0.062897,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.023308,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001012,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.037737,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029473,"duration_s":0.188875,"completed_at":"2026-08-23T07:40:05.048Z","load_balancing_strategy":"primary","db_duration_s":0.012963,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 148.707922] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7c9bfb1c7c4ec11366d51482","created_at":"2026-08-23T07:40:04.255Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaf3808240c2c5956dffeba5fe7f21ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.264Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7c9bfb1c7c4ec11366d51482: start","job_status":"start","queue_duration_s":0.78904,"scheduling_latency_s":0.789055}1362gitlab # [ 148.719571] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7c9bfb1c7c4ec11366d51482","created_at":"2026-08-23T07:40:04.255Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaf3808240c2c5956dffeba5fe7f21ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.264Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7c9bfb1c7c4ec11366d51482: done: 0.024115 sec","job_status":"done","queue_duration_s":0.78904,"scheduling_latency_s":0.789055,"redis_calls":13,"redis_duration_s":0.0035700000000000003,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002328,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006710909,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.024115,"completed_at":"2026-08-23T07:40:05.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002473,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1363gitlab # [ 148.754747] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2244696c4b12f8eb7ee8995d","created_at":"2026-08-23T07:40:04.273Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d1071ca9e1c11307e1c7ed8f95288b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.283Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2244696c4b12f8eb7ee8995d: start","job_status":"start","queue_duration_s":0.795398,"scheduling_latency_s":0.795412}1364gitlab # [ 148.766642] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.086Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1365gitlab # [ 148.769832] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2244696c4b12f8eb7ee8995d","created_at":"2026-08-23T07:40:04.273Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d1071ca9e1c11307e1c7ed8f95288b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.283Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2244696c4b12f8eb7ee8995d: done: 0.012283 sec","job_status":"done","queue_duration_s":0.795398,"scheduling_latency_s":0.795412,"redis_calls":10,"redis_duration_s":0.001301,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199467,"duration_s":0.012283,"completed_at":"2026-08-23T07:40:05.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 148.804332] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"21551fed000706962e7a58f7","created_at":"2026-08-23T07:40:04.299Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"063c55e1a21b783c017c2a1b9d4254a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.307Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-21551fed000706962e7a58f7: start","job_status":"start","queue_duration_s":0.783933,"scheduling_latency_s":0.783946}1367gitlab # [ 148.816335] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"21551fed000706962e7a58f7","created_at":"2026-08-23T07:40:04.299Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"063c55e1a21b783c017c2a1b9d4254a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.307Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-21551fed000706962e7a58f7: done: 0.046698 sec","job_status":"done","queue_duration_s":0.783933,"scheduling_latency_s":0.783946,"redis_calls":14,"redis_duration_s":0.001961,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000295568,"exclusive_lock_hold_duration_s":0.03210408,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.046698,"completed_at":"2026-08-23T07:40:05.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 148.817728] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7d3255322e4f11128b162f01","created_at":"2026-08-23T07:40:04.313Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b8eeed7ddf95b9ea24242ecfa5bf8bd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.321Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7d3255322e4f11128b162f01: start","job_status":"start","queue_duration_s":0.817711,"scheduling_latency_s":0.817724}1369gitlab # [ 148.828803] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.184Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7d3255322e4f11128b162f01","created_at":"2026-08-23T07:40:04.313Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b8eeed7ddf95b9ea24242ecfa5bf8bd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.321Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7d3255322e4f11128b162f01: done: 0.044719 sec","job_status":"done","queue_duration_s":0.817711,"scheduling_latency_s":0.817724,"redis_calls":16,"redis_duration_s":0.002177,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001135,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208965,"duration_s":0.044719,"completed_at":"2026-08-23T07:40:05.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 148.886770] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"6cd90bc321fd3ee5f44a6472","created_at":"2026-08-23T07:40:04.329Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cb49eaf717ebd9530b0cc23e8098952","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.336Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-6cd90bc321fd3ee5f44a6472: start","job_status":"start","queue_duration_s":0.848285,"scheduling_latency_s":0.848298}1371gitlab # [ 148.887553] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"6cd90bc321fd3ee5f44a6472","created_at":"2026-08-23T07:40:04.329Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cb49eaf717ebd9530b0cc23e8098952","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.336Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-6cd90bc321fd3ee5f44a6472: done: 0.015381 sec","job_status":"done","queue_duration_s":0.848285,"scheduling_latency_s":0.848298,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196953,"duration_s":0.015381,"completed_at":"2026-08-23T07:40:05.200Z","load_balancing_strategy":"primary","db_duration_s":0.002355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 148.927131] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f4a5627f57c30764076d53e1","created_at":"2026-08-23T07:40:04.346Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04ba69c53ee39002e5de62c04e7f8592","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:40:04.351Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f4a5627f57c30764076d53e1: start","job_status":"start","queue_duration_s":0.849919,"scheduling_latency_s":0.849932}1373gitlab # [ 148.927691] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f4a5627f57c30764076d53e1","created_at":"2026-08-23T07:40:04.346Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04ba69c53ee39002e5de62c04e7f8592","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:40:04.351Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f4a5627f57c30764076d53e1: done: 0.06344 sec","job_status":"done","queue_duration_s":0.849919,"scheduling_latency_s":0.849932,"redis_calls":10,"redis_duration_s":0.004632,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232432,"duration_s":0.06344,"completed_at":"2026-08-23T07:40:05.264Z","load_balancing_strategy":"primary","db_duration_s":0.004094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 148.971184] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"07eede754a63da11f4b5333f","created_at":"2026-08-23T07:40:04.358Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d0d41f1d9565206fc6aa0fa0b0a5b75","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.364Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-07eede754a63da11f4b5333f: start","job_status":"start","queue_duration_s":0.901482,"scheduling_latency_s":0.901496}1375gitlab # [ 148.971764] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"07eede754a63da11f4b5333f","created_at":"2026-08-23T07:40:04.358Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d0d41f1d9565206fc6aa0fa0b0a5b75","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.364Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-07eede754a63da11f4b5333f: done: 0.013015 sec","job_status":"done","queue_duration_s":0.901482,"scheduling_latency_s":0.901496,"redis_calls":12,"redis_duration_s":0.00164,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000311212,"exclusive_lock_hold_duration_s":0.001958349,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013015,"completed_at":"2026-08-23T07:40:05.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 148.999748] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3175e03abe868a9e5d573042","created_at":"2026-08-23T07:40:04.378Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4050414237fb6ef0fef991740cadb6a3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.387Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3175e03abe868a9e5d573042: start","job_status":"start","queue_duration_s":0.89322,"scheduling_latency_s":0.893233}1377gitlab # [ 149.011607] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3175e03abe868a9e5d573042","created_at":"2026-08-23T07:40:04.378Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4050414237fb6ef0fef991740cadb6a3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.387Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3175e03abe868a9e5d573042: done: 0.024114 sec","job_status":"done","queue_duration_s":0.89322,"scheduling_latency_s":0.893233,"redis_calls":10,"redis_duration_s":0.0018089999999999998,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364292,"duration_s":0.024114,"completed_at":"2026-08-23T07:40:05.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 149.073968] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"a721a4b0f0a083de0f3a35b9","created_at":"2026-08-23T07:40:04.399Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87ff1301d5ef9d4b4a940d17444ab21","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.409Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-a721a4b0f0a083de0f3a35b9: start","job_status":"start","queue_duration_s":0.896406,"scheduling_latency_s":0.89642}1379gitlab # [ 149.074664] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"a721a4b0f0a083de0f3a35b9","created_at":"2026-08-23T07:40:04.399Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87ff1301d5ef9d4b4a940d17444ab21","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.409Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-a721a4b0f0a083de0f3a35b9: done: 0.012764 sec","job_status":"done","queue_duration_s":0.896406,"scheduling_latency_s":0.89642,"redis_calls":11,"redis_duration_s":0.001423,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.0002,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195276,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.012764,"completed_at":"2026-08-23T07:40:05.318Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 149.114296] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d9e6f0edd236cb3ed3664b24","created_at":"2026-08-23T07:40:04.429Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52bfff39109d79e3b4fd37ffed49f8cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.439Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d9e6f0edd236cb3ed3664b24: start","job_status":"start","queue_duration_s":0.880091,"scheduling_latency_s":0.880104}1381gitlab # [ 149.114914] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d9e6f0edd236cb3ed3664b24","created_at":"2026-08-23T07:40:04.429Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52bfff39109d79e3b4fd37ffed49f8cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.439Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d9e6f0edd236cb3ed3664b24: done: 0.016652 sec","job_status":"done","queue_duration_s":0.880091,"scheduling_latency_s":0.880104,"redis_calls":12,"redis_duration_s":0.0052829999999999995,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019807,"duration_s":0.016652,"completed_at":"2026-08-23T07:40:05.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 149.135901] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ddd456334252ccf22c94d4c0","created_at":"2026-08-23T07:40:04.453Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b55c2537ca190a32cdfd9e347ed394f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.463Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ddd456334252ccf22c94d4c0: start","job_status":"start","queue_duration_s":0.875045,"scheduling_latency_s":0.875059}1383gitlab # [ 149.147921] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.346Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1384gitlab # [ 149.183590] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ddd456334252ccf22c94d4c0","created_at":"2026-08-23T07:40:04.453Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b55c2537ca190a32cdfd9e347ed394f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.463Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ddd456334252ccf22c94d4c0: done: 0.011417 sec","job_status":"done","queue_duration_s":0.875045,"scheduling_latency_s":0.875059,"redis_calls":10,"redis_duration_s":0.001254,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195556,"duration_s":0.011417,"completed_at":"2026-08-23T07:40:05.350Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 149.185529] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a3974b16081d5f17e0f3a626","created_at":"2026-08-23T07:40:04.473Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"836b982706c33d4520dfa340b8caeec0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.483Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a3974b16081d5f17e0f3a626: start","job_status":"start","queue_duration_s":0.867595,"scheduling_latency_s":0.867608}1386gitlab # [ 149.221706] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.357Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1387gitlab # [ 149.222520] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a3974b16081d5f17e0f3a626","created_at":"2026-08-23T07:40:04.473Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"836b982706c33d4520dfa340b8caeec0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.483Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a3974b16081d5f17e0f3a626: done: 0.011014 sec","job_status":"done","queue_duration_s":0.867595,"scheduling_latency_s":0.867608,"redis_calls":10,"redis_duration_s":0.001222,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196394,"duration_s":0.011014,"completed_at":"2026-08-23T07:40:05.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 149.234218] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9e0db4f2299899b98d2f5931","created_at":"2026-08-23T07:40:04.496Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0a028e2e61b6ac5f0be52a262533779","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.506Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9e0db4f2299899b98d2f5931: start","job_status":"start","queue_duration_s":0.856847,"scheduling_latency_s":0.856859}1389gitlab # [ 149.332188] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9e0db4f2299899b98d2f5931","created_at":"2026-08-23T07:40:04.496Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0a028e2e61b6ac5f0be52a262533779","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.506Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9e0db4f2299899b98d2f5931: done: 0.371525 sec","job_status":"done","queue_duration_s":0.856847,"scheduling_latency_s":0.856859,"redis_calls":565,"redis_duration_s":0.214996,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.213996,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224051,"duration_s":0.371525,"completed_at":"2026-08-23T07:40:05.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 149.367377] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fb6229d51b791516876a6912","created_at":"2026-08-23T07:40:04.516Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf4602402ef018c48bcc21ef3f85d392","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:40:04.530Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fb6229d51b791516876a6912: start","job_status":"start","queue_duration_s":1.239469,"scheduling_latency_s":1.239498}1391gitlab # [ 149.383138] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.785Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1392gitlab # [ 149.392786] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fb6229d51b791516876a6912","created_at":"2026-08-23T07:40:04.516Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf4602402ef018c48bcc21ef3f85d392","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:40:04.530Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fb6229d51b791516876a6912: done: 0.025372 sec","job_status":"done","queue_duration_s":1.239469,"scheduling_latency_s":1.239498,"redis_calls":10,"redis_duration_s":0.002202,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385803,"duration_s":0.025372,"completed_at":"2026-08-23T07:40:05.794Z","load_balancing_strategy":"primary","db_duration_s":0.000551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 149.395702] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f6a6f4ed5359c00100bb10e0","created_at":"2026-08-23T07:40:04.543Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4dc054288c634398010a0c07dda3854","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.553Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f6a6f4ed5359c00100bb10e0: start","job_status":"start","queue_duration_s":1.244973,"scheduling_latency_s":1.244997}1394gitlab # [ 149.415553] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.817Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f6a6f4ed5359c00100bb10e0","created_at":"2026-08-23T07:40:04.543Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4dc054288c634398010a0c07dda3854","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.553Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f6a6f4ed5359c00100bb10e0: done: 0.019666 sec","job_status":"done","queue_duration_s":1.244973,"scheduling_latency_s":1.244997,"redis_calls":12,"redis_duration_s":0.002881,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000449,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270425,"duration_s":0.019666,"completed_at":"2026-08-23T07:40:05.817Z","load_balancing_strategy":"primary","db_duration_s":0.00051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 149.437271] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c6d359cbb0d3a0371209b8c7","created_at":"2026-08-23T07:40:04.579Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb2853b22c7fea0b4c18fc1a72c4cc83","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.589Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c6d359cbb0d3a0371209b8c7: start","job_status":"start","queue_duration_s":1.234885,"scheduling_latency_s":1.234897}1396gitlab # [ 149.483342] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c6d359cbb0d3a0371209b8c7","created_at":"2026-08-23T07:40:04.579Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb2853b22c7fea0b4c18fc1a72c4cc83","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.589Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c6d359cbb0d3a0371209b8c7: done: 0.022523 sec","job_status":"done","queue_duration_s":1.234885,"scheduling_latency_s":1.234897,"redis_calls":12,"redis_duration_s":0.0077919999999999994,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001781,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001596,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000552025,"exclusive_lock_hold_duration_s":0.004400559,"duration_s":0.022523,"completed_at":"2026-08-23T07:40:05.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 149.484697] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f03bbae779a041526ce809bc","created_at":"2026-08-23T07:40:04.598Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfdc77a9c20a66ad45799bf74aa159ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.607Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f03bbae779a041526ce809bc: start","job_status":"start","queue_duration_s":1.242112,"scheduling_latency_s":1.242126}1398gitlab # [ 149.495493] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f03bbae779a041526ce809bc","created_at":"2026-08-23T07:40:04.598Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfdc77a9c20a66ad45799bf74aa159ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.607Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f03bbae779a041526ce809bc: done: 0.013876 sec","job_status":"done","queue_duration_s":1.242112,"scheduling_latency_s":1.242126,"redis_calls":10,"redis_duration_s":0.001265,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019807,"duration_s":0.013876,"completed_at":"2026-08-23T07:40:05.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 149.531263] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"7229c2c432f63d6f387a4bd2","created_at":"2026-08-23T07:40:04.626Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a39849f35535a57f0d004c791695b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.637Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-7229c2c432f63d6f387a4bd2: start","job_status":"start","queue_duration_s":1.226717,"scheduling_latency_s":1.226729}1400gitlab # [ 149.541255] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"7229c2c432f63d6f387a4bd2","created_at":"2026-08-23T07:40:04.626Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a39849f35535a57f0d004c791695b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.637Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-7229c2c432f63d6f387a4bd2: done: 0.022979 sec","job_status":"done","queue_duration_s":1.226717,"scheduling_latency_s":1.226729,"redis_calls":20,"redis_duration_s":0.004718,"redis_read_bytes":23,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000788,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000394,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.003231,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243327,"duration_s":0.022979,"completed_at":"2026-08-23T07:40:05.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 149.577633] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"3f8d899b019d2bce87bd5553","created_at":"2026-08-23T07:40:04.663Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd7ba1977de7a469c0054a5f81e780bd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.752Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-3f8d899b019d2bce87bd5553: start","job_status":"start","queue_duration_s":1.138701,"scheduling_latency_s":1.138714}1402gitlab # [ 149.586973] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"3f8d899b019d2bce87bd5553","created_at":"2026-08-23T07:40:04.663Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd7ba1977de7a469c0054a5f81e780bd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.752Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-3f8d899b019d2bce87bd5553: done: 0.016727 sec","job_status":"done","queue_duration_s":1.138701,"scheduling_latency_s":1.138714,"redis_calls":10,"redis_duration_s":0.0027489999999999997,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201143,"duration_s":0.016727,"completed_at":"2026-08-23T07:40:05.907Z","load_balancing_strategy":"primary","db_duration_s":0.000266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 149.642525] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"80fd5ea674509c35a5307c7e","created_at":"2026-08-23T07:40:04.759Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.777Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-80fd5ea674509c35a5307c7e: start","job_status":"start","queue_duration_s":1.131387,"scheduling_latency_s":1.131399}1404gitlab # [ 149.643162] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"80fd5ea674509c35a5307c7e","created_at":"2026-08-23T07:40:04.759Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.777Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-80fd5ea674509c35a5307c7e: done: 0.022359 sec","job_status":"done","queue_duration_s":1.131387,"scheduling_latency_s":1.131399,"redis_calls":19,"redis_duration_s":0.002424,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000168,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.022359,"completed_at":"2026-08-23T07:40:05.930Z","load_balancing_strategy":"primary","db_duration_s":0.0012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 149.679286] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.932Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b73531c974b9a86b808e171d","created_at":"2026-08-23T07:40:04.808Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e0a4d9183c98626d22d996306a295f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.825Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b73531c974b9a86b808e171d: start","job_status":"start","queue_duration_s":1.10637,"scheduling_latency_s":1.106384}1406gitlab # [ 149.679944] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b73531c974b9a86b808e171d","created_at":"2026-08-23T07:40:04.808Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e0a4d9183c98626d22d996306a295f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.825Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b73531c974b9a86b808e171d: done: 0.03125 sec","job_status":"done","queue_duration_s":1.10637,"scheduling_latency_s":1.106384,"redis_calls":12,"redis_duration_s":0.004691,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000765,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001528,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000355911,"exclusive_lock_hold_duration_s":0.007961347,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.03125,"completed_at":"2026-08-23T07:40:05.963Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 149.723088] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f556fa592abbd744608dd73e","created_at":"2026-08-23T07:40:04.852Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9ad02f12eb8081cb14dae8fbc3c05a9","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.866Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f556fa592abbd744608dd73e: start","job_status":"start","queue_duration_s":1.09787,"scheduling_latency_s":1.097883}1408gitlab # [ 149.724059] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f556fa592abbd744608dd73e","created_at":"2026-08-23T07:40:04.852Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9ad02f12eb8081cb14dae8fbc3c05a9","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.866Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f556fa592abbd744608dd73e: done: 0.020329 sec","job_status":"done","queue_duration_s":1.09787,"scheduling_latency_s":1.097883,"redis_calls":10,"redis_duration_s":0.00156,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258693,"duration_s":0.020329,"completed_at":"2026-08-23T07:40:05.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 149.759281] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:05.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"fe7e14a5a953074f71a4bfb1","created_at":"2026-08-23T07:40:04.897Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af5a2be2f1ab9d09ef75886e786f1d97","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.911Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-fe7e14a5a953074f71a4bfb1: start","job_status":"start","queue_duration_s":1.077517,"scheduling_latency_s":1.07753}1410gitlab # [ 149.795033] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"fe7e14a5a953074f71a4bfb1","created_at":"2026-08-23T07:40:04.897Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af5a2be2f1ab9d09ef75886e786f1d97","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.911Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-fe7e14a5a953074f71a4bfb1: done: 0.027334 sec","job_status":"done","queue_duration_s":1.077517,"scheduling_latency_s":1.07753,"redis_calls":10,"redis_duration_s":0.005096,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229638,"duration_s":0.027334,"completed_at":"2026-08-23T07:40:06.016Z","load_balancing_strategy":"primary","db_duration_s":0.00723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 149.803101] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"d3fa9712cf0201aac25143d0","created_at":"2026-08-23T07:40:04.938Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7840ab1cac0667ce442270a7ee456e4","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.956Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-d3fa9712cf0201aac25143d0: start","job_status":"start","queue_duration_s":1.06209,"scheduling_latency_s":1.062104}1412gitlab # [ 149.814070] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"d3fa9712cf0201aac25143d0","created_at":"2026-08-23T07:40:04.938Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7840ab1cac0667ce442270a7ee456e4","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.956Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-d3fa9712cf0201aac25143d0: done: 0.024392 sec","job_status":"done","queue_duration_s":1.06209,"scheduling_latency_s":1.062104,"redis_calls":10,"redis_duration_s":0.001389,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209245,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00120127},"duration_s":0.024392,"completed_at":"2026-08-23T07:40:06.043Z","load_balancing_strategy":"primary","db_duration_s":0.005821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 149.849585] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.044Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"32c85364af89e8bb747bc8bf","created_at":"2026-08-23T07:40:04.964Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e73765035254d7d086431dee28f5b101","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.970Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-32c85364af89e8bb747bc8bf: start","job_status":"start","queue_duration_s":1.073862,"scheduling_latency_s":1.073874}1414gitlab # [ 149.893152] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"32c85364af89e8bb747bc8bf","created_at":"2026-08-23T07:40:04.964Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e73765035254d7d086431dee28f5b101","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.970Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-32c85364af89e8bb747bc8bf: done: 0.021438 sec","job_status":"done","queue_duration_s":1.073862,"scheduling_latency_s":1.073874,"redis_calls":10,"redis_duration_s":0.001357,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218184,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.021438,"completed_at":"2026-08-23T07:40:06.065Z","load_balancing_strategy":"primary","db_duration_s":0.005712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 149.894039] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"095ec481ff6130d7cc2b2d67","created_at":"2026-08-23T07:40:04.978Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bb727f09e006a7a5b6ecd96b3a3c689","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.987Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-095ec481ff6130d7cc2b2d67: start","job_status":"start","queue_duration_s":1.079116,"scheduling_latency_s":1.079128}1416gitlab # [ 149.930269] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.074Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1417gitlab # [ 149.930928] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"095ec481ff6130d7cc2b2d67","created_at":"2026-08-23T07:40:04.978Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bb727f09e006a7a5b6ecd96b3a3c689","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:04.987Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-095ec481ff6130d7cc2b2d67: done: 0.012816 sec","job_status":"done","queue_duration_s":1.079116,"scheduling_latency_s":1.079128,"redis_calls":10,"redis_duration_s":0.001494,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022908,"duration_s":0.012816,"completed_at":"2026-08-23T07:40:06.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 149.941943] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"5cc4bdf589a9808f8685a30c","created_at":"2026-08-23T07:40:04.997Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c8a60735b32ab410ca332a6e6f13cf9","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.007Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-5cc4bdf589a9808f8685a30c: start","job_status":"start","queue_duration_s":1.072888,"scheduling_latency_s":1.072901}1419gitlab # [ 149.953992] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"5cc4bdf589a9808f8685a30c","created_at":"2026-08-23T07:40:04.997Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-3b308e8003a54c92","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c8a60735b32ab410ca332a6e6f13cf9","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.007Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-5cc4bdf589a9808f8685a30c: done: 0.023364 sec","job_status":"done","queue_duration_s":1.072888,"scheduling_latency_s":1.072901,"redis_calls":13,"redis_duration_s":0.004026,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214831,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.023364,"completed_at":"2026-08-23T07:40:06.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 150.007237] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4cbc104204fd3131b3fd6e","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4cbc104204fd3131b3fd6e: start","job_status":"start","queue_duration_s":1.064392,"scheduling_latency_s":1.064404}1421gitlab # [ 150.007874] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4cbc104204fd3131b3fd6e","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4cbc104204fd3131b3fd6e: done: 0.016773 sec","job_status":"done","queue_duration_s":1.064392,"scheduling_latency_s":1.064404,"redis_calls":16,"redis_duration_s":0.004055,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00108,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002247,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214553,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016773,"completed_at":"2026-08-23T07:40:06.121Z","load_balancing_strategy":"primary","db_duration_s":0.000258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 150.044542] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac709caeca3b3f1ee758423e","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac709caeca3b3f1ee758423e: start","job_status":"start","queue_duration_s":1.082074,"scheduling_latency_s":1.082086}1423gitlab # [ 150.045284] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac709caeca3b3f1ee758423e","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac709caeca3b3f1ee758423e: done: 0.019369 sec","job_status":"done","queue_duration_s":1.082074,"scheduling_latency_s":1.082086,"redis_calls":13,"redis_duration_s":0.008156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019369,"completed_at":"2026-08-23T07:40:06.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 150.084452] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0116207fb78b440a0fb31f91","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0116207fb78b440a0fb31f91: start","job_status":"start","queue_duration_s":1.104093,"scheduling_latency_s":1.104106}1425gitlab # [ 150.085119] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0116207fb78b440a0fb31f91","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0116207fb78b440a0fb31f91: done: 0.018282 sec","job_status":"done","queue_duration_s":1.104093,"scheduling_latency_s":1.104106,"redis_calls":13,"redis_duration_s":0.009673000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007228,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018282,"completed_at":"2026-08-23T07:40:06.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 150.132676] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d05c3b4e90afab046e79c5","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d05c3b4e90afab046e79c5: start","job_status":"start","queue_duration_s":1.123242,"scheduling_latency_s":1.123255}1427gitlab # [ 150.133453] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d05c3b4e90afab046e79c5","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d05c3b4e90afab046e79c5: done: 0.009035 sec","job_status":"done","queue_duration_s":1.123242,"scheduling_latency_s":1.123255,"redis_calls":13,"redis_duration_s":0.0015229999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009035,"completed_at":"2026-08-23T07:40:06.173Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 150.173633] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"205f7136fe29c6b7260a86d8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-205f7136fe29c6b7260a86d8: start","job_status":"start","queue_duration_s":1.133098,"scheduling_latency_s":1.133111}1429gitlab # [ 150.174316] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"205f7136fe29c6b7260a86d8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-205f7136fe29c6b7260a86d8: done: 0.008794 sec","job_status":"done","queue_duration_s":1.133098,"scheduling_latency_s":1.133111,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008794,"completed_at":"2026-08-23T07:40:06.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 150.223534] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3766d6da2ab591ee28b4031a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3766d6da2ab591ee28b4031a: start","job_status":"start","queue_duration_s":1.142706,"scheduling_latency_s":1.142718}1431gitlab # [ 150.224177] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3766d6da2ab591ee28b4031a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3766d6da2ab591ee28b4031a: done: 0.008754 sec","job_status":"done","queue_duration_s":1.142706,"scheduling_latency_s":1.142718,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008754,"completed_at":"2026-08-23T07:40:06.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 150.238720] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"868a2b3d5ed7ac9a712c476a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-868a2b3d5ed7ac9a712c476a: start","job_status":"start","queue_duration_s":1.152276,"scheduling_latency_s":1.152288}1433gitlab # [ 150.248881] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"868a2b3d5ed7ac9a712c476a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-868a2b3d5ed7ac9a712c476a: done: 0.018061 sec","job_status":"done","queue_duration_s":1.152276,"scheduling_latency_s":1.152288,"redis_calls":13,"redis_duration_s":0.010567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001299,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009268,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018061,"completed_at":"2026-08-23T07:40:06.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 150.286914] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b25e2fa28a0ddc74e359ac","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b25e2fa28a0ddc74e359ac: start","job_status":"start","queue_duration_s":1.173215,"scheduling_latency_s":1.173228}1435gitlab # [ 150.289913] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b25e2fa28a0ddc74e359ac","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b25e2fa28a0ddc74e359ac: done: 0.019275 sec","job_status":"done","queue_duration_s":1.173215,"scheduling_latency_s":1.173228,"redis_calls":13,"redis_duration_s":0.010236,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019275,"completed_at":"2026-08-23T07:40:06.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 150.342214] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d9ce660ff24d2256b116d9","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d9ce660ff24d2256b116d9: start","job_status":"start","queue_duration_s":1.195089,"scheduling_latency_s":1.195102}1437gitlab # [ 150.342970] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d9ce660ff24d2256b116d9","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d9ce660ff24d2256b116d9: done: 0.017725 sec","job_status":"done","queue_duration_s":1.195089,"scheduling_latency_s":1.195102,"redis_calls":13,"redis_duration_s":0.009086,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017725,"completed_at":"2026-08-23T07:40:06.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 150.381859] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32d198007f17bc9bf1491429","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32d198007f17bc9bf1491429: start","job_status":"start","queue_duration_s":1.213751,"scheduling_latency_s":1.213764}1439gitlab # [ 150.382802] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32d198007f17bc9bf1491429","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32d198007f17bc9bf1491429: done: 0.009065 sec","job_status":"done","queue_duration_s":1.213751,"scheduling_latency_s":1.213764,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009065,"completed_at":"2026-08-23T07:40:06.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 150.407081] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3488b2d3ca4accc530b4f04f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3488b2d3ca4accc530b4f04f: start","job_status":"start","queue_duration_s":1.223625,"scheduling_latency_s":1.223637}1441gitlab # [ 150.417680] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3488b2d3ca4accc530b4f04f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3488b2d3ca4accc530b4f04f: done: 0.008819 sec","job_status":"done","queue_duration_s":1.223625,"scheduling_latency_s":1.223637,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008819,"completed_at":"2026-08-23T07:40:06.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 150.457160] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d39882aa74a04ac8f250bfb","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d39882aa74a04ac8f250bfb: start","job_status":"start","queue_duration_s":1.233266,"scheduling_latency_s":1.233279}1443gitlab # [ 150.458752] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d39882aa74a04ac8f250bfb","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d39882aa74a04ac8f250bfb: done: 0.008776 sec","job_status":"done","queue_duration_s":1.233266,"scheduling_latency_s":1.233279,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008776,"completed_at":"2026-08-23T07:40:06.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 150.505712] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2972de4f9e416894ed1cc0f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2972de4f9e416894ed1cc0f: start","job_status":"start","queue_duration_s":1.242832,"scheduling_latency_s":1.242844}1445gitlab # [ 150.506617] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2972de4f9e416894ed1cc0f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2972de4f9e416894ed1cc0f: done: 0.008778 sec","job_status":"done","queue_duration_s":1.242832,"scheduling_latency_s":1.242844,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008778,"completed_at":"2026-08-23T07:40:06.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 150.533095] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0763f938f137d19c901cd3a9","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0763f938f137d19c901cd3a9: start","job_status":"start","queue_duration_s":1.252403,"scheduling_latency_s":1.252415}1447gitlab # [ 150.543479] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0763f938f137d19c901cd3a9","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0763f938f137d19c901cd3a9: done: 0.00883 sec","job_status":"done","queue_duration_s":1.252403,"scheduling_latency_s":1.252415,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00883,"completed_at":"2026-08-23T07:40:06.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 150.578870] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f35c5bb44eccd224645a2479","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f35c5bb44eccd224645a2479: start","job_status":"start","queue_duration_s":1.262044,"scheduling_latency_s":1.262056}1449gitlab # [ 150.584711] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f35c5bb44eccd224645a2479","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f35c5bb44eccd224645a2479: done: 0.008782 sec","job_status":"done","queue_duration_s":1.262044,"scheduling_latency_s":1.262056,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008782,"completed_at":"2026-08-23T07:40:06.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 150.635296] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c08009980ae514d35dd2e8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c08009980ae514d35dd2e8: start","job_status":"start","queue_duration_s":1.271657,"scheduling_latency_s":1.271669}1451gitlab # [ 150.636079] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c08009980ae514d35dd2e8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c08009980ae514d35dd2e8: done: 0.009029 sec","job_status":"done","queue_duration_s":1.271657,"scheduling_latency_s":1.271669,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009029,"completed_at":"2026-08-23T07:40:06.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 150.679860] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01ab1d330e4b35362c7ef0b4","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01ab1d330e4b35362c7ef0b4: start","job_status":"start","queue_duration_s":1.281495,"scheduling_latency_s":1.281507}1453gitlab # [ 150.680826] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01ab1d330e4b35362c7ef0b4","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01ab1d330e4b35362c7ef0b4: done: 0.008822 sec","job_status":"done","queue_duration_s":1.281495,"scheduling_latency_s":1.281507,"redis_calls":13,"redis_duration_s":0.0015190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008822,"completed_at":"2026-08-23T07:40:06.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 150.701918] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67f50b8b71c6214fe7acd560","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67f50b8b71c6214fe7acd560: start","job_status":"start","queue_duration_s":1.291129,"scheduling_latency_s":1.291141}1455gitlab # [ 150.712894] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67f50b8b71c6214fe7acd560","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67f50b8b71c6214fe7acd560: done: 0.008787 sec","job_status":"done","queue_duration_s":1.291129,"scheduling_latency_s":1.291141,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008787,"completed_at":"2026-08-23T07:40:06.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 150.755828] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0425bca8982fed3bceb89f63","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0425bca8982fed3bceb89f63: start","job_status":"start","queue_duration_s":1.300744,"scheduling_latency_s":1.300756}1457gitlab # [ 150.756781] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0425bca8982fed3bceb89f63","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0425bca8982fed3bceb89f63: done: 0.008959 sec","job_status":"done","queue_duration_s":1.300744,"scheduling_latency_s":1.300756,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008959,"completed_at":"2026-08-23T07:40:06.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 150.789202] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51943e87b95c4c43e56a85ee","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51943e87b95c4c43e56a85ee: start","job_status":"start","queue_duration_s":1.310499,"scheduling_latency_s":1.310512}1459gitlab # [ 150.831541] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51943e87b95c4c43e56a85ee","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51943e87b95c4c43e56a85ee: done: 0.009234 sec","job_status":"done","queue_duration_s":1.310499,"scheduling_latency_s":1.310512,"redis_calls":13,"redis_duration_s":0.0016780000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009234,"completed_at":"2026-08-23T07:40:06.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 150.832586] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f654001587b427a695bba7e8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f654001587b427a695bba7e8: start","job_status":"start","queue_duration_s":1.320533,"scheduling_latency_s":1.320545}1461gitlab # [ 150.840753] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f654001587b427a695bba7e8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f654001587b427a695bba7e8: done: 0.009057 sec","job_status":"done","queue_duration_s":1.320533,"scheduling_latency_s":1.320545,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009057,"completed_at":"2026-08-23T07:40:06.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 150.904637] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143e3976a0c2863c31a7d8bf","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143e3976a0c2863c31a7d8bf: start","job_status":"start","queue_duration_s":1.330399,"scheduling_latency_s":1.330411}1463gitlab # [ 150.905463] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143e3976a0c2863c31a7d8bf","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143e3976a0c2863c31a7d8bf: done: 0.009006 sec","job_status":"done","queue_duration_s":1.330399,"scheduling_latency_s":1.330411,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009006,"completed_at":"2026-08-23T07:40:06.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 150.913940] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7182d890c46247109056d7fb","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7182d890c46247109056d7fb: start","job_status":"start","queue_duration_s":1.340219,"scheduling_latency_s":1.340231}1465gitlab # [ 150.924148] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7182d890c46247109056d7fb","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7182d890c46247109056d7fb: done: 0.008965 sec","job_status":"done","queue_duration_s":1.340219,"scheduling_latency_s":1.340231,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008965,"completed_at":"2026-08-23T07:40:06.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 150.978677] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e96b688005ddb0409204ccbd","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e96b688005ddb0409204ccbd: start","job_status":"start","queue_duration_s":1.349998,"scheduling_latency_s":1.350011}1467gitlab # [ 150.979507] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e96b688005ddb0409204ccbd","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e96b688005ddb0409204ccbd: done: 0.008979 sec","job_status":"done","queue_duration_s":1.349998,"scheduling_latency_s":1.350011,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008979,"completed_at":"2026-08-23T07:40:06.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 151.029472] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7ee9efbf7c6bf17594b648","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7ee9efbf7c6bf17594b648: start","job_status":"start","queue_duration_s":1.359968,"scheduling_latency_s":1.35998}1469gitlab # [ 151.030125] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7ee9efbf7c6bf17594b648","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7ee9efbf7c6bf17594b648: done: 0.009317 sec","job_status":"done","queue_duration_s":1.359968,"scheduling_latency_s":1.35998,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009317,"completed_at":"2026-08-23T07:40:06.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 151.066368] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6bcab7bdc9c3c2159d0c521","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6bcab7bdc9c3c2159d0c521: start","job_status":"start","queue_duration_s":1.370247,"scheduling_latency_s":1.37026}1471gitlab # [ 151.067035] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6bcab7bdc9c3c2159d0c521","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6bcab7bdc9c3c2159d0c521: done: 0.009605 sec","job_status":"done","queue_duration_s":1.370247,"scheduling_latency_s":1.37026,"redis_calls":13,"redis_duration_s":0.0017749999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009605,"completed_at":"2026-08-23T07:40:06.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 151.080140] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8872408363bb2386a6fbba4","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8872408363bb2386a6fbba4: start","job_status":"start","queue_duration_s":1.380814,"scheduling_latency_s":1.380826}1473gitlab # [ 151.120822] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8872408363bb2386a6fbba4","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8872408363bb2386a6fbba4: done: 0.009333 sec","job_status":"done","queue_duration_s":1.380814,"scheduling_latency_s":1.380826,"redis_calls":13,"redis_duration_s":0.0015310000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009333,"completed_at":"2026-08-23T07:40:06.430Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 151.121816] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d8f0c78d5953fb2d91be219","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d8f0c78d5953fb2d91be219: start","job_status":"start","queue_duration_s":1.391132,"scheduling_latency_s":1.391144}1475gitlab # [ 151.131931] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d8f0c78d5953fb2d91be219","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d8f0c78d5953fb2d91be219: done: 0.009494 sec","job_status":"done","queue_duration_s":1.391132,"scheduling_latency_s":1.391144,"redis_calls":13,"redis_duration_s":0.001517,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009494,"completed_at":"2026-08-23T07:40:06.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 151.164338] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5519f0ede27358f0a8af03e","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5519f0ede27358f0a8af03e: start","job_status":"start","queue_duration_s":1.401569,"scheduling_latency_s":1.401583}1477gitlab # [ 151.174669] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5519f0ede27358f0a8af03e","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5519f0ede27358f0a8af03e: done: 0.009308 sec","job_status":"done","queue_duration_s":1.401569,"scheduling_latency_s":1.401583,"redis_calls":13,"redis_duration_s":0.001528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009308,"completed_at":"2026-08-23T07:40:06.451Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 151.232888] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b3d0e6d5cfe01adff6e375","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b3d0e6d5cfe01adff6e375: start","job_status":"start","queue_duration_s":1.411678,"scheduling_latency_s":1.411691}1479gitlab # [ 151.233683] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b3d0e6d5cfe01adff6e375","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b3d0e6d5cfe01adff6e375: done: 0.009571 sec","job_status":"done","queue_duration_s":1.411678,"scheduling_latency_s":1.411691,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009571,"completed_at":"2026-08-23T07:40:06.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 151.270352] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dffcbf8dfff718a96eadd193","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dffcbf8dfff718a96eadd193: start","job_status":"start","queue_duration_s":1.422059,"scheduling_latency_s":1.422072}1481gitlab # [ 151.271090] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dffcbf8dfff718a96eadd193","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dffcbf8dfff718a96eadd193: done: 0.009448 sec","job_status":"done","queue_duration_s":1.422059,"scheduling_latency_s":1.422072,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009448,"completed_at":"2026-08-23T07:40:06.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 151.314305] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87381f4d10b4215fc9197a10","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87381f4d10b4215fc9197a10: start","job_status":"start","queue_duration_s":1.432356,"scheduling_latency_s":1.432369}1483gitlab # [ 151.314912] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87381f4d10b4215fc9197a10","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87381f4d10b4215fc9197a10: done: 0.009496 sec","job_status":"done","queue_duration_s":1.432356,"scheduling_latency_s":1.432369,"redis_calls":13,"redis_duration_s":0.0015860000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009496,"completed_at":"2026-08-23T07:40:06.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 151.360185] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe5ece1217d9882e2cf73640","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe5ece1217d9882e2cf73640: start","job_status":"start","queue_duration_s":1.442726,"scheduling_latency_s":1.442738}1485gitlab # [ 151.360812] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe5ece1217d9882e2cf73640","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe5ece1217d9882e2cf73640: done: 0.009526 sec","job_status":"done","queue_duration_s":1.442726,"scheduling_latency_s":1.442738,"redis_calls":13,"redis_duration_s":0.0015559999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009526,"completed_at":"2026-08-23T07:40:06.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 151.370653] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3a6d4c660c5a3baf4dfd82f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3a6d4c660c5a3baf4dfd82f: start","job_status":"start","queue_duration_s":1.453067,"scheduling_latency_s":1.453079}1487gitlab # [ 151.380576] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3a6d4c660c5a3baf4dfd82f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3a6d4c660c5a3baf4dfd82f: done: 0.009314 sec","job_status":"done","queue_duration_s":1.453067,"scheduling_latency_s":1.453079,"redis_calls":13,"redis_duration_s":0.001574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009314,"completed_at":"2026-08-23T07:40:06.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 151.416654] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66ba78c5f930fbe2ed8bd01f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66ba78c5f930fbe2ed8bd01f: start","job_status":"start","queue_duration_s":1.463342,"scheduling_latency_s":1.463355}1489gitlab # [ 151.420836] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66ba78c5f930fbe2ed8bd01f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66ba78c5f930fbe2ed8bd01f: done: 0.00931 sec","job_status":"done","queue_duration_s":1.463342,"scheduling_latency_s":1.463355,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00931,"completed_at":"2026-08-23T07:40:06.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 151.460185] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc885006b89e2d12bd648eb","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc885006b89e2d12bd648eb: start","job_status":"start","queue_duration_s":1.473621,"scheduling_latency_s":1.473634}1491gitlab # [ 151.461571] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc885006b89e2d12bd648eb","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc885006b89e2d12bd648eb: done: 0.010051 sec","job_status":"done","queue_duration_s":1.473621,"scheduling_latency_s":1.473634,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010051,"completed_at":"2026-08-23T07:40:06.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 151.526586] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aea0b89ac99a92fb45aba85a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aea0b89ac99a92fb45aba85a: start","job_status":"start","queue_duration_s":1.484695,"scheduling_latency_s":1.484707}1493gitlab # [ 151.527303] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aea0b89ac99a92fb45aba85a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aea0b89ac99a92fb45aba85a: done: 0.009354 sec","job_status":"done","queue_duration_s":1.484695,"scheduling_latency_s":1.484707,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009354,"completed_at":"2026-08-23T07:40:06.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 151.534925] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7feb5c2541044769c2ceb6f2","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7feb5c2541044769c2ceb6f2: start","job_status":"start","queue_duration_s":1.495005,"scheduling_latency_s":1.495018}1495gitlab # [ 151.575926] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7feb5c2541044769c2ceb6f2","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7feb5c2541044769c2ceb6f2: done: 0.009362 sec","job_status":"done","queue_duration_s":1.495005,"scheduling_latency_s":1.495018,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009362,"completed_at":"2026-08-23T07:40:06.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 151.576914] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"906dcc0a66b9f775d2773710","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-906dcc0a66b9f775d2773710: start","job_status":"start","queue_duration_s":1.505347,"scheduling_latency_s":1.50536}1497gitlab # [ 151.585601] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"906dcc0a66b9f775d2773710","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-906dcc0a66b9f775d2773710: done: 0.009291 sec","job_status":"done","queue_duration_s":1.505347,"scheduling_latency_s":1.50536,"redis_calls":13,"redis_duration_s":0.0015730000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009291,"completed_at":"2026-08-23T07:40:06.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 151.623538] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77dfd9e9a9da288c8f08c3e2","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77dfd9e9a9da288c8f08c3e2: start","job_status":"start","queue_duration_s":1.515459,"scheduling_latency_s":1.515471}1499gitlab # [ 151.626553] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77dfd9e9a9da288c8f08c3e2","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77dfd9e9a9da288c8f08c3e2: done: 0.009575 sec","job_status":"done","queue_duration_s":1.515459,"scheduling_latency_s":1.515471,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009575,"completed_at":"2026-08-23T07:40:06.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 151.662715] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c34ba49c9d90bce3a60f34","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c34ba49c9d90bce3a60f34: start","job_status":"start","queue_duration_s":1.525812,"scheduling_latency_s":1.525824}1501gitlab # [ 151.667693] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c34ba49c9d90bce3a60f34","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c34ba49c9d90bce3a60f34: done: 0.009661 sec","job_status":"done","queue_duration_s":1.525812,"scheduling_latency_s":1.525824,"redis_calls":13,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009661,"completed_at":"2026-08-23T07:40:06.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 151.707467] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8d94bb54ed701aab9c03ef8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8d94bb54ed701aab9c03ef8: start","job_status":"start","queue_duration_s":1.53631,"scheduling_latency_s":1.536322}1503gitlab # [ 151.708782] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8d94bb54ed701aab9c03ef8","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8d94bb54ed701aab9c03ef8: done: 0.00948 sec","job_status":"done","queue_duration_s":1.53631,"scheduling_latency_s":1.536322,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00948,"completed_at":"2026-08-23T07:40:06.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 151.742618] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89587cfbbfc47dc4a1f7e3d7","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89587cfbbfc47dc4a1f7e3d7: start","job_status":"start","queue_duration_s":1.546625,"scheduling_latency_s":1.546638}1505gitlab # [ 151.781978] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89587cfbbfc47dc4a1f7e3d7","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89587cfbbfc47dc4a1f7e3d7: done: 0.010939 sec","job_status":"done","queue_duration_s":1.546625,"scheduling_latency_s":1.546638,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010939,"completed_at":"2026-08-23T07:40:06.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 151.784143] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff1be8bfee668227b398ef5f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff1be8bfee668227b398ef5f: start","job_status":"start","queue_duration_s":1.55845,"scheduling_latency_s":1.558463}1507gitlab # [ 151.795384] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff1be8bfee668227b398ef5f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff1be8bfee668227b398ef5f: done: 0.009625 sec","job_status":"done","queue_duration_s":1.55845,"scheduling_latency_s":1.558463,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009625,"completed_at":"2026-08-23T07:40:06.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 151.857164] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d481e7e6a8ad73fb17009099","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d481e7e6a8ad73fb17009099: start","job_status":"start","queue_duration_s":1.568867,"scheduling_latency_s":1.56888}1509gitlab # [ 151.857787] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d481e7e6a8ad73fb17009099","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d481e7e6a8ad73fb17009099: done: 0.009694 sec","job_status":"done","queue_duration_s":1.568867,"scheduling_latency_s":1.56888,"redis_calls":13,"redis_duration_s":0.001645,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009694,"completed_at":"2026-08-23T07:40:06.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 151.869398] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"649e4481d03ba0647e5a0b36","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-649e4481d03ba0647e5a0b36: start","job_status":"start","queue_duration_s":1.579551,"scheduling_latency_s":1.579564}1511gitlab # [ 151.879181] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"649e4481d03ba0647e5a0b36","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-649e4481d03ba0647e5a0b36: done: 0.009478 sec","job_status":"done","queue_duration_s":1.579551,"scheduling_latency_s":1.579564,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009478,"completed_at":"2026-08-23T07:40:06.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 151.914478] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4f6b4c3fe5f48d7b815f54a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4f6b4c3fe5f48d7b815f54a: start","job_status":"start","queue_duration_s":1.589805,"scheduling_latency_s":1.589817}1513gitlab # [ 151.919928] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4f6b4c3fe5f48d7b815f54a","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4f6b4c3fe5f48d7b815f54a: done: 0.009249 sec","job_status":"done","queue_duration_s":1.589805,"scheduling_latency_s":1.589817,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009249,"completed_at":"2026-08-23T07:40:06.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 151.955538] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e98b21bc181711b5d9bcef5d","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e98b21bc181711b5d9bcef5d: start","job_status":"start","queue_duration_s":1.600013,"scheduling_latency_s":1.600026}1515gitlab # [ 151.960601] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e98b21bc181711b5d9bcef5d","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e98b21bc181711b5d9bcef5d: done: 0.00939 sec","job_status":"done","queue_duration_s":1.600013,"scheduling_latency_s":1.600026,"redis_calls":13,"redis_duration_s":0.0015819999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00939,"completed_at":"2026-08-23T07:40:06.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 152.001459] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af216933514f7dd4766e4032","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af216933514f7dd4766e4032: start","job_status":"start","queue_duration_s":1.610394,"scheduling_latency_s":1.610407}1517gitlab # [ 152.001984] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af216933514f7dd4766e4032","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af216933514f7dd4766e4032: done: 0.009449 sec","job_status":"done","queue_duration_s":1.610394,"scheduling_latency_s":1.610407,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009449,"completed_at":"2026-08-23T07:40:06.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 152.041530] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5af3123853b3c181ef36616f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5af3123853b3c181ef36616f: start","job_status":"start","queue_duration_s":1.620826,"scheduling_latency_s":1.620838}1519gitlab # [ 152.042275] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5af3123853b3c181ef36616f","created_at":"2026-08-23T07:40:04.909Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-a6b0da738307441c","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4b8eb674da5df426360b009dc8f25d0d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.040Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5af3123853b3c181ef36616f: done: 0.009422 sec","job_status":"done","queue_duration_s":1.620826,"scheduling_latency_s":1.620838,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009422,"completed_at":"2026-08-23T07:40:06.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 152.096097] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.672Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"12140c3593a0341dc6633c11","created_at":"2026-08-23T07:40:05.871Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-4496b701a8b543a0","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6a39849f35535a57f0d004c791695b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.879Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-12140c3593a0341dc6633c11: start","job_status":"start","queue_duration_s":0.793058,"scheduling_latency_s":0.793072}1521gitlab # [ 152.096655] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.687Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"12140c3593a0341dc6633c11","created_at":"2026-08-23T07:40:05.871Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-4496b701a8b543a0","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6a39849f35535a57f0d004c791695b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.879Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-12140c3593a0341dc6633c11: done: 0.015677 sec","job_status":"done","queue_duration_s":0.793058,"scheduling_latency_s":0.793072,"redis_calls":10,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022433,"duration_s":0.015677,"completed_at":"2026-08-23T07:40:06.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 152.145209] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.688Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"0edd4ba00c5cac2ffdf90805","created_at":"2026-08-23T07:40:05.879Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-4496b701a8b543a0","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6a39849f35535a57f0d004c791695b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.881Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-0edd4ba00c5cac2ffdf90805: start","job_status":"start","queue_duration_s":0.806743,"scheduling_latency_s":0.806756}1523gitlab # [ 152.145870] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.701Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"0edd4ba00c5cac2ffdf90805","created_at":"2026-08-23T07:40:05.879Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-4496b701a8b543a0","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6a39849f35535a57f0d004c791695b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.881Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-0edd4ba00c5cac2ffdf90805: done: 0.013121 sec","job_status":"done","queue_duration_s":0.806743,"scheduling_latency_s":0.806756,"redis_calls":10,"redis_duration_s":0.001373,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196952,"duration_s":0.013121,"completed_at":"2026-08-23T07:40:06.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 152.191466] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.702Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"eed1954ec06e7e6c6f482fd6","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-eed1954ec06e7e6c6f482fd6: start","job_status":"start","queue_duration_s":0.77766,"scheduling_latency_s":0.777673}1525gitlab # [ 152.191949] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.713Z","message":"No existing merge request to be cleaned up."}1526gitlab # [ 152.192619] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.721Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"eed1954ec06e7e6c6f482fd6","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-eed1954ec06e7e6c6f482fd6: done: 0.019136 sec","job_status":"done","queue_duration_s":0.77766,"scheduling_latency_s":0.777673,"redis_calls":13,"redis_duration_s":0.001714,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242209,"duration_s":0.019136,"completed_at":"2026-08-23T07:40:06.721Z","load_balancing_strategy":"primary","db_duration_s":0.002634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 152.229289] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.722Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5eaa09463b6ddd68f27549e9","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5eaa09463b6ddd68f27549e9: start","job_status":"start","queue_duration_s":0.797807,"scheduling_latency_s":0.797819}1528gitlab # [ 152.229901] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.729Z","message":"No existing merge request to be cleaned up."}1529gitlab # [ 152.230544] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.734Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5eaa09463b6ddd68f27549e9","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5eaa09463b6ddd68f27549e9: done: 0.011152 sec","job_status":"done","queue_duration_s":0.797807,"scheduling_latency_s":0.797819,"redis_calls":10,"redis_duration_s":0.001275,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011152,"completed_at":"2026-08-23T07:40:06.734Z","load_balancing_strategy":"primary","db_duration_s":0.001248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 152.250592] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.735Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ee00876f67ded58963d03430","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ee00876f67ded58963d03430: start","job_status":"start","queue_duration_s":0.809967,"scheduling_latency_s":0.80998}1531gitlab # [ 152.290386] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.741Z","message":"No existing merge request to be cleaned up."}1532gitlab # [ 152.290947] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.746Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ee00876f67ded58963d03430","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ee00876f67ded58963d03430: done: 0.010963 sec","job_status":"done","queue_duration_s":0.809967,"scheduling_latency_s":0.80998,"redis_calls":10,"redis_duration_s":0.0012959999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010963,"completed_at":"2026-08-23T07:40:06.746Z","load_balancing_strategy":"primary","db_duration_s":0.001264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 152.291930] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.747Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9edee0fdfbb980408579f6ea","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9edee0fdfbb980408579f6ea: start","job_status":"start","queue_duration_s":0.821891,"scheduling_latency_s":0.821904}1534gitlab # [ 152.331084] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.753Z","message":"No existing merge request to be cleaned up."}1535gitlab # [ 152.331801] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:06.758Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9edee0fdfbb980408579f6ea","created_at":"2026-08-23T07:40:05.917Z","trace_propagation_headers":{"sentry-trace":"432151183bfa4af396ccd2d259a1785a-5a7e1f40fc5b4b88","baggage":"sentry-trace_id=432151183bfa4af396ccd2d259a1785a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"89e8ac769c968e99a6b758d3d5d3c28e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:05.925Z","job_size_bytes":2,"pid":1617,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9edee0fdfbb980408579f6ea: done: 0.011382 sec","job_status":"done","queue_duration_s":0.821891,"scheduling_latency_s":0.821904,"redis_calls":10,"redis_duration_s":0.001338,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011382,"completed_at":"2026-08-23T07:40:06.758Z","load_balancing_strategy":"primary","db_duration_s":0.001465,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 152.515378] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2099993260 wd_nsec: 20999933591537gitlab # [ 160.397062] setup-gitlab-start[2223]: W, [2026-08-23T07:40:16.798869 #2223] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1538gitlab # [ 181.908143] postgres[2424]: [2424] ERROR: relation "table_without_models" does not exist1539gitlab # [ 181.910311] postgres[2424]: [2424] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1540gitlab # [ 185.462770] runuser[2222]: pam_unix(runuser:session): session closed for user gitlab1541gitlab # [ 185.465511] setup-gitlab-start[2204]: + systemctl restart gitlab-sidekiq.service1542gitlab # [ 185.488262] systemd[1]: Stopping gitlab-sidekiq.service...1543gitlab # [ 185.490854] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:41.892Z","message":"Shutting down"}1544gitlab # [ 185.492345] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:41.893Z","message":"Scheduler exiting..."}1545gitlab # [ 185.493282] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:41.893Z","message":"Terminating quiet threads for default capsule"}1546gitlab # [ 185.494373] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:41.894Z","message":"Scheduler exiting..."}1547gitlab # [ 185.994654] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:42.396Z","message":"Bye!"}1548gitlab # [ 186.021425] sidekiq-cluster[1617]: {"severity":"INFO","time":"2026-08-23T07:40:42.423Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1617,"worker_id":"sidekiq_0","memwd_rss_bytes":944037888,"retry":0}1549gitlab # [ 186.823065] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1550gitlab # [ 186.824660] systemd[1]: Stopped gitlab-sidekiq.service.1551gitlab # [ 186.826644] systemd[1]: gitlab-sidekiq.service: Consumed 55.976s CPU time over 1min 54.079s wall clock time, 959.7M memory peak, 4.4M read from disk.1552gitlab # [ 186.828192] systemd[1]: Started gitlab-sidekiq.service.1553gitlab # [ 186.833872] setup-gitlab-start[2204]: + mkdir -p /var/lib/secrets1554gitlab # [ 186.837836] setup-gitlab-start[2204]: + echo nixbot-test-token-of-20-chars1555gitlab # [ 186.840802] setup-gitlab-start[2204]: + chmod 644 /var/lib/secrets/gitlab-token1556gitlab # [ 186.843202] setup-gitlab-start[2204]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1557gitlab # [ 187.453219] gitaly[930]: time="2026-08-23T07:40:43.855Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:53.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:43.855" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1558gitlab # [ 187.454420] gitaly[930]: time="2026-08-23T07:40:43.855Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:53.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:43.855" grpc.time_ms=0.249 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1559gitlab # [ 187.595239] gitaly[930]: time="2026-08-23T07:40:43.997Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:53.146" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:43.997" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1560gitlab # [ 187.597304] gitaly[930]: time="2026-08-23T07:40:43.997Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:53.146" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:43.997" grpc.time_ms=0.472 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1561gitlab # [ 187.702372] gitaly[930]: time="2026-08-23T07:40:44.104Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY diskcache=0e9d8a76-c34b-4228-8f2d-49f4001dd8ed grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:40:54.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.047" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 187.723415] gitaly[930]: time="2026-08-23T07:40:44.125Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=25 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:40:54.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.047" grpc.time_ms=57.71 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1563gitlab # [ 187.762261] gitaly[930]: time="2026-08-23T07:40:44.164Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.123" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.164" pid=930 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1564gitlab # [ 187.763657] gitaly[930]: time="2026-08-23T07:40:44.165Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.123" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.164" grpc.time_ms=0.845 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1565gitlab # [ 187.806895] gitaly[930]: time="2026-08-23T07:40:44.209Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:40:54.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.197" grpc.time_ms=10.803 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1566gitlab # [ 187.902826] gitaly[930]: time="2026-08-23T07:40:44.305Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.264" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.304" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1567gitlab # [ 187.904368] gitaly[930]: time="2026-08-23T07:40:44.305Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.264" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.304" grpc.time_ms=0.698 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1568gitlab # [ 187.961956] gitaly[930]: time="2026-08-23T07:40:44.364Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY diskcache=cdfdca27-276f-417b-b424-ff284c65501a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:40:54.270" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.310" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1569gitlab # [ 187.963431] gitaly[930]: time="2026-08-23T07:40:44.364Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=32 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=20 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:40:54.270" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.310" grpc.time_ms=54.008 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1570gitlab # [ 187.994360] gitaly[930]: time="2026-08-23T07:40:44.396Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.026" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.396" pid=930 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1571gitlab # [ 187.995442] gitaly[930]: time="2026-08-23T07:40:44.396Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.026" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.396" grpc.time_ms=0.451 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1572gitlab # [ 188.027211] gitaly[930]: time="2026-08-23T07:40:44.429Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:40:54.048" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.419" grpc.time_ms=10.154 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1573gitlab # [ 188.073665] gitaly[930]: time="2026-08-23T07:40:44.476Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:40:54.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.475" grpc.time_ms=0.186 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1574gitlab # [ 188.096643] gitaly[930]: time="2026-08-23T07:40:44.499Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:40:54.128" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:44.498" grpc.time_ms=0.193 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 188.614535] gitaly[930]: time="2026-08-23T07:40:45.016Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS13BVBAXP5BERXPM5GBSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:40:55.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:45.006" grpc.time_ms=9.314 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 188.890601] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:45 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 20321577gitlab # [ 188.896875] setup-gitlab-start[2204]: + mkdir -p /tmp/test-flake1578gitlab # [ 188.901567] setup-gitlab-start[2204]: + cd /tmp/test-flake1579gitlab # [ 188.902478] setup-gitlab-start[2204]: + git init -b master1580gitlab # [ 188.926945] setup-gitlab-start[2505]: Initialized empty Git repository in /tmp/test-flake/.git/1581gitlab # [ 188.928271] setup-gitlab-start[2204]: + git config user.name test1582gitlab # [ 188.933633] setup-gitlab-start[2204]: + git config user.email test@example.com1583gitlab # [ 188.938635] setup-gitlab-start[2204]: + cat1584gitlab # [ 188.941214] setup-gitlab-start[2204]: + git add flake.nix1585gitlab # [ 188.946469] setup-gitlab-start[2204]: + git commit -m 'initial commit'1586gitlab # [ 188.970255] setup-gitlab-start[2510]: [master (root-commit) 918c9f1] initial commit1587gitlab # [ 188.971970] setup-gitlab-start[2510]: 1 file changed, 10 insertions(+)1588gitlab # [ 188.973640] setup-gitlab-start[2510]: create mode 100644 flake.nix1589gitlab # [ 188.975353] setup-gitlab-start[2204]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1590gitlab # [ 188.978480] setup-gitlab-start[2204]: + git push -u origin master1591gitlab # [ 189.058500] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 471592gitlab # [ 189.644483] gitaly[930]: time="2026-08-23T07:40:46.046Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS15GTJ2MGBR6N27HDDA39 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:46.035" grpc.time_ms=10.922 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1593gitlab # [ 189.671389] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 5801594gitlab # [ 189.851103] sidekiq-cluster[2458]: {"severity":"INFO","time":"2026-08-23T07:40:46.236Z","message":"Starting cluster with 1 processes"}1595gitlab # [ 189.960024] gitaly[930]: time="2026-08-23T07:40:46.362Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:40:56.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:46.356" grpc.time_ms=6.187 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 190.017905] gitaly[930]: time="2026-08-23T07:40:46.420Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T07:41:16.011" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T07:40:46.412" grpc.time_ms=7.921 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 190.082412] gitaly[930]: time="2026-08-23T07:40:46.484Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0PS164225V8XZAMM137BC0J duration_ms=271ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/allowed"1598gitlab # [ 190.107148] gitaly[930]: time="2026-08-23T07:40:46.509Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0PS164225V8XZAMM137BC0J duration_ms=24ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/pre_receive"1599gitlab # [ 190.113320] gitaly[930]: time="2026-08-23T07:40:46.510Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:46.212" grpc.time_ms=297.07 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1600gitlab # [ 190.176836] gitaly[930]: time="2026-08-23T07:40:46.579Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:46.578" grpc.time_ms=0.889 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1601gitlab # [ 190.234986] gitaly[930]: time="2026-08-23T07:40:46.637Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:46.636" grpc.time_ms=0.555 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1602gitlab # [ 190.268807] gitaly[930]: time="2026-08-23T07:40:46.671Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:46.671" grpc.time_ms=0.263 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1603gitlab # [ 190.355521] gitaly[930]: time="2026-08-23T07:40:46.757Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:40:56.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:46.747" grpc.time_ms=10.408 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 190.398300] gitaly[930]: time="2026-08-23T07:40:46.800Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T07:40:56.041" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:46.782" grpc.time_ms=18.337 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 190.416108] gitaly[930]: time="2026-08-23T07:40:46.818Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0PS164225V8XZAMM137BC0J duration_ms=114ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/post_receive"1606gitlab # [ 190.417268] gitaly[930]: time="2026-08-23T07:40:46.819Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:46.703" grpc.time_ms=116.585 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1607gitlab # [ 190.439324] gitaly[930]: time="2026-08-23T07:40:46.841Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J diskcache=ba3d3100-0048-4a2d-b4d6-044ee006e4b4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:46.148" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1608gitlab # [ 190.447730] gitaly[930]: time="2026-08-23T07:40:46.850Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=212 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=14056 command.oublock=32 command.real_time_ms=685 command.spawn_token_fork_ms=1 command.system_time_ms=134 command.user_time_ms=78 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:46.148" grpc.time_ms=693.592 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1609gitlab # [ 190.449603] gitlab-workhorse[830]: time="2026-08-23T07:40:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521610gitlab # [ 190.450501] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7681611gitlab # [ 190.463910] setup-gitlab-start[2514]: To http://gitlab/root/test-flake.git1612gitlab # [ 190.464941] setup-gitlab-start[2514]: * [new branch] master -> master1613gitlab # [ 190.469974] setup-gitlab-start[2514]: branch 'master' set up to track 'origin/master'.1614gitlab # [ 190.473843] systemd[1]: Finished setup-gitlab.service.1615gitlab # [ 190.481296] systemd[1]: Starting nixbot CI service...1616gitlab: (finished: waiting for unit setup-gitlab.service, in 191.59 seconds)1617gitlab: waiting for unit nixbot.service1618gitlab # [ 191.627808] nixbot[2609]: {"ts": "2026-08-23T07:40:48.029Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1619gitlab # [ 191.656512] nixbot[2609]: {"ts": "2026-08-23T07:40:48.058Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1620gitlab # [ 191.688642] nixbot[2609]: {"ts": "2026-08-23T07:40:48.091Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1621gitlab # [ 191.698425] nixbot[2609]: {"ts": "2026-08-23T07:40:48.100Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1622gitlab # [ 191.708755] nixbot[2609]: {"ts": "2026-08-23T07:40:48.111Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1623gitlab # [ 191.721856] nixbot[2609]: {"ts": "2026-08-23T07:40:48.124Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1624gitlab # [ 191.731681] nixbot[2609]: {"ts": "2026-08-23T07:40:48.134Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1625gitlab # [ 191.738959] nixbot[2609]: {"ts": "2026-08-23T07:40:48.141Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1626gitlab # [ 191.752714] nixbot[2609]: {"ts": "2026-08-23T07:40:48.155Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1627gitlab # [ 191.760487] nixbot[2609]: {"ts": "2026-08-23T07:40:48.162Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1628gitlab # [ 191.773605] nixbot[2609]: {"ts": "2026-08-23T07:40:48.175Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1629gitlab # [ 191.786699] nixbot[2609]: {"ts": "2026-08-23T07:40:48.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1630gitlab # [ 191.796154] nixbot[2609]: {"ts": "2026-08-23T07:40:48.198Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1631gitlab # [ 191.804385] nixbot[2609]: {"ts": "2026-08-23T07:40:48.206Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1632gitlab # [ 191.814893] nixbot[2609]: {"ts": "2026-08-23T07:40:48.217Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1633gitlab # [ 191.823189] nixbot[2609]: {"ts": "2026-08-23T07:40:48.225Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1634gitlab # [ 191.830878] nixbot[2609]: {"ts": "2026-08-23T07:40:48.233Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1635gitlab # [ 191.838281] nixbot[2609]: {"ts": "2026-08-23T07:40:48.240Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1636gitlab # [ 191.849510] nixbot[2609]: {"ts": "2026-08-23T07:40:48.251Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1637gitlab # [ 191.854359] nixbot[2609]: {"ts": "2026-08-23T07:40:48.256Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1638gitlab # [ 191.862193] nixbot[2609]: {"ts": "2026-08-23T07:40:48.264Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1639gitlab # [ 191.874391] nixbot[2609]: {"ts": "2026-08-23T07:40:48.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1640gitlab # [ 191.882158] nixbot[2609]: {"ts": "2026-08-23T07:40:48.284Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1641gitlab # [ 191.890100] nixbot[2609]: {"ts": "2026-08-23T07:40:48.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1642gitlab # [ 191.897283] nixbot[2609]: {"ts": "2026-08-23T07:40:48.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1643gitlab # [ 192.247728] nixbot[2609]: INFO: Started server process [2609]1644gitlab # [ 192.249989] nixbot[2609]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1645gitlab # [ 192.286097] nixbot[2609]: INFO: ::ffff:127.0.0.1:52326 - "GET /health HTTP/1.1" 200 OK1646gitlab # [ 192.291121] systemd[1]: Started nixbot CI service.1647gitlab # [ 192.293351] systemd[1]: Reached target Multi-User System.1648gitlab # [ 192.295117] systemd[1]: Startup finished in 1.143s (kernel) + 3.556s (initrd) + 3min 7.595s (userspace) = 3min 12.294s.1649gitlab # [ 192.557181] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:48 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2691650gitlab # [ 192.562206] nixbot[2609]: {"ts": "2026-08-23T07:40:48.958Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1651gitlab # [ 192.584529] nixbot[2609]: {"ts": "2026-08-23T07:40:48.986Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1652gitlab # [ 192.722760] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1241653gitlab # [ 192.728713] nixbot[2609]: {"ts": "2026-08-23T07:40:49.130Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1654gitlab # [ 192.734949] nixbot[2609]: {"ts": "2026-08-23T07:40:49.137Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1655gitlab # [ 192.878310] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1331656gitlab # [ 192.882885] nixbot[2609]: {"ts": "2026-08-23T07:40:49.279Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1657gitlab # [ 193.064464] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1671658gitlab # [ 193.069988] nixbot[2609]: {"ts": "2026-08-23T07:40:49.468Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1659gitlab: (finished: waiting for unit nixbot.service, in 2.10 seconds)1660gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1661gitlab # [ 193.110479] nixbot[2609]: INFO: ::ffff:127.0.0.1:32826 - "GET /health HTTP/1.1" 200 OK1662gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1663subtest: project discovered and webhook registered1664gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1665gitlab # [ 193.142140] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 531666gitlab # [ 193.144356] nixbot[2609]: {"ts": "2026-08-23T07:40:49.545Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1667gitlab # [ 193.193056] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 461668gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1669(finished: subtest: project discovered and webhook registered, in 0.08 seconds)1670subtest: push delivers the webhook1671gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1672gitlab # [ 193.259091] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 1061673gitlab # [ 193.261083] nixbot[2609]: {"ts": "2026-08-23T07:40:49.663Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1674gitlab # [ 193.343683] gitaly[930]: time="2026-08-23T07:40:49.745Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19M9KA4ATWWKKGJNS2XQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-23T07:41:19.329" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:49.730" grpc.time_ms=14.772 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 193.375566] gitaly[930]: time="2026-08-23T07:40:49.777Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19M9KA4ATWWKKGJNS2XQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:41:19.376" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:40:49.776" grpc.time_ms=0.754 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 193.386239] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1531677gitlab # [ 193.394868] gitaly[930]: time="2026-08-23T07:40:49.797Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19M9KA4ATWWKKGJNS2XQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-23T07:40:59.010" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:40:49.790" grpc.time_ms=6.479 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 193.417719] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1471679gitlab # [ 193.419734] nixbot[2609]: {"ts": "2026-08-23T07:40:49.821Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1680gitlab # [ 193.489848] gitaly[930]: time="2026-08-23T07:40:49.892Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19QYP7V07ZM7VBGDEJ2Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:49.883" grpc.time_ms=9.004 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1681gitlab # [ 193.515708] nixbot[2609]: {"ts": "2026-08-23T07:40:49.912Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1682gitlab # [ 193.520696] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 891683gitlab # [ 193.525216] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 204 "" "git/2.55.0" 1261684gitlab # Enumerating objects: 5, done.1685gitlab # [ 193.527846] nixbot[2609]: {"ts": "2026-08-23T07:40:49.930Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1686gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1687gitlab # Delta compression using up to 4 threads1688gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1689gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1690gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1691gitlab # [ 193.621118] gitaly[930]: time="2026-08-23T07:40:50.023Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19XHPEPPHHC4599T9JXW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.014" grpc.time_ms=9.223 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1692gitlab # [ 193.623146] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551693gitlab # [ 193.742212] gitaly[930]: time="2026-08-23T07:40:50.144Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19ZBXR7PH5BM37TN1ZAN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.128" pid=930 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1694gitlab # [ 193.743345] gitaly[930]: time="2026-08-23T07:40:50.144Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19ZBXR7PH5BM37TN1ZAN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.128" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1695gitlab # [ 193.779905] gitaly[930]: time="2026-08-23T07:40:50.182Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19ZBXR7PH5BM37TN1ZAN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.128" grpc.time_ms=16.367 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1696gitlab # [ 193.792080] gitlab-workhorse[830]: time="2026-08-23T07:40:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131697gitlab # [ 193.792704] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1661698gitlab # [ 193.822281] gitaly[930]: time="2026-08-23T07:40:50.224Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T07:41:20.016" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T07:40:50.217" grpc.time_ms=7.381 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 193.841035] gitaly[930]: time="2026-08-23T07:40:50.243Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0PS19WMCSEJNFD05DFQBH09 duration_ms=154ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/allowed"1700gitlab # [ 193.877689] gitaly[930]: time="2026-08-23T07:40:50.280Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1A4REB1DPAVC9BQ3TXVD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.265" pid=930 remote_ip="2001:db8:1::1" request_sha=4d403897e810fa9105d73c34dc23378a934b2018 response_bytes=223 span.kind=server system=grpc1701gitlab # [ 193.878582] gitaly[930]: time="2026-08-23T07:40:50.280Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1A4REB1DPAVC9BQ3TXVD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.265" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1702gitlab # [ 193.879416] gitaly[930]: time="2026-08-23T07:40:50.280Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1A4REB1DPAVC9BQ3TXVD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.265" grpc.time_ms=15.334 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1703gitlab # [ 193.889973] gitaly[930]: time="2026-08-23T07:40:50.292Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0PS19WMCSEJNFD05DFQBH09 duration_ms=48ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/pre_receive"1704gitlab # [ 193.890690] gitaly[930]: time="2026-08-23T07:40:50.292Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:50.089" grpc.time_ms=203.615 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1705gitlab # [ 193.919031] gitlab-workhorse[830]: time="2026-08-23T07:40:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231706gitlab # [ 193.919713] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1211707gitlab # [ 193.946343] gitaly[930]: time="2026-08-23T07:40:50.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:50.348" grpc.time_ms=0.403 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1708gitlab # [ 193.982679] gitaly[930]: time="2026-08-23T07:40:50.385Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:50.384" grpc.time_ms=0.301 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1709gitlab # [ 194.012812] gitaly[930]: time="2026-08-23T07:40:50.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:50.414" grpc.time_ms=0.584 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1710gitlab # [ 194.026153] gitaly[930]: time="2026-08-23T07:40:50.428Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1A9VCKZ9ZYEEXQGKP4P1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.418" grpc.time_ms=10.043 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1711gitlab # [ 194.027788] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651712gitlab # [ 194.121316] gitaly[930]: time="2026-08-23T07:40:50.523Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AC8M3YST1E8QBY1BDT4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.513" pid=930 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1713gitlab # [ 194.134459] gitaly[930]: time="2026-08-23T07:40:50.523Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AC8M3YST1E8QBY1BDT4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.513" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1714gitlab # [ 194.145213] gitlab-workhorse[830]: time="2026-08-23T07:40:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671715gitlab # [ 194.146865] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 841716gitlab # [ 194.148572] gitaly[930]: time="2026-08-23T07:40:50.524Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AC8M3YST1E8QBY1BDT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.513" grpc.time_ms=11.095 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1717gitlab # [ 194.162528] gitaly[930]: time="2026-08-23T07:40:50.560Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0PS19WMCSEJNFD05DFQBH09 duration_ms=108ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/post_receive"1718gitlab # [ 194.165170] gitaly[930]: time="2026-08-23T07:40:50.561Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:50.450" grpc.time_ms=110.318 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 194.174529] gitaly[930]: time="2026-08-23T07:40:50.576Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 diskcache=02196548-2f7f-4777-af18-86cd32457235 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.004" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1720gitlab # To http://gitlab/root/test-flake.git1721gitlab # 918c9f1..742da14 master -> master1722gitlab # [ 194.184047] gitlab-workhorse[830]: time="2026-08-23T07:40:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521723gitlab # [ 194.185782] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6351724gitlab # [ 194.187494] gitaly[930]: time="2026-08-23T07:40:50.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=137 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13881 command.oublock=32 command.real_time_ms=558 command.spawn_token_fork_ms=2 command.system_time_ms=88 command.user_time_ms=49 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.004" grpc.time_ms=571.723 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 194.198349] gitaly[930]: time="2026-08-23T07:40:50.599Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AEYE2DD59V9YD7EPTJY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.584" pid=930 remote_ip="2001:db8:1::1" request_sha=df2c734abda64a473b9c2776dacf581cbad099d9 response_bytes=343 span.kind=server system=grpc1726gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.02 seconds)1727gitlab: must succeed: git -C /tmp/test-flake rev-parse master1728gitlab # [ 194.207230] gitaly[930]: time="2026-08-23T07:40:50.599Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AEYE2DD59V9YD7EPTJY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.584" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1729gitlab # [ 194.207865] gitlab-workhorse[830]: time="2026-08-23T07:40:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3431730gitlab # [ 194.208459] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 343 "" "git/2.55.0" 741731gitlab # [ 194.209082] gitaly[930]: time="2026-08-23T07:40:50.599Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AEYE2DD59V9YD7EPTJY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.584" grpc.time_ms=15.441 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1732gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1733gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1734gitlab # [ 194.298576] nixbot[2609]: INFO: ::ffff:127.0.0.1:32834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1735gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.06 seconds)1736gitlab # [ 194.318394] gitaly[930]: time="2026-08-23T07:40:50.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1AKDQZDXWGQSDF18NYNQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.713" grpc.time_ms=7.448 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 194.329380] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511738gitlab # [ 194.374269] gitaly[930]: time="2026-08-23T07:40:50.776Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AN37KQBTEEQKQ4N87DE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.763" pid=930 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1739gitlab # [ 194.375340] gitaly[930]: time="2026-08-23T07:40:50.776Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1179 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AN37KQBTEEQKQ4N87DE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.763" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1740gitlab # [ 194.376086] gitlab-workhorse[830]: time="2026-08-23T07:40:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091741gitlab # [ 194.377333] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 531742gitlab # [ 194.379655] gitaly[930]: time="2026-08-23T07:40:50.776Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1179 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1AN37KQBTEEQKQ4N87DE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:40:50.763" grpc.time_ms=12.566 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1743gitlab # [ 194.515200] gitaly[930]: time="2026-08-23T07:40:50.917Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:41:20.716" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:40:50.916" grpc.time_ms=0.673 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 194.557080] gitaly[930]: time="2026-08-23T07:40:50.959Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T07:41:20.749" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:50.949" grpc.time_ms=9.557 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 194.589906] gitaly[930]: time="2026-08-23T07:40:50.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:00.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:50.985" grpc.time_ms=6.448 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 194.622336] gitaly[930]: time="2026-08-23T07:40:51.024Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:01.018" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:51.018" grpc.time_ms=5.877 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 194.673098] gitaly[930]: time="2026-08-23T07:40:51.075Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:41:01.033" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:51.074" grpc.time_ms=0.659 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748gitlab # [ 194.687802] gitaly[930]: time="2026-08-23T07:40:51.090Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:41:01.040" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:51.081" grpc.time_ms=8.774 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749gitlab # [ 194.739088] gitaly[930]: time="2026-08-23T07:40:51.141Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:51.138" grpc.time_ms=1.803 pid=930 span.kind=server system=grpc1750gitlab # [ 194.770528] gitaly[930]: time="2026-08-23T07:40:51.173Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:40:51.172" grpc.time_ms=0.327 pid=930 span.kind=server system=grpc1751gitlab # [ 194.789089] gitaly[930]: time="2026-08-23T07:40:51.191Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y diskcache=9514ed46-dc0b-42f7-9485-f55ecc5b1bb7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:41:01.062" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:51.103" pid=930 ref=refs/keep-around/918c9f17c68ff4d81258525d87438834bd26ffb2 remote_ip="2001:db8:1::1" revision=918c9f17c68ff4d81258525d87438834bd26ffb2 span.kind=server system=grpc username=root1752gitlab # [ 194.798519] gitaly[930]: time="2026-08-23T07:40:51.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5396 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:41:01.062" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:40:51.103" grpc.time_ms=88.302 pid=930 ref=refs/keep-around/918c9f17c68ff4d81258525d87438834bd26ffb2 remote_ip="2001:db8:1::1" revision=918c9f17c68ff4d81258525d87438834bd26ffb2 span.kind=server system=grpc username=root1753gitlab # [ 194.815504] gitaly[930]: time="2026-08-23T07:40:51.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:41:21.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:40:51.217" grpc.time_ms=0.501 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 194.953849] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4931755gitlab # [ 194.960807] nixbot[2609]: {"ts": "2026-08-23T07:40:51.363Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}1756gitlab # [ 194.977386] nixbot[2609]: {"ts": "2026-08-23T07:40:51.379Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-918c9f17c68f-0"}1757gitlab # [ 195.050322] systemd[1]: Started Nix Daemon.1758gitlab # [ 195.113946] nix-daemon[2821]: accepted connection from pid 2815, user nixbot1759gitlab # [ 195.199394] nix-daemon[2821]: accepted connection from pid 2828, user nixbot1760gitlab # [ 195.219686] nixbot[2609]: {"ts": "2026-08-23T07:40:51.622Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-918c9f17c68f-0", "argv0": "bwrap"}1761gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1762gitlab # [ 195.345423] nixbot[2609]: INFO: ::ffff:127.0.0.1:32840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1763gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.05 seconds)1764gitlab # [ 195.366378] nix-daemon[2821]: accepted connection from pid 2838, user nixbot1765gitlab # [ 195.431968] nix-daemon[2821]: accepted connection from pid 2851, user nixbot1766gitlab # [ 195.446769] nix-daemon[2821]: accepted connection from pid 2838, user nixbot1767gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1768gitlab # [ 196.384828] nixbot[2609]: INFO: ::ffff:127.0.0.1:32852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1769gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1770gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1771gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.03 seconds)1772gitlab # [ 197.424793] nixbot[2609]: INFO: ::ffff:127.0.0.1:32868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1773gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1774gitlab # [ 198.459529] nixbot[2609]: INFO: ::ffff:127.0.0.1:32880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1775gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1776gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1777gitlab # [ 199.498499] nixbot[2609]: INFO: ::ffff:127.0.0.1:32896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1778gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1779gitlab # [ 200.137990] nix-daemon[2821]: accepted connection from pid 2879, user nixbot1780gitlab # [ 200.196348] gitaly[930]: time="2026-08-23T07:40:56.598Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1GAAFQKC5TAGFZ20YGAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:41:26.196" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:40:56.597" grpc.time_ms=0.928 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab # [ 200.386529] gitaly[930]: time="2026-08-23T07:40:56.789Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1GAAFQKC5TAGFZ20YGAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:06.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:56.782" grpc.time_ms=6.239 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 200.488095] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3661783gitlab # [ 200.489810] nixbot[2609]: {"ts": "2026-08-23T07:40:56.892Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}1784gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1785gitlab # [ 200.524318] nixbot[2609]: INFO: ::ffff:127.0.0.1:32898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1786gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.02 seconds)1787gitlab # [ 200.570940] gitaly[930]: time="2026-08-23T07:40:56.973Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1GP567CX0BMSTSPRMGFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:41:26.771" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:40:56.972" grpc.time_ms=0.867 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 200.603199] gitaly[930]: time="2026-08-23T07:40:57.005Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1GP567CX0BMSTSPRMGFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:06.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:40:56.999" grpc.time_ms=5.654 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 200.639756] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:40:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1401790gitlab # [ 200.640841] nixbot[2609]: {"ts": "2026-08-23T07:40:57.043Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1792gitlab # [ 201.561346] nixbot[2609]: INFO: ::ffff:127.0.0.1:32912 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1793gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1795gitlab # [ 202.587387] nixbot[2609]: INFO: ::ffff:127.0.0.1:32926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1796gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.02 seconds)1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1798gitlab # [ 203.624160] nixbot[2609]: INFO: ::ffff:127.0.0.1:54376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1799gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1800gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1801gitlab # [ 204.645641] nix-daemon[2821]: accepted connection from pid 2921, user nixbot1802gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.03 seconds)1803gitlab # [ 204.661750] nixbot[2609]: INFO: ::ffff:127.0.0.1:54378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1804gitlab # [ 204.735263] gitaly[930]: time="2026-08-23T07:41:01.137Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1MRQ73THWW51F93A2C9Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:41:31.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:01.135" grpc.time_ms=0.969 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 204.775174] gitaly[930]: time="2026-08-23T07:41:01.177Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1MRQ73THWW51F93A2C9Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:11.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:01.169" grpc.time_ms=7.921 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 204.842047] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1641807gitlab # [ 204.843640] nixbot[2609]: {"ts": "2026-08-23T07:41:01.245Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}1808gitlab # [ 204.943956] nix-daemon[2821]: accepted connection from pid 2938, user nixbot1809gitlab # [ 205.059775] gitaly[930]: time="2026-08-23T07:41:01.461Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1N2HNBEZSYG1310PKFS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:01.446" grpc.time_ms=15.611 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1810gitlab # [ 205.087422] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 691811gitlab # [ 205.175363] gitaly[930]: time="2026-08-23T07:41:01.577Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1N5GGEAR2E5RHQEPB9YN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:01.563" pid=930 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1812gitlab # [ 205.196127] gitaly[930]: time="2026-08-23T07:41:01.577Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1N5GGEAR2E5RHQEPB9YN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:01.563" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1813gitlab # [ 205.219511] gitlab-workhorse[830]: time="2026-08-23T07:41:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671814gitlab # [ 205.222681] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 901815gitlab # [ 205.225423] gitaly[930]: time="2026-08-23T07:41:01.578Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1N5GGEAR2E5RHQEPB9YN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:01.563" grpc.time_ms=14.519 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc1816gitlab # [ 205.285482] nix-daemon[2821]: accepted connection from pid 2963, user nixbot1817gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1818gitlab # [ 205.698151] nixbot[2609]: INFO: ::ffff:127.0.0.1:54384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1821gitlab # [ 206.738487] nixbot[2609]: INFO: ::ffff:127.0.0.1:54394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1824gitlab # [ 207.778423] nixbot[2609]: INFO: ::ffff:127.0.0.1:54408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1826gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1827gitlab # [ 208.816363] nixbot[2609]: INFO: ::ffff:127.0.0.1:54416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1830gitlab # [ 209.856827] nixbot[2609]: INFO: ::ffff:127.0.0.1:54430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1833gitlab # [ 210.896412] nixbot[2609]: INFO: ::ffff:127.0.0.1:54438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1836gitlab # [ 211.936312] nixbot[2609]: INFO: ::ffff:127.0.0.1:54450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1839gitlab # [ 212.976698] nixbot[2609]: INFO: ::ffff:127.0.0.1:41874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1840gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1842gitlab # [ 214.015638] nixbot[2609]: INFO: ::ffff:127.0.0.1:41888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1845gitlab # [ 215.052492] nixbot[2609]: INFO: ::ffff:127.0.0.1:41900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1846gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1848gitlab # [ 216.090766] nixbot[2609]: INFO: ::ffff:127.0.0.1:41916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1850gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1851gitlab # [ 217.130481] nixbot[2609]: INFO: ::ffff:127.0.0.1:41930 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1852gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1853gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1854gitlab # [ 218.161452] nixbot[2609]: INFO: ::ffff:127.0.0.1:41940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.03 seconds)1856gitlab # [ 218.225343] sidekiq-cluster[2545]: 2026-08-23T07:41:14.627Z pid=2545 tid=xuh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2545, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433647616}1857gitlab # [ 218.422879] sidekiq-cluster[2545]: W, [2026-08-23T07:41:14.825057 #2545] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1858gitlab # [ 218.464703] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:14.866Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1860gitlab # [ 219.199570] nixbot[2609]: INFO: ::ffff:127.0.0.1:41956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1863gitlab # [ 220.238499] nixbot[2609]: INFO: ::ffff:127.0.0.1:41964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1865gitlab # [ 220.703651] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:17.105Z","message":"GitLab reliable fetch activated!"}1866gitlab # [ 220.705247] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:17.105Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1868gitlab # [ 221.277780] nixbot[2609]: INFO: ::ffff:127.0.0.1:41966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1869gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1870gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1871gitlab # [ 222.315337] nixbot[2609]: INFO: ::ffff:127.0.0.1:41970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1873gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1874gitlab # [ 223.352140] nixbot[2609]: INFO: ::ffff:127.0.0.1:32854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1877gitlab # [ 224.387490] nixbot[2609]: INFO: ::ffff:127.0.0.1:32856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1880gitlab # [ 225.429660] nixbot[2609]: INFO: ::ffff:127.0.0.1:32858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1883gitlab # [ 226.469201] nixbot[2609]: INFO: ::ffff:127.0.0.1:32868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1885gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1886gitlab # [ 227.507401] nixbot[2609]: INFO: ::ffff:127.0.0.1:32872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1889gitlab # [ 228.546202] nixbot[2609]: INFO: ::ffff:127.0.0.1:32878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1892gitlab # [ 229.583954] nixbot[2609]: INFO: ::ffff:127.0.0.1:32884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1894gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1895gitlab # [ 230.622705] nixbot[2609]: INFO: ::ffff:127.0.0.1:32900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1898gitlab # [ 231.660908] nixbot[2609]: INFO: ::ffff:127.0.0.1:32914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1901gitlab # [ 232.700089] nixbot[2609]: INFO: ::ffff:127.0.0.1:32918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1904gitlab # [ 233.738129] nixbot[2609]: INFO: ::ffff:127.0.0.1:58980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1907gitlab # [ 234.776154] nixbot[2609]: INFO: ::ffff:127.0.0.1:58984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1910gitlab # [ 235.815534] nixbot[2609]: INFO: ::ffff:127.0.0.1:58990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1913gitlab # [ 236.853986] nixbot[2609]: INFO: ::ffff:127.0.0.1:58996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1916gitlab # [ 237.894781] nixbot[2609]: INFO: ::ffff:127.0.0.1:58998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1919gitlab # [ 238.933704] nixbot[2609]: INFO: ::ffff:127.0.0.1:59014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1922gitlab # [ 239.973117] nixbot[2609]: INFO: ::ffff:127.0.0.1:59020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1925gitlab # [ 241.004696] nixbot[2609]: INFO: ::ffff:127.0.0.1:59022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.03 seconds)1927gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1928gitlab # [ 242.041696] nixbot[2609]: INFO: ::ffff:127.0.0.1:59038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1929gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1931gitlab # [ 243.083624] nixbot[2609]: INFO: ::ffff:127.0.0.1:55068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1933gitlab # [ 243.809718] postgres[3098]: [3098] ERROR: relation "table_without_models" does not exist1934gitlab # [ 243.812732] postgres[3098]: [3098] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1936gitlab # [ 244.125349] nixbot[2609]: INFO: ::ffff:127.0.0.1:55070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1937gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1939gitlab # [ 245.163954] nixbot[2609]: INFO: ::ffff:127.0.0.1:55072 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1942gitlab # [ 246.203585] nixbot[2609]: INFO: ::ffff:127.0.0.1:55080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1944gitlab # [ 246.535356] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:42.937Z","message":"Booted Rails 7.2.3.1 application in production environment"}1945gitlab # [ 246.540740] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:42.943Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1946gitlab # [ 246.542174] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:42.944Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1947gitlab # [ 246.543190] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:42.944Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1948gitlab # [ 246.544396] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:42.946Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1950gitlab # [ 247.246510] nixbot[2609]: INFO: ::ffff:127.0.0.1:55094 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1952gitlab # [ 247.941111] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.342Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8356798c840741ff02a5cd53","created_at":"2026-08-23T07:40:44.232Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.276Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8356798c840741ff02a5cd53: start","job_status":"start","queue_duration_s":60.065798,"scheduling_latency_s":60.065888}1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1954gitlab # [ 248.204154] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.605Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8356798c840741ff02a5cd53","created_at":"2026-08-23T07:40:44.232Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.276Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8356798c840741ff02a5cd53: done: 0.264209 sec","job_status":"done","queue_duration_s":60.065798,"scheduling_latency_s":60.065888,"redis_calls":23,"redis_duration_s":0.00925,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005211,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002182,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.117772231,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.264209,"completed_at":"2026-08-23T07:41:44.605Z","load_balancing_strategy":"primary","db_duration_s":0.071774,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1955gitlab # [ 248.206871] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.608Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"58a8dac94a1954ec4d6c591f","created_at":"2026-08-23T07:40:44.291Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.298Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-58a8dac94a1954ec4d6c591f: start","job_status":"start","queue_duration_s":60.309206,"scheduling_latency_s":60.30924}1956gitlab # [ 248.315111] nixbot[2609]: INFO: ::ffff:127.0.0.1:55102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.07 seconds)1958gitlab # [ 248.318841] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.720Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"58a8dac94a1954ec4d6c591f","created_at":"2026-08-23T07:40:44.291Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.298Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-58a8dac94a1954ec4d6c591f: done: 0.112513 sec","job_status":"done","queue_duration_s":60.309206,"scheduling_latency_s":60.30924,"redis_calls":14,"redis_duration_s":0.005978,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002134,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002884,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08060661400000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.112513,"completed_at":"2026-08-23T07:41:44.720Z","load_balancing_strategy":"primary","db_duration_s":0.025454,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1959gitlab # [ 248.320677] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.722Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9ceb7653acc096405cf018f2","created_at":"2026-08-23T07:40:44.931Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.936Z","job_size_bytes":5,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9ceb7653acc096405cf018f2: start","job_status":"start","queue_duration_s":59.786467,"scheduling_latency_s":59.786497}1960gitlab # [ 248.470293] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.872Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9ceb7653acc096405cf018f2","created_at":"2026-08-23T07:40:44.931Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.936Z","job_size_bytes":5,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9ceb7653acc096405cf018f2: done: 0.149194 sec","job_status":"done","queue_duration_s":59.786467,"scheduling_latency_s":59.786497,"redis_calls":12,"redis_duration_s":0.003108,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002166,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042268,"duration_s":0.149194,"completed_at":"2026-08-23T07:41:44.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016897,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1961gitlab # [ 248.542789] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:44.944Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"8eddf610299498e668c82bbc","created_at":"2026-08-23T07:40:44.958Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.961Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-8eddf610299498e668c82bbc: start","job_status":"start","queue_duration_s":59.98273,"scheduling_latency_s":59.982775}1962gitlab # [ 248.778505] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:45.180Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"8eddf610299498e668c82bbc","created_at":"2026-08-23T07:40:44.958Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.961Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-8eddf610299498e668c82bbc: done: 0.235939 sec","job_status":"done","queue_duration_s":59.98273,"scheduling_latency_s":59.982775,"redis_calls":11,"redis_duration_s":0.004176,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001027,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.171,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.171,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.13965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328254,"duration_s":0.235939,"completed_at":"2026-08-23T07:41:45.180Z","load_balancing_strategy":"primary","db_duration_s":0.081161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1963gitlab # [ 248.781692] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:45.181Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"aeaabc58f9b9766e7e2e6b48","created_at":"2026-08-23T07:40:44.963Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.967Z","job_size_bytes":89,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-aeaabc58f9b9766e7e2e6b48: start","job_status":"start","queue_duration_s":60.214891,"scheduling_latency_s":60.21491}1964gitlab # [ 248.890887] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:45.292Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"aeaabc58f9b9766e7e2e6b48","created_at":"2026-08-23T07:40:44.963Z","trace_propagation_headers":{"sentry-trace":"79c73cf0c1aa476f87621a91428ece3b-ec742c9becb34152","baggage":"sentry-trace_id=79c73cf0c1aa476f87621a91428ece3b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS13BVBAXP5BERXPM5GBSY","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:44.967Z","job_size_bytes":89,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-aeaabc58f9b9766e7e2e6b48: done: 0.11071 sec","job_status":"done","queue_duration_s":60.214891,"scheduling_latency_s":60.21491,"redis_calls":11,"redis_duration_s":0.0036239999999999996,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001016,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.071,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000557334,"duration_s":0.11071,"completed_at":"2026-08-23T07:41:45.292Z","load_balancing_strategy":"primary","db_duration_s":0.072038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1965gitlab # [ 248.894379] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:45.296Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 918c9f17c68ff4d81258525d87438834bd26ffb2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1466ebb430954b60178d06a1","created_at":"2026-08-23T07:40:46.734Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-71931c344c5141b0","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:46.738Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1466ebb430954b60178d06a1: start","job_status":"start","queue_duration_s":58.557318,"scheduling_latency_s":58.557374}1966gitlab # [ 248.919256] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:45.321Z","message":"changes: \"0000000000000000000000000000000000000000 918c9f17c68ff4d81258525d87438834bd26ffb2 refs/heads/master\\n\""}1967gitlab # [ 248.959880] gitaly[930]: time="2026-08-23T07:41:45.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:55.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:45.351" grpc.time_ms=10.213 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 248.975126] gitaly[930]: time="2026-08-23T07:41:45.377Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:41:55.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:45.366" grpc.time_ms=10.938 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 249.057281] gitaly[930]: time="2026-08-23T07:41:45.459Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T07:41:55.102" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:45.443" grpc.time_ms=16.219 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 249.144374] gitaly[930]: time="2026-08-23T07:41:45.546Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:45.545" grpc.time_ms=0.653 pid=930 span.kind=server system=grpc1971gitlab # [ 249.206387] gitaly[930]: time="2026-08-23T07:41:45.608Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:45.607" grpc.time_ms=0.736 pid=930 span.kind=server system=grpc1972gitlab # [ 249.235087] gitaly[930]: time="2026-08-23T07:41:45.637Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J diskcache=d2bb9c97-9faa-49b4-9120-f03d45a8f547 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:41:55.157" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:45.498" pid=930 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1973gitlab # [ 249.236537] gitaly[930]: time="2026-08-23T07:41:45.637Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=114 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5106 command.oublock=8 command.real_time_ms=131 command.spawn_token_fork_ms=0 command.system_time_ms=72 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:41:55.157" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:45.498" grpc.time_ms=139.305 pid=930 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1974gitlab # [ 249.289251] gitaly[930]: time="2026-08-23T07:41:45.691Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:41:55.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:45.691" grpc.time_ms=0.346 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1976gitlab # [ 249.321972] gitaly[930]: time="2026-08-23T07:41:45.724Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=933 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T07:41:55.027" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:45.708" grpc.time_ms=15.673 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab # [ 249.357589] nixbot[2609]: INFO: ::ffff:127.0.0.1:55106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1979gitlab # [ 249.416159] gitaly[930]: time="2026-08-23T07:41:45.818Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-23T07:42:15.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:45.810" grpc.time_ms=8.184 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 249.472758] gitaly[930]: time="2026-08-23T07:41:45.875Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:41:55.193" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:45.874" grpc.time_ms=0.496 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 249.506716] gitaly[930]: time="2026-08-23T07:41:45.909Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T07:41:55.220" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T07:41:45.900" grpc.time_ms=8.008 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 249.562474] gitaly[930]: time="2026-08-23T07:41:45.964Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:55.271" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:45.951" grpc.time_ms=12.993 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 249.607239] gitaly[930]: time="2026-08-23T07:41:46.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:55.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:45.997" grpc.time_ms=11.478 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 249.644092] gitaly[930]: time="2026-08-23T07:41:46.046Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:42:16.026" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:46.026" grpc.time_ms=19.671 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 250.040983] gitaly[930]: time="2026-08-23T07:41:46.442Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T07:41:56.099" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:46.440" grpc.time_ms=2.05 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 250.100247] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:46.501Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 918c9f17c68ff4d81258525d87438834bd26ffb2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1466ebb430954b60178d06a1","created_at":"2026-08-23T07:40:46.734Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-71931c344c5141b0","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:46.738Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1466ebb430954b60178d06a1: done: 1.205673 sec","job_status":"done","queue_duration_s":58.557318,"scheduling_latency_s":58.557374,"gitaly_calls":13,"gitaly_duration_s":0.449607,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.10307,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.004668,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.027405,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002184,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007335,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.023345,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.038133,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.184,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.207,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.579537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000587225,"exclusive_lock_hold_duration_s":0.027864435,"duration_s":1.205673,"completed_at":"2026-08-23T07:41:46.501Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.106704,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1987gitlab # [ 250.175148] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:46.576Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","918c9f17c68ff4d81258525d87438834bd26ffb2 742da146b5ddeef593f619931c24837c865fb273 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"63c2ad64db8d78cad606aef6","created_at":"2026-08-23T07:40:50.494Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-b3f565c420d84600","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:50.497Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-63c2ad64db8d78cad606aef6: start","job_status":"start","queue_duration_s":56.079776,"scheduling_latency_s":56.079841}1988gitlab # [ 250.197145] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:46.599Z","message":"changes: \"918c9f17c68ff4d81258525d87438834bd26ffb2 742da146b5ddeef593f619931c24837c865fb273 refs/heads/master\\n\""}1989gitlab # [ 250.235746] gitaly[930]: time="2026-08-23T07:41:46.638Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:56.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:46.627" grpc.time_ms=10.821 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 250.252292] gitaly[930]: time="2026-08-23T07:41:46.654Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:41:56.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:46.643" grpc.time_ms=10.514 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 250.259295] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:46.661Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"46df108f0dd4d99681daef58","created_at":"2026-08-23T07:41:46.658Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"79abd6ed3ed1fd9777924128","job_size_bytes":46,"pid":2545,"job_status":"deduplicated","message":"ProjectCacheWorker JID-46df108f0dd4d99681daef58: deduplicated: until executing","deduplication.type":"until executing"}1992gitlab # [ 250.287177] gitaly[930]: time="2026-08-23T07:41:46.689Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T07:41:56.038" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:46.678" grpc.time_ms=11.025 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 250.315263] gitaly[930]: time="2026-08-23T07:41:46.717Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-23T07:42:16.706" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:46.706" grpc.time_ms=11.149 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 250.331733] gitaly[930]: time="2026-08-23T07:41:46.734Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T07:41:56.088" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T07:41:46.728" grpc.time_ms=5.739 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'1996gitlab # [ 250.354136] gitaly[930]: time="2026-08-23T07:41:46.756Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:56.107" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:46.748" grpc.time_ms=8.213 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 250.394965] nixbot[2609]: INFO: ::ffff:127.0.0.1:55108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)1999gitlab # [ 250.448131] gitaly[930]: time="2026-08-23T07:41:46.850Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T07:41:56.208" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:46.848" grpc.time_ms=1.333 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 250.480829] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:46.882Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","918c9f17c68ff4d81258525d87438834bd26ffb2 742da146b5ddeef593f619931c24837c865fb273 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"63c2ad64db8d78cad606aef6","created_at":"2026-08-23T07:40:50.494Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-b3f565c420d84600","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:40:50.497Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-63c2ad64db8d78cad606aef6: done: 0.305873 sec","job_status":"done","queue_duration_s":56.079776,"scheduling_latency_s":56.079841,"gitaly_calls":7,"gitaly_duration_s":0.091372,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.027875999999999998,"redis_read_bytes":500,"redis_write_bytes":11939,"redis_cache_calls":9,"redis_cache_duration_s":0.003067,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001068,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5716,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003547,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010306,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009888,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.028,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.028,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.162836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001038958,"exclusive_lock_hold_duration_s":0.025012676,"duration_s":0.305873,"completed_at":"2026-08-23T07:41:46.882Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029634,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2001gitlab # [ 250.526522] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:46.885Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"76c4fc0c5992ef5aefd5fabf","created_at":"2026-08-23T07:40:51.221Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.228Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-76c4fc0c5992ef5aefd5fabf: start","job_status":"start","queue_duration_s":55.657012,"scheduling_latency_s":55.657062}2002gitlab # [ 250.663774] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.065Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"76c4fc0c5992ef5aefd5fabf","created_at":"2026-08-23T07:40:51.221Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.228Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-76c4fc0c5992ef5aefd5fabf: done: 0.180348 sec","job_status":"done","queue_duration_s":55.657012,"scheduling_latency_s":55.657062,"redis_calls":16,"redis_duration_s":0.004907,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002594,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000332165,"duration_s":0.180348,"completed_at":"2026-08-23T07:41:47.065Z","load_balancing_strategy":"primary","db_duration_s":0.024613,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2003gitlab # [ 250.666692] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.067Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ed5073bd507351edb2b54e0e","created_at":"2026-08-23T07:40:51.229Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.232Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ed5073bd507351edb2b54e0e: start","job_status":"start","queue_duration_s":55.834751,"scheduling_latency_s":55.834768}2004gitlab # [ 250.752652] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.154Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ed5073bd507351edb2b54e0e","created_at":"2026-08-23T07:40:51.229Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.232Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ed5073bd507351edb2b54e0e: done: 0.087387 sec","job_status":"done","queue_duration_s":55.834751,"scheduling_latency_s":55.834768,"redis_calls":21,"redis_duration_s":0.0052840000000000005,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002295,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000350603,"duration_s":0.087387,"completed_at":"2026-08-23T07:41:47.154Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 250.754889] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.156Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3197fcd052a7ee5a4965672f","created_at":"2026-08-23T07:40:51.335Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.341Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3197fcd052a7ee5a4965672f: start","job_status":"start","queue_duration_s":55.815276,"scheduling_latency_s":55.815294}2006gitlab # [ 250.997841] gitaly[930]: time="2026-08-23T07:41:47.400Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:47.399" grpc.time_ms=0.727 pid=930 span.kind=server system=grpc2007gitlab # [ 251.065326] gitaly[930]: time="2026-08-23T07:41:47.466Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:47.465" grpc.time_ms=0.707 pid=930 span.kind=server system=grpc2008gitlab # [ 251.120288] gitaly[930]: time="2026-08-23T07:41:47.522Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:47.521" grpc.time_ms=0.601 pid=930 span.kind=server system=grpc2009gitlab # [ 251.146213] gitaly[930]: time="2026-08-23T07:41:47.548Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y diskcache=ff711e1e-101d-4969-8da0-00f99c81ed7b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:17.350" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:47.351" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 251.147180] gitaly[930]: time="2026-08-23T07:41:47.549Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=199 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7445 command.oublock=0 command.real_time_ms=187 command.spawn_token_fork_ms=1 command.system_time_ms=119 command.user_time_ms=80 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:17.350" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:47.351" grpc.time_ms=197.326 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 251.273958] gitaly[930]: time="2026-08-23T07:41:47.676Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:42:17.673" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:47.674" grpc.time_ms=1.716 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 251.306800] gitaly[930]: time="2026-08-23T07:41:47.709Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS1ASEVJJ8K5TEMVG2K32Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:17.707" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:47.708" grpc.time_ms=1.018 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 251.317298] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.718Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3197fcd052a7ee5a4965672f","created_at":"2026-08-23T07:40:51.335Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.341Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3197fcd052a7ee5a4965672f: rescheduled"}2014gitlab # [ 251.324162] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.726Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3197fcd052a7ee5a4965672f","created_at":"2026-08-23T07:40:51.335Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-b8576b3175674dd9","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:40:51.341Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3197fcd052a7ee5a4965672f: done: 0.570089 sec","job_status":"done","queue_duration_s":55.815276,"scheduling_latency_s":55.815294,"gitaly_calls":3,"gitaly_duration_s":0.208773,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.031756,"redis_read_bytes":462,"redis_write_bytes":29296,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00189,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001357,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011394,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004673,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006672,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000752,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000859,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002269,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.027,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.031,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.071,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.223981,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.477287197,"duration_s":0.570089,"completed_at":"2026-08-23T07:41:47.726Z","load_balancing_strategy":"primary","db_duration_s":0.117586,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'2016gitlab # [ 251.359285] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.727Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"79abd6ed3ed1fd9777924128","created_at":"2026-08-23T07:41:45.393Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:45.415Z","job_size_bytes":46,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-79abd6ed3ed1fd9777924128: start","job_status":"start","queue_duration_s":2.312317,"scheduling_latency_s":2.312334}2017gitlab # [ 251.411636] gitaly[930]: time="2026-08-23T07:41:47.814Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-23T13:41:47.810" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:47.811" grpc.time_ms=2.463 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 251.439745] nixbot[2609]: INFO: ::ffff:127.0.0.1:55116 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.04 seconds)2020gitlab # [ 251.442941] gitaly[930]: time="2026-08-23T07:41:47.845Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T07:42:17.034" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:47.835" grpc.time_ms=9.9 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 251.478705] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.880Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"79abd6ed3ed1fd9777924128","created_at":"2026-08-23T07:41:45.393Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:45.415Z","job_size_bytes":46,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-79abd6ed3ed1fd9777924128: done: 0.153073 sec","job_status":"done","queue_duration_s":2.312317,"scheduling_latency_s":2.312334,"gitaly_calls":2,"gitaly_duration_s":0.087077,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006084,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001025,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000529,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002583,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025087,"duration_s":0.153073,"completed_at":"2026-08-23T07:41:47.880Z","load_balancing_strategy":"primary","db_duration_s":0.012134,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2022gitlab # [ 251.482686] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.882Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"47e95769b53ecddbc67f46f5","created_at":"2026-08-23T07:41:45.433Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:45.438Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-47e95769b53ecddbc67f46f5: start","job_status":"start","queue_duration_s":2.444438,"scheduling_latency_s":2.444457}2023gitlab # [ 251.528244] gitaly[930]: time="2026-08-23T07:41:47.930Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J diskcache=6b7fbdb8-6e96-4995-a9fe-cca0055e1f65 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:41:47.901" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:47.902" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 251.529206] gitaly[930]: time="2026-08-23T07:41:47.931Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:41:47.901" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:47.902" grpc.time_ms=28.633 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 251.593810] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.995Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"47e95769b53ecddbc67f46f5","created_at":"2026-08-23T07:41:45.433Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:45.438Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-47e95769b53ecddbc67f46f5: done: 0.113282 sec","job_status":"done","queue_duration_s":2.444438,"scheduling_latency_s":2.444457,"gitaly_calls":1,"gitaly_duration_s":0.059954,"redis_calls":15,"redis_duration_s":0.004086,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000619,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.093118539,"duration_s":0.113282,"completed_at":"2026-08-23T07:41:47.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2026gitlab # [ 251.596486] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:47.997Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0cc6ccf5d047c0384b0e7fb2","created_at":"2026-08-23T07:41:45.681Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:45.686Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0cc6ccf5d047c0384b0e7fb2: start","job_status":"start","queue_duration_s":2.311031,"scheduling_latency_s":2.311049}2027gitlab # [ 251.630816] gitaly[930]: time="2026-08-23T07:41:48.033Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T07:42:18.019" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:48.020" grpc.time_ms=13.084 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 251.645715] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:48.047Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0cc6ccf5d047c0384b0e7fb2","created_at":"2026-08-23T07:41:45.681Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:45.686Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0cc6ccf5d047c0384b0e7fb2: done: 0.050223 sec","job_status":"done","queue_duration_s":2.311031,"scheduling_latency_s":2.311049,"gitaly_calls":1,"gitaly_duration_s":0.015895,"redis_calls":16,"redis_duration_s":0.004654,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000415,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001969,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050223,"completed_at":"2026-08-23T07:41:48.047Z","load_balancing_strategy":"primary","db_duration_s":0.002859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2029gitlab # [ 251.661954] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:48.049Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e086b35bcf9285cc8c0c130b","created_at":"2026-08-23T07:41:46.281Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:47e4e479ae00bc6bc169616188b15f57f53092207c5f40975a9e3355137d9d5f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.291Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e086b35bcf9285cc8c0c130b: start","job_status":"start","queue_duration_s":1.758764,"scheduling_latency_s":1.758804}2030gitlab # [ 251.711831] gitaly[930]: time="2026-08-23T07:41:48.081Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:18.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:48.080" grpc.time_ms=0.794 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 251.712861] gitaly[930]: time="2026-08-23T07:41:48.090Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:41:58.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:48.083" grpc.time_ms=6.405 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 251.774567] gitaly[930]: time="2026-08-23T07:41:48.176Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:42:18.174" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:48.175" grpc.time_ms=1.343 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 251.782222] gitaly[930]: time="2026-08-23T07:41:48.184Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=87 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T07:42:18.181" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:48.181" grpc.time_ms=2.973 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 251.895913] gitaly[930]: time="2026-08-23T07:41:48.298Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:58.205" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:48.285" grpc.time_ms=12.43 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'2036gitlab # [ 252.426193] gitaly[930]: time="2026-08-23T07:41:48.827Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:42:18.805" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:48.806" grpc.time_ms=21.191 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 252.444309] gitaly[930]: time="2026-08-23T07:41:48.846Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PS164225V8XZAMM137BC0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T07:42:18.830" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:48.831" grpc.time_ms=15.392 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 252.472492] sidekiq-cluster[2545]: {"severity":"WARN","time":"2026-08-23T07:41:48.874Z","class":"CreatePipelineWorker","correlation_id":"01M0PS164225V8XZAMM137BC0J","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"918c9f17c68ff4d81258525d87438834bd26ffb2","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"918c9f17c68ff4d81258525d87438834bd26ffb2","ref":"refs/heads/master"},"retry":0}2039gitlab # [ 252.479985] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:48.882Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e086b35bcf9285cc8c0c130b","created_at":"2026-08-23T07:41:46.281Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:47e4e479ae00bc6bc169616188b15f57f53092207c5f40975a9e3355137d9d5f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.291Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e086b35bcf9285cc8c0c130b: done: 0.83233 sec","job_status":"done","queue_duration_s":1.758764,"scheduling_latency_s":1.758804,"gitaly_calls":7,"gitaly_duration_s":0.081704,"redis_calls":51,"redis_duration_s":0.01297,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001051,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004438,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003154,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00313,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.68509,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000377423,"duration_s":0.83233,"completed_at":"2026-08-23T07:41:48.882Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048282,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2040gitlab # [ 252.494863] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:48.886Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9c48203f-98b5-4906-a14f-26bff6d33cf4\"}"],"class":"WebHookWorker","jid":"9ce0eddc6423e541f958c8b7","created_at":"2026-08-23T07:41:46.411Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:44be8bfddff901fc95955b79d290b92b9b98abf8d1e8cf0288cf82f1426a7609","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.418Z","job_size_bytes":1751,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9ce0eddc6423e541f958c8b7: start","job_status":"start","queue_duration_s":2.468711,"scheduling_latency_s":2.468733}2041gitlab # [ 252.562150] nixbot[2609]: INFO: ::ffff:127.0.0.1:55120 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.12 seconds)2043gitlab # [ 252.636203] nixbot[2609]: INFO: ::ffff:127.0.0.1:55134 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2044gitlab # [ 252.653616] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.055Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9c48203f-98b5-4906-a14f-26bff6d33cf4\"}"],"class":"WebHookWorker","jid":"9ce0eddc6423e541f958c8b7","created_at":"2026-08-23T07:41:46.411Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5e7034ec96724e4f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:44be8bfddff901fc95955b79d290b92b9b98abf8d1e8cf0288cf82f1426a7609","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.418Z","job_size_bytes":1751,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9ce0eddc6423e541f958c8b7: done: 0.168915 sec","job_status":"done","queue_duration_s":2.468711,"scheduling_latency_s":2.468733,"redis_calls":19,"redis_duration_s":0.003944,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001078,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00043,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001697,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04094570699999167,"cpu_s":0.076271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341663,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.168915,"completed_at":"2026-08-23T07:41:49.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045gitlab # [ 252.663329] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.057Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"6afa5c8657637a0d29a0e04f","created_at":"2026-08-23T07:41:46.669Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"47e95769b53ecddbc67f46f5","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.672Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-6afa5c8657637a0d29a0e04f: start","job_status":"start","queue_duration_s":2.384573,"scheduling_latency_s":2.38459}2046gitlab # [ 252.719660] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.095Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"6afa5c8657637a0d29a0e04f","created_at":"2026-08-23T07:41:46.669Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"47e95769b53ecddbc67f46f5","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.672Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-6afa5c8657637a0d29a0e04f: done: 0.038173 sec","job_status":"done","queue_duration_s":2.384573,"scheduling_latency_s":2.38459,"gitaly_calls":1,"gitaly_duration_s":0.014212,"redis_calls":12,"redis_duration_s":0.001778,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000392,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.024120105,"duration_s":0.038173,"completed_at":"2026-08-23T07:41:49.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 252.730086] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.096Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5af799220b6e49e83c47e19d","created_at":"2026-08-23T07:41:46.827Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5ef33f43e17622f66a39cf9a13bb81907a587c1965b2aa63d743e57c72d0b0b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.828Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5af799220b6e49e83c47e19d: start","job_status":"start","queue_duration_s":2.267769,"scheduling_latency_s":2.267785}2048gitlab # [ 252.744317] gitaly[930]: time="2026-08-23T07:41:49.083Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 diskcache=b96581c7-a765-492c-8bb5-6f35f24f2dea grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:41:49.071" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.071" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 252.785990] gitaly[930]: time="2026-08-23T07:41:49.083Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:41:49.071" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.071" grpc.time_ms=12.071 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050gitlab # [ 252.786707] gitaly[930]: time="2026-08-23T07:41:49.153Z" level=info msg="finished unary call with code OK" catfile.duration_ms=41 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=41 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:19.112" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.112" grpc.time_ms=41.372 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 252.787433] gitaly[930]: time="2026-08-23T07:41:49.163Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:41:59.076" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:49.156" grpc.time_ms=7.171 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 252.789359] gitaly[930]: time="2026-08-23T07:41:49.191Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:42:19.190" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.190" grpc.time_ms=1.032 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 252.829542] gitaly[930]: time="2026-08-23T07:41:49.202Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=308 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T07:42:19.198" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.199" grpc.time_ms=3.369 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 252.838416] gitaly[930]: time="2026-08-23T07:41:49.240Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:41:59.153" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:49.233" grpc.time_ms=7.088 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 253.075114] gitaly[930]: time="2026-08-23T07:41:49.477Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS33TNZDVGZ41YY8PBZASJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:49.465" grpc.time_ms=11.496 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2056gitlab # [ 253.077730] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2082057gitlab # [ 253.167659] gitaly[930]: time="2026-08-23T07:41:49.570Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:42:19.554" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.554" grpc.time_ms=15.538 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 253.197339] gitaly[930]: time="2026-08-23T07:41:49.584Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS19WMCSEJNFD05DFQBH09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T07:42:19.572" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.572" grpc.time_ms=11.145 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 253.213988] sidekiq-cluster[2545]: {"severity":"WARN","time":"2026-08-23T07:41:49.595Z","class":"CreatePipelineWorker","correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"918c9f17c68ff4d81258525d87438834bd26ffb2","after":"742da146b5ddeef593f619931c24837c865fb273","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"742da146b5ddeef593f619931c24837c865fb273","ref":"refs/heads/master"},"retry":0}2060gitlab # [ 253.214588] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5af799220b6e49e83c47e19d","created_at":"2026-08-23T07:41:46.827Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5ef33f43e17622f66a39cf9a13bb81907a587c1965b2aa63d743e57c72d0b0b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.828Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5af799220b6e49e83c47e19d: done: 0.503681 sec","job_status":"done","queue_duration_s":2.267769,"scheduling_latency_s":2.267785,"gitaly_calls":7,"gitaly_duration_s":0.104313,"redis_calls":33,"redis_duration_s":0.005053,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000509,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002913,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.38386,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.503681,"completed_at":"2026-08-23T07:41:49.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014435,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2061gitlab # [ 253.222618] gitlab-workhorse[830]: time="2026-08-23T07:41:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672062gitlab # [ 253.223984] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 832063gitlab # [ 253.225704] gitaly[930]: time="2026-08-23T07:41:49.593Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34262H072AV39Q434Z8K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:49.586" pid=930 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2064gitlab # [ 253.266472] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.602Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f42cc7f0-370d-43bd-8acc-048b11434786\"}"],"class":"WebHookWorker","jid":"b83cdb34644b1f419ad19778","created_at":"2026-08-23T07:41:46.838Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:eee98aa852aa88eb1cc837cd48eb9bfd65c936863290772598e79f3605836226","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.840Z","job_size_bytes":1749,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b83cdb34644b1f419ad19778: start","job_status":"start","queue_duration_s":2.762547,"scheduling_latency_s":2.762571}2065gitlab # [ 253.267108] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.643Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f42cc7f0-370d-43bd-8acc-048b11434786\"}"],"class":"WebHookWorker","jid":"b83cdb34644b1f419ad19778","created_at":"2026-08-23T07:41:46.838Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-3ce258c7ad0540ff","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:eee98aa852aa88eb1cc837cd48eb9bfd65c936863290772598e79f3605836226","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:46.840Z","job_size_bytes":1749,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b83cdb34644b1f419ad19778: done: 0.041067 sec","job_status":"done","queue_duration_s":2.762547,"scheduling_latency_s":2.762571,"redis_calls":14,"redis_duration_s":0.0018,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000246,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007319365999990168,"cpu_s":0.018556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.041067,"completed_at":"2026-08-23T07:41:49.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2066gitlab # [ 253.304427] nixbot[2609]: INFO: ::ffff:127.0.0.1:48508 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2067gitlab # [ 253.305210] gitaly[930]: time="2026-08-23T07:41:49.593Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34262H072AV39Q434Z8K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:49.586" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2068gitlab # [ 253.305964] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b79a23b58086afab6d07e719","created_at":"2026-08-23T07:41:47.333Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.338Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b79a23b58086afab6d07e719: start","job_status":"start","queue_duration_s":2.30615,"scheduling_latency_s":2.306172}2069gitlab # [ 253.313722] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.707Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b79a23b58086afab6d07e719","created_at":"2026-08-23T07:41:47.333Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.338Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b79a23b58086afab6d07e719: done: 0.062715 sec","job_status":"done","queue_duration_s":2.30615,"scheduling_latency_s":2.306172,"redis_calls":10,"redis_duration_s":0.00336,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000358,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283555,"duration_s":0.062715,"completed_at":"2026-08-23T07:41:49.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010884,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2070gitlab # [ 253.351838] gitaly[930]: time="2026-08-23T07:41:49.593Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34262H072AV39Q434Z8K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:49.586" grpc.time_ms=6.524 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2071gitlab # [ 253.364040] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.713Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"216a4acd5c2824adbe683797","created_at":"2026-08-23T07:41:47.555Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.561Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-216a4acd5c2824adbe683797: start","job_status":"start","queue_duration_s":2.151255,"scheduling_latency_s":2.151273}2072gitlab # [ 253.404618] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.750Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"216a4acd5c2824adbe683797","created_at":"2026-08-23T07:41:47.555Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.561Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-216a4acd5c2824adbe683797: done: 0.037851 sec","job_status":"done","queue_duration_s":2.151255,"scheduling_latency_s":2.151273,"redis_calls":10,"redis_duration_s":0.0074470000000000005,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001019683,"duration_s":0.037851,"completed_at":"2026-08-23T07:41:49.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008984,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 253.414529] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"68a4ba4491cad074356b425e","created_at":"2026-08-23T07:41:47.574Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.586Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-68a4ba4491cad074356b425e: start","job_status":"start","queue_duration_s":2.167067,"scheduling_latency_s":2.167083}2074gitlab # [ 253.427695] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"68a4ba4491cad074356b425e","created_at":"2026-08-23T07:41:47.574Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.586Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-68a4ba4491cad074356b425e: done: 0.026722 sec","job_status":"done","queue_duration_s":2.167067,"scheduling_latency_s":2.167083,"redis_calls":10,"redis_duration_s":0.003656,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000823,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002546,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218184,"duration_s":0.026722,"completed_at":"2026-08-23T07:41:49.780Z","load_balancing_strategy":"primary","db_duration_s":0.003702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 253.464930] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.781Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9b748dd4a442b52a9507241e","created_at":"2026-08-23T07:41:47.607Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.614Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9b748dd4a442b52a9507241e: start","job_status":"start","queue_duration_s":2.167398,"scheduling_latency_s":2.167412}2076gitlab # [ 253.477968] nixbot[2609]: {"ts": "2026-08-23T07:41:49.829Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2077gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'2078gitlab # [ 253.580539] gitaly[930]: time="2026-08-23T07:41:49.981Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:19.580" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:49.981" grpc.time_ms=0.611 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.03 seconds)2080gitlab # [ 253.588055] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.989Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9b748dd4a442b52a9507241e","created_at":"2026-08-23T07:41:47.607Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.614Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9b748dd4a442b52a9507241e: done: 0.207927 sec","job_status":"done","queue_duration_s":2.167398,"scheduling_latency_s":2.167412,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000399,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217626,"duration_s":0.207927,"completed_at":"2026-08-23T07:41:49.989Z","load_balancing_strategy":"primary","db_duration_s":0.00657,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 253.591674] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:49.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"489dc7ff08b77e226ee556be","created_at":"2026-08-23T07:41:47.615Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.620Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-489dc7ff08b77e226ee556be: start","job_status":"start","queue_duration_s":2.372248,"scheduling_latency_s":2.372278}2082gitlab # [ 253.606539] nixbot[2609]: INFO: ::ffff:127.0.0.1:48512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK2083gitlab # [ 253.608634] gitaly[930]: time="2026-08-23T07:41:50.011Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9HD65XVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.001" grpc.time_ms=9.747 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2084gitlab # [ 253.618802] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 902085gitlab # [ 253.629221] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.031Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"489dc7ff08b77e226ee556be","created_at":"2026-08-23T07:41:47.615Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.620Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-489dc7ff08b77e226ee556be: done: 0.038117 sec","job_status":"done","queue_duration_s":2.372248,"scheduling_latency_s":2.372278,"redis_calls":10,"redis_duration_s":0.006083,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257295,"duration_s":0.038117,"completed_at":"2026-08-23T07:41:50.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 253.658506] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.037Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"91b1e98ecd59e20decf4087a","created_at":"2026-08-23T07:41:47.621Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.627Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-91b1e98ecd59e20decf4087a: start","job_status":"start","queue_duration_s":2.409097,"scheduling_latency_s":2.409113}2087gitlab # [ 253.672193] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"91b1e98ecd59e20decf4087a","created_at":"2026-08-23T07:41:47.621Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.627Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-91b1e98ecd59e20decf4087a: done: 0.030475 sec","job_status":"done","queue_duration_s":2.409097,"scheduling_latency_s":2.409113,"redis_calls":11,"redis_duration_s":0.00937,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001771,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003029,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000297523,"duration_s":0.030475,"completed_at":"2026-08-23T07:41:50.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 253.709251] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.069Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2ac59b2933210c93fb61ed5d","created_at":"2026-08-23T07:41:47.631Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.635Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2ac59b2933210c93fb61ed5d: start","job_status":"start","queue_duration_s":2.433762,"scheduling_latency_s":2.433778}2089gitlab # [ 253.723777] gitlab-workhorse[830]: time="2026-08-23T07:41:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672090gitlab # [ 253.725425] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 612091gitlab # [ 253.726780] gitaly[930]: time="2026-08-23T07:41:50.073Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34HXA9JZ31GH1QJYRNE8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.058" pid=930 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2092gitlab # [ 253.770369] gitaly[930]: time="2026-08-23T07:41:50.073Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34HXA9JZ31GH1QJYRNE8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.058" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2093gitlab # [ 253.771127] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.164Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2ac59b2933210c93fb61ed5d","created_at":"2026-08-23T07:41:47.631Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.635Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2ac59b2933210c93fb61ed5d: done: 0.09495 sec","job_status":"done","queue_duration_s":2.433762,"scheduling_latency_s":2.433778,"redis_calls":10,"redis_duration_s":0.008987,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000492,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000305626,"duration_s":0.09495,"completed_at":"2026-08-23T07:41:50.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 253.784039] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"049e384145617ee406a128ae","created_at":"2026-08-23T07:41:47.636Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.640Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-049e384145617ee406a128ae: start","job_status":"start","queue_duration_s":2.525719,"scheduling_latency_s":2.525736}2095gitlab # [ 253.797763] gitaly[930]: time="2026-08-23T07:41:50.074Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34HXA9JZ31GH1QJYRNE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.058" grpc.time_ms=15.952 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2096gitlab # [ 253.809718] gitaly[930]: time="2026-08-23T07:41:50.206Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34PBQ8TX0TQR6YCNWTDA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.193" grpc.time_ms=13.106 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2097gitlab # [ 253.846364] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 512098gitlab # [ 253.847149] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"049e384145617ee406a128ae","created_at":"2026-08-23T07:41:47.636Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.640Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-049e384145617ee406a128ae: done: 0.035443 sec","job_status":"done","queue_duration_s":2.525719,"scheduling_latency_s":2.525736,"redis_calls":10,"redis_duration_s":0.007784,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006555,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005216026,"duration_s":0.035443,"completed_at":"2026-08-23T07:41:50.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2099gitlab # [ 253.858791] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.202Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a45b149af02d24658a8817c5","created_at":"2026-08-23T07:41:47.644Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.647Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a45b149af02d24658a8817c5: start","job_status":"start","queue_duration_s":2.554932,"scheduling_latency_s":2.554973}2100gitlab # [ 253.908296] gitaly[930]: time="2026-08-23T07:41:50.262Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34R16XZS1ATAY8MTZT70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.243" pid=930 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2101gitlab # [ 253.909123] gitlab-workhorse[830]: time="2026-08-23T07:41:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212102gitlab # [ 253.909647] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 532103gitlab # [ 253.910141] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.232Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a45b149af02d24658a8817c5","created_at":"2026-08-23T07:41:47.644Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.647Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a45b149af02d24658a8817c5: done: 0.02976 sec","job_status":"done","queue_duration_s":2.554932,"scheduling_latency_s":2.554973,"redis_calls":10,"redis_duration_s":0.004392,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327974,"duration_s":0.02976,"completed_at":"2026-08-23T07:41:50.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2104gitlab # [ 253.921249] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.235Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9205897fd2fc297246b85c4f","created_at":"2026-08-23T07:41:47.648Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.651Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9205897fd2fc297246b85c4f: start","job_status":"start","queue_duration_s":2.583763,"scheduling_latency_s":2.583779}2105gitlab # [ 253.935298] gitaly[930]: time="2026-08-23T07:41:50.262Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34R16XZS1ATAY8MTZT70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.243" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2106gitlab # [ 253.945985] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.253Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9205897fd2fc297246b85c4f","created_at":"2026-08-23T07:41:47.648Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.651Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9205897fd2fc297246b85c4f: done: 0.01806 sec","job_status":"done","queue_duration_s":2.583763,"scheduling_latency_s":2.583779,"redis_calls":10,"redis_duration_s":0.002619,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000698,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000241372,"duration_s":0.01806,"completed_at":"2026-08-23T07:41:50.253Z","load_balancing_strategy":"primary","db_duration_s":0.001494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab # [ 253.997250] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7fb37fc851030cf19d801b96","created_at":"2026-08-23T07:41:47.651Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.654Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7fb37fc851030cf19d801b96: start","job_status":"start","queue_duration_s":2.599731,"scheduling_latency_s":2.599744}2108gitlab # [ 253.997909] gitaly[930]: time="2026-08-23T07:41:50.263Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34R16XZS1ATAY8MTZT70 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:41:50.243" grpc.time_ms=19.674 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc2109gitlab # [ 254.005623] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7fb37fc851030cf19d801b96","created_at":"2026-08-23T07:41:47.651Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.654Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7fb37fc851030cf19d801b96: done: 0.025522 sec","job_status":"done","queue_duration_s":2.599731,"scheduling_latency_s":2.599744,"redis_calls":10,"redis_duration_s":0.001913,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000251988,"duration_s":0.025522,"completed_at":"2026-08-23T07:41:50.279Z","load_balancing_strategy":"primary","db_duration_s":0.004575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 254.070938] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.281Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7311e2b07951414f12295f3a","created_at":"2026-08-23T07:41:47.659Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.662Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7311e2b07951414f12295f3a: start","job_status":"start","queue_duration_s":2.618714,"scheduling_latency_s":2.61873}2111gitlab # [ 254.071666] gitaly[930]: time="2026-08-23T07:41:50.365Z" level=info msg="finished unary call with code OK" catfile.duration_ms=11 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=11 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:20.153" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:50.353" grpc.time_ms=11.64 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 254.072263] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.338Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7311e2b07951414f12295f3a","created_at":"2026-08-23T07:41:47.659Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.662Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7311e2b07951414f12295f3a: done: 0.057394 sec","job_status":"done","queue_duration_s":2.618714,"scheduling_latency_s":2.61873,"redis_calls":14,"redis_duration_s":0.003356,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001241,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527162,"duration_s":0.057394,"completed_at":"2026-08-23T07:41:50.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 254.101026] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"082f678ec2be0e15742dcd51","created_at":"2026-08-23T07:41:47.719Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.720Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-082f678ec2be0e15742dcd51: start","job_status":"start","queue_duration_s":2.620059,"scheduling_latency_s":2.620075}2114gitlab # [ 254.147686] gitaly[930]: time="2026-08-23T07:41:50.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T07:42:20.172" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:50.372" grpc.time_ms=7.706 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 254.148505] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.372Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"082f678ec2be0e15742dcd51","created_at":"2026-08-23T07:41:47.719Z","trace_propagation_headers":{"sentry-trace":"0c80b86a334e4b85bcb59e23c659ab71-3c4bc04234654599","baggage":"sentry-trace_id=0c80b86a334e4b85bcb59e23c659ab71,sentry-release=Unknown"},"correlation_id":"01M0PS1ASEVJJ8K5TEMVG2K32Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.720Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-082f678ec2be0e15742dcd51: done: 0.031877 sec","job_status":"done","queue_duration_s":2.620059,"scheduling_latency_s":2.620075,"redis_calls":8,"redis_duration_s":0.003975,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003696,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031877,"completed_at":"2026-08-23T07:41:50.372Z","load_balancing_strategy":"primary","db_duration_s":0.011923,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2116gitlab # [ 254.160856] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.374Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3d52c414cd7e50ed97e69df4","created_at":"2026-08-23T07:41:47.867Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-c454e0e618b34520","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.872Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3d52c414cd7e50ed97e69df4: start","job_status":"start","queue_duration_s":2.502482,"scheduling_latency_s":2.502499}2117gitlab # [ 254.173331] gitaly[930]: time="2026-08-23T07:41:50.391Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:00.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:50.385" grpc.time_ms=6.016 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 254.184460] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3d52c414cd7e50ed97e69df4","created_at":"2026-08-23T07:41:47.867Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-c454e0e618b34520","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:47.872Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3d52c414cd7e50ed97e69df4: done: 0.077327 sec","job_status":"done","queue_duration_s":2.502482,"scheduling_latency_s":2.502499,"redis_calls":19,"redis_duration_s":0.006526,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003545,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000394,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.043067483999999996,"duration_s":0.077327,"completed_at":"2026-08-23T07:41:50.453Z","load_balancing_strategy":"primary","db_duration_s":0.036873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab # [ 254.221743] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.455Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9ce0eddc6423e541f958c8b7"],"class":"WebHooks::LogExecutionWorker","jid":"d34dbc2bc14b4e488b213651","created_at":"2026-08-23T07:41:49.042Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-e09330353cce4e1d","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7adbd1ea7d012dec66b80e91474800cc6eb9ac77590d1004f33879e86492bb6c","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:49.048Z","job_size_bytes":2593,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d34dbc2bc14b4e488b213651: start","job_status":"start","queue_duration_s":1.406261,"scheduling_latency_s":1.406276}2120gitlab # [ 254.236414] gitaly[930]: time="2026-08-23T07:41:50.454Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:42:00.083" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:50.453" grpc.time_ms=0.276 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 254.244275] nixbot[2609]: {"ts": "2026-08-23T07:41:50.627Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 \"HTTP/1.1 201 Created\""}2122gitlab # [ 254.246613] nixbot[2609]: {"ts": "2026-08-23T07:41:50.632Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-742da146b5dd-3"}2123gitlab # [ 254.248765] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.496Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9ce0eddc6423e541f958c8b7"],"class":"WebHooks::LogExecutionWorker","jid":"d34dbc2bc14b4e488b213651","created_at":"2026-08-23T07:41:49.042Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-e09330353cce4e1d","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7adbd1ea7d012dec66b80e91474800cc6eb9ac77590d1004f33879e86492bb6c","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:49.048Z","job_size_bytes":2593,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d34dbc2bc14b4e488b213651: done: 0.040872 sec","job_status":"done","queue_duration_s":1.406261,"scheduling_latency_s":1.406276,"redis_calls":10,"redis_duration_s":0.002754,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234946,"duration_s":0.040872,"completed_at":"2026-08-23T07:41:50.495Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 254.296869] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.497Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b83cdb34644b1f419ad19778"],"class":"WebHooks::LogExecutionWorker","jid":"25ed0bb9e8612dba0445ce7b","created_at":"2026-08-23T07:41:49.637Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-c6fd03c8207d4aab","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:016227bf2a19793e4669ae1d2fcfd34575779a5c39f1170b249647e658358a99","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:49.639Z","job_size_bytes":2592,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-25ed0bb9e8612dba0445ce7b: start","job_status":"start","queue_duration_s":0.857805,"scheduling_latency_s":0.857819}2125gitlab # [ 254.298912] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3232126gitlab # [ 254.304570] gitaly[930]: time="2026-08-23T07:41:50.465Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:42:00.088" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:50.458" grpc.time_ms=6.326 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 254.311303] gitaly[930]: time="2026-08-23T07:41:50.511Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:50.510" grpc.time_ms=0.564 pid=930 span.kind=server system=grpc2128gitlab # [ 254.322423] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.517Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b83cdb34644b1f419ad19778"],"class":"WebHooks::LogExecutionWorker","jid":"25ed0bb9e8612dba0445ce7b","created_at":"2026-08-23T07:41:49.637Z","trace_propagation_headers":{"sentry-trace":"9727442d60f7484fba0895863fad8801-c6fd03c8207d4aab","baggage":"sentry-trace_id=9727442d60f7484fba0895863fad8801,sentry-release=Unknown"},"correlation_id":"01M0PS19WMCSEJNFD05DFQBH09","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:016227bf2a19793e4669ae1d2fcfd34575779a5c39f1170b249647e658358a99","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:49.639Z","job_size_bytes":2592,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-25ed0bb9e8612dba0445ce7b: done: 0.019907 sec","job_status":"done","queue_duration_s":0.857805,"scheduling_latency_s":0.857819,"redis_calls":7,"redis_duration_s":0.001848,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001554,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019907,"completed_at":"2026-08-23T07:41:50.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2129gitlab # [ 254.363709] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.518Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d9af8773937b39eb87f86370","created_at":"2026-08-23T07:41:50.403Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5cc92bbaa95d478f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.444Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d9af8773937b39eb87f86370: start","job_status":"start","queue_duration_s":0.073817,"scheduling_latency_s":0.073831}2130gitlab # [ 254.403953] nix-daemon[2821]: accepted connection from pid 3352, user nixbot2131gitlab # [ 254.404531] nix-daemon[2821]: accepted connection from pid 3361, user nixbot2132gitlab # [ 254.404947] gitaly[930]: time="2026-08-23T07:41:50.536Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:50.536" grpc.time_ms=0.296 pid=930 span.kind=server system=grpc2133gitlab # [ 254.405276] gitaly[930]: time="2026-08-23T07:41:50.547Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT diskcache=912e2813-cc36-46aa-92d0-07c1284094dd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:42:00.096" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:50.467" pid=930 ref=refs/keep-around/742da146b5ddeef593f619931c24837c865fb273 remote_ip="2001:db8:1::1" revision=742da146b5ddeef593f619931c24837c865fb273 span.kind=server system=grpc username=root2134gitlab # [ 254.405898] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d9af8773937b39eb87f86370","created_at":"2026-08-23T07:41:50.403Z","trace_propagation_headers":{"sentry-trace":"800de4c3eae54ec1ba7ef395e2d5423e-5cc92bbaa95d478f","baggage":"sentry-trace_id=800de4c3eae54ec1ba7ef395e2d5423e,sentry-release=Unknown"},"correlation_id":"01M0PS164225V8XZAMM137BC0J","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.444Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d9af8773937b39eb87f86370: done: 0.082199 sec","job_status":"done","queue_duration_s":0.073817,"scheduling_latency_s":0.073831,"redis_calls":11,"redis_duration_s":0.002624,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279086,"duration_s":0.082199,"completed_at":"2026-08-23T07:41:50.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 254.449038] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.602Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b65e34bf24b67c01313a2f4c","created_at":"2026-08-23T07:41:50.552Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-638a25cab61c4a0a","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.555Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b65e34bf24b67c01313a2f4c: start","job_status":"start","queue_duration_s":0.047152,"scheduling_latency_s":0.047171}2136gitlab # [ 254.449800] nixbot[2609]: {"ts": "2026-08-23T07:41:50.770Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-742da146b5dd-3", "argv0": "bwrap"}2137gitlab # [ 254.450241] gitaly[930]: time="2026-08-23T07:41:50.548Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=51 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5144 command.oublock=8 command.real_time_ms=71 command.spawn_token_fork_ms=0 command.system_time_ms=35 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:42:00.096" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:41:50.467" grpc.time_ms=80.585 pid=930 ref=refs/keep-around/742da146b5ddeef593f619931c24837c865fb273 remote_ip="2001:db8:1::1" revision=742da146b5ddeef593f619931c24837c865fb273 span.kind=server system=grpc username=root2138gitlab # [ 254.450824] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.626Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b65e34bf24b67c01313a2f4c","created_at":"2026-08-23T07:41:50.552Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-638a25cab61c4a0a","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.555Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b65e34bf24b67c01313a2f4c: done: 0.02419 sec","job_status":"done","queue_duration_s":0.047152,"scheduling_latency_s":0.047171,"redis_calls":7,"redis_duration_s":0.00199,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02419,"completed_at":"2026-08-23T07:41:50.626Z","load_balancing_strategy":"primary","db_duration_s":0.003612,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2139gitlab # [ 254.512731] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.627Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"db8689318c048fd83ae75f92","created_at":"2026-08-23T07:41:50.556Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-638a25cab61c4a0a","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.557Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-db8689318c048fd83ae75f92: start","job_status":"start","queue_duration_s":0.070464,"scheduling_latency_s":0.070482}2140gitlab # [ 254.513529] gitaly[930]: time="2026-08-23T07:41:50.551Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:20.350" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:50.551" grpc.time_ms=0.377 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 254.514088] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.672Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"db8689318c048fd83ae75f92","created_at":"2026-08-23T07:41:50.556Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-638a25cab61c4a0a","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.557Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-db8689318c048fd83ae75f92: done: 0.044341 sec","job_status":"done","queue_duration_s":0.070464,"scheduling_latency_s":0.070482,"redis_calls":10,"redis_duration_s":0.0016840000000000002,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044341,"completed_at":"2026-08-23T07:41:50.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2142gitlab # [ 254.546976] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.673Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a92cc977c00921af7b401a29","created_at":"2026-08-23T07:41:50.611Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-638a25cab61c4a0a","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.613Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a92cc977c00921af7b401a29: start","job_status":"start","queue_duration_s":0.059389,"scheduling_latency_s":0.059409}2143gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273'2144gitlab # [ 254.588136] gitaly[930]: time="2026-08-23T07:41:50.735Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:42:20.733" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:50.734" grpc.time_ms=0.869 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 254.589063] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.772Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a92cc977c00921af7b401a29","created_at":"2026-08-23T07:41:50.611Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-638a25cab61c4a0a","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.613Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a92cc977c00921af7b401a29: done: 0.099503 sec","job_status":"done","queue_duration_s":0.059389,"scheduling_latency_s":0.059409,"gitaly_calls":2,"gitaly_duration_s":0.006842,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006857,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000722,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000864,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000242,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002175,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000159,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001033,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065724,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.075652911,"duration_s":0.099503,"completed_at":"2026-08-23T07:41:50.772Z","load_balancing_strategy":"primary","db_duration_s":0.020044,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2146gitlab # [ 254.612125] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"347406453fbdc9c7f7c0d846","created_at":"2026-08-23T07:41:50.720Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-d26701a2d2074d27","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.722Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-347406453fbdc9c7f7c0d846: start","job_status":"start","queue_duration_s":0.051749,"scheduling_latency_s":0.051766}2147gitlab # [ 254.624881] gitaly[930]: time="2026-08-23T07:41:50.762Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34TYSTW6C811T2686ADT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:20.760" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:50.760" grpc.time_ms=1.104 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 254.661348] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:50.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"347406453fbdc9c7f7c0d846","created_at":"2026-08-23T07:41:50.720Z","trace_propagation_headers":{"sentry-trace":"a42239c33d1547b791fa0c3fefabe780-d26701a2d2074d27","baggage":"sentry-trace_id=a42239c33d1547b791fa0c3fefabe780,sentry-release=Unknown"},"correlation_id":"01M0PS34TYSTW6C811T2686ADT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:50.722Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-347406453fbdc9c7f7c0d846: done: 0.024429 sec","job_status":"done","queue_duration_s":0.051749,"scheduling_latency_s":0.051766,"redis_calls":7,"redis_duration_s":0.001029,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024429,"completed_at":"2026-08-23T07:41:50.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2149gitlab # [ 254.722529] nixbot[2609]: INFO: ::ffff:127.0.0.1:48520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 200 OK2150gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=742da146b5ddeef593f619931c24837c865fb273', in 0.13 seconds)2151(finished: subtest: push delivers the webhook, in 61.53 seconds)2152subtest: eval and build post commit statuses2153gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/742da146b5ddeef593f619931c24837c865fb273/statuses2154gitlab # [ 254.770922] nix-daemon[2821]: accepted connection from pid 3374, user nixbot2155gitlab # [ 254.788859] gitaly[930]: time="2026-08-23T07:41:51.191Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:01.023" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.183" grpc.time_ms=7.336 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 254.793587] gitaly[930]: time="2026-08-23T07:41:51.196Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS35NJCMQ4Y8CXC2GNS2SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.194" grpc.time_ms=0.491 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 254.813338] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/742da146b5ddeef593f619931c24837c865fb273/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 602158gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/742da146b5ddeef593f619931c24837c865fb273/statuses, in 0.09 seconds)2159gitlab # [ 254.827305] nix-daemon[2821]: accepted connection from pid 3390, user nixbot2160gitlab # [ 254.837362] nix-daemon[2821]: accepted connection from pid 3374, user nixbot2161gitlab # [ 254.859584] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.261Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d1138d532429dcc68e8dff7d","created_at":"2026-08-23T07:41:51.253Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-a452faee94ab486d","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.259Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d1138d532429dcc68e8dff7d: start","job_status":"start","queue_duration_s":0.001936,"scheduling_latency_s":0.00198}2162gitlab # [ 254.870609] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 13522163gitlab # [ 254.877382] nixbot[2609]: {"ts": "2026-08-23T07:41:51.279Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}2164gitlab # [ 254.925115] gitaly[930]: time="2026-08-23T07:41:51.327Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS35SJF1JGVSDQFN7XY615 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.125" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.325" grpc.time_ms=1.431 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 254.932685] gitaly[930]: time="2026-08-23T07:41:51.335Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS35SJF1JGVSDQFN6450QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.234" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.334" grpc.time_ms=0.561 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 254.975155] gitaly[930]: time="2026-08-23T07:41:51.377Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:51.376" grpc.time_ms=0.59 pid=930 span.kind=server system=grpc2167gitlab # [ 254.978106] gitaly[930]: time="2026-08-23T07:41:51.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS35SJF1JGVSDQFN6450QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:01.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.371" grpc.time_ms=9.117 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 254.988288] gitaly[930]: time="2026-08-23T07:41:51.390Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PS35SJF1JGVSDQFN7XY615 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:01.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.384" grpc.time_ms=5.918 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 255.029113] gitaly[930]: time="2026-08-23T07:41:51.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:51.430" grpc.time_ms=0.276 pid=930 span.kind=server system=grpc2170gitlab # [ 255.035041] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1542171gitlab # [ 255.036275] nixbot[2609]: {"ts": "2026-08-23T07:41:51.438Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}2172gitlab # [ 255.050088] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1692173gitlab # [ 255.050860] nixbot[2609]: {"ts": "2026-08-23T07:41:51.453Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 \"HTTP/1.1 201 Created\""}2174gitlab # [ 255.067397] gitaly[930]: time="2026-08-23T07:41:51.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:51.469" grpc.time_ms=0.642 pid=930 span.kind=server system=grpc2175gitlab # [ 255.084333] gitaly[930]: time="2026-08-23T07:41:51.486Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N diskcache=d1d55439-dd15-46d4-a992-b44880259e67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:21.332" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.333" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 255.092977] gitaly[930]: time="2026-08-23T07:41:51.487Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7060 command.oublock=0 command.real_time_ms=127 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:21.332" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.333" grpc.time_ms=153.869 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 255.104636] gitaly[930]: time="2026-08-23T07:41:51.506Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS35YKYXA7K3Y2AB9NKWFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.299" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.499" grpc.time_ms=6.619 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 255.128083] gitaly[930]: time="2026-08-23T07:41:51.530Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:42:21.529" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.529" grpc.time_ms=1.006 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 255.138959] gitaly[930]: time="2026-08-23T07:41:51.533Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS35Z0ENRW3QV0EFX34E2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.532" grpc.time_ms=0.79 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 255.150498] gitaly[930]: time="2026-08-23T07:41:51.542Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS35YKYXA7K3Y2AB9NKWFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:01.160" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.532" grpc.time_ms=9.75 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 255.159961] gitaly[930]: time="2026-08-23T07:41:51.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.561" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.561" grpc.time_ms=0.499 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 255.173376] gitaly[930]: time="2026-08-23T07:41:51.575Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS35Z0ENRW3QV0EFX34E2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:01.219" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.570" grpc.time_ms=5.685 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 255.204109] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.606Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c08b8f6d8dae3d634b4584e7","created_at":"2026-08-23T07:41:51.603Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"d1138d532429dcc68e8dff7d","job_size_bytes":3,"pid":2545,"job_status":"deduplicated","message":"PipelineProcessWorker JID-c08b8f6d8dae3d634b4584e7: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2184gitlab # [ 255.211132] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1692185gitlab # [ 255.214069] nixbot[2609]: {"ts": "2026-08-23T07:41:51.615Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/918c9f17c68ff4d81258525d87438834bd26ffb2 \"HTTP/1.1 201 Created\""}2186gitlab # [ 255.225081] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.626Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d1138d532429dcc68e8dff7d","created_at":"2026-08-23T07:41:51.253Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-a452faee94ab486d","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.259Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d1138d532429dcc68e8dff7d: rescheduled"}2187gitlab # [ 255.232589] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d1138d532429dcc68e8dff7d","created_at":"2026-08-23T07:41:51.253Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-a452faee94ab486d","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.259Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d1138d532429dcc68e8dff7d: done: 0.373212 sec","job_status":"done","queue_duration_s":0.001936,"scheduling_latency_s":0.00198,"gitaly_calls":3,"gitaly_duration_s":0.164585,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013352,"redis_read_bytes":227,"redis_write_bytes":18468,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000524,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000907,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003041,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004729,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000194,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000878,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002555,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.143384,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.277601483,"duration_s":0.373212,"completed_at":"2026-08-23T07:41:51.634Z","load_balancing_strategy":"primary","db_duration_s":0.043935,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2188gitlab # [ 255.243263] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7e7e4721f8b9ff0eeb1f03b6","created_at":"2026-08-23T07:41:51.323Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.326Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7e7e4721f8b9ff0eeb1f03b6: start","job_status":"start","queue_duration_s":0.309514,"scheduling_latency_s":0.309544}2189gitlab # [ 255.256762] nixbot[2609]: {"ts": "2026-08-23T07:41:51.640Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 \"HTTP/1.1 201 Created\""}2190gitlab # [ 255.259055] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1832191gitlab # [ 255.267989] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.670Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7e7e4721f8b9ff0eeb1f03b6","created_at":"2026-08-23T07:41:51.323Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.326Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7e7e4721f8b9ff0eeb1f03b6: done: 0.034335 sec","job_status":"done","queue_duration_s":0.309514,"scheduling_latency_s":0.309544,"redis_calls":7,"redis_duration_s":0.001072,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034335,"completed_at":"2026-08-23T07:41:51.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007498,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2192gitlab # [ 255.296752] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"57595ccfb26afd4caf901004","created_at":"2026-08-23T07:41:51.426Z","trace_propagation_headers":{"sentry-trace":"1be843b5f19a421ea9f248ffa4729405-02a8d6b97582489a","baggage":"sentry-trace_id=1be843b5f19a421ea9f248ffa4729405,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS35SJF1JGVSDQFN6450QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.432Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-57595ccfb26afd4caf901004: start","job_status":"start","queue_duration_s":0.239104,"scheduling_latency_s":0.239125}2193gitlab # [ 255.342476] gitaly[930]: time="2026-08-23T07:41:51.745Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS35SJF1JGVSDQFN6450QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:42:21.743" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.744" grpc.time_ms=0.932 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 255.367960] gitaly[930]: time="2026-08-23T07:41:51.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS35SJF1JGVSDQFN6450QX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.768" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.769" grpc.time_ms=0.639 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 255.374434] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.776Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"57595ccfb26afd4caf901004","created_at":"2026-08-23T07:41:51.426Z","trace_propagation_headers":{"sentry-trace":"1be843b5f19a421ea9f248ffa4729405-02a8d6b97582489a","baggage":"sentry-trace_id=1be843b5f19a421ea9f248ffa4729405,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS35SJF1JGVSDQFN6450QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.432Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-57595ccfb26afd4caf901004: rescheduled"}2196gitlab # [ 255.381284] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.782Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"57595ccfb26afd4caf901004","created_at":"2026-08-23T07:41:51.426Z","trace_propagation_headers":{"sentry-trace":"1be843b5f19a421ea9f248ffa4729405-02a8d6b97582489a","baggage":"sentry-trace_id=1be843b5f19a421ea9f248ffa4729405,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PS35SJF1JGVSDQFN6450QX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.432Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-57595ccfb26afd4caf901004: done: 0.11101 sec","job_status":"done","queue_duration_s":0.239104,"scheduling_latency_s":0.239125,"gitaly_calls":2,"gitaly_duration_s":0.006175,"redis_calls":40,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005978,"redis_read_bytes":90,"redis_write_bytes":7681,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000838,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000727,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":6,"redis_queues_duration_s":0.000701,"redis_queues_read_bytes":9,"redis_queues_write_bytes":3277,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1187,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000213,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000325,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078492,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.083265331,"duration_s":0.11101,"completed_at":"2026-08-23T07:41:51.782Z","load_balancing_strategy":"primary","db_duration_s":0.024038,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2197gitlab # [ 255.400803] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.783Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"814d4b00668aba2efd5d4d44","created_at":"2026-08-23T07:41:51.493Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.495Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-814d4b00668aba2efd5d4d44: start","job_status":"start","queue_duration_s":0.288269,"scheduling_latency_s":0.288288}2198gitlab # [ 255.409643] gitaly[930]: time="2026-08-23T07:41:51.789Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS368472Y80CKERQBN4QMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:42:21.388" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:41:51.788" grpc.time_ms=0.644 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2199gitlab # [ 255.420228] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.808Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"814d4b00668aba2efd5d4d44","created_at":"2026-08-23T07:41:51.493Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.495Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-814d4b00668aba2efd5d4d44: done: 0.024662 sec","job_status":"done","queue_duration_s":0.288269,"scheduling_latency_s":0.288288,"redis_calls":7,"redis_duration_s":0.0028629999999999997,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000783,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024662,"completed_at":"2026-08-23T07:41:51.808Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2200gitlab # [ 255.478643] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.810Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8071e1355afe6f62f200c650","created_at":"2026-08-23T07:41:51.500Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.503Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8071e1355afe6f62f200c650: start","job_status":"start","queue_duration_s":0.30701,"scheduling_latency_s":0.307027}2201gitlab # [ 255.479486] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.846Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8071e1355afe6f62f200c650","created_at":"2026-08-23T07:41:51.500Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.503Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8071e1355afe6f62f200c650: done: 0.035599 sec","job_status":"done","queue_duration_s":0.30701,"scheduling_latency_s":0.307027,"redis_calls":7,"redis_duration_s":0.004743,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001457,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035599,"completed_at":"2026-08-23T07:41:51.846Z","load_balancing_strategy":"primary","db_duration_s":0.005287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 255.522625] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2d9631fd594bd5bdf790f29a","created_at":"2026-08-23T07:41:51.510Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.511Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2d9631fd594bd5bdf790f29a: start","job_status":"start","queue_duration_s":0.336658,"scheduling_latency_s":0.336696}2203gitlab # [ 255.523458] gitaly[930]: time="2026-08-23T07:41:51.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PS368472Y80CKERQBN4QMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:42:01.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:51.823" grpc.time_ms=6.946 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 255.525997] gitlab-workhorse[830]: gitlab 2001:db8:1::1 - - [2026/08/23:07:41:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1262205gitlab # [ 255.527574] nixbot[2609]: {"ts": "2026-08-23T07:41:51.873Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/742da146b5ddeef593f619931c24837c865fb273 \"HTTP/1.1 201 Created\""}2206gitlab # [ 255.562787] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.879Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2d9631fd594bd5bdf790f29a","created_at":"2026-08-23T07:41:51.510Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.511Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2d9631fd594bd5bdf790f29a: done: 0.030884 sec","job_status":"done","queue_duration_s":0.336658,"scheduling_latency_s":0.336696,"redis_calls":10,"redis_duration_s":0.004174,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000464,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030884,"completed_at":"2026-08-23T07:41:51.879Z","load_balancing_strategy":"primary","db_duration_s":0.004288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 255.564609] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f2429e0c6fc0b695bb9f8940","created_at":"2026-08-23T07:41:51.511Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.513Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f2429e0c6fc0b695bb9f8940: start","job_status":"start","queue_duration_s":0.368075,"scheduling_latency_s":0.3681}2208gitlab # [ 255.602119] nix-daemon[2821]: accepted connection from pid 3447, user nixbot2209gitlab # [ 255.603065] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f2429e0c6fc0b695bb9f8940","created_at":"2026-08-23T07:41:51.511Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.513Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f2429e0c6fc0b695bb9f8940: done: 0.027994 sec","job_status":"done","queue_duration_s":0.368075,"scheduling_latency_s":0.3681,"redis_calls":7,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027994,"completed_at":"2026-08-23T07:41:51.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 255.612984] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f8fc3be1324cdaf3be5d37d4","created_at":"2026-08-23T07:41:51.513Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.515Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f8fc3be1324cdaf3be5d37d4: start","job_status":"start","queue_duration_s":0.395203,"scheduling_latency_s":0.395224}2211gitlab # [ 255.626492] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.932Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f8fc3be1324cdaf3be5d37d4","created_at":"2026-08-23T07:41:51.513Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.515Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f8fc3be1324cdaf3be5d37d4: done: 0.021825 sec","job_status":"done","queue_duration_s":0.395203,"scheduling_latency_s":0.395224,"redis_calls":8,"redis_duration_s":0.002632,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021825,"completed_at":"2026-08-23T07:41:51.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 255.661049] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.933Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8b6a5b18116c5f4ebe525d82","created_at":"2026-08-23T07:41:51.515Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.516Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8b6a5b18116c5f4ebe525d82: start","job_status":"start","queue_duration_s":0.416639,"scheduling_latency_s":0.416655}2213gitlab # [ 255.698858] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.956Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8b6a5b18116c5f4ebe525d82","created_at":"2026-08-23T07:41:51.515Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.516Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8b6a5b18116c5f4ebe525d82: done: 0.022663 sec","job_status":"done","queue_duration_s":0.416639,"scheduling_latency_s":0.416655,"redis_calls":7,"redis_duration_s":0.002427,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022663,"completed_at":"2026-08-23T07:41:51.956Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2214gitlab # [ 255.711575] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.958Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9e1c49903e4961338358da47","created_at":"2026-08-23T07:41:51.517Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.518Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9e1c49903e4961338358da47: start","job_status":"start","queue_duration_s":0.44011,"scheduling_latency_s":0.440131}2215gitlab # [ 255.723692] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.978Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9e1c49903e4961338358da47","created_at":"2026-08-23T07:41:51.517Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.518Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9e1c49903e4961338358da47: done: 0.019816 sec","job_status":"done","queue_duration_s":0.44011,"scheduling_latency_s":0.440131,"redis_calls":7,"redis_duration_s":0.000997,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019816,"completed_at":"2026-08-23T07:41:51.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 255.775959] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.979Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"00c3c3f60f75178cd5746b32","created_at":"2026-08-23T07:41:51.518Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.519Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-00c3c3f60f75178cd5746b32: start","job_status":"start","queue_duration_s":0.459478,"scheduling_latency_s":0.459492}2217gitlab # [ 255.776959] gitaly[930]: time="2026-08-23T07:41:52.110Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:52.110" grpc.time_ms=0.333 pid=930 span.kind=server system=grpc2218gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/742da146b5ddeef593f619931c24837c865fb273/statuses2219gitlab # [ 255.781527] gitaly[930]: time="2026-08-23T07:41:52.136Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:52.135" grpc.time_ms=0.478 pid=930 span.kind=server system=grpc2220gitlab # [ 255.788911] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.988Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"00c3c3f60f75178cd5746b32","created_at":"2026-08-23T07:41:51.518Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.519Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-00c3c3f60f75178cd5746b32: done: 0.009834 sec","job_status":"done","queue_duration_s":0.459478,"scheduling_latency_s":0.459492,"redis_calls":7,"redis_duration_s":0.000944,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009834,"completed_at":"2026-08-23T07:41:51.988Z","load_balancing_strategy":"primary","db_duration_s":0.000319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 255.847236] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:51.990Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e8f89dfd6807d4349289d537","created_at":"2026-08-23T07:41:51.520Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.520Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e8f89dfd6807d4349289d537: start","job_status":"start","queue_duration_s":0.469024,"scheduling_latency_s":0.469041}2222gitlab # [ 255.847820] gitaly[930]: time="2026-08-23T07:41:52.156Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:41:52.156" grpc.time_ms=0.34 pid=930 span.kind=server system=grpc2223gitlab # [ 255.848407] gitaly[930]: time="2026-08-23T07:41:52.160Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:22.085" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:52.085" operations="[repack_refs]" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 255.849454] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:52.006Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e8f89dfd6807d4349289d537","created_at":"2026-08-23T07:41:51.520Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.520Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e8f89dfd6807d4349289d537: done: 0.016035 sec","job_status":"done","queue_duration_s":0.469024,"scheduling_latency_s":0.469041,"redis_calls":7,"redis_duration_s":0.000981,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016035,"completed_at":"2026-08-23T07:41:52.005Z","load_balancing_strategy":"primary","db_duration_s":0.002586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 255.883139] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:52.006Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8d5655cbd05b2e6b3bae7704","created_at":"2026-08-23T07:41:51.627Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.629Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8d5655cbd05b2e6b3bae7704: start","job_status":"start","queue_duration_s":0.377296,"scheduling_latency_s":0.377311}2226gitlab # [ 255.920060] gitaly[930]: time="2026-08-23T07:41:52.161Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:22.085" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:52.085" pid=930 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-23 07:40:44.077486224 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2227gitlab # [ 255.920763] gitaly[930]: time="2026-08-23T07:41:52.168Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N diskcache=174a68b2-d5be-4971-996f-46ccc18398ce grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:42:22.085" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:41:52.085" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2228gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/742da146b5ddeef593f619931c24837c865fb273/statuses, in 0.14 seconds)2229(finished: subtest: eval and build post commit statuses, in 1.23 seconds)2230(finished: run the VM test script, in 309.14 seconds)2231gitlab # [ 255.921490] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:52.242Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8d5655cbd05b2e6b3bae7704","created_at":"2026-08-23T07:41:51.627Z","trace_propagation_headers":{"sentry-trace":"7ec3a426dfb34a4b8e00c7ff70627d98-862ecde549ac4e7c","baggage":"sentry-trace_id=7ec3a426dfb34a4b8e00c7ff70627d98,sentry-release=Unknown"},"correlation_id":"01M0PS34F0RMAKE2AH9K255P2N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.629Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8d5655cbd05b2e6b3bae7704: done: 0.235614 sec","job_status":"done","queue_duration_s":0.377296,"scheduling_latency_s":0.377311,"gitaly_calls":3,"gitaly_duration_s":0.0911,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008494,"redis_read_bytes":144,"redis_write_bytes":16720,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000353,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000676,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001771,"redis_queues_read_bytes":24,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.00337,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000232,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000385,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001354,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120457,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.213122059,"duration_s":0.235614,"completed_at":"2026-08-23T07:41:52.242Z","load_balancing_strategy":"primary","db_duration_s":0.020036,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2232gitlab # [ 255.954525] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-08-23T07:41:52.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5371679fc102e0cb9b047dd7","created_at":"2026-08-23T07:41:51.727Z","trace_propagation_headers":{"sentry-trace":"1be843b5f19a421ea9f248ffa4729405-d1a4b658ebd84312","baggage":"sentry-trace_id=1be843b5f19a421ea9f248ffa4729405,sentry-release=Unknown"},"correlation_id":"01M0PS35SJF1JGVSDQFN6450QX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:41:51.729Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7x5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5371679fc102e0cb9b047dd7: start","job_status":"start","queue_duration_s":0.514497,"scheduling_latency_s":0.514515}2233test script finished in 309.19s2234cleanup2235kill QemuMachine (pid 46)2236gitlab # [ 255.997674] gitaly[930]: time="2026-08-23T07:41:52.168Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7527 command.oublock=0 command.real_time_ms=75 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M0PS34F0RMAKE2AH9K255P2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2237(finished: cleanup, in 1.71 seconds)2238additionally exposed symbols:2239 gitlab,2240 vlan1,2241 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2242[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-23T07:40:49.259Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2243[]2244[]2245[]2246[]2247[]2248[]2249[]2250[]2251[]2252[]2253[]2254[]2255[]2256[]2257[]2258[]2259[]2260[]2261[]2262[]2263[]2264[]2265[]2266[]2267[]2268[]2269[]2270[]2271[]2272[]2273[]2274[]2275[]2276[]2277[]2278[]2279[]2280[]2281[]2282[]2283[]2284[]2285[]2286[]2287[]2288[]2289[]2290[]2291[]2292[]2293[]2294[]2295[]2296[]2297[]2298[]2299[]2300[]2301[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '742da146b5ddeef593f619931c24837c865fb273', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-23T07:41:50.293441Z', 'started_at': '2026-08-23T07:41:50.628731Z', 'finished_at': None}]2302[{'id': 3, 'sha': '742da146b5ddeef593f619931c24837c865fb273', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T07:41:50.606Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2303[{'id': 3, 'sha': '742da146b5ddeef593f619931c24837c865fb273', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-23T07:41:50.606Z', 'started_at': None, 'finished_at': '2026-08-23T07:41:51.419Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '742da146b5ddeef593f619931c24837c865fb273', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-23T07:41:51.614Z', 'started_at': None, 'finished_at': '2026-08-23T07:41:51.851Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]