vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #249
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.PChADYalJl', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 50.91 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: 08640897-18ec-495d-8f42-0fe51832860318gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pgna3g3magh9wmir73w3abgpn5mr0vzl-nixos-system-gitlab-test/init regInfo=/nix/store/qlmz6y777n45x84ymiccincml5361dks-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 487732520 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000006] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002803] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002814] Using GB pages for direct mapping73gitlab # [ 0.002942] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002952] ACPI: Early table checksum verification disabled75gitlab # [ 0.002955] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002960] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002964] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002971] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002973] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002975] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002977] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002978] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002979] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002981] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002981] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002982] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002982] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002983] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003224] No NUMA configuration found90gitlab # [ 0.003225] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003227] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005750] Zone ranges:93gitlab # [ 0.005751] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005753] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005754] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005755] Device empty97gitlab # [ 0.005756] Movable zone start for each node98gitlab # [ 0.005757] Early memory node ranges99gitlab # [ 0.005757] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005758] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005759] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005760] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005781] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006067] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.124870] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.125306] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.125322] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.125357] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.125360] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.125362] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.125363] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.125364] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.125365] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.125367] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.125368] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.125374] TSC deadline timer available117gitlab # [ 0.125378] CPU topo: Max. logical packages: 1118gitlab # [ 0.125379] CPU topo: Max. logical dies: 1119gitlab # [ 0.125379] CPU topo: Max. dies per package: 1120gitlab # [ 0.125383] CPU topo: Max. threads per core: 1121gitlab # [ 0.125384] CPU topo: Num. cores per package: 4122gitlab # [ 0.125384] CPU topo: Num. threads per package: 4123gitlab # [ 0.125385] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.125411] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.125428] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.125431] kvm-guest: setup PV sched yield127gitlab # [ 0.125447] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.125448] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.125449] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.125451] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.125453] Booting paravirtualized kernel on KVM132gitlab # [ 0.125457] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.129939] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.132390] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.132445] kvm-guest: PV spinlocks enabled136gitlab # [ 0.132446] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.132450] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pgna3g3magh9wmir73w3abgpn5mr0vzl-nixos-system-gitlab-test/init regInfo=/nix/store/qlmz6y777n45x84ymiccincml5361dks-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.132550] Unknown kernel command line parameters "regInfo=/nix/store/qlmz6y777n45x84ymiccincml5361dks-closure-info/registration", will be passed to user space.139gitlab # [ 0.132563] random: crng init done140gitlab # [ 0.132564] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.142295] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.147398] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.147484] software IO TLB: area num 4.144gitlab # [ 0.230389] Fallback order for Node 0: 0145gitlab # [ 0.230398] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.230400] Policy zone: Normal147gitlab # [ 0.233144] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.243631] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.259724] allocated 12582912 bytes of page_ext150gitlab # [ 0.270167] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.270170] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.271184] Dynamic Preempt: lazy153gitlab # [ 0.271374] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.271375] rcu: RCU event tracing is enabled.155gitlab # [ 0.271375] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.271377] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.271378] Rude variant of Tasks RCU enabled.158gitlab # [ 0.271378] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.271379] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.271379] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.271411] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.271413] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.271414] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.276122] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.276448] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.276458] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.276589] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.280294] Console: colour VGA+ 80x25169gitlab # [ 0.280297] printk: legacy console [tty0] enabled170gitlab # [ 0.311373] printk: legacy console [ttyS0] enabled171gitlab # [ 0.411827] ACPI: Core revision 20250807172gitlab # [ 0.412803] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.414327] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.415304] x2apic enabled175gitlab # [ 0.416078] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.417098] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.418285] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.419785] kvm-guest: setup PV IPIs179gitlab # [ 0.421409] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.422458] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.424225] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.426315] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.427348] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.429222] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.430226] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.431222] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.432223] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.433222] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.434222] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.435222] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.437230] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.438223] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.439223] active return thunk: srso_alias_return_thunk194gitlab # [ 0.440251] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.441222] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.442222] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.444028] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.445047] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.446042] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.447222] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.448223] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.449222] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.450222] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.451222] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.452222] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.453223] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.484622] Freeing SMP alternatives memory: 44K208gitlab # [ 0.485225] pid_max: default: 32768 minimum: 301209gitlab # [ 0.486330] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.487331] landlock: Up and running.211gitlab # [ 0.488223] Yama: becoming mindful.212gitlab # [ 0.489053] LSM support for eBPF active213gitlab # [ 0.489936] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.491382] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.494120] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.494828] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.495227] ... version: 2218gitlab # [ 0.495982] ... bit width: 48219gitlab # [ 0.496225] ... generic counters: 6220gitlab # [ 0.496978] ... generic bitmap: 000000000000003f221gitlab # [ 0.497292] ... fixed-purpose counters: 0222gitlab # [ 0.498028] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.498973] ... value mask: 0000ffffffffffff224gitlab # [ 0.499224] ... max period: 00007fffffffffff225gitlab # [ 0.500147] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.501097] signal: max sigframe size: 3376227gitlab # [ 0.501840] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.502227] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.503405] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.509180] smp: Bringing up secondary CPUs ...231gitlab # [ 0.510299] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.511156] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.515393] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.516949] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.517581] Memory: 6011380K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.519227] devtmpfs: initialized237gitlab # [ 0.520437] x86/mm: Memory block size: 128MB238gitlab # [ 0.524293] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.525368] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.526316] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.527498] PM: RTC time: 06:09:02, date: 2026-08-20242gitlab # [ 0.531462] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.533721] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.534294] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.536438] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.537238] audit: initializing netlink subsys (disabled)247gitlab # [ 0.538257] audit: type=2000 audit(1787206142.534:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.538454] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.540225] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.541225] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.542224] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.543224] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.544247] cpuidle: using governor menu254gitlab # [ 0.546471] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.547560] PCI: Using configuration type 1 for base access256gitlab # [ 0.548226] PCI: Using configuration type 1 for extended access257gitlab # [ 0.549423] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.552383] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.553225] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.554225] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.555225] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.560899] ACPI: Added _OSI(Module Device)263gitlab # [ 0.562232] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.564235] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.571431] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.578537] ACPI: Interpreter enabled267gitlab # [ 0.579263] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.579975] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.580262] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.581225] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.582488] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.595651] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.598245] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.602572] acpiphp: Slot [3] registered275gitlab # [ 0.604329] acpiphp: Slot [4] registered276gitlab # [ 0.606303] acpiphp: Slot [5] registered277gitlab # [ 0.608294] acpiphp: Slot [6] registered278gitlab # [ 0.610297] acpiphp: Slot [7] registered279gitlab # [ 0.611315] acpiphp: Slot [8] registered280gitlab # [ 0.613297] acpiphp: Slot [9] registered281gitlab # [ 0.615296] acpiphp: Slot [10] registered282gitlab # [ 0.616285] acpiphp: Slot [11] registered283gitlab # [ 0.618303] acpiphp: Slot [12] registered284gitlab # [ 0.619278] acpiphp: Slot [13] registered285gitlab # [ 0.620270] acpiphp: Slot [14] registered286gitlab # [ 0.622293] acpiphp: Slot [15] registered287gitlab # [ 0.623280] acpiphp: Slot [16] registered288gitlab # [ 0.625277] acpiphp: Slot [17] registered289gitlab # [ 0.626266] acpiphp: Slot [18] registered290gitlab # [ 0.627290] acpiphp: Slot [19] registered291gitlab # [ 0.629306] acpiphp: Slot [20] registered292gitlab # [ 0.630278] acpiphp: Slot [21] registered293gitlab # [ 0.631276] acpiphp: Slot [22] registered294gitlab # [ 0.633289] acpiphp: Slot [23] registered295gitlab # [ 0.634273] acpiphp: Slot [24] registered296gitlab # [ 0.635247] acpiphp: Slot [25] registered297gitlab # [ 0.635985] acpiphp: Slot [26] registered298gitlab # [ 0.637258] acpiphp: Slot [27] registered299gitlab # [ 0.637984] acpiphp: Slot [28] registered300gitlab # [ 0.638246] acpiphp: Slot [29] registered301gitlab # [ 0.639003] acpiphp: Slot [30] registered302gitlab # [ 0.640249] acpiphp: Slot [31] registered303gitlab # [ 0.640963] PCI host bridge to bus 0000:00304gitlab # [ 0.641230] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.642225] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.643225] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.645236] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.646253] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.648272] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.649936] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.654718] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.658326] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.666313] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.668300] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.671234] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.673232] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.676241] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.678766] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.685796] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.689551] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.692760] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.695241] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.698741] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.720346] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.722242] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.723229] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.724723] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.728308] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.741254] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.743248] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.746287] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.776248] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.781171] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.789265] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.790231] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.791300] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.799967] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.811254] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.813250] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.815285] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.821509] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.831379] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.834246] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.836310] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.842659] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.853250] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.854242] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.856273] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.861714] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.872294] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.875251] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.877286] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.883851] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.892266] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.894248] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.896286] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.899245] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.905308] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.911474] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.913286] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.919393] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.927271] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.929243] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.931283] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.936854] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.947250] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.949247] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.951284] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.963450] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.966682] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.969592] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.971563] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.974436] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.980297] iommu: Default domain type: Translated375gitlab # [ 0.982231] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.986037] ACPI: bus type USB registered377gitlab # [ 0.988593] usbcore: registered new interface driver usbfs378gitlab # [ 0.990284] usbcore: registered new interface driver hub379gitlab # [ 0.992305] usbcore: registered new device driver usb380gitlab # [ 0.997693] NetLabel: Initializing381gitlab # [ 0.999233] NetLabel: domain hash size = 128382gitlab # [ 1.001230] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 1.003497] NetLabel: unlabeled traffic allowed by default384gitlab # [ 1.006257] PCI: Using ACPI for IRQ routing385gitlab # [ 1.008482] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 1.009221] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 1.009221] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 1.016238] vgaarb: loaded389gitlab # [ 1.017631] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 1.019229] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 1.026227] clocksource: Switched to clocksource kvm-clock392gitlab # [ 1.031089] VFS: Disk quotas dquot_6.6.0393gitlab # [ 1.031876] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 1.033823] pnp: PnP ACPI init395gitlab # [ 1.035241] pnp: PnP ACPI: found 6 devices396gitlab # [ 1.045498] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 1.047027] clocksource: Switched to clocksource acpi_pm398gitlab # [ 1.048456] NET: Registered PF_INET protocol family399gitlab # [ 1.050550] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 1.069324] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 1.070823] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 1.072237] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 1.076332] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 1.077697] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 1.079239] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 1.080888] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 1.082333] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 1.083679] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 1.084689] NET: Registered PF_XDP protocol family410gitlab # [ 1.085578] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 1.086614] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 1.087662] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 1.088836] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 1.089982] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 1.091352] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 1.092362] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 1.094846] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 1.097437] PCI: CLS 0 bytes, default 64419gitlab # [ 1.098234] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 1.098613] Trying to unpack rootfs image as initramfs...421gitlab # [ 1.099293] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 1.099433] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 1.123108] Initialise system trusted keyrings424gitlab # [ 1.124403] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.136641] Key type asymmetric registered426gitlab # [ 1.137431] Asymmetric key parser 'x509' registered427gitlab # [ 1.138404] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.140103] io scheduler mq-deadline registered429gitlab # [ 1.140923] io scheduler kyber registered430gitlab # [ 1.145499] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.146957] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.149483] Linux agpgart interface v0.103433gitlab # [ 1.150270] ACPI: bus type drm_connector registered434gitlab # [ 1.153676] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.154841] usbserial: USB Serial support registered for generic436gitlab # [ 1.155883] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.155883] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.158150] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.159628] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.160897] NET: Registered PF_INET6 protocol family441gitlab # [ 1.162729] Segment Routing with IPv6442gitlab # [ 1.163440] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.166407] IPI shorthand broadcast: enabled444gitlab # [ 1.170869] sched_clock: Marking stable (1031011201, 139763088)->(1198771584, -27997295)445gitlab # [ 1.172727] registered taskstats version 1446gitlab # [ 1.173803] Loading compiled-in X.509 certificates447gitlab # [ 1.183659] Demotion targets for Node 0: null448gitlab # [ 1.184838] Key type .fscrypt registered449gitlab # [ 1.185533] Key type fscrypt-provisioning registered450gitlab # [ 1.186578] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.187518] ima: Allocated hash algorithm: sha1452gitlab # [ 1.188335] ima: No architecture policies found453gitlab # [ 1.189441] PM: Magic number: 6:765:165454gitlab # [ 1.191217] RAS: Correctable Errors collector initialized.455gitlab # [ 1.195685] clk: Disabling unused clocks456gitlab # [ 1.196422] PM: genpd: Disabling unused power domains457gitlab # [ 1.384076] Freeing initrd memory: 29392K458gitlab # [ 1.391682] Freeing unused decrypted memory: 2028K459gitlab # [ 1.398329] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.400961] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.405913] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.409738] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.478148] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.479278] Run /init as init process465gitlab # [ 1.491701] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.514326] fuse: init (API version 7.45)467gitlab # [ 1.522544] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.529370] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.532498] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.569195] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.906162] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.945891] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.947995] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.950016] systemd[1]: Running in initrd.475gitlab # [ 1.952427] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.955236] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 2.068192] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.110609] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.118499] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.119697] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.121143] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.122261] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.123408] systemd[1]: Reached target Path Units.484gitlab # [ 2.124278] systemd[1]: Reached target Slice Units.485gitlab # [ 2.125186] systemd[1]: Reached target Swaps.486gitlab # [ 2.125978] systemd[1]: Reached target Timer Units.487gitlab # [ 2.126970] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.128205] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.129335] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.130327] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.131328] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.132254] systemd[1]: Reached target Socket Units.493gitlab # [ 2.134225] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.136391] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.138532] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.142854] systemd[1]: Starting Journal Service...497gitlab # [ 2.145065] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.146056] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.152846] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.158794] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.165857] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...502gitlab # [ 2.172175] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.175898] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.177229] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.183728] systemd-journald[92]: Collecting audit messages is disabled.506gitlab # [ 2.200011] netfs: FS-Cache loaded507gitlab # [ 2.200202] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.203007] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.204655] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.510gitlab # [ 2.212996] systemd[1]: Starting Create Static Device Nodes in /dev...511gitlab # [ 2.215805] 9pnet: Installing 9P2000 support512gitlab # [ 2.222104] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.223592] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.514gitlab # [ 2.225368] systemd[1]: Finished Load Kernel Module 9pnet_virtio.515gitlab # [ 2.227842] systemd[1]: Starting Apply Kernel Variables...516gitlab # [ 2.230517] systemd[1]: Finished Create Static Device Nodes in /dev.517gitlab # [ 2.091795] systemd-modules-load[94]: Using 4 probe threads518gitlab # [ 2.231957] systemd[1]: Started Journal Service.519gitlab # [ 2.093383] systemd-modules-load[94]: Inserted module 'virtio_balloon'520gitlab # [ 2.094452] systemd-modules-load[94]: Inserted module 'dm_mod'521gitlab # [ 2.095414] systemd-modules-load[94]: Inserted module 'virtio_gpu'522gitlab # [ 2.096358] systemd[1]: Reached target Preparation for Local File Systems.523gitlab # [ 2.097466] systemd[1]: Reached target Local File Systems.524gitlab # [ 2.098403] systemd[1]: Starting Create System Files and Directories...525gitlab # [ 2.099792] systemd[1]: Starting Rule-based Manager for Device Events and Files...526gitlab # [ 2.106141] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 2.112458] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.122756] systemd-udevd[107]: Using default interface naming scheme 'v261'.529gitlab # [ 2.133432] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.176641] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.177605] systemd[1]: Reached target System Initialization.532gitlab # [ 2.178388] systemd[1]: Reached target Basic System.533gitlab # [ 2.408994] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.411496] SCSI subsystem initialized535gitlab # [ 2.417075] uhci_hcd 0000:00:01.2: UHCI Host Controller536gitlab # [ 2.417289] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)537gitlab # [ 2.417540] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1538gitlab # [ 2.421678] uhci_hcd 0000:00:01.2: detected 2 ports539gitlab # [ 2.422617] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140540gitlab # [ 2.423651] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18541gitlab # [ 2.424864] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1542gitlab # [ 2.426131] usb usb1: Product: UHCI Host Controller543gitlab # [ 2.426288] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12544gitlab # [ 2.426363] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd545gitlab # [ 2.428628] virtio_blk virtio5: 4/0/0 default/read/poll queues546gitlab # [ 2.429492] serio: i8042 KBD port at 0x60,0x64 irq 1547gitlab # [ 2.429784] usb usb1: SerialNumber: 0000:00:01.2548gitlab # [ 2.429977] hub 1-0:1.0: USB hub found549gitlab # [ 2.429992] hub 1-0:1.0: 2 ports detected550gitlab # [ 2.433754] serio: i8042 AUX port at 0x60,0x64 irq 12551gitlab # [ 2.435386] virtio_blk virtio5: [vdb] 11789120 512-byte logical blocks (6.04 GB/5.62 GiB)552gitlab # [ 2.479563] scsi host0: ata_piix553gitlab # [ 2.481060] scsi host1: ata_piix554gitlab # [ 2.483976] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.345435] systemd[1]: Starting Virtual Console Setup...556gitlab # [ 2.348829] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.489754] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0558gitlab # [ 2.352850] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.356322] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.366081] systemd-vconsole-setup[148]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 2.368388] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 2.373808] systemd[1]: Found device /dev/disk/by-label/nix-store.563gitlab # [ 2.377557] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.378422] systemd[1]: Reached target Initrd Root Device.565gitlab # [ 2.379203] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...566gitlab # [ 2.404246] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.407963] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.648192] ata2: found unknown device (class 0)569gitlab # [ 2.649033] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.652894] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.657018] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.694353] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.721979] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.752478] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.819834] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.822823] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.825329] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.826952] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.828409] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.860293] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.874233] usbcore: registered new interface driver usbhid582gitlab # [ 2.876325] usbhid: USB HID core driver583gitlab # [ 2.887411] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.891331] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 3.018455] systemd[1]: Mounting /sysroot...586gitlab # [ 3.315555] EXT4-fs (vda): mounted filesystem 08640897-18ec-495d-8f42-0fe518328603 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.183240] systemd[1]: Mounted /sysroot.588gitlab # [ 3.184565] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.187445] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.189378] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.192995] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.195155] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.202703] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.207128] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.217098] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.596gitlab # [ 3.220054] systemd[1]: Mounted /sysroot/run.597gitlab # [ 3.221169] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...598gitlab # [ 3.222637] systemd[1]: Reloading...599gitlab # [ 3.368177] 9p: Installing v9fs 9p2000 file system support600gitlab # [ 3.371640] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.286481] systemd[1]: Reloading finished in 62 ms.602gitlab # [ 3.308676] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...603gitlab # [ 3.311598] systemd[1]: Mounted /sysroot/nix/.ro-store.604gitlab # [ 3.313480] systemd[1]: Mounted /sysroot/nix/.rw-store.605gitlab # [ 3.315332] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.317374] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.319265] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...608gitlab # [ 3.321756] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.323859] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.326281] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.328543] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.339749] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.342399] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 4.018863] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 4.067155] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 4.069133] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 4.071299] systemd[1]: Starting Find NixOS closure...618gitlab # [ 4.073237] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 4.101696] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 4.104634] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.621gitlab # [ 4.118741] systemd[1]: Finished Find NixOS closure.622gitlab # [ 4.120665] systemd[1]: Reached target Initrd Default Target.623gitlab # [ 4.122771] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...624gitlab # [ 4.151877] systemd[1]: Stopped target Initrd Default Target.625gitlab # [ 4.154051] systemd[1]: Stopped target Basic System.626gitlab # [ 4.155809] systemd[1]: Stopped target Initrd Root Device.627gitlab # [ 4.157757] systemd[1]: Stopped target Path Units.628gitlab # [ 4.159543] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.629gitlab # [ 4.162071] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.630gitlab # [ 4.165880] systemd[1]: Stopped target Slice Units.631gitlab # [ 4.167724] systemd[1]: Stopped target Socket Units.632gitlab # [ 4.169593] systemd[1]: Stopped target System Initialization.633gitlab # [ 4.173079] systemd[1]: Stopped target Swaps.634gitlab # [ 4.175073] systemd[1]: Stopped target Timer Units.635gitlab # [ 4.176923] systemd[1]: dbus.socket: Deactivated successfully.636gitlab # [ 4.179149] systemd[1]: Closed D-Bus System Message Bus Socket.637gitlab # [ 4.181254] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.638gitlab # [ 4.184418] systemd[1]: Stopped Find NixOS closure.639gitlab # [ 4.186270] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio640gitlab # [ 4.189756] systemd[1]: Starting rw-sysroot-nix-store.service...641gitlab # [ 4.191829] systemd[1]: systemd-sysctl.service: Deactivated successfully.642gitlab # [ 4.193639] systemd[1]: Stopped Apply Kernel Variables.643gitlab # [ 4.195150] systemd[1]: systemd-modules-load.service: Deactivated successfully.644gitlab # [ 4.197212] systemd[1]: Stopped Load Kernel Modules.645gitlab # [ 4.198696] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.646gitlab # [ 4.200844] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.647gitlab # [ 4.202824] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.648gitlab # [ 4.204723] systemd[1]: Stopped Create System Files and Directories.649gitlab # [ 4.206519] systemd[1]: Stopped target Local File Systems.650gitlab # [ 4.208073] systemd[1]: Stopped target Preparation for Local File Systems.651gitlab # [ 4.209417] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.652gitlab # [ 4.210386] systemd[1]: Stopped Coldplug All udev Devices.653gitlab # [ 4.211150] systemd[1]: Stopping Rule-based Manager for Device Events and Files...654gitlab # [ 4.212114] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.655gitlab # [ 4.213059] systemd[1]: Stopped Virtual Console Setup.656gitlab # [ 4.213795] systemd[1]: initrd-cleanup.service: Deactivated successfully.657gitlab # [ 4.214694] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.658gitlab # [ 4.215532] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.659gitlab # [ 4.216499] systemd[1]: Finished rw-sysroot-nix-store.service.660gitlab # [ 4.217448] systemd[1]: systemd-udevd.service: Deactivated successfully.661gitlab # [ 4.218363] systemd[1]: Stopped Rule-based Manager for Device Events and Files.662gitlab # [ 4.219362] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.663gitlab # [ 4.220324] systemd[1]: Closed udev Control Socket.664gitlab # [ 4.221054] systemd[1]: Starting Cleanup udev Database...665gitlab # [ 4.221786] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.666gitlab # [ 4.222808] systemd[1]: Stopped Create Static Device Nodes in /dev.667gitlab # [ 4.223674] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.668gitlab # [ 4.224761] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.669gitlab # [ 4.225720] systemd[1]: kmod-static-nodes.service: Deactivated successfully.670gitlab # [ 4.226674] systemd[1]: Stopped Create List of Static Device Nodes.671gitlab # [ 4.241855] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.672gitlab # [ 4.243292] systemd[1]: Finished Cleanup udev Database.673gitlab # [ 4.244818] systemd[1]: Reached target Switch Root.674gitlab # [ 4.245979] systemd[1]: Starting NixOS Activation...675gitlab # [ 4.377927] initrd-nixos-activation-start[229]: booting system configuration /nix/store/pgna3g3magh9wmir73w3abgpn5mr0vzl-nixos-system-gitlab-test676gitlab # [ 4.431130] initrd-nixos-activation-start[229]: running activation script...677gitlab # [ 4.635652] initrd-nixos-activation-start[252]: setting up /etc...678gitlab # [ 4.710322] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.679gitlab # [ 4.712456] systemd[1]: Finished NixOS Activation.680gitlab # [ 4.713633] systemd[1]: Starting Switch Root...681gitlab # [ 4.739298] systemd[1]: Switching root.682gitlab # [ 4.944593] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).683gitlab # [ 5.041878] NET: Registered PF_VSOCK protocol family684gitlab # [ 5.405198] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)685gitlab # [ 5.414724] systemd[1]: Detected virtualization kvm.686gitlab # [ 5.416505] systemd[1]: Detected architecture x86-64.687gitlab # [ 5.418377] systemd[1]: Detected first boot.688gitlab # [ 5.420890] systemd[1]: Initializing machine ID from random generator.689gitlab # [ 5.568378] systemd[1]: bpf-restrict-fs: LSM BPF program attached690gitlab # [ 5.660301] systemd[1]: Applying preset policy.691gitlab # [ 5.799900] systemd[1]: Populated /etc with preset unit settings.692gitlab # [ 5.896523] systemd[1]: initrd-switch-root.service: Deactivated successfully.693gitlab # [ 5.897891] systemd[1]: Stopped initrd-switch-root.service.694gitlab # [ 5.899934] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.695gitlab # [ 5.902119] systemd[1]: Created slice Slice /system/getty.696gitlab # [ 5.903457] systemd[1]: Created slice GitLab DevOps Platform Slice.697gitlab # [ 5.904866] systemd[1]: Created slice User and Session Slice.698gitlab # [ 5.905739] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.699gitlab # [ 5.906958] systemd[1]: Started Forward Password Requests to Wall Directory Watch.700gitlab # [ 5.907998] systemd[1]: Expecting device /dev/hvc0...701gitlab # [ 5.908685] systemd[1]: Expecting device /dev/ttyS0...702gitlab # [ 5.909417] systemd[1]: Reached target Local Encrypted Volumes.703gitlab # [ 5.910202] systemd[1]: Stopped target initrd-fs.target.704gitlab # [ 5.910977] systemd[1]: Stopped target initrd-root-fs.target.705gitlab # [ 5.911779] systemd[1]: Stopped target initrd-switch-root.target.706gitlab # [ 5.912605] systemd[1]: Reached target Virtual Machines and Containers.707gitlab # [ 5.913510] systemd[1]: Reached target Path Units.708gitlab # [ 5.914203] systemd[1]: Reached target Remote File Systems.709gitlab # [ 5.914992] systemd[1]: Reached target Slice Units.710gitlab # [ 5.915693] systemd[1]: Reached target Swaps.711gitlab # [ 5.917130] systemd[1]: Listening on Query the User Interactively for a Password.712gitlab # [ 5.919093] systemd[1]: Listening on Process Core Dump Socket.713gitlab # [ 5.920461] systemd[1]: Listening on Credential Encryption/Decryption.714gitlab # [ 5.922006] systemd[1]: Listening on Factory Reset Management.715gitlab # [ 5.922967] systemd[1]: Listening on Hostname Service Socket.716gitlab # [ 5.925340] systemd[1]: Starting Journal Log Access Socket...717gitlab # [ 5.926820] systemd[1]: Listening on Journal Audit Socket.718gitlab # [ 5.928686] systemd[1]: Listening on Console Output Muting Service Socket.719gitlab # [ 5.929882] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.720gitlab # [ 5.931057] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 5.932312] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki722gitlab # [ 5.934881] systemd[1]: Listening on Disk Repartitioning Service Socket.723gitlab # [ 5.935910] systemd[1]: Listening on udev Control Socket.724gitlab # [ 5.936790] systemd[1]: Listening on udev Varlink Socket.725gitlab # [ 5.939399] systemd[1]: Mounting Huge Pages File System...726gitlab # [ 5.941429] systemd[1]: Mounting POSIX Message Queue File System...727gitlab # [ 5.951325] systemd[1]: Mounting Kernel Debug File System...728gitlab # [ 5.953654] systemd[1]: Mounting Kernel Trace File System...729gitlab # [ 5.955678] systemd[1]: Starting Create List of Static Device Nodes...730gitlab # [ 5.958398] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio731gitlab # [ 5.965652] systemd[1]: Starting Load Kernel Module configfs...732gitlab # [ 5.969417] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm733gitlab # [ 5.971311] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore734gitlab # [ 5.973771] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse735gitlab # [ 5.987961] systemd[1]: Mounting FUSE Control File System...736gitlab # [ 5.988846] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67737gitlab # [ 5.992553] systemd[1]: Starting Journal Service...738gitlab # [ 5.995871] systemd[1]: Starting Load Kernel Modules...739gitlab # [ 6.001878] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...740gitlab # [ 6.004852] systemd[1]: Starting Remount Root and Kernel File Systems...741gitlab # [ 6.005791] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os742gitlab # [ 6.011196] systemd-journald[322]: Collecting audit messages is enabled.743gitlab # [ 6.011831] systemd[1]: Starting Coldplug All udev Devices...744gitlab # [ 6.018270] systemd[1]: Listening on Journal Log Access Socket.745gitlab # [ 5.881752] systemd[1]: Queued start job for [ 6.021931] systemd[1]: Started Journal Service.746gitlab # default target Multi-User System.747gitlab # [ 5.886511] systemd[1]: Unnecessary job was removed for /dev/vdb.748gitlab # [ 5.888159] systemd[1]: systemd-journald.service: Deactivated successfully.749gitlab # [ 5.892063] systemd-modules-load[323]: Using 3 probe threads750gitlab # [ 5.893878] systemd[1]: Mounted Huge Pages File System.751gitlab # [ 5.895275] systemd[1]: Mounted POSIX Message Queue File System.752gitlab # [ 5.896694] systemd[1]: Mounted Kernel Debug File System.753gitlab # [ 5.899431] systemd[1]: Mounted Kernel Trace File System.754gitlab # [ 5.900707] systemd[1]: Finis[ 6.040330] EXT4-fs (vda): re-mounted 08640897-18ec-495d-8f42-0fe518328603.755gitlab # hed Create List of Static Device Nodes.756gitlab # [ 5.902898] systemd[1]: modprobe@configfs.service: Deactivated successfully.757gitlab # [ 5.904070] systemd[1]: Finished Load Kernel Module configfs.758gitlab # [ 5.904974] systemd[1]: Mounted FUSE Control File System.759gitlab # [ 5.905844] systemd[1]: Mounting Kernel Configuration File System...760gitlab # [ 5.906742] systemd-modules-load[323]: Inserted module 'tls'761gitlab # [ 5.909159] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...762gitlab # [ 5.912023] systemd[1]: Finished Remount Root and Kernel File Systems.763gitlab # [ 5.913119] systemd[1]: Mounted Kernel Configuration File System.764gitlab # [ 6.055602] loop: module loaded765gitlab # [ 5.916556] systemd-modules-load[323]: Inserted module 'loop'766gitlab # [ 5.920081] systemd[1]: Finished Load Kernel Modules.767gitlab # [ 5.921100] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.924261] systemd[1]: Starting Firewall...769gitlab # [ 5.926128] systemd[1]: Starting Flush Journal to Persistent Storage...770gitlab # [ 5.927074] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 5.931071] systemd[1]: Starting Load/Save OS Random Seed...772gitlab # [ 5.932245] systemd-oomd[325]: No swap; memory pressure usage will be degraded773gitlab # [ 5.933640] systemd[1]: Starting Apply Kernel Variables...774gitlab # [ 5.934370] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os775gitlab # [ 5.935545] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.776gitlab # [ 5.937910] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.777gitlab # [ 5.942139] systemd[1]: Starting Create Static Device Nodes in /dev...778gitlab # [ 6.082984] systemd-journald[322]: Received client request to flush runtime journal.779gitlab # [ 5.985718] systemd[1]: Finished Load/Save OS Random Seed.780gitlab # [ 5.988965] systemd[1]: Reached target First Boot Complete.781gitlab # [ 5.990226] systemd[1]: Finished Create Static Device Nodes in /dev.782gitlab # [ 5.991216] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 5.992069] systemd[1]: Reached target Preparation for Local File Systems.784gitlab # [ 5.993169] systemd[1]: Starting Rule-based Manager for Device Events and Files...785gitlab # [ 5.994617] systemd-udevd[354]: Using default interface naming scheme 'v261'.786gitlab # [ 5.995744] systemd[1]: Finished Flush Journal to Persistent Storage.787gitlab # [ 6.021738] systemd[1]: Started Rule-based Manager for Device Events and Files.788gitlab # [ 6.043205] systemd[1]: Finished Coldplug All udev Devices.789gitlab # [ 6.104535] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse790gitlab # [ 6.122660] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.791gitlab # [ 6.137346] (udev-worker)[434]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.792gitlab # [ 6.139485] (udev-worker)[434]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 6.148660] systemd[1]: Condition check resulted in Virtio network device being skipped.794gitlab # [ 6.149786] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore795gitlab # [ 6.151461] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67796gitlab # [ 6.153651] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore797gitlab # [ 6.155311] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os798gitlab # [ 6.156674] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os799gitlab # [ 6.160068] (udev-worker)[418]: Network interface NamePolicy= disabled on kernel command line.800gitlab # [ 6.185482] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.801gitlab # [ 6.338726] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3802gitlab # [ 6.353443] ACPI: button: Power Button [PWRF]803gitlab # [ 6.217267] systemd[1]: Finished Firewall.804gitlab # [ 6.374438] rtc_cmos 00:05: RTC can wake from S4805gitlab # [ 6.378854] Floppy drive(s): fd0 is 2.88M AMI BIOS806gitlab # [ 6.382256] rtc_cmos 00:05: registered as rtc0807gitlab # [ 6.383093] rtc_cmos 00:05: setting system clock to 2026-08-20T06:09:07 UTC (1787206147)808gitlab # [ 6.384079] mousedev: PS/2 mouse device common for all mice809gitlab # [ 6.385012] systemd-journald[322]: Time jumped backwards, rotating.810gitlab # [ 6.386561] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs811gitlab # [ 6.391338] FDC 0 is a S82078B812gitlab # [ 6.392976] parport_pc 00:03: reported by Plug and Play ACPI813gitlab # [ 6.394576] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0814gitlab # [ 6.398451] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console815gitlab # [ 6.400903] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD816gitlab # [ 6.401451] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]817gitlab # [ 6.416805] Console: switching to colour dummy device 80x25818gitlab # [ 6.419609] [drm] Found bochs VGA, ID 0xb0c5.819gitlab # [ 6.419611] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.820gitlab # [ 6.421853] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic821gitlab # [ 6.421969] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5822gitlab # [ 6.422546] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0823gitlab # [ 6.424276] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4824gitlab # [ 6.435532] Console: switching to colour frame buffer device 160x50825gitlab # [ 6.437158] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device826gitlab # [ 6.438049] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6827gitlab # [ 6.356353] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 6.537179] ppdev: user-space parallel port driver829gitlab # [ 6.405172] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.830gitlab # [ 6.406353] systemd[1]: Stopped Virtual Console Setup.831gitlab # [ 6.413065] systemd[1]: Starting Virtual Console Setup...832gitlab # [ 6.562388] kvm_amd: TSC scaling supported833gitlab # [ 6.562900] kvm_amd: Nested Virtualization enabled834gitlab # [ 6.563345] kvm_amd: Nested Paging enabled835gitlab # [ 6.563735] kvm_amd: LBR virtualization supported836gitlab # [ 6.564226] kvm_amd: Virtual VMLOAD VMSAVE supported837gitlab # [ 6.564709] kvm_amd: Virtual GIF supported838gitlab # [ 6.565177] kvm_amd: Virtual NMI enabled839gitlab # [ 6.479654] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.840gitlab # [ 6.482855] systemd[1]: Finished Virtual Console Setup.841gitlab # [ 6.673488] EDAC MC: Ver: 3.0.0842gitlab # [ 6.762163] systemd[1]: Mounting /run/wrappers...843gitlab # [ 6.785503] systemd[1]: Mounted /run/wrappers.844gitlab # [ 6.788529] systemd[1]: Reached target Local File Systems.845gitlab # [ 6.791739] systemd[1]: Listening on Boot Loader Control Service Socket.846gitlab # [ 6.796361] systemd[1]: Starting register-nix-paths.service...847gitlab # [ 6.800505] systemd[1]: Starting Create SUID/SGID Wrappers...848gitlab # [ 6.802352] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.849gitlab # [ 6.815815] systemd[1]: Starting Save Transient machine-id to Disk...850gitlab # [ 6.818507] systemd[1]: Starting Create System Files and Directories...851gitlab # [ 6.868508] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.852gitlab # [ 6.870467] systemd[1]: Finished Save Transient machine-id to Disk.853gitlab # [ 6.872336] systemd[1]: Finished Create System Files and Directories.854gitlab # [ 6.880611] systemd[1]: Starting Rebuild Journal Catalog...855gitlab # [ 6.883302] systemd[1]: Starting Record System Boot/Shutdown in UTMP...856gitlab # [ 6.904213] systemd[1]: Finished Record System Boot/Shutdown in UTMP.857gitlab # [ 6.919894] systemd[1]: Finished Rebuild Journal Catalog.858gitlab # [ 6.922079] systemd[1]: Starting Update is Completed...859gitlab # [ 6.937589] systemd[1]: Finished Update is Completed.860gitlab # [ 6.968030] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.861gitlab # [ 6.969151] systemd[1]: Finished Create SUID/SGID Wrappers.862gitlab # [ 7.192359] systemd[1]: Finished register-nix-paths.service.863gitlab # [ 7.194474] systemd[1]: Reached target System Initialization.864gitlab # [ 7.196471] systemd[1]: Started Discard unused filesystem blocks once a week.865gitlab # [ 7.198832] systemd[1]: Started logrotate.timer.866gitlab # [ 7.200442] systemd[1]: Started Daily Cleanup of Temporary Directories.867gitlab # [ 7.202526] systemd[1]: Reached target Timer Units.868gitlab # [ 7.204199] systemd[1]: Listening on D-Bus System Message Bus Socket.869gitlab # [ 7.206273] systemd[1]: Listening on Nix Daemon Socket.870gitlab # [ 7.208067] systemd[1]: Starting nixbot CI service socket...871gitlab # [ 7.209966] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.872gitlab # [ 7.212668] systemd[1]: Listening on nixbot CI service socket.873gitlab # [ 7.214619] systemd[1]: Reached target Socket Units.874gitlab # [ 7.216636] systemd[1]: Starting D-Bus System Message Bus...875gitlab # [ 7.244216] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...876gitlab # [ 7.247453] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'877gitlab # [ 7.249996] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"878gitlab # [ 7.255067] systemd[1]: Started D-Bus System Message Bus.879gitlab # [ 7.273222] dbus-broker-launch[577]: Ready880gitlab # [ 7.276308] systemd[1]: Reached target Basic System.881gitlab # [ 7.278731] systemd[1]: Started backdoor.service.882gitlab # [ 7.281778] systemd[1]: Starting gitlab-config.service...883gitlab # [ 7.294850] systemd[1]: Starting Import lastlog data into lastlog2 database...884gitlab # [ 7.300578] systemd[1]: Starting Logrotate configuration check...885gitlab # [ 7.311967] systemd[1]: Starting Name Service Cache Daemon (nsncd)...886gitlab # [ 7.315358] systemd[1]: Starting Post-Boot Actions...887gitlab # connecting to host...888gitlab # [ 7.325156] systemd[1]: Started Reset console on configuration changes.889gitlab # [ 7.327513] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.890gitlab: Guest shell says: b'Spawning backdoor root shell...\n'891gitlab # [ 7.340076] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf892gitlab: connected to guest root shell893gitlab # [ 7.342341] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'894gitlab: (connecting took 7.98 seconds)895gitlab # [ 7.344159] logrotate[582]: Reading state from file: /var/lib/logrotate.status896gitlab: (finished: waiting for the VM to finish booting, in 7.98 seconds)897gitlab # [ 7.345829] logrotate[582]: state file /var/lib/logrotate.status does not exist898gitlab # [ 7.347364] logrotate[582]: Allocating hash table for state file, size 64 entries899gitlab # [ 7.348915] logrotate[582]: Handling 4 logs900gitlab # [ 7.349819] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed901gitlab # [ 7.351971] logrotate[582]: considering log /var/log/btmp902gitlab # [ 7.355173] logrotate[582]: Creating new state903gitlab # [ 7.355767] logrotate[582]: Now: 2026-08-20 06:09904gitlab # [ 7.356399] logrotate[582]: Last rotated at 2026-08-20 06:00905gitlab # [ 7.357272] logrotate[582]: log does not need rotating (log has already been rotated)906gitlab # [ 7.358842] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab # [ 7.360767] logrotate[582]: considering log /var/log/wtmp908gitlab # [ 7.361490] logrotate[582]: Creating new state909gitlab # [ 7.362085] logrotate[582]: Now: 2026-08-20 06:09910gitlab # [ 7.362687] logrotate[582]: Last rotated at 2026-08-20 06:00911gitlab # [ 7.363441] logrotate[582]: log does not need rotating (log has already been rotated)912gitlab # [ 7.364440] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed913gitlab # [ 7.366178] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)914gitlab # [ 7.367148] logrotate[582]: considering log /var/gitlab/state/log/*.log915gitlab # [ 7.367973] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping916gitlab # [ 7.368981] logrotate[582]: Creating new state917gitlab # [ 7.369546] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)918gitlab # [ 7.370505] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed919gitlab # [ 7.372361] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)920gitlab # [ 7.373961] logrotate[582]: considering log /var/log/nginx/*.log921gitlab # [ 7.374800] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping922gitlab # [ 7.375950] logrotate[582]: Creating new state923gitlab # [ 7.376654] logrotate[582]: not running postrotate script, since no logs were rotated924gitlab # [ 7.377589] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)925gitlab # [ 7.379266] nsncd[583]: Aug 20 06:09:08.613 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"926gitlab # [ 7.381992] systemd[1]: Starting resolvconf update...927gitlab # [ 7.382878] systemd[1]: Finished Logrotate configuration check.928gitlab # [ 7.384630] systemd[1]: Finished Post-Boot Actions.929gitlab # [ 7.385500] systemd[1]: Finished Import lastlog data into lastlog2 database.930gitlab # [ 7.386572] systemd[1]: Started Name Service Cache Daemon (nsncd).931gitlab # [ 7.387539] systemd[1]: Reached target Host and Network Name Lookups.932gitlab # [ 7.389595] systemd[1]: Reached target User and Group Name Lookups.933gitlab # [ 7.390651] systemd[1]: Starting User Login Management...934gitlab # [ 7.408145] systemd-logind[617]: New seat seat0.935gitlab # [ 7.410667] systemd-logind[617]: Watching system buttons on /dev/input/event2 (Power Button)936gitlab # [ 7.411497] systemd-logind[617]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)937gitlab # [ 7.412258] systemd-logind[617]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)938gitlab # [ 7.413520] systemd[1]: Started User Login Management.939gitlab # [ 7.417179] systemd[1]: Stopped target Host and Network Name Lookups.940gitlab # [ 7.417699] systemd[1]: Stopping Host and Network Name Lookups...941gitlab # [ 7.418163] systemd[1]: Stopped target User and Group Name Lookups.942gitlab # [ 7.418768] systemd[1]: Stopping User and Group Name Lookups...943gitlab # [ 7.419206] systemd[1]: Starting linger-users.service...944gitlab # [ 7.419615] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.422477] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.423117] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.423487] systemd[1]: nscd.service: Consumed 26ms CPU time over 110ms wall clock time, 7.1M memory peak, 5.5M read from disk.948gitlab # [ 7.429797] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.438432] systemd[1]: linger-users.service: Deactivated successfully.950gitlab # [ 7.439846] systemd[1]: Finished linger-users.service.951gitlab # [ 7.449159] systemd[1]: Started Name Service Cache Daemon (nsncd).952gitlab # [ 7.449749] systemd[1]: Reached target Host and Network Name Lookups.953gitlab # [ 7.450665] systemd[1]: Reached target User and Group Name Lookups.954gitlab # [ 7.452402] nsncd[673]: Aug 20 06:09:08.708 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"955gitlab # [ 7.458038] systemd[1]: Finished resolvconf update.956gitlab # [ 7.458722] systemd[1]: Reached target Preparation for Network.957gitlab # [ 7.462251] systemd[1]: Starting DHCP Client...958gitlab # [ 7.463941] systemd[1]: Starting Address configuration of eth1...959gitlab # [ 7.465636] systemd[1]: Starting Extra networking commands....960gitlab # [ 7.497276] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done961gitlab # [ 7.500484] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done962gitlab # [ 7.504774] systemd[1]: Finished Address configuration of eth1.963gitlab # [ 7.533672] dhcpcd[709]: dhcpcd-10.3.2 starting964gitlab # [ 7.535638] systemd[1]: Finished Extra networking commands..965gitlab # [ 7.536772] dhcpcd[765]: dev: loaded udev966gitlab # [ 7.537502] systemd[1]: Reached target Network.967gitlab # [ 7.539078] systemd[1]: Starting gitlab-workhorse.service...968gitlab # [ 7.542376] systemd[1]: Starting Nginx Web Server...969gitlab # [ 7.684947] 8021q: 802.1Q VLAN Support v1.8970gitlab # [ 7.685391] 8021q: adding VLAN 0 to HW filter on device eth1971gitlab # [ 7.547649] systemd[1]: Starting PostgreSQL Server...972gitlab # [ 7.548569] systemd[1]: Starting Redis Server - redis-gitlab...973gitlab # [ 7.550630] systemd[1]: Starting Permit User Sessions...974gitlab # [ 7.561918] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.975gitlab # [ 7.588704] systemd[1]: Finished Permit User Sessions.976gitlab # [ 7.594284] systemd[1]: Started Getty on tty1.977gitlab # [ 7.594925] systemd[1]: Reached target Login Prompts.978gitlab # [ 7.770529] cfg80211: Loading compiled-in X.509 certificates for regulatory database979gitlab # [ 7.778039] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'980gitlab # [ 7.779068] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'981gitlab # [ 7.780357] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2982gitlab # [ 7.781768] cfg80211: failed to load regulatory.db983gitlab # [ 7.806022] 8021q: adding VLAN 0 to HW filter on device eth0984gitlab # [ 7.667471] dhcpcd[765]: eth0: waiting for carrier985gitlab # [ 7.668260] dhcpcd[765]: eth0: carrier acquired986gitlab # [ 7.672598] dhcpcd[765]: DUID 00:01:00:01:32:19:56:84:52:54:00:12:34:56987gitlab # [ 7.673226] dhcpcd[765]: eth0: IAID 00:12:34:56988gitlab # [ 7.673711] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456989gitlab # [ 7.691294] nginx-pre-start[793]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.691863] nginx-pre-start[793]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.697874] systemd[1]: Started Nginx Web Server.992gitlab # [ 7.700359] postgresql-pre-start[796]: The files belonging to this database system will be owned by user "postgres".993gitlab # [ 7.701020] postgresql-pre-start[796]: This user must also own the server process.994gitlab # [ 7.705717] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.995gitlab # [ 7.707668] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo996gitlab # [ 7.708827] postgresql-pre-start[796]: The database cluster will be initialized with locale "en_US.UTF-8".997gitlab # [ 7.710077] postgresql-pre-start[796]: The default database encoding has accordingly been set to "UTF8".998gitlab # [ 7.712303] postgresql-pre-start[796]: The default text search configuration will be set to "english".999gitlab # [ 7.712765] postgresql-pre-start[796]: Data page checksums are enabled.1000gitlab # [ 7.713506] postgresql-pre-start[796]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1001gitlab # [ 7.713968] postgresql-pre-start[796]: creating subdirectories ... ok1002gitlab # [ 7.714651] postgresql-pre-start[796]: selecting dynamic shared memory implementation ... posix1003gitlab # [ 7.715181] systemd[1]: Started Redis Server - redis-gitlab.1004gitlab # [ 7.715890] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started1005gitlab # [ 7.716642] redis-server[789]: Configuration loaded1006gitlab # [ 7.717514] redis[789]: monotonic clock: POSIX clock_gettime1007gitlab # [ 7.718103] redis[789]: Running mode=standalone, port=0.1008gitlab # [ 7.718562] redis[789]: Server initialized1009gitlab # [ 7.719042] redis[789]: Ready to accept connections unix1010gitlab # [ 7.719436] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1011gitlab # [ 7.740641] postgresql-pre-start[796]: selecting default "max_connections" ... 1001012gitlab # [ 7.777627] postgresql-pre-start[796]: selecting default "shared_buffers" ... 128MB1013gitlab # [ 8.039610] systemd[1]: Started gitlab-workhorse.service.1014gitlab # [ 8.126133] postgresql-pre-start[796]: selecting default time zone ... UTC1015gitlab # [ 8.128867] postgresql-pre-start[796]: creating configuration files ... ok1016gitlab # [ 8.241225] gitlab-workhorse[825]: time="2026-08-20T06:09:09Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41017gitlab # [ 8.242227] gitlab-workhorse[825]: time="2026-08-20T06:09:09Z" level=info msg="Using redis/go-redis"1018gitlab # [ 8.242893] gitlab-workhorse[825]: time="2026-08-20T06:09:09Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1019gitlab # [ 8.313108] postgresql-pre-start[796]: running bootstrap script ... ok1020gitlab # [ 8.725256] postgresql-pre-start[796]: performing post-bootstrap initialization ... ok1021gitlab # [ 9.039847] postgresql-pre-start[796]: syncing data to disk ... ok1022gitlab # [ 9.041434] postgresql-pre-start[796]: initdb: warning: enabling "trust" authentication for local connections1023gitlab # [ 9.042400] postgresql-pre-start[796]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1024gitlab # [ 9.043439] postgresql-pre-start[796]: Success. You can now start the database server using:1025gitlab # [ 9.044892] postgresql-pre-start[796]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1026gitlab # [ 9.150754] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1027gitlab # [ 9.152431] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321028gitlab # [ 9.153448] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321029gitlab # [ 9.162798] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1030gitlab # [ 9.179742] postgres[859]: [859] LOG: database system was shut down at 2026-08-20 06:09:09 GMT1031gitlab # [ 9.189833] postgres[850]: [850] LOG: database system is ready to accept connections1032gitlab # [ 9.194191] systemd[1]: Started PostgreSQL Server.1033gitlab # [ 9.199247] systemd[1]: Starting PostgreSQL Setup Scripts...1034gitlab # [ 9.348089] dhcpcd[765]: eth0: soliciting a DHCP lease1035gitlab # [ 9.493124] NET: Registered PF_PACKET protocol family1036gitlab # [ 9.359243] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21037gitlab # [ 9.362304] dhcpcd[765]: eth0: probing address 10.0.2.15/241038gitlab # [ 9.419511] postgresql-setup-start[870]: CREATE DATABASE1039gitlab # [ 9.441052] postgresql-setup-start[882]: CREATE ROLE1040gitlab # [ 9.453022] postgresql-setup-start[884]: ALTER DATABASE1041gitlab # [ 9.453669] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[875]: mkdir -p /var/gitlab/state/home/.ssh: OK1042gitlab # [ 9.456471] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[875]: chmod 700 /var/gitlab/state/home/.ssh: OK1043gitlab # [ 9.472615] postgresql-setup-start[901]: CREATE ROLE1044gitlab # [ 9.474767] systemd[1]: Finished PostgreSQL Setup Scripts.1045gitlab # [ 9.476084] systemd[1]: Reached target PostgreSQL.1046gitlab # [ 9.477483] systemd[1]: Starting gitlab-postgresql.service...1047gitlab # [ 9.497817] systemd[1]: Finished gitlab-config.service.1048gitlab # [ 9.500662] systemd[1]: Started gitaly.service.1049gitlab # [ 9.502655] systemd[1]: Starting gitlab-db-config.service...1050gitlab # [ 9.567961] gitlab-postgresql-start[920]: CREATE DATABASE1051gitlab # [ 9.601136] gitlab-postgresql-start[927]: CREATE EXTENSION1052gitlab # [ 9.685853] gitlab-postgresql-start[929]: CREATE EXTENSION1053gitlab # [ 9.688962] systemd[1]: Finished gitlab-postgresql.service.1054gitlab # [ 9.969187] dhcpcd[765]: eth0: soliciting an IPv6 router1055gitlab # [ 9.969924] dhcpcd[765]: eth0: Router Advertisement from fe80::21056gitlab # [ 9.971287] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641057gitlab # [ 9.972417] dhcpcd[765]: eth0: adding route to fec0::/641058gitlab # [ 9.973917] dhcpcd[765]: eth0: adding default route via fe80::21059gitlab # [ 10.021694] gitaly[918]: time="2026-08-20T06:09:11.277Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9181060gitlab # [ 10.023471] gitaly[918]: time="2026-08-20T06:09:11.278Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9181061gitlab # [ 10.025104] gitaly[918]: time="2026-08-20T06:09:11.278Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9181062gitlab # [ 10.036316] gitaly[918]: time="2026-08-20T06:09:11.292Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9181063gitlab # [ 10.037997] gitaly[918]: time="2026-08-20T06:09:11.292Z" level=info msg="Starting Gitaly" pid=918 version=1064gitlab # [ 10.224964] gitaly[918]: time="2026-08-20T06:09:11.481Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=180 pid=9181065gitlab # [ 10.225830] gitaly[918]: time="2026-08-20T06:09:11.481Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9181066gitlab # [ 10.226488] gitaly[918]: time="2026-08-20T06:09:11.481Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9181067gitlab # [ 10.226942] gitaly[918]: time="2026-08-20T06:09:11.481Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-918/git-exec-1732866918.d/git pid=9181068gitlab # [ 10.235059] gitaly[918]: time="2026-08-20T06:09:11.491Z" level=info msg="finished detecting git version" duration_ms=9 pid=9181069gitlab # [ 10.235672] gitaly[918]: time="2026-08-20T06:09:11.491Z" level=info msg="using Git version" pid=918 version=2.53.g1070gitlab # [ 10.238145] gitaly[918]: time="2026-08-20T06:09:11.494Z" level=info msg="clearing disk cache object folder" pid=918 storage=default1071gitlab # [ 10.239233] gitaly[918]: time="2026-08-20T06:09:11.495Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2407919815 pid=918 storage=default1072gitlab # [ 10.239724] gitaly[918]: time="2026-08-20T06:09:11.495Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2407919815 pid=918 storage=default1073gitlab # [ 10.240188] gitaly[918]: time="2026-08-20T06:09:11.495Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9181074gitlab # [ 10.240576] gitaly[918]: time="2026-08-20T06:09:11.495Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9181075gitlab # [ 10.241130] gitaly[918]: time="2026-08-20T06:09:11.496Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2407919815 clear_duration_ms=0 pid=918 storage=default1076gitlab # [ 10.276470] gitaly[918]: time="2026-08-20T06:09:11.533Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9181077gitlab # [ 10.277276] gitaly[918]: time="2026-08-20T06:09:11.533Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=918 schema=unix1078gitlab # [ 10.277874] gitaly[918]: time="2026-08-20T06:09:11.533Z" level=info msg="counting repositories" pid=9181079gitlab # [ 10.278565] gitaly[918]: time="2026-08-20T06:09:11.534Z" level=info msg="starting to count repositories" pid=918 storage_path=/var/gitlab/state/repositories1080gitlab # [ 10.282648] gitaly[918]: time="2026-08-20T06:09:11.539Z" level=info msg="finished tempdir cleaner walk" pid=918 storage=default time_ms=31081gitlab # [ 10.284353] gitaly[918]: time="2026-08-20T06:09:11.533Z" level=info msg="listening at address" address=/run/gitaly/gitaly-918/sock.d/intern pid=918 schema=unix1082gitlab # [ 10.286349] gitaly[918]: time="2026-08-20T06:09:11.539Z" level=info msg="completed counting repositories" counting_duration_ms=5 pid=918 storage_path=/var/gitlab/state/repositories1083gitlab # [ 10.286947] gitaly[918]: time="2026-08-20T06:09:11.539Z" level=info msg="completed counting all repositories" counting_duration=5 pid=9181084gitlab # [ 10.287636] gitaly[918]: time="2026-08-20T06:09:11.540Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9181085gitlab # [ 10.288177] gitaly[918]: time="2026-08-20T06:09:11.540Z" level=info msg="Started Gitaly" duration_ms=247 pid=9181086gitlab # [ 10.288631] gitaly[918]: time="2026-08-20T06:09:11.540Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9181087gitlab # [ 10.289185] gitaly[918]: time="2026-08-20T06:09:11.541Z" level=info msg="maintenance: daily scheduled" pid=918 scheduled="2026-08-20 12:00:00 +0000 UTC"1088gitlab # [ 10.841791] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1089gitlab # [ 10.847588] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1090gitlab # [ 10.879283] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1091gitlab # [ 12.169941] gitaly[918]: time="2026-08-20T06:09:13.425Z" level=info msg="License database preloaded" duration_ms=2132 pid=9181092gitlab # [ 14.843544] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1093gitlab # [ 14.845880] dhcpcd[765]: eth0: adding route to 10.0.2.0/241094gitlab # [ 14.847659] dhcpcd[765]: eth0: adding default route via 10.0.2.21095gitlab # [ 14.961619] systemd[1]: Started DHCP Client.1096gitlab # [ 14.963545] systemd[1]: Reached target Network is Online.1097gitlab # [ 40.499236] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[923]: W, [2026-08-20T06:09:41.754870 #923] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1098gitlab # [ 42.491214] postgres[1307]: [1307] ERROR: relation "feature_gates" does not exist at character 5231099gitlab # [ 42.493288] postgres[1307]: [1307] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1100gitlab # [ 42.494381] postgres[1307]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1101gitlab # [ 42.496151] postgres[1307]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1102gitlab # [ 42.497925] postgres[1307]: attidentity AS identity,1103gitlab # [ 42.499677] postgres[1307]: attgenerated as attgenerated1104gitlab # [ 42.501529] postgres[1307]: FROM pg_attribute a1105gitlab # [ 42.503294] postgres[1307]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1106gitlab # [ 42.505127] postgres[1307]: LEFT JOIN pg_type t ON a.atttypid = t.oid1107gitlab # [ 42.505773] postgres[1307]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1108gitlab # [ 42.507903] postgres[1307]: WHERE a.attrelid = '"feature_gates"'::regclass1109gitlab # [ 42.509975] postgres[1307]: AND a.attnum > 0 AND NOT a.attisdropped1110gitlab # [ 42.511398] postgres[1307]: ORDER BY a.attnum1111gitlab # [ 42.512437] postgres[1307]:1112gitlab # [ 45.795439] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1340]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1113gitlab # [ 45.797043] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1340]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1114gitlab # [ 48.294895] gitlab-workhorse[825]: time="2026-08-20T06:09:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1115gitlab # [ 58.305630] gitlab-workhorse[825]: time="2026-08-20T06:09:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1116gitlab # [ 60.873851] postgres[1406]: [1406] ERROR: relation "table_without_models" does not exist1117gitlab # [ 60.874915] postgres[1406]: [1406] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1118gitlab # [ 68.314696] gitlab-workhorse[825]: time="2026-08-20T06:10:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 72.089824] systemd[1]: Finished gitlab-db-config.service.1120gitlab # [ 72.092324] systemd[1]: Started gitlab-sidekiq.service.1121gitlab # [ 72.094878] systemd[1]: Starting gitlab.service...1122gitlab # [ 72.456101] bundle[1573]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1123gitlab # [ 72.460507] bundle[1573]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1124gitlab # [ 72.465318] bundle[1573]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1125gitlab # [ 75.145518] sidekiq-cluster[1572]: {"severity":"INFO","time":"2026-08-20T06:10:16.384Z","message":"Starting cluster with 1 processes"}1126gitlab # [ 75.250090] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.485Z","pid":1573,"message":"* Enabling systemd notification integration"}1127gitlab # [ 75.253882] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.505Z","pid":1573,"message":"Puma starting in cluster mode..."}1128gitlab # [ 75.257401] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.505Z","pid":1573,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1129gitlab # [ 75.260818] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.505Z","pid":1573,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1130gitlab # [ 75.264903] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.505Z","pid":1573,"message":"* Min threads: 0"}1131gitlab # [ 75.267826] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.506Z","pid":1573,"message":"* Max threads: 4"}1132gitlab # [ 75.270895] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.506Z","pid":1573,"message":"* Environment: production"}1133gitlab # [ 75.274061] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.506Z","pid":1573,"message":"* Master PID: 1573"}1134gitlab # [ 75.277274] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.506Z","pid":1573,"message":"* Workers: 2"}1135gitlab # [ 75.280195] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.506Z","pid":1573,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1136gitlab # [ 75.283786] bundle[1573]: {"timestamp":"2026-08-20T06:10:16.506Z","pid":1573,"message":"* Preloading application"}1137gitlab # [ 78.323890] gitlab-workhorse[825]: time="2026-08-20T06:10:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1138gitlab # [ 88.324754] gitlab-workhorse[825]: time="2026-08-20T06:10:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1139gitlab # [ 97.876440] bundle[1573]: W, [2026-08-20T06:10:39.132014 #1573] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1140gitlab # [ 98.333741] gitlab-workhorse[825]: time="2026-08-20T06:10:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 100.121832] sidekiq-cluster[1603]: 2026-08-20T06:10:41.377Z pid=1603 tid=wkr INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1603, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>440381440}1142gitlab # [ 100.292865] sidekiq-cluster[1603]: W, [2026-08-20T06:10:41.549292 #1603] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1143gitlab # [ 100.332832] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:41.589Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1144gitlab # [ 102.218417] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.474Z","message":"GitLab reliable fetch activated!"}1145gitlab # [ 102.222072] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.474Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1146gitlab # [ 102.264470] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.520Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1147gitlab # [ 102.275346] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.531Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1148gitlab # [ 102.285052] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.541Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1149gitlab # [ 102.291990] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.548Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1150gitlab # [ 102.300150] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.556Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1151gitlab # [ 102.307830] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.564Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 102.315466] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.572Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1153gitlab # [ 102.322097] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.578Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1154gitlab # [ 102.328298] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.584Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1155gitlab # [ 102.334051] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.590Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1156gitlab # [ 102.339816] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.596Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1157gitlab # [ 102.348158] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.604Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1158gitlab # [ 102.352350] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.608Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1159gitlab # [ 102.359021] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.615Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1160gitlab # [ 102.365309] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.621Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1161gitlab # [ 102.369241] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.625Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1162gitlab # [ 102.375231] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.631Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1163gitlab # [ 102.379096] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.635Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1164gitlab # [ 102.383921] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.640Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1165gitlab # [ 102.388580] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.645Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1166gitlab # [ 102.395494] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.652Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1167gitlab # [ 102.399235] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.655Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1168gitlab # [ 102.402933] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.659Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1169gitlab # [ 102.406926] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.663Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1170gitlab # [ 102.411036] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.667Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1171gitlab # [ 102.415670] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.672Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1172gitlab # [ 102.420139] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.676Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1173gitlab # [ 102.424439] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.681Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1174gitlab # [ 102.428816] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.685Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1175gitlab # [ 102.432703] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.689Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1176gitlab # [ 102.436753] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.693Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1177gitlab # [ 102.440667] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.697Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1178gitlab # [ 102.444219] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.700Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1179gitlab # [ 102.447934] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.704Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1180gitlab # [ 102.451664] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.708Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1181gitlab # [ 102.454622] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.711Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1182gitlab # [ 102.457893] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.714Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1183gitlab # [ 102.460339] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.716Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1184gitlab # [ 102.462413] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.719Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1185gitlab # [ 102.464440] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.721Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1186gitlab # [ 102.466486] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.723Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1187gitlab # [ 102.468481] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.725Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1188gitlab # [ 102.470566] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.727Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1189gitlab # [ 102.472807] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.729Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1190gitlab # [ 102.475504] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.732Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1191gitlab # [ 102.477687] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.734Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1192gitlab # [ 102.479963] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.736Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1193gitlab # [ 102.482342] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.738Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1194gitlab # [ 102.484613] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.741Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1195gitlab # [ 102.487099] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.743Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1196gitlab # [ 102.489468] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.746Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1197gitlab # [ 102.492197] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.748Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1198gitlab # [ 102.501298] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.757Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1199gitlab # [ 102.503868] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.760Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1200gitlab # [ 102.506504] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.763Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1201gitlab # [ 102.509095] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.765Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1202gitlab # [ 102.511512] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.768Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1203gitlab # [ 102.514232] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.770Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1204gitlab # [ 102.516331] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.772Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1205gitlab # [ 102.518564] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.775Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1206gitlab # [ 102.520783] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.777Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1207gitlab # [ 102.523026] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.779Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1208gitlab # [ 102.525582] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.782Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1209gitlab # [ 102.528207] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.784Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1210gitlab # [ 102.530561] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.787Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1211gitlab # [ 102.533357] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.789Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1212gitlab # [ 102.535472] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.792Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1213gitlab # [ 102.537437] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.794Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1214gitlab # [ 102.539409] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.796Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1215gitlab # [ 102.541566] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.798Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1216gitlab # [ 102.543470] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.800Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1217gitlab # [ 102.546178] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.802Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1218gitlab # [ 102.548111] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.804Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1219gitlab # [ 102.550167] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.806Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1220gitlab # [ 102.552293] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.808Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1221gitlab # [ 102.554504] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.811Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1222gitlab # [ 102.556783] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.813Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1223gitlab # [ 102.558819] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.815Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1224gitlab # [ 102.560935] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.817Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1225gitlab # [ 102.562755] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.819Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1226gitlab # [ 102.564928] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.821Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1227gitlab # [ 102.566990] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.823Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1228gitlab # [ 102.569528] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.826Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1229gitlab # [ 102.571789] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.828Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1230gitlab # [ 102.574233] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.830Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1231gitlab # [ 102.576344] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.832Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1232gitlab # [ 102.578770] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.835Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1233gitlab # [ 102.581611] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.838Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1234gitlab # [ 102.583632] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.840Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1235gitlab # [ 102.585590] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.842Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1236gitlab # [ 102.587693] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.844Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1237gitlab # [ 102.589680] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.846Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1238gitlab # [ 102.591825] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.848Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1239gitlab # [ 102.593853] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.850Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1240gitlab # [ 102.596432] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.853Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1241gitlab # [ 102.599091] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.855Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1242gitlab # [ 102.601227] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.857Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1243gitlab # [ 102.603332] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.859Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1244gitlab # [ 102.612916] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.869Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1245gitlab # [ 102.615298] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.871Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1246gitlab # [ 102.617407] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.874Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1247gitlab # [ 102.620361] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.876Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1248gitlab # [ 102.622965] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.879Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1249gitlab # [ 102.654610] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.911Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1250gitlab # [ 102.657168] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.913Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1251gitlab # [ 102.659642] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.916Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1252gitlab # [ 102.661888] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.918Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1253gitlab # [ 102.664983] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.921Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1254gitlab # [ 102.667459] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:10:43.924Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1255gitlab # [ 108.342795] gitlab-workhorse[825]: time="2026-08-20T06:10:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1256gitlab # [ 118.343882] gitlab-workhorse[825]: time="2026-08-20T06:10:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1257gitlab # [ 126.964649] postgres[2041]: [2041] ERROR: relation "table_without_models" does not exist1258gitlab # [ 126.965720] postgres[2041]: [2041] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1259gitlab # [ 128.345307] gitlab-workhorse[825]: time="2026-08-20T06:11:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 129.269254] postgres[2061]: [2061] ERROR: relation "table_without_models" does not exist1261gitlab # [ 129.271816] postgres[2061]: [2061] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1262gitlab # [ 129.518483] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:10.771Z","message":"Booted Rails 7.2.3.1 application in production environment"}1263gitlab # [ 129.519154] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:10.775Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1264gitlab # [ 129.520161] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:10.776Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1265gitlab # [ 129.520717] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:10.776Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1266gitlab # [ 129.528060] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:10.782Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1267gitlab # [ 130.871633] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:12.127Z","message":"Cleaning working queues"}1268gitlab # [ 130.872814] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:12.128Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d01b76e6690d5fcd87b5236f","created_at":"2026-08-20T06:10:13.021Z","trace_propagation_headers":{"sentry-trace":"69fcbafdef7c41f3a68a0dbf22ab1f36-e9c8164f99f34038","baggage":"sentry-trace_id=69fcbafdef7c41f3a68a0dbf22ab1f36,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2277421484a86353c42444f54a5f427c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:10:13.029Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d01b76e6690d5fcd87b5236f: start","job_status":"start","queue_duration_s":59.099295,"scheduling_latency_s":59.099338}1269gitlab # [ 131.069918] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:12.325Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d01b76e6690d5fcd87b5236f","created_at":"2026-08-20T06:10:13.021Z","trace_propagation_headers":{"sentry-trace":"69fcbafdef7c41f3a68a0dbf22ab1f36-e9c8164f99f34038","baggage":"sentry-trace_id=69fcbafdef7c41f3a68a0dbf22ab1f36,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2277421484a86353c42444f54a5f427c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:10:13.029Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d01b76e6690d5fcd87b5236f: done: 0.196955 sec","job_status":"done","queue_duration_s":59.099295,"scheduling_latency_s":59.099338,"redis_calls":31,"redis_duration_s":0.009082,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.00568,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002152,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.093369408,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.196955,"completed_at":"2026-08-20T06:11:12.325Z","load_balancing_strategy":"primary","db_duration_s":0.064295,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1270gitlab # [ 132.118976] bundle[1573]: {"timestamp":"2026-08-20T06:11:13.374Z","pid":1573,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1271gitlab # [ 132.120119] bundle[1573]: {"timestamp":"2026-08-20T06:11:13.374Z","pid":1573,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1272gitlab # [ 132.120749] bundle[1573]: {"timestamp":"2026-08-20T06:11:13.374Z","pid":1573,"message":"! #\u003cThread:0x00007016fc635e10 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1273gitlab # [ 132.121652] bundle[1573]: {"timestamp":"2026-08-20T06:11:13.374Z","pid":1573,"message":"! #\u003cThread:0x00007016fc832510 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1274gitlab # [ 132.122464] bundle[1573]: {"timestamp":"2026-08-20T06:11:13.375Z","pid":1573,"message":"Use Ctrl-C to stop"}1275gitlab # [ 132.131727] bundle[1573]: {"timestamp":"2026-08-20T06:11:13.375Z","pid":1573,"message":"Sending status to systemd every 1.0 sec"}1276gitlab # [ 132.845651] bundle[1573]: {"timestamp":"2026-08-20T06:11:14.101Z","pid":1573,"message":"- Worker 0 (PID: 2161) booted in 0.66s, phase: 0"}1277gitlab # [ 132.930495] bundle[1573]: {"timestamp":"2026-08-20T06:11:14.186Z","pid":1573,"message":"- Worker 1 (PID: 2165) booted in 0.72s, phase: 0"}1278gitlab # [ 132.936736] systemd[1]: Started gitlab.service.1279gitlab # [ 132.937986] systemd[1]: Reached target Common target for all GitLab services..1280gitlab # [ 132.941562] systemd[1]: Starting setup-gitlab.service...1281gitlab # [ 132.967996] setup-gitlab-start[2198]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1282gitlab # [ 134.992843] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:11:16 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 19931283gitlab # [ 135.000676] setup-gitlab-start[2198]: + TOKEN=nixbot-test-token-of-20-chars1284gitlab # [ 135.002140] setup-gitlab-start[2198]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1285gitlab # [ 135.024855] runuser[2216]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1286gitlab # [ 135.385274] setup-gitlab-start[2217]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1287gitlab # [ 135.387213] setup-gitlab-start[2217]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1288gitlab # [ 135.388579] setup-gitlab-start[2217]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1289gitlab # [ 135.951720] setup-gitlab-start[2217]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 135.953382] setup-gitlab-start[2217]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 135.954360] setup-gitlab-start[2217]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 144.034806] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"31213fbfd7e2db4a82231746","created_at":"2026-08-20T06:11:25.256Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae3ffee2ef190fcc55e2d0d456b66e22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.287Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-31213fbfd7e2db4a82231746: start","job_status":"start","queue_duration_s":0.002576,"scheduling_latency_s":0.00262}1293gitlab # [ 144.134849] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"31213fbfd7e2db4a82231746","created_at":"2026-08-20T06:11:25.256Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae3ffee2ef190fcc55e2d0d456b66e22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.287Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-31213fbfd7e2db4a82231746: done: 0.100518 sec","job_status":"done","queue_duration_s":0.002576,"scheduling_latency_s":0.00262,"redis_calls":12,"redis_duration_s":0.020886,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003636,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000588901,"duration_s":0.100518,"completed_at":"2026-08-20T06:11:25.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 144.197034] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"673d75a92e5ee39db0e6acac","created_at":"2026-08-20T06:11:25.324Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e94828bc637b1d004eb1722885da470","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.334Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-673d75a92e5ee39db0e6acac: start","job_status":"start","queue_duration_s":0.118264,"scheduling_latency_s":0.118312}1295gitlab # [ 144.218347] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.474Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1296gitlab # [ 144.241204] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"673d75a92e5ee39db0e6acac","created_at":"2026-08-20T06:11:25.324Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e94828bc637b1d004eb1722885da470","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.334Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-673d75a92e5ee39db0e6acac: done: 0.044122 sec","job_status":"done","queue_duration_s":0.118264,"scheduling_latency_s":0.118312,"redis_calls":10,"redis_duration_s":0.007372,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006234,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000639,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002172063,"duration_s":0.044122,"completed_at":"2026-08-20T06:11:25.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 144.275332] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ab789d6d1647bbd7bc2c7c88","created_at":"2026-08-20T06:11:25.361Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c8cbfba91f61aa1bb61c6787d1ba3f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.482Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ab789d6d1647bbd7bc2c7c88: start","job_status":"start","queue_duration_s":0.018667,"scheduling_latency_s":0.018701}1298gitlab # [ 144.290329] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.546Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1299gitlab # [ 144.303958] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ab789d6d1647bbd7bc2c7c88","created_at":"2026-08-20T06:11:25.361Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c8cbfba91f61aa1bb61c6787d1ba3f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.482Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ab789d6d1647bbd7bc2c7c88: done: 0.058733 sec","job_status":"done","queue_duration_s":0.018667,"scheduling_latency_s":0.018701,"redis_calls":10,"redis_duration_s":0.008575,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004752,"duration_s":0.058733,"completed_at":"2026-08-20T06:11:25.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 144.322799] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"3f41cc264db397fa695410ed","created_at":"2026-08-20T06:11:25.494Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.509Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-3f41cc264db397fa695410ed: start","job_status":"start","queue_duration_s":0.053154,"scheduling_latency_s":0.05318}1301gitlab # [ 144.509392] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.765Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"3f41cc264db397fa695410ed","created_at":"2026-08-20T06:11:25.494Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.509Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-3f41cc264db397fa695410ed: done: 0.202757 sec","job_status":"done","queue_duration_s":0.053154,"scheduling_latency_s":0.05318,"redis_calls":28,"redis_duration_s":0.06286,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004349,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000755,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.04205,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.015706,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000912966,"duration_s":0.202757,"completed_at":"2026-08-20T06:11:25.765Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 144.579962] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"459d9ffc8710e811adea4728","created_at":"2026-08-20T06:11:25.538Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b06669cd5a2a17a01ec4752afbccda82","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.557Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-459d9ffc8710e811adea4728: start","job_status":"start","queue_duration_s":0.278745,"scheduling_latency_s":0.278766}1303gitlab # [ 144.650758] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"459d9ffc8710e811adea4728","created_at":"2026-08-20T06:11:25.538Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b06669cd5a2a17a01ec4752afbccda82","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.557Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-459d9ffc8710e811adea4728: done: 0.07058 sec","job_status":"done","queue_duration_s":0.278745,"scheduling_latency_s":0.278766,"redis_calls":12,"redis_duration_s":0.017908,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.011541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002337,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000837816,"exclusive_lock_hold_duration_s":0.011297525,"duration_s":0.07058,"completed_at":"2026-08-20T06:11:25.906Z","load_balancing_strategy":"primary","db_duration_s":0.00582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 144.689108] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"67fef71b9e55fb8164d3bc40","created_at":"2026-08-20T06:11:25.576Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1989b28a7f3f2c5704a8b0b9b328a2fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.616Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-67fef71b9e55fb8164d3bc40: start","job_status":"start","queue_duration_s":0.328646,"scheduling_latency_s":0.32867}1305gitlab # [ 144.733938] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:25.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"67fef71b9e55fb8164d3bc40","created_at":"2026-08-20T06:11:25.576Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1989b28a7f3f2c5704a8b0b9b328a2fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.616Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-67fef71b9e55fb8164d3bc40: done: 0.044764 sec","job_status":"done","queue_duration_s":0.328646,"scheduling_latency_s":0.32867,"redis_calls":12,"redis_duration_s":0.013996,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003633,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001124724,"exclusive_lock_hold_duration_s":0.004313117,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.044764,"completed_at":"2026-08-20T06:11:25.990Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 144.782868] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"eea4638685171815695992f8","created_at":"2026-08-20T06:11:25.628Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e12918b0621a808a0afa43c7ab466246","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.637Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-eea4638685171815695992f8: start","job_status":"start","queue_duration_s":0.401703,"scheduling_latency_s":0.401753}1307gitlab # [ 144.838489] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"eea4638685171815695992f8","created_at":"2026-08-20T06:11:25.628Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e12918b0621a808a0afa43c7ab466246","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.637Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-eea4638685171815695992f8: done: 0.055366 sec","job_status":"done","queue_duration_s":0.401703,"scheduling_latency_s":0.401753,"redis_calls":13,"redis_duration_s":0.004852,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000697,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002334,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013353095,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.055366,"completed_at":"2026-08-20T06:11:26.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003306,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1308gitlab # [ 144.882305] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dac90baa49be463090bb3b4d","created_at":"2026-08-20T06:11:25.647Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b20089a547a93913cc1b5649fb1cc35","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.661Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dac90baa49be463090bb3b4d: start","job_status":"start","queue_duration_s":0.476748,"scheduling_latency_s":0.476794}1309gitlab # [ 144.939709] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dac90baa49be463090bb3b4d","created_at":"2026-08-20T06:11:25.647Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b20089a547a93913cc1b5649fb1cc35","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.661Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dac90baa49be463090bb3b4d: done: 0.057536 sec","job_status":"done","queue_duration_s":0.476748,"scheduling_latency_s":0.476794,"redis_calls":16,"redis_duration_s":0.0050620000000000005,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002527,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000564317,"duration_s":0.057536,"completed_at":"2026-08-20T06:11:26.195Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 144.989528] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a677840eeddb947e7d13f2c1","created_at":"2026-08-20T06:11:25.673Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.691Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a677840eeddb947e7d13f2c1: start","job_status":"start","queue_duration_s":0.553504,"scheduling_latency_s":0.553552}1311gitlab # [ 145.089776] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a677840eeddb947e7d13f2c1","created_at":"2026-08-20T06:11:25.673Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.691Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a677840eeddb947e7d13f2c1: done: 0.099792 sec","job_status":"done","queue_duration_s":0.553504,"scheduling_latency_s":0.553552,"redis_calls":71,"redis_duration_s":0.017978,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002861,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001192,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013073,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000289422,"duration_s":0.099792,"completed_at":"2026-08-20T06:11:26.345Z","load_balancing_strategy":"primary","db_duration_s":0.00185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 145.154934] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"978486689c0d13734f31d92c","created_at":"2026-08-20T06:11:25.730Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b9b4ebe3c92dc4a99e0c77be21f3dd7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.740Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-978486689c0d13734f31d92c: start","job_status":"start","queue_duration_s":0.671068,"scheduling_latency_s":0.671104}1313gitlab # [ 145.488863] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"978486689c0d13734f31d92c","created_at":"2026-08-20T06:11:25.730Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b9b4ebe3c92dc4a99e0c77be21f3dd7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.740Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-978486689c0d13734f31d92c: done: 0.334039 sec","job_status":"done","queue_duration_s":0.671068,"scheduling_latency_s":0.671104,"redis_calls":565,"redis_duration_s":0.109108,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000855,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.106973,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.240445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000294171,"duration_s":0.334039,"completed_at":"2026-08-20T06:11:26.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 145.559979] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"842d23f171e13e6f7070c45a","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-842d23f171e13e6f7070c45a: start","job_status":"start","queue_duration_s":1.004222,"scheduling_latency_s":1.004237}1315gitlab # [ 145.605740] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"842d23f171e13e6f7070c45a","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-842d23f171e13e6f7070c45a: done: 0.115379 sec","job_status":"done","queue_duration_s":1.004222,"scheduling_latency_s":1.004237,"redis_calls":16,"redis_duration_s":0.004875,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000802,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002819,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000394743,"duration_s":0.115379,"completed_at":"2026-08-20T06:11:26.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 145.645836] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d275109b181661212a46d5a0","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d275109b181661212a46d5a0: start","job_status":"start","queue_duration_s":1.121399,"scheduling_latency_s":1.121435}1317gitlab # [ 145.646802] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d275109b181661212a46d5a0","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d275109b181661212a46d5a0: done: 0.013865 sec","job_status":"done","queue_duration_s":1.121399,"scheduling_latency_s":1.121435,"redis_calls":13,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013865,"completed_at":"2026-08-20T06:11:26.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 145.653224] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fe3d72830ebe7aaed25ee65f","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fe3d72830ebe7aaed25ee65f: start","job_status":"start","queue_duration_s":1.1363,"scheduling_latency_s":1.136313}1319gitlab # [ 145.664294] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fe3d72830ebe7aaed25ee65f","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fe3d72830ebe7aaed25ee65f: done: 0.011826 sec","job_status":"done","queue_duration_s":1.1363,"scheduling_latency_s":1.136313,"redis_calls":13,"redis_duration_s":0.002672,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011826,"completed_at":"2026-08-20T06:11:26.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 145.709735] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"13c398fc96344a7fd47a6a27","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-13c398fc96344a7fd47a6a27: start","job_status":"start","queue_duration_s":1.149316,"scheduling_latency_s":1.149329}1321gitlab # [ 145.710638] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"13c398fc96344a7fd47a6a27","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-13c398fc96344a7fd47a6a27: done: 0.011944 sec","job_status":"done","queue_duration_s":1.149316,"scheduling_latency_s":1.149329,"redis_calls":13,"redis_duration_s":0.002811,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011944,"completed_at":"2026-08-20T06:11:26.903Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 145.752588] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"afc2b00f06b9836388ed4a1c","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-afc2b00f06b9836388ed4a1c: start","job_status":"start","queue_duration_s":1.162191,"scheduling_latency_s":1.162204}1323gitlab # [ 145.753280] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"afc2b00f06b9836388ed4a1c","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-afc2b00f06b9836388ed4a1c: done: 0.011918 sec","job_status":"done","queue_duration_s":1.162191,"scheduling_latency_s":1.162204,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011918,"completed_at":"2026-08-20T06:11:26.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 145.791789] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3bf401948445116951a8b399","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3bf401948445116951a8b399: start","job_status":"start","queue_duration_s":1.174996,"scheduling_latency_s":1.175009}1325gitlab # [ 145.792552] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3bf401948445116951a8b399","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3bf401948445116951a8b399: done: 0.01084 sec","job_status":"done","queue_duration_s":1.174996,"scheduling_latency_s":1.175009,"redis_calls":13,"redis_duration_s":0.001599,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01084,"completed_at":"2026-08-20T06:11:26.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 145.831961] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"27fe81198de1fa074dbed88b","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-27fe81198de1fa074dbed88b: start","job_status":"start","queue_duration_s":1.186814,"scheduling_latency_s":1.186827}1327gitlab # [ 145.832583] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"27fe81198de1fa074dbed88b","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-27fe81198de1fa074dbed88b: done: 0.01087 sec","job_status":"done","queue_duration_s":1.186814,"scheduling_latency_s":1.186827,"redis_calls":13,"redis_duration_s":0.002347,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001641,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01087,"completed_at":"2026-08-20T06:11:26.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 145.879503] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"15e8483dc1a7a32ad21e7dd8","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-15e8483dc1a7a32ad21e7dd8: start","job_status":"start","queue_duration_s":1.198899,"scheduling_latency_s":1.198913}1329gitlab # [ 145.880130] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"15e8483dc1a7a32ad21e7dd8","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-15e8483dc1a7a32ad21e7dd8: done: 0.011223 sec","job_status":"done","queue_duration_s":1.198899,"scheduling_latency_s":1.198913,"redis_calls":13,"redis_duration_s":0.0023829999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011223,"completed_at":"2026-08-20T06:11:26.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 145.917115] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cc371dc9b834e50f13b25652","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cc371dc9b834e50f13b25652: start","job_status":"start","queue_duration_s":1.2114,"scheduling_latency_s":1.211413}1331gitlab # [ 145.917723] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cc371dc9b834e50f13b25652","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cc371dc9b834e50f13b25652: done: 0.011757 sec","job_status":"done","queue_duration_s":1.2114,"scheduling_latency_s":1.211413,"redis_calls":13,"redis_duration_s":0.0028150000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011757,"completed_at":"2026-08-20T06:11:26.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 145.951822] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7cfb2ec71dd821dad76acb3d","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7cfb2ec71dd821dad76acb3d: start","job_status":"start","queue_duration_s":1.224144,"scheduling_latency_s":1.224157}1333gitlab # [ 145.952598] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7cfb2ec71dd821dad76acb3d","created_at":"2026-08-20T06:11:25.663Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-f52c6559edcf4158","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"34b23d98604393bafe640a596ad9f0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.742Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7cfb2ec71dd821dad76acb3d: done: 0.010262 sec","job_status":"done","queue_duration_s":1.224144,"scheduling_latency_s":1.224157,"redis_calls":13,"redis_duration_s":0.0015429999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010262,"completed_at":"2026-08-20T06:11:26.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 145.990973] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:26.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"51ca296c1d4050c20eb30f35","created_at":"2026-08-20T06:11:25.756Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6e5e662a17db8d0d65ef87dc8f55107","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.767Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-51ca296c1d4050c20eb30f35: start","job_status":"start","queue_duration_s":1.210089,"scheduling_latency_s":1.210103}1335gitlab # [ 145.991568] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"51ca296c1d4050c20eb30f35","created_at":"2026-08-20T06:11:25.756Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6e5e662a17db8d0d65ef87dc8f55107","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.767Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-51ca296c1d4050c20eb30f35: done: 0.023747 sec","job_status":"done","queue_duration_s":1.210089,"scheduling_latency_s":1.210103,"redis_calls":10,"redis_duration_s":0.001447,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254502,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.023747,"completed_at":"2026-08-20T06:11:27.001Z","load_balancing_strategy":"primary","db_duration_s":0.008264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 146.030160] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.002Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3bfca31a72cd17c4b09f6a2b","created_at":"2026-08-20T06:11:25.770Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ec0b9808bad5c1b9a1a9481594b0506","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.774Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3bfca31a72cd17c4b09f6a2b: start","job_status":"start","queue_duration_s":1.228328,"scheduling_latency_s":1.228344}1337gitlab # [ 146.064905] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3bfca31a72cd17c4b09f6a2b","created_at":"2026-08-20T06:11:25.770Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ec0b9808bad5c1b9a1a9481594b0506","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.774Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3bfca31a72cd17c4b09f6a2b: done: 0.017016 sec","job_status":"done","queue_duration_s":1.228328,"scheduling_latency_s":1.228344,"redis_calls":10,"redis_duration_s":0.001477,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239695,"duration_s":0.017016,"completed_at":"2026-08-20T06:11:27.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 146.065845] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f3aee0c81a1d8a1453dda1bb","created_at":"2026-08-20T06:11:25.780Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0edbe4e08fe470f46b7a273e4cb552bf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.783Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f3aee0c81a1d8a1453dda1bb: start","job_status":"start","queue_duration_s":1.237007,"scheduling_latency_s":1.23702}1339gitlab # [ 146.102211] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f3aee0c81a1d8a1453dda1bb","created_at":"2026-08-20T06:11:25.780Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0edbe4e08fe470f46b7a273e4cb552bf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.783Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f3aee0c81a1d8a1453dda1bb: done: 0.015135 sec","job_status":"done","queue_duration_s":1.237007,"scheduling_latency_s":1.23702,"redis_calls":10,"redis_duration_s":0.001252,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.015135,"completed_at":"2026-08-20T06:11:27.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 146.138921] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.036Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"398706e808e69fbd55f84bbb","created_at":"2026-08-20T06:11:25.792Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4414d049ad062853355ebfebd37c73d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.795Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-398706e808e69fbd55f84bbb: start","job_status":"start","queue_duration_s":1.24111,"scheduling_latency_s":1.241123}1341gitlab # [ 146.139590] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.043Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1342gitlab # [ 146.140164] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"398706e808e69fbd55f84bbb","created_at":"2026-08-20T06:11:25.792Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4414d049ad062853355ebfebd37c73d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.795Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-398706e808e69fbd55f84bbb: done: 0.011887 sec","job_status":"done","queue_duration_s":1.24111,"scheduling_latency_s":1.241123,"redis_calls":10,"redis_duration_s":0.0012259999999999999,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192203,"duration_s":0.011887,"completed_at":"2026-08-20T06:11:27.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 146.176138] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"03c906034ef6dd2184fcff6a","created_at":"2026-08-20T06:11:25.798Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.801Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-03c906034ef6dd2184fcff6a: start","job_status":"start","queue_duration_s":1.24774,"scheduling_latency_s":1.247753}1344gitlab # [ 146.176776] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"03c906034ef6dd2184fcff6a","created_at":"2026-08-20T06:11:25.798Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.801Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-03c906034ef6dd2184fcff6a: done: 0.022492 sec","job_status":"done","queue_duration_s":1.24774,"scheduling_latency_s":1.247753,"redis_calls":19,"redis_duration_s":0.0023409999999999998,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000241,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001233,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.022492,"completed_at":"2026-08-20T06:11:27.071Z","load_balancing_strategy":"primary","db_duration_s":0.00208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 146.213662] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"286a5c8e24331d409cdc720e","created_at":"2026-08-20T06:11:25.803Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b30280bd0a24367dee06238b13f63b66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:11:25.806Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-286a5c8e24331d409cdc720e: start","job_status":"start","queue_duration_s":1.26578,"scheduling_latency_s":1.265794}1346gitlab # [ 146.214408] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.079Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1347gitlab # [ 146.214996] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"286a5c8e24331d409cdc720e","created_at":"2026-08-20T06:11:25.803Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b30280bd0a24367dee06238b13f63b66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:11:25.806Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-286a5c8e24331d409cdc720e: done: 0.011787 sec","job_status":"done","queue_duration_s":1.26578,"scheduling_latency_s":1.265794,"redis_calls":10,"redis_duration_s":0.001209,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190807,"duration_s":0.011787,"completed_at":"2026-08-20T06:11:27.084Z","load_balancing_strategy":"primary","db_duration_s":0.000244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 146.264301] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"94521b7698be22df17892e16","created_at":"2026-08-20T06:11:25.813Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd1f82a1fc11483e92e04f7165a40163","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.816Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-94521b7698be22df17892e16: start","job_status":"start","queue_duration_s":1.269077,"scheduling_latency_s":1.269091}1349gitlab # [ 146.264857] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.092Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1350gitlab # [ 146.265443] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"94521b7698be22df17892e16","created_at":"2026-08-20T06:11:25.813Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd1f82a1fc11483e92e04f7165a40163","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.816Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-94521b7698be22df17892e16: done: 0.011386 sec","job_status":"done","queue_duration_s":1.269077,"scheduling_latency_s":1.269091,"redis_calls":10,"redis_duration_s":0.0012820000000000002,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196393,"duration_s":0.011386,"completed_at":"2026-08-20T06:11:27.096Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 146.312644] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"05b9eb4e8f037c754afe89ec","created_at":"2026-08-20T06:11:25.834Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d6b42206ea85a75925d9958de9882e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:11:25.852Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-05b9eb4e8f037c754afe89ec: start","job_status":"start","queue_duration_s":1.244974,"scheduling_latency_s":1.244987}1352gitlab # [ 146.313393] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"05b9eb4e8f037c754afe89ec","created_at":"2026-08-20T06:11:25.834Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d6b42206ea85a75925d9958de9882e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:11:25.852Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-05b9eb4e8f037c754afe89ec: done: 0.019111 sec","job_status":"done","queue_duration_s":1.244974,"scheduling_latency_s":1.244987,"redis_calls":10,"redis_duration_s":0.001278,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194997,"duration_s":0.019111,"completed_at":"2026-08-20T06:11:27.116Z","load_balancing_strategy":"primary","db_duration_s":0.00212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 146.350552] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.117Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"88c88b4ea9b874c6ede7131d","created_at":"2026-08-20T06:11:25.875Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b17a6d7f2e113e4bf0b8476c0d5c098","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:11:25.882Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-88c88b4ea9b874c6ede7131d: start","job_status":"start","queue_duration_s":1.235254,"scheduling_latency_s":1.235267}1354gitlab # [ 146.351194] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.127Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1355gitlab # [ 146.351802] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"88c88b4ea9b874c6ede7131d","created_at":"2026-08-20T06:11:25.875Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b17a6d7f2e113e4bf0b8476c0d5c098","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:11:25.882Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-88c88b4ea9b874c6ede7131d: done: 0.019512 sec","job_status":"done","queue_duration_s":1.235254,"scheduling_latency_s":1.235267,"redis_calls":10,"redis_duration_s":0.002056,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019807,"duration_s":0.019512,"completed_at":"2026-08-20T06:11:27.137Z","load_balancing_strategy":"primary","db_duration_s":0.000327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 146.400065] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a09e09881684492b40a083b7","created_at":"2026-08-20T06:11:25.890Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06a02b85e428330c62745b0372cdf5e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.903Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a09e09881684492b40a083b7: start","job_status":"start","queue_duration_s":1.234318,"scheduling_latency_s":1.234332}1357gitlab # [ 146.400670] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a09e09881684492b40a083b7","created_at":"2026-08-20T06:11:25.890Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06a02b85e428330c62745b0372cdf5e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.903Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a09e09881684492b40a083b7: done: 0.037342 sec","job_status":"done","queue_duration_s":1.234318,"scheduling_latency_s":1.234332,"redis_calls":12,"redis_duration_s":0.00223,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001294,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000329372,"exclusive_lock_hold_duration_s":0.022107837999999998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.037342,"completed_at":"2026-08-20T06:11:27.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006796,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 146.437922] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"08004d17f67b5cba06750cdc","created_at":"2026-08-20T06:11:25.949Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae1994b5542b5b886e0063469ca1b4e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.966Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-08004d17f67b5cba06750cdc: start","job_status":"start","queue_duration_s":1.210426,"scheduling_latency_s":1.21044}1359gitlab # [ 146.439692] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"08004d17f67b5cba06750cdc","created_at":"2026-08-20T06:11:25.949Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae1994b5542b5b886e0063469ca1b4e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.966Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-08004d17f67b5cba06750cdc: done: 0.025899 sec","job_status":"done","queue_duration_s":1.210426,"scheduling_latency_s":1.21044,"redis_calls":14,"redis_duration_s":0.001809,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000318476,"exclusive_lock_hold_duration_s":0.012072484,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.025899,"completed_at":"2026-08-20T06:11:27.202Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 146.479276] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"40970bb91dfeefa9783e4438","created_at":"2026-08-20T06:11:25.975Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12d7979c12940cea9d9e67a13f49460d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.985Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-40970bb91dfeefa9783e4438: start","job_status":"start","queue_duration_s":1.217598,"scheduling_latency_s":1.217611}1361gitlab # [ 146.486585] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"40970bb91dfeefa9783e4438","created_at":"2026-08-20T06:11:25.975Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12d7979c12940cea9d9e67a13f49460d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:11:25.985Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-40970bb91dfeefa9783e4438: done: 0.128179 sec","job_status":"done","queue_duration_s":1.217598,"scheduling_latency_s":1.217611,"redis_calls":12,"redis_duration_s":0.001895,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000367644,"exclusive_lock_hold_duration_s":0.111556916,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.128179,"completed_at":"2026-08-20T06:11:27.331Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 146.538886] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9400c01cf9fdcedb5ee670ba","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9400c01cf9fdcedb5ee670ba: start","job_status":"start","queue_duration_s":0.99495,"scheduling_latency_s":0.994965}1363gitlab # [ 146.539615] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9400c01cf9fdcedb5ee670ba","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9400c01cf9fdcedb5ee670ba: done: 0.014604 sec","job_status":"done","queue_duration_s":0.99495,"scheduling_latency_s":0.994965,"redis_calls":16,"redis_duration_s":0.002035,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197232,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014604,"completed_at":"2026-08-20T06:11:27.347Z","load_balancing_strategy":"primary","db_duration_s":0.000312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 146.587895] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b27d2600ef1c0127b99ab05","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b27d2600ef1c0127b99ab05: start","job_status":"start","queue_duration_s":1.010529,"scheduling_latency_s":1.010541}1365gitlab # [ 146.588556] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b27d2600ef1c0127b99ab05","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b27d2600ef1c0127b99ab05: done: 0.009598 sec","job_status":"done","queue_duration_s":1.010529,"scheduling_latency_s":1.010541,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009598,"completed_at":"2026-08-20T06:11:27.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 146.603582] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0c782f2c44c38963ad03b7","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0c782f2c44c38963ad03b7: start","job_status":"start","queue_duration_s":1.025163,"scheduling_latency_s":1.025178}1367gitlab # [ 146.613151] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0c782f2c44c38963ad03b7","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0c782f2c44c38963ad03b7: done: 0.009523 sec","job_status":"done","queue_duration_s":1.025163,"scheduling_latency_s":1.025178,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009523,"completed_at":"2026-08-20T06:11:27.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 146.664054] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20eba1ee1740d961a5d03ba6","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20eba1ee1740d961a5d03ba6: start","job_status":"start","queue_duration_s":1.035472,"scheduling_latency_s":1.035485}1369gitlab # [ 146.664706] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20eba1ee1740d961a5d03ba6","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20eba1ee1740d961a5d03ba6: done: 0.009447 sec","job_status":"done","queue_duration_s":1.035472,"scheduling_latency_s":1.035485,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009447,"completed_at":"2026-08-20T06:11:27.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 146.708608] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22448a1f13fe18dff619ab1e","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22448a1f13fe18dff619ab1e: start","job_status":"start","queue_duration_s":1.045796,"scheduling_latency_s":1.045809}1371gitlab # [ 146.709431] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22448a1f13fe18dff619ab1e","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22448a1f13fe18dff619ab1e: done: 0.010321 sec","job_status":"done","queue_duration_s":1.045796,"scheduling_latency_s":1.045809,"redis_calls":13,"redis_duration_s":0.0017569999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010321,"completed_at":"2026-08-20T06:11:27.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 146.726144] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6b747c7d5546c9d7b05fd84","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6b747c7d5546c9d7b05fd84: start","job_status":"start","queue_duration_s":1.056913,"scheduling_latency_s":1.056926}1373gitlab # [ 146.760650] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6b747c7d5546c9d7b05fd84","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6b747c7d5546c9d7b05fd84: done: 0.009747 sec","job_status":"done","queue_duration_s":1.056913,"scheduling_latency_s":1.056926,"redis_calls":13,"redis_duration_s":0.0018089999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009747,"completed_at":"2026-08-20T06:11:27.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 146.766823] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"260c73cee9e396ba51c986cb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-260c73cee9e396ba51c986cb: start","job_status":"start","queue_duration_s":1.067525,"scheduling_latency_s":1.067537}1375gitlab # [ 146.776912] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"260c73cee9e396ba51c986cb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-260c73cee9e396ba51c986cb: done: 0.009554 sec","job_status":"done","queue_duration_s":1.067525,"scheduling_latency_s":1.067537,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009554,"completed_at":"2026-08-20T06:11:27.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 146.838785] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d57a9082b54b2450156ebc0","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d57a9082b54b2450156ebc0: start","job_status":"start","queue_duration_s":1.077895,"scheduling_latency_s":1.077907}1377gitlab # [ 146.839392] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d57a9082b54b2450156ebc0","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d57a9082b54b2450156ebc0: done: 0.009615 sec","job_status":"done","queue_duration_s":1.077895,"scheduling_latency_s":1.077907,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009615,"completed_at":"2026-08-20T06:11:27.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 146.849128] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"851cab8e0e01ad4fd799318c","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-851cab8e0e01ad4fd799318c: start","job_status":"start","queue_duration_s":1.088346,"scheduling_latency_s":1.088359}1379gitlab # [ 146.859249] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"851cab8e0e01ad4fd799318c","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-851cab8e0e01ad4fd799318c: done: 0.009973 sec","job_status":"done","queue_duration_s":1.088346,"scheduling_latency_s":1.088359,"redis_calls":13,"redis_duration_s":0.002138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009973,"completed_at":"2026-08-20T06:11:27.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 146.901218] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bf30e361897952ff35b17ba","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bf30e361897952ff35b17ba: start","job_status":"start","queue_duration_s":1.099339,"scheduling_latency_s":1.099352}1381gitlab # [ 146.901864] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bf30e361897952ff35b17ba","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bf30e361897952ff35b17ba: done: 0.009458 sec","job_status":"done","queue_duration_s":1.099339,"scheduling_latency_s":1.099352,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009458,"completed_at":"2026-08-20T06:11:27.446Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 146.956588] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"211f653a76dfde4b28f3ca10","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-211f653a76dfde4b28f3ca10: start","job_status":"start","queue_duration_s":1.110235,"scheduling_latency_s":1.110248}1383gitlab # [ 146.957259] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"211f653a76dfde4b28f3ca10","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-211f653a76dfde4b28f3ca10: done: 0.009401 sec","job_status":"done","queue_duration_s":1.110235,"scheduling_latency_s":1.110248,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-08-20T06:11:27.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 146.972863] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46d87e535dc858eaad4133af","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46d87e535dc858eaad4133af: start","job_status":"start","queue_duration_s":1.120738,"scheduling_latency_s":1.120751}1385gitlab # [ 146.982943] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46d87e535dc858eaad4133af","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46d87e535dc858eaad4133af: done: 0.009567 sec","job_status":"done","queue_duration_s":1.120738,"scheduling_latency_s":1.120751,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009567,"completed_at":"2026-08-20T06:11:27.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 147.025069] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ef82cb5f63a0f3b6d658b1","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ef82cb5f63a0f3b6d658b1: start","job_status":"start","queue_duration_s":1.131333,"scheduling_latency_s":1.131346}1387gitlab # [ 147.025692] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ef82cb5f63a0f3b6d658b1","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ef82cb5f63a0f3b6d658b1: done: 0.058808 sec","job_status":"done","queue_duration_s":1.131333,"scheduling_latency_s":1.131346,"redis_calls":13,"redis_duration_s":0.001866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.058808,"completed_at":"2026-08-20T06:11:27.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 147.084668] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"163df1a87dcd102706b59610","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-163df1a87dcd102706b59610: start","job_status":"start","queue_duration_s":1.19122,"scheduling_latency_s":1.191238}1389gitlab # [ 147.085444] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"163df1a87dcd102706b59610","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-163df1a87dcd102706b59610: done: 0.010237 sec","job_status":"done","queue_duration_s":1.19122,"scheduling_latency_s":1.191238,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010237,"completed_at":"2026-08-20T06:11:27.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 147.128538] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"303ef85ca35e16fd79badb1f","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-303ef85ca35e16fd79badb1f: start","job_status":"start","queue_duration_s":1.202299,"scheduling_latency_s":1.202312}1391gitlab # [ 147.129179] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"303ef85ca35e16fd79badb1f","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-303ef85ca35e16fd79badb1f: done: 0.008881 sec","job_status":"done","queue_duration_s":1.202299,"scheduling_latency_s":1.202312,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008881,"completed_at":"2026-08-20T06:11:27.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 147.135934] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56c1ebda29f5ec336c9e5761","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56c1ebda29f5ec336c9e5761: start","job_status":"start","queue_duration_s":1.212345,"scheduling_latency_s":1.212357}1393gitlab # [ 147.145937] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56c1ebda29f5ec336c9e5761","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56c1ebda29f5ec336c9e5761: done: 0.009065 sec","job_status":"done","queue_duration_s":1.212345,"scheduling_latency_s":1.212357,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009065,"completed_at":"2026-08-20T06:11:27.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 147.187057] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"389f06ddf09e14387d94f786","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-389f06ddf09e14387d94f786: start","job_status":"start","queue_duration_s":1.222245,"scheduling_latency_s":1.222258}1395gitlab # [ 147.187761] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"389f06ddf09e14387d94f786","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-389f06ddf09e14387d94f786: done: 0.009218 sec","job_status":"done","queue_duration_s":1.222245,"scheduling_latency_s":1.222258,"redis_calls":13,"redis_duration_s":0.0016870000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009218,"completed_at":"2026-08-20T06:11:27.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 147.233975] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b62f8f0f255834affcec038","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b62f8f0f255834affcec038: start","job_status":"start","queue_duration_s":1.232373,"scheduling_latency_s":1.232386}1397gitlab # [ 147.234612] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b62f8f0f255834affcec038","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b62f8f0f255834affcec038: done: 0.009036 sec","job_status":"done","queue_duration_s":1.232373,"scheduling_latency_s":1.232386,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009036,"completed_at":"2026-08-20T06:11:27.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 147.270961] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68b4fab4edd9a2a3820cf903","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68b4fab4edd9a2a3820cf903: start","job_status":"start","queue_duration_s":1.24226,"scheduling_latency_s":1.242272}1399gitlab # [ 147.271612] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68b4fab4edd9a2a3820cf903","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68b4fab4edd9a2a3820cf903: done: 0.008994 sec","job_status":"done","queue_duration_s":1.24226,"scheduling_latency_s":1.242272,"redis_calls":13,"redis_duration_s":0.0015090000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008994,"completed_at":"2026-08-20T06:11:27.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 147.324617] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6782ee4e628b6fa5f591317f","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6782ee4e628b6fa5f591317f: start","job_status":"start","queue_duration_s":1.252522,"scheduling_latency_s":1.253055}1401gitlab # [ 147.325396] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6782ee4e628b6fa5f591317f","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6782ee4e628b6fa5f591317f: done: 0.01266 sec","job_status":"done","queue_duration_s":1.252522,"scheduling_latency_s":1.253055,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01266,"completed_at":"2026-08-20T06:11:27.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 147.371714] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c24ab4659ff7e04f0303d1b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c24ab4659ff7e04f0303d1b: start","job_status":"start","queue_duration_s":1.26597,"scheduling_latency_s":1.265984}1403gitlab # [ 147.372481] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c24ab4659ff7e04f0303d1b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c24ab4659ff7e04f0303d1b: done: 0.019017 sec","job_status":"done","queue_duration_s":1.26597,"scheduling_latency_s":1.265984,"redis_calls":13,"redis_duration_s":0.011489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019017,"completed_at":"2026-08-20T06:11:27.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 147.380903] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d812797297b6a1b98fa1d4eb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d812797297b6a1b98fa1d4eb: start","job_status":"start","queue_duration_s":1.285875,"scheduling_latency_s":1.285888}1405gitlab # [ 147.415951] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d812797297b6a1b98fa1d4eb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d812797297b6a1b98fa1d4eb: done: 0.009036 sec","job_status":"done","queue_duration_s":1.285875,"scheduling_latency_s":1.285888,"redis_calls":13,"redis_duration_s":0.0018180000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009036,"completed_at":"2026-08-20T06:11:27.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 147.454153] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845091fec61395ff2a856fee","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845091fec61395ff2a856fee: start","job_status":"start","queue_duration_s":1.295763,"scheduling_latency_s":1.295775}1407gitlab # [ 147.454872] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845091fec61395ff2a856fee","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845091fec61395ff2a856fee: done: 0.009462 sec","job_status":"done","queue_duration_s":1.295763,"scheduling_latency_s":1.295775,"redis_calls":13,"redis_duration_s":0.001987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009462,"completed_at":"2026-08-20T06:11:27.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 147.489616] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c839145c2b65ffd063f5b795","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c839145c2b65ffd063f5b795: start","job_status":"start","queue_duration_s":1.306317,"scheduling_latency_s":1.306329}1409gitlab # [ 147.490226] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c839145c2b65ffd063f5b795","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c839145c2b65ffd063f5b795: done: 0.008878 sec","job_status":"done","queue_duration_s":1.306317,"scheduling_latency_s":1.306329,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008878,"completed_at":"2026-08-20T06:11:27.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 147.525493] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dfbbdabaaadd7b88bd798ac","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dfbbdabaaadd7b88bd798ac: start","job_status":"start","queue_duration_s":1.315949,"scheduling_latency_s":1.315961}1411gitlab # [ 147.526107] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dfbbdabaaadd7b88bd798ac","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dfbbdabaaadd7b88bd798ac: done: 0.01251 sec","job_status":"done","queue_duration_s":1.315949,"scheduling_latency_s":1.315961,"redis_calls":13,"redis_duration_s":0.004707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01251,"completed_at":"2026-08-20T06:11:27.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 147.544095] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80c0a0e90f82af96e690dc9b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80c0a0e90f82af96e690dc9b: start","job_status":"start","queue_duration_s":1.329575,"scheduling_latency_s":1.329589}1413gitlab # [ 147.554101] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80c0a0e90f82af96e690dc9b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80c0a0e90f82af96e690dc9b: done: 0.008903 sec","job_status":"done","queue_duration_s":1.329575,"scheduling_latency_s":1.329589,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008903,"completed_at":"2026-08-20T06:11:27.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 147.597653] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"626b0fc28181535a99afb214","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-626b0fc28181535a99afb214: start","job_status":"start","queue_duration_s":1.33961,"scheduling_latency_s":1.339623}1415gitlab # [ 147.597868] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"626b0fc28181535a99afb214","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-626b0fc28181535a99afb214: done: 0.009003 sec","job_status":"done","queue_duration_s":1.33961,"scheduling_latency_s":1.339623,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009003,"completed_at":"2026-08-20T06:11:27.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 147.636087] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4237330f60487f363e3a65c9","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4237330f60487f363e3a65c9: start","job_status":"start","queue_duration_s":1.34943,"scheduling_latency_s":1.349443}1417gitlab # [ 147.636743] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4237330f60487f363e3a65c9","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4237330f60487f363e3a65c9: done: 0.014095 sec","job_status":"done","queue_duration_s":1.34943,"scheduling_latency_s":1.349443,"redis_calls":13,"redis_duration_s":0.006494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004294,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014095,"completed_at":"2026-08-20T06:11:27.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 147.671209] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ebf2479325fa7c4ed4b1ff3","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ebf2479325fa7c4ed4b1ff3: start","job_status":"start","queue_duration_s":1.364408,"scheduling_latency_s":1.36442}1419gitlab # [ 147.705337] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ebf2479325fa7c4ed4b1ff3","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ebf2479325fa7c4ed4b1ff3: done: 0.008925 sec","job_status":"done","queue_duration_s":1.364408,"scheduling_latency_s":1.36442,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008925,"completed_at":"2026-08-20T06:11:27.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 147.706389] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f068a7189d46f5d2b813d453","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f068a7189d46f5d2b813d453: start","job_status":"start","queue_duration_s":1.374509,"scheduling_latency_s":1.374522}1421gitlab # [ 147.742867] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f068a7189d46f5d2b813d453","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f068a7189d46f5d2b813d453: done: 0.008933 sec","job_status":"done","queue_duration_s":1.374509,"scheduling_latency_s":1.374522,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008933,"completed_at":"2026-08-20T06:11:27.720Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 147.745597] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db8bdad3fcd2ace95cb3e09e","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db8bdad3fcd2ace95cb3e09e: start","job_status":"start","queue_duration_s":1.384276,"scheduling_latency_s":1.384288}1423gitlab # [ 147.783190] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db8bdad3fcd2ace95cb3e09e","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db8bdad3fcd2ace95cb3e09e: done: 0.008841 sec","job_status":"done","queue_duration_s":1.384276,"scheduling_latency_s":1.384288,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008841,"completed_at":"2026-08-20T06:11:27.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 147.785548] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f626f2675377ae802739b67a","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f626f2675377ae802739b67a: start","job_status":"start","queue_duration_s":1.393945,"scheduling_latency_s":1.393958}1425gitlab # [ 147.826891] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f626f2675377ae802739b67a","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f626f2675377ae802739b67a: done: 0.015532 sec","job_status":"done","queue_duration_s":1.393945,"scheduling_latency_s":1.393958,"redis_calls":13,"redis_duration_s":0.007725999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015532,"completed_at":"2026-08-20T06:11:27.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 147.827864] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eed2149aa12474da80dbe82a","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eed2149aa12474da80dbe82a: start","job_status":"start","queue_duration_s":1.414296,"scheduling_latency_s":1.41431}1427gitlab # [ 147.861774] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eed2149aa12474da80dbe82a","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eed2149aa12474da80dbe82a: done: 0.012757 sec","job_status":"done","queue_duration_s":1.414296,"scheduling_latency_s":1.41431,"redis_calls":13,"redis_duration_s":0.004176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002631,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012757,"completed_at":"2026-08-20T06:11:27.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 147.864842] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b554fe50cd19fd6a5a03254d","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b554fe50cd19fd6a5a03254d: start","job_status":"start","queue_duration_s":1.427891,"scheduling_latency_s":1.427904}1429gitlab # [ 147.906633] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b554fe50cd19fd6a5a03254d","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b554fe50cd19fd6a5a03254d: done: 0.009042 sec","job_status":"done","queue_duration_s":1.427891,"scheduling_latency_s":1.427904,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009042,"completed_at":"2026-08-20T06:11:27.774Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 147.907484] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99ee326740e7535821f89e1","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99ee326740e7535821f89e1: start","job_status":"start","queue_duration_s":1.437712,"scheduling_latency_s":1.437725}1431gitlab # [ 147.940742] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99ee326740e7535821f89e1","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99ee326740e7535821f89e1: done: 0.009065 sec","job_status":"done","queue_duration_s":1.437712,"scheduling_latency_s":1.437725,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009065,"completed_at":"2026-08-20T06:11:27.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 147.943880] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7b5a05ec25c3539f359272","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7b5a05ec25c3539f359272: start","job_status":"start","queue_duration_s":1.447576,"scheduling_latency_s":1.447589}1433gitlab # [ 147.977785] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7b5a05ec25c3539f359272","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7b5a05ec25c3539f359272: done: 0.009026 sec","job_status":"done","queue_duration_s":1.447576,"scheduling_latency_s":1.447589,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009026,"completed_at":"2026-08-20T06:11:27.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 148.015814] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1657e521ae40a4bdf3c01885","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1657e521ae40a4bdf3c01885: start","job_status":"start","queue_duration_s":1.46235,"scheduling_latency_s":1.462365}1435gitlab # [ 148.016570] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1657e521ae40a4bdf3c01885","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1657e521ae40a4bdf3c01885: done: 0.013875 sec","job_status":"done","queue_duration_s":1.46235,"scheduling_latency_s":1.462365,"redis_calls":13,"redis_duration_s":0.0049700000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003395,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013875,"completed_at":"2026-08-20T06:11:27.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 148.051534] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07ffb93b2b1e533502fa1eb3","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07ffb93b2b1e533502fa1eb3: start","job_status":"start","queue_duration_s":1.476993,"scheduling_latency_s":1.477006}1437gitlab # [ 148.052234] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07ffb93b2b1e533502fa1eb3","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07ffb93b2b1e533502fa1eb3: done: 0.009269 sec","job_status":"done","queue_duration_s":1.476993,"scheduling_latency_s":1.477006,"redis_calls":13,"redis_duration_s":0.0014459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009269,"completed_at":"2026-08-20T06:11:27.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 148.088860] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2f4d370805f45ad8d3a0709","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2f4d370805f45ad8d3a0709: start","job_status":"start","queue_duration_s":1.487026,"scheduling_latency_s":1.487038}1439gitlab # [ 148.089083] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2f4d370805f45ad8d3a0709","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2f4d370805f45ad8d3a0709: done: 0.009102 sec","job_status":"done","queue_duration_s":1.487026,"scheduling_latency_s":1.487038,"redis_calls":13,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009102,"completed_at":"2026-08-20T06:11:27.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 148.132434] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fe184383666b6cef68f985e","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fe184383666b6cef68f985e: start","job_status":"start","queue_duration_s":1.496931,"scheduling_latency_s":1.496944}1441gitlab # [ 148.133093] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fe184383666b6cef68f985e","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fe184383666b6cef68f985e: done: 0.009073 sec","job_status":"done","queue_duration_s":1.496931,"scheduling_latency_s":1.496944,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009073,"completed_at":"2026-08-20T06:11:27.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 148.170480] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2f973f0ef1b04689a40d5cb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2f973f0ef1b04689a40d5cb: start","job_status":"start","queue_duration_s":1.51227,"scheduling_latency_s":1.512283}1443gitlab # [ 148.171151] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2f973f0ef1b04689a40d5cb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2f973f0ef1b04689a40d5cb: done: 0.018201 sec","job_status":"done","queue_duration_s":1.51227,"scheduling_latency_s":1.512283,"redis_calls":13,"redis_duration_s":0.007457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005524,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018201,"completed_at":"2026-08-20T06:11:27.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 148.214157] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41571b9089c5aa89ff2dedf9","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41571b9089c5aa89ff2dedf9: start","job_status":"start","queue_duration_s":1.531707,"scheduling_latency_s":1.531727}1445gitlab # [ 148.214837] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41571b9089c5aa89ff2dedf9","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41571b9089c5aa89ff2dedf9: done: 0.010187 sec","job_status":"done","queue_duration_s":1.531707,"scheduling_latency_s":1.531727,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010187,"completed_at":"2026-08-20T06:11:27.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 148.250544] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6437ad5af3d69e52a184961f","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6437ad5af3d69e52a184961f: start","job_status":"start","queue_duration_s":1.542689,"scheduling_latency_s":1.542702}1447gitlab # [ 148.251205] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6437ad5af3d69e52a184961f","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6437ad5af3d69e52a184961f: done: 0.009372 sec","job_status":"done","queue_duration_s":1.542689,"scheduling_latency_s":1.542702,"redis_calls":13,"redis_duration_s":0.002038,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-08-20T06:11:27.889Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 148.284978] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8b475d473b01a1223c0aa6b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8b475d473b01a1223c0aa6b: start","job_status":"start","queue_duration_s":1.552896,"scheduling_latency_s":1.552909}1449gitlab # [ 148.285614] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8b475d473b01a1223c0aa6b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8b475d473b01a1223c0aa6b: done: 0.008923 sec","job_status":"done","queue_duration_s":1.552896,"scheduling_latency_s":1.552909,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008923,"completed_at":"2026-08-20T06:11:27.899Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 148.337551] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fddb09235a6f398db861fbb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fddb09235a6f398db861fbb: start","job_status":"start","queue_duration_s":1.562975,"scheduling_latency_s":1.562988}1451gitlab # [ 148.338227] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fddb09235a6f398db861fbb","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fddb09235a6f398db861fbb: done: 0.008882 sec","job_status":"done","queue_duration_s":1.562975,"scheduling_latency_s":1.562988,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008882,"completed_at":"2026-08-20T06:11:27.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 148.345547] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acb9f416c842bcc8e92a3a4b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acb9f416c842bcc8e92a3a4b: start","job_status":"start","queue_duration_s":1.572657,"scheduling_latency_s":1.57267}1453gitlab # [ 148.355535] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acb9f416c842bcc8e92a3a4b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acb9f416c842bcc8e92a3a4b: done: 0.008938 sec","job_status":"done","queue_duration_s":1.572657,"scheduling_latency_s":1.57267,"redis_calls":13,"redis_duration_s":0.001476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008938,"completed_at":"2026-08-20T06:11:27.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 148.409300] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60310b2efce470916dcd9062","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60310b2efce470916dcd9062: start","job_status":"start","queue_duration_s":1.583055,"scheduling_latency_s":1.583068}1455gitlab # [ 148.409903] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60310b2efce470916dcd9062","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60310b2efce470916dcd9062: done: 0.014196 sec","job_status":"done","queue_duration_s":1.583055,"scheduling_latency_s":1.583068,"redis_calls":13,"redis_duration_s":0.006372000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014196,"completed_at":"2026-08-20T06:11:27.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 148.427160] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1df2bb366913008eabe1637","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1df2bb366913008eabe1637: start","job_status":"start","queue_duration_s":1.598044,"scheduling_latency_s":1.598058}1457gitlab # [ 148.437141] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1df2bb366913008eabe1637","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1df2bb366913008eabe1637: done: 0.009298 sec","job_status":"done","queue_duration_s":1.598044,"scheduling_latency_s":1.598058,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009298,"completed_at":"2026-08-20T06:11:27.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 148.481712] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9678917eb0809589e1c565b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9678917eb0809589e1c565b: start","job_status":"start","queue_duration_s":1.60824,"scheduling_latency_s":1.608253}1459gitlab # [ 148.482444] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9678917eb0809589e1c565b","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9678917eb0809589e1c565b: done: 0.008835 sec","job_status":"done","queue_duration_s":1.60824,"scheduling_latency_s":1.608253,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008835,"completed_at":"2026-08-20T06:11:27.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 148.508825] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc7d595ba9ea776afd42cde0","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc7d595ba9ea776afd42cde0: start","job_status":"start","queue_duration_s":1.617938,"scheduling_latency_s":1.617951}1461gitlab # [ 148.549172] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc7d595ba9ea776afd42cde0","created_at":"2026-08-20T06:11:26.274Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-b1abf28cba24407d","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d1123763861ec9110f4cb37825e7a6dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:26.337Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc7d595ba9ea776afd42cde0: done: 0.008936 sec","job_status":"done","queue_duration_s":1.617938,"scheduling_latency_s":1.617951,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008936,"completed_at":"2026-08-20T06:11:27.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 148.550135] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.970Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d0e6c231d54601480b514d8e","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d0e6c231d54601480b514d8e: start","job_status":"start","queue_duration_s":0.90407,"scheduling_latency_s":0.904083}1463gitlab # [ 148.558780] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.986Z","message":"No existing merge request to be cleaned up."}1464gitlab # [ 148.560087] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.994Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d0e6c231d54601480b514d8e","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d0e6c231d54601480b514d8e: done: 0.023707 sec","job_status":"done","queue_duration_s":0.90407,"scheduling_latency_s":0.904083,"redis_calls":13,"redis_duration_s":0.00415,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000794,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001655,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238857,"duration_s":0.023707,"completed_at":"2026-08-20T06:11:27.994Z","load_balancing_strategy":"primary","db_duration_s":0.004627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 148.605501] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:27.995Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2031f33c185b10ed37c96e9","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2031f33c185b10ed37c96e9: start","job_status":"start","queue_duration_s":0.928612,"scheduling_latency_s":0.928625}1466gitlab # [ 148.606196] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.001Z","message":"No existing merge request to be cleaned up."}1467gitlab # [ 148.606597] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.005Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2031f33c185b10ed37c96e9","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2031f33c185b10ed37c96e9: done: 0.010354 sec","job_status":"done","queue_duration_s":0.928612,"scheduling_latency_s":0.928625,"redis_calls":10,"redis_duration_s":0.001204,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010354,"completed_at":"2026-08-20T06:11:28.005Z","load_balancing_strategy":"primary","db_duration_s":0.00098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 148.633526] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.006Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bfce8074d4560d07a66452df","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bfce8074d4560d07a66452df: start","job_status":"start","queue_duration_s":0.939741,"scheduling_latency_s":0.939764}1469gitlab # [ 148.643338] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.012Z","message":"No existing merge request to be cleaned up."}1470gitlab # [ 148.644668] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.016Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bfce8074d4560d07a66452df","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bfce8074d4560d07a66452df: done: 0.010018 sec","job_status":"done","queue_duration_s":0.939741,"scheduling_latency_s":0.939764,"redis_calls":10,"redis_duration_s":0.001274,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010018,"completed_at":"2026-08-20T06:11:28.016Z","load_balancing_strategy":"primary","db_duration_s":0.000905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 148.683581] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.021Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"724b7553fab293cf07d302e1","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-724b7553fab293cf07d302e1: start","job_status":"start","queue_duration_s":0.955087,"scheduling_latency_s":0.955102}1472gitlab # [ 148.684200] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.034Z","message":"No existing merge request to be cleaned up."}1473gitlab # [ 148.685501] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:11:28.043Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"724b7553fab293cf07d302e1","created_at":"2026-08-20T06:11:27.059Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-852e502c54c1411f","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"857434ba43040f768c421c463ce36fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:11:27.066Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-724b7553fab293cf07d302e1: done: 0.021186 sec","job_status":"done","queue_duration_s":0.955087,"scheduling_latency_s":0.955102,"redis_calls":10,"redis_duration_s":0.007519,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004713,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021186,"completed_at":"2026-08-20T06:11:28.043Z","load_balancing_strategy":"primary","db_duration_s":0.007633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 148.889449] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2458115637 wd_nsec: 24581153861475gitlab # [ 160.941649] setup-gitlab-start[2217]: W, [2026-08-20T06:11:42.197370 #2217] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1476gitlab # [ 181.800603] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0f2d8f3633b8701ac5ed810e","created_at":"2026-08-20T06:12:03.008Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f85b39f38e4c09751ce7198dbb22d43b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.053Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0f2d8f3633b8701ac5ed810e: start","job_status":"start","queue_duration_s":0.002389,"scheduling_latency_s":0.002436}1477gitlab # [ 181.856048] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0f2d8f3633b8701ac5ed810e","created_at":"2026-08-20T06:12:03.008Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f85b39f38e4c09751ce7198dbb22d43b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.053Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0f2d8f3633b8701ac5ed810e: done: 0.055701 sec","job_status":"done","queue_duration_s":0.002389,"scheduling_latency_s":0.002436,"redis_calls":8,"redis_duration_s":0.017096,"redis_read_bytes":133,"redis_write_bytes":846,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.012237,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002096,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055701,"completed_at":"2026-08-20T06:12:03.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 181.889770] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.117Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"da42f53cc16543fbd68caeaf","created_at":"2026-08-20T06:12:03.065Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"185c97433211e047712eaa67522b8646","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.070Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-da42f53cc16543fbd68caeaf: start","job_status":"start","queue_duration_s":0.046561,"scheduling_latency_s":0.0466}1479gitlab # [ 181.901304] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.143Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1480gitlab # [ 181.909042] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"da42f53cc16543fbd68caeaf","created_at":"2026-08-20T06:12:03.065Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"185c97433211e047712eaa67522b8646","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.070Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-da42f53cc16543fbd68caeaf: done: 0.048075 sec","job_status":"done","queue_duration_s":0.046561,"scheduling_latency_s":0.0466,"redis_calls":7,"redis_duration_s":0.017015,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048075,"completed_at":"2026-08-20T06:12:03.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 181.913726] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e470cf2b2ba6b48021258af8","created_at":"2026-08-20T06:12:03.091Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f33c8fb779e4abfebd1b6c4dad80bb68","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.096Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e470cf2b2ba6b48021258af8: start","job_status":"start","queue_duration_s":0.073525,"scheduling_latency_s":0.073567}1482gitlab # [ 181.932941] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.189Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1483gitlab # [ 181.948759] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e470cf2b2ba6b48021258af8","created_at":"2026-08-20T06:12:03.091Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f33c8fb779e4abfebd1b6c4dad80bb68","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.096Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e470cf2b2ba6b48021258af8: done: 0.035154 sec","job_status":"done","queue_duration_s":0.073525,"scheduling_latency_s":0.073567,"redis_calls":7,"redis_duration_s":0.010303,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005472,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035154,"completed_at":"2026-08-20T06:12:03.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 181.959045] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d4d374f0316ecc737ce3d73f","created_at":"2026-08-20T06:12:03.107Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca8941409f8425b6be9519c36df05a0b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.118Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d4d374f0316ecc737ce3d73f: start","job_status":"start","queue_duration_s":0.096846,"scheduling_latency_s":0.096879}1485gitlab # [ 182.082959] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d4d374f0316ecc737ce3d73f","created_at":"2026-08-20T06:12:03.107Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca8941409f8425b6be9519c36df05a0b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.118Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d4d374f0316ecc737ce3d73f: done: 0.123926 sec","job_status":"done","queue_duration_s":0.096846,"scheduling_latency_s":0.096879,"redis_calls":11,"redis_duration_s":0.027005,"redis_read_bytes":137,"redis_write_bytes":1274,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002477,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":390,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001848559,"duration_s":0.123926,"completed_at":"2026-08-20T06:12:03.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 182.102681] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7c73fa9517b785d8f5f8ca1","created_at":"2026-08-20T06:12:03.138Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d946907c2395afee14f3c2719d86b5d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.146Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7c73fa9517b785d8f5f8ca1: start","job_status":"start","queue_duration_s":0.202343,"scheduling_latency_s":0.202365}1487gitlab # [ 182.142412] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7c73fa9517b785d8f5f8ca1","created_at":"2026-08-20T06:12:03.138Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d946907c2395afee14f3c2719d86b5d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.146Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7c73fa9517b785d8f5f8ca1: done: 0.04963 sec","job_status":"done","queue_duration_s":0.202343,"scheduling_latency_s":0.202365,"redis_calls":9,"redis_duration_s":0.033348,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.029458,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00389,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000833626,"exclusive_lock_hold_duration_s":0.004028445,"duration_s":0.04963,"completed_at":"2026-08-20T06:12:03.398Z","load_balancing_strategy":"primary","db_duration_s":0.002186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 182.188294] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"816725d7908f0c93e38c5c2a","created_at":"2026-08-20T06:12:03.161Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ae782ea57b1992ad1d9dc3907e0614e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.166Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-816725d7908f0c93e38c5c2a: start","job_status":"start","queue_duration_s":0.277684,"scheduling_latency_s":0.277711}1489gitlab # [ 182.246456] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"816725d7908f0c93e38c5c2a","created_at":"2026-08-20T06:12:03.161Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ae782ea57b1992ad1d9dc3907e0614e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.166Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-816725d7908f0c93e38c5c2a: done: 0.057946 sec","job_status":"done","queue_duration_s":0.277684,"scheduling_latency_s":0.277711,"redis_calls":9,"redis_duration_s":0.00686,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000616559,"exclusive_lock_hold_duration_s":0.003165486,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.057946,"completed_at":"2026-08-20T06:12:03.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 182.282726] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"59087f8afd2e5008b3741ef9","created_at":"2026-08-20T06:12:03.175Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c459526284caa8e33bfb42d7a42b58e7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.185Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-59087f8afd2e5008b3741ef9: start","job_status":"start","queue_duration_s":0.353559,"scheduling_latency_s":0.353584}1491gitlab # [ 182.337282] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"59087f8afd2e5008b3741ef9","created_at":"2026-08-20T06:12:03.175Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c459526284caa8e33bfb42d7a42b58e7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.185Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-59087f8afd2e5008b3741ef9: done: 0.054464 sec","job_status":"done","queue_duration_s":0.353559,"scheduling_latency_s":0.353584,"redis_calls":10,"redis_duration_s":0.007951,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003818,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004133,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006665372,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.054464,"completed_at":"2026-08-20T06:12:03.593Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006433,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1492gitlab # [ 182.372886] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c27e3342a64b5cf0deb815e2","created_at":"2026-08-20T06:12:03.198Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d4712b09e420e27a64d3e2749e6fabc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.203Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c27e3342a64b5cf0deb815e2: start","job_status":"start","queue_duration_s":0.426219,"scheduling_latency_s":0.426246}1493gitlab # [ 182.418647] postgres[2410]: [2410] ERROR: relation "table_without_models" does not exist1494gitlab # [ 182.419445] postgres[2410]: [2410] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1495gitlab # [ 182.425560] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c27e3342a64b5cf0deb815e2","created_at":"2026-08-20T06:12:03.198Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d4712b09e420e27a64d3e2749e6fabc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.203Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c27e3342a64b5cf0deb815e2: done: 0.052732 sec","job_status":"done","queue_duration_s":0.426219,"scheduling_latency_s":0.426246,"redis_calls":7,"redis_duration_s":0.001715,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052732,"completed_at":"2026-08-20T06:12:03.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012787,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 182.458673] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b01c634651def8514eef13fa","created_at":"2026-08-20T06:12:03.216Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.220Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b01c634651def8514eef13fa: start","job_status":"start","queue_duration_s":0.494533,"scheduling_latency_s":0.494565}1497gitlab # [ 182.550895] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b01c634651def8514eef13fa","created_at":"2026-08-20T06:12:03.216Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.220Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b01c634651def8514eef13fa: done: 0.092059 sec","job_status":"done","queue_duration_s":0.494533,"scheduling_latency_s":0.494565,"redis_calls":60,"redis_duration_s":0.010418,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000603,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.009194,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092059,"completed_at":"2026-08-20T06:12:03.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 182.610853] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.866Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"0a1a33ec69a05dece357fd4c","created_at":"2026-08-20T06:12:03.249Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"1ff65f49bfba9efe53bac45da8aa5670","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.259Z","job_size_bytes":3,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-0a1a33ec69a05dece357fd4c: start","job_status":"start","queue_duration_s":0.606915,"scheduling_latency_s":0.606953}1499gitlab # [ 182.646426] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.902Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"0a1a33ec69a05dece357fd4c","created_at":"2026-08-20T06:12:03.249Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"1ff65f49bfba9efe53bac45da8aa5670","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.259Z","job_size_bytes":3,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-0a1a33ec69a05dece357fd4c: done: 0.035476 sec","job_status":"done","queue_duration_s":0.606915,"scheduling_latency_s":0.606953,"redis_calls":10,"redis_duration_s":0.002249,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000432178,"duration_s":0.035476,"completed_at":"2026-08-20T06:12:03.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 182.682293] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:03.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"aa07db7151e1538d51c5bcfe","created_at":"2026-08-20T06:12:03.269Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a9fd59baaf124d752f36a8be1e6df3f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.289Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-aa07db7151e1538d51c5bcfe: start","job_status":"start","queue_duration_s":0.648344,"scheduling_latency_s":0.648397}1501gitlab # [ 182.951974] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"aa07db7151e1538d51c5bcfe","created_at":"2026-08-20T06:12:03.269Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a9fd59baaf124d752f36a8be1e6df3f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.289Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-aa07db7151e1538d51c5bcfe: done: 0.269436 sec","job_status":"done","queue_duration_s":0.648344,"scheduling_latency_s":0.648397,"redis_calls":562,"redis_duration_s":0.09310099999999999,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.091663,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.269436,"completed_at":"2026-08-20T06:12:04.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 182.953864] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.208Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"800c21f456789f92770c9eb9","created_at":"2026-08-20T06:12:03.301Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7865aaa9b6fdb956ab33867d6b23ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.303Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-800c21f456789f92770c9eb9: start","job_status":"start","queue_duration_s":0.905046,"scheduling_latency_s":0.905066}1503gitlab # [ 183.064868] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"800c21f456789f92770c9eb9","created_at":"2026-08-20T06:12:03.301Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7865aaa9b6fdb956ab33867d6b23ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.303Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-800c21f456789f92770c9eb9: done: 0.111878 sec","job_status":"done","queue_duration_s":0.905046,"scheduling_latency_s":0.905066,"redis_calls":7,"redis_duration_s":0.0020759999999999997,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.111878,"completed_at":"2026-08-20T06:12:04.320Z","load_balancing_strategy":"primary","db_duration_s":0.008883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 183.111632] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"78e39bb25d33f293520fc440","created_at":"2026-08-20T06:12:03.308Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97fd615bcf40bf6112805aac539cedae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.311Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-78e39bb25d33f293520fc440: start","job_status":"start","queue_duration_s":1.056464,"scheduling_latency_s":1.05651}1505gitlab # [ 183.132828] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"78e39bb25d33f293520fc440","created_at":"2026-08-20T06:12:03.308Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97fd615bcf40bf6112805aac539cedae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.311Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-78e39bb25d33f293520fc440: done: 0.021364 sec","job_status":"done","queue_duration_s":1.056464,"scheduling_latency_s":1.05651,"redis_calls":7,"redis_duration_s":0.002314,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000681,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021364,"completed_at":"2026-08-20T06:12:04.388Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 183.168993] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c1ab18373ba7ddc84b850681","created_at":"2026-08-20T06:12:03.315Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fce40de66eb7f93d0d64d01e916d486d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.320Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c1ab18373ba7ddc84b850681: start","job_status":"start","queue_duration_s":1.104822,"scheduling_latency_s":1.104862}1507gitlab # [ 183.203569] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c1ab18373ba7ddc84b850681","created_at":"2026-08-20T06:12:03.315Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fce40de66eb7f93d0d64d01e916d486d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.320Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c1ab18373ba7ddc84b850681: done: 0.034245 sec","job_status":"done","queue_duration_s":1.104822,"scheduling_latency_s":1.104862,"redis_calls":7,"redis_duration_s":0.001933,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034245,"completed_at":"2026-08-20T06:12:04.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001829,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 183.238811] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ac67401b3b0b36f1e028be39","created_at":"2026-08-20T06:12:03.326Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af1d6e7a2be35380802e79f4e3a41c01","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.333Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ac67401b3b0b36f1e028be39: start","job_status":"start","queue_duration_s":1.160955,"scheduling_latency_s":1.160998}1509gitlab # [ 183.323988] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ac67401b3b0b36f1e028be39","created_at":"2026-08-20T06:12:03.326Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af1d6e7a2be35380802e79f4e3a41c01","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.333Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ac67401b3b0b36f1e028be39: done: 0.085211 sec","job_status":"done","queue_duration_s":1.160955,"scheduling_latency_s":1.160998,"redis_calls":12,"redis_duration_s":0.003904,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001332572,"exclusive_lock_hold_duration_s":0.009006452,"duration_s":0.085211,"completed_at":"2026-08-20T06:12:04.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 183.386725] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ba05c6cc60fc4cdb75e0e348","created_at":"2026-08-20T06:12:03.345Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"484c492e932a850674b7be74364f49a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.348Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ba05c6cc60fc4cdb75e0e348: start","job_status":"start","queue_duration_s":1.294152,"scheduling_latency_s":1.294198}1511gitlab # [ 183.399128] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.655Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1512gitlab # [ 183.409060] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ba05c6cc60fc4cdb75e0e348","created_at":"2026-08-20T06:12:03.345Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"484c492e932a850674b7be74364f49a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.348Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ba05c6cc60fc4cdb75e0e348: done: 0.022326 sec","job_status":"done","queue_duration_s":1.294152,"scheduling_latency_s":1.294198,"redis_calls":7,"redis_duration_s":0.002443,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022326,"completed_at":"2026-08-20T06:12:04.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 183.444102] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"67315de2a70ecdcdc3982434","created_at":"2026-08-20T06:12:03.356Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.385Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-67315de2a70ecdcdc3982434: start","job_status":"start","queue_duration_s":1.314285,"scheduling_latency_s":1.314328}1514gitlab # [ 183.481162] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"67315de2a70ecdcdc3982434","created_at":"2026-08-20T06:12:03.356Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.385Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-67315de2a70ecdcdc3982434: done: 0.037566 sec","job_status":"done","queue_duration_s":1.314285,"scheduling_latency_s":1.314328,"redis_calls":14,"redis_duration_s":0.004272,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000296,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002239,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037566,"completed_at":"2026-08-20T06:12:04.737Z","load_balancing_strategy":"primary","db_duration_s":0.001647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 183.515918] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"75264a38eacf94dfbf38855b","created_at":"2026-08-20T06:12:03.392Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1911df78ed95730d3dce6e376e6418","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:12:03.395Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-75264a38eacf94dfbf38855b: start","job_status":"start","queue_duration_s":1.376894,"scheduling_latency_s":1.376925}1516gitlab # [ 183.539377] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.795Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1517gitlab # [ 183.548588] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"75264a38eacf94dfbf38855b","created_at":"2026-08-20T06:12:03.392Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1911df78ed95730d3dce6e376e6418","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:12:03.395Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-75264a38eacf94dfbf38855b: done: 0.03243 sec","job_status":"done","queue_duration_s":1.376894,"scheduling_latency_s":1.376925,"redis_calls":7,"redis_duration_s":0.002099,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03243,"completed_at":"2026-08-20T06:12:04.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 183.582884] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e3e7b704ee496c479eafdb9c","created_at":"2026-08-20T06:12:03.440Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573ec94f190e83b1289ec3814eb39dac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.444Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e3e7b704ee496c479eafdb9c: start","job_status":"start","queue_duration_s":1.394792,"scheduling_latency_s":1.39484}1519gitlab # [ 183.596336] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.852Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1520gitlab # [ 183.604587] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e3e7b704ee496c479eafdb9c","created_at":"2026-08-20T06:12:03.440Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573ec94f190e83b1289ec3814eb39dac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.444Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e3e7b704ee496c479eafdb9c: done: 0.021795 sec","job_status":"done","queue_duration_s":1.394792,"scheduling_latency_s":1.39484,"redis_calls":7,"redis_duration_s":0.002415,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021795,"completed_at":"2026-08-20T06:12:04.860Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 183.606657] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"42e42fd7034a70fef2171283","created_at":"2026-08-20T06:12:03.476Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1afaf7abc1e55c1957e49b7eff34d97","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:12:03.481Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-42e42fd7034a70fef2171283: start","job_status":"start","queue_duration_s":1.380996,"scheduling_latency_s":1.381028}1522gitlab # [ 183.636615] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"42e42fd7034a70fef2171283","created_at":"2026-08-20T06:12:03.476Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1afaf7abc1e55c1957e49b7eff34d97","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:12:03.481Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-42e42fd7034a70fef2171283: done: 0.029148 sec","job_status":"done","queue_duration_s":1.380996,"scheduling_latency_s":1.381028,"redis_calls":7,"redis_duration_s":0.00261,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029148,"completed_at":"2026-08-20T06:12:04.891Z","load_balancing_strategy":"primary","db_duration_s":0.002266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 183.643818] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f33813f192e5a67021b5c5bd","created_at":"2026-08-20T06:12:03.490Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d674a3c1cb6b70438ba02242cce8a5d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.501Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f33813f192e5a67021b5c5bd: start","job_status":"start","queue_duration_s":1.392971,"scheduling_latency_s":1.392998}1524gitlab # [ 183.657540] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.913Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f33813f192e5a67021b5c5bd","created_at":"2026-08-20T06:12:03.490Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d674a3c1cb6b70438ba02242cce8a5d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.501Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f33813f192e5a67021b5c5bd: done: 0.019433 sec","job_status":"done","queue_duration_s":1.392971,"scheduling_latency_s":1.392998,"redis_calls":12,"redis_duration_s":0.002473,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000669,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243606,"duration_s":0.019433,"completed_at":"2026-08-20T06:12:04.913Z","load_balancing_strategy":"primary","db_duration_s":0.001846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 183.701994] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b8f538a06a439a7049737ce0","created_at":"2026-08-20T06:12:03.551Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4873b06380dca74b10e8cee8cf42b5b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:12:03.555Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b8f538a06a439a7049737ce0: start","job_status":"start","queue_duration_s":1.359684,"scheduling_latency_s":1.359698}1526gitlab # [ 183.702986] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.919Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1527gitlab # [ 183.703675] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b8f538a06a439a7049737ce0","created_at":"2026-08-20T06:12:03.551Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4873b06380dca74b10e8cee8cf42b5b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:12:03.555Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b8f538a06a439a7049737ce0: done: 0.007664 sec","job_status":"done","queue_duration_s":1.359684,"scheduling_latency_s":1.359698,"redis_calls":7,"redis_duration_s":0.000909,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007664,"completed_at":"2026-08-20T06:12:04.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 183.740192] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0c5a1a5b1f6494efa8086c11","created_at":"2026-08-20T06:12:03.565Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34e4931794ee5896c81aedd9c5ef2eb8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.570Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0c5a1a5b1f6494efa8086c11: start","job_status":"start","queue_duration_s":1.352627,"scheduling_latency_s":1.352639}1529gitlab # [ 183.745151] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0c5a1a5b1f6494efa8086c11","created_at":"2026-08-20T06:12:03.565Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34e4931794ee5896c81aedd9c5ef2eb8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.570Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0c5a1a5b1f6494efa8086c11: done: 0.027653 sec","job_status":"done","queue_duration_s":1.352627,"scheduling_latency_s":1.352639,"redis_calls":9,"redis_duration_s":0.0021349999999999997,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000538057,"exclusive_lock_hold_duration_s":0.013260345,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.027653,"completed_at":"2026-08-20T06:12:04.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 183.786360] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:04.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"222f433c7976c25464b99ac6","created_at":"2026-08-20T06:12:03.578Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b36cb4c0ec4bbf7d9e1259961fe073d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.582Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-222f433c7976c25464b99ac6: start","job_status":"start","queue_duration_s":1.369151,"scheduling_latency_s":1.369163}1531gitlab # [ 183.873985] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"222f433c7976c25464b99ac6","created_at":"2026-08-20T06:12:03.578Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b36cb4c0ec4bbf7d9e1259961fe073d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.582Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-222f433c7976c25464b99ac6: done: 0.176877 sec","job_status":"done","queue_duration_s":1.369151,"scheduling_latency_s":1.369163,"redis_calls":9,"redis_duration_s":0.002088,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000373232,"exclusive_lock_hold_duration_s":0.162586027,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.176877,"completed_at":"2026-08-20T06:12:05.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.151752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 183.910937] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"92cd496d7dcae6c261a0be09","created_at":"2026-08-20T06:12:03.589Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5768616c40e28bd8cfc0f64b7bd49de7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.592Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-92cd496d7dcae6c261a0be09: start","job_status":"start","queue_duration_s":1.574781,"scheduling_latency_s":1.574823}1533gitlab # [ 184.105368] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"92cd496d7dcae6c261a0be09","created_at":"2026-08-20T06:12:03.589Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5768616c40e28bd8cfc0f64b7bd49de7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.592Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-92cd496d7dcae6c261a0be09: done: 0.193325 sec","job_status":"done","queue_duration_s":1.574781,"scheduling_latency_s":1.574823,"redis_calls":11,"redis_duration_s":0.003747,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00068,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.143445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000804851,"exclusive_lock_hold_duration_s":0.170255716,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.193325,"completed_at":"2026-08-20T06:12:05.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 184.108157] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"75585da9465e1ddc5889d8fb","created_at":"2026-08-20T06:12:03.641Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eecad5008aeb96289e2e3140f93202bd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.652Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-75585da9465e1ddc5889d8fb: start","job_status":"start","queue_duration_s":1.709477,"scheduling_latency_s":1.709492}1535gitlab # [ 184.177475] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"75585da9465e1ddc5889d8fb","created_at":"2026-08-20T06:12:03.641Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-1416b8694f08434a","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eecad5008aeb96289e2e3140f93202bd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.652Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-75585da9465e1ddc5889d8fb: done: 0.012948 sec","job_status":"done","queue_duration_s":1.709477,"scheduling_latency_s":1.709492,"redis_calls":12,"redis_duration_s":0.001996,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333283,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.012948,"completed_at":"2026-08-20T06:12:05.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 184.187245] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4867a16452f50ce03a260e68","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4867a16452f50ce03a260e68: start","job_status":"start","queue_duration_s":1.577363,"scheduling_latency_s":1.577376}1537gitlab # [ 184.198056] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4867a16452f50ce03a260e68","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4867a16452f50ce03a260e68: done: 0.010684 sec","job_status":"done","queue_duration_s":1.577363,"scheduling_latency_s":1.577376,"redis_calls":13,"redis_duration_s":0.0024850000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010684,"completed_at":"2026-08-20T06:12:05.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 184.248534] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cb550eee073efaed24f18b0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cb550eee073efaed24f18b0: start","job_status":"start","queue_duration_s":1.589087,"scheduling_latency_s":1.589099}1539gitlab # [ 184.249188] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cb550eee073efaed24f18b0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cb550eee073efaed24f18b0: done: 0.01025 sec","job_status":"done","queue_duration_s":1.589087,"scheduling_latency_s":1.589099,"redis_calls":13,"redis_duration_s":0.002379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001655,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01025,"completed_at":"2026-08-20T06:12:05.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 184.288363] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"248379b3c6e4e5df28e4f4e2","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-248379b3c6e4e5df28e4f4e2: start","job_status":"start","queue_duration_s":1.600347,"scheduling_latency_s":1.600359}1541gitlab # [ 184.288969] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"248379b3c6e4e5df28e4f4e2","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-248379b3c6e4e5df28e4f4e2: done: 0.010162 sec","job_status":"done","queue_duration_s":1.600347,"scheduling_latency_s":1.600359,"redis_calls":13,"redis_duration_s":0.002401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001662,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010162,"completed_at":"2026-08-20T06:12:05.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 184.327904] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1df6913355b18b318d44da7f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1df6913355b18b318d44da7f: start","job_status":"start","queue_duration_s":1.611544,"scheduling_latency_s":1.611557}1543gitlab # [ 184.328583] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1df6913355b18b318d44da7f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1df6913355b18b318d44da7f: done: 0.010181 sec","job_status":"done","queue_duration_s":1.611544,"scheduling_latency_s":1.611557,"redis_calls":13,"redis_duration_s":0.002432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001629,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010181,"completed_at":"2026-08-20T06:12:05.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 184.350708] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7938fb8d9226d9811301bf2d","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7938fb8d9226d9811301bf2d: start","job_status":"start","queue_duration_s":1.623212,"scheduling_latency_s":1.623225}1545gitlab # [ 184.390751] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7938fb8d9226d9811301bf2d","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7938fb8d9226d9811301bf2d: done: 0.010174 sec","job_status":"done","queue_duration_s":1.623212,"scheduling_latency_s":1.623225,"redis_calls":13,"redis_duration_s":0.002481,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001703,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010174,"completed_at":"2026-08-20T06:12:05.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 184.391568] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61e2a81c6a529a3ac69fb26f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61e2a81c6a529a3ac69fb26f: start","job_status":"start","queue_duration_s":1.634281,"scheduling_latency_s":1.634293}1547gitlab # [ 184.400937] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61e2a81c6a529a3ac69fb26f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61e2a81c6a529a3ac69fb26f: done: 0.009331 sec","job_status":"done","queue_duration_s":1.634281,"scheduling_latency_s":1.634293,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009331,"completed_at":"2026-08-20T06:12:05.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 184.442306] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a40c9ad2a1bb701b3611101a","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a40c9ad2a1bb701b3611101a: start","job_status":"start","queue_duration_s":1.64442,"scheduling_latency_s":1.644433}1549gitlab # [ 184.442922] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a40c9ad2a1bb701b3611101a","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a40c9ad2a1bb701b3611101a: done: 0.009256 sec","job_status":"done","queue_duration_s":1.64442,"scheduling_latency_s":1.644433,"redis_calls":13,"redis_duration_s":0.0015209999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009256,"completed_at":"2026-08-20T06:12:05.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 184.472889] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9572ec7e389975400faf9ef2","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9572ec7e389975400faf9ef2: start","job_status":"start","queue_duration_s":1.654489,"scheduling_latency_s":1.654502}1551gitlab # [ 184.482892] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9572ec7e389975400faf9ef2","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9572ec7e389975400faf9ef2: done: 0.009191 sec","job_status":"done","queue_duration_s":1.654489,"scheduling_latency_s":1.654502,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009191,"completed_at":"2026-08-20T06:12:05.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 184.527264] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a4b882aa55266a3e6cf12cf","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a4b882aa55266a3e6cf12cf: start","job_status":"start","queue_duration_s":1.664953,"scheduling_latency_s":1.664966}1553gitlab # [ 184.527971] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a4b882aa55266a3e6cf12cf","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a4b882aa55266a3e6cf12cf: done: 0.009289 sec","job_status":"done","queue_duration_s":1.664953,"scheduling_latency_s":1.664966,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009289,"completed_at":"2026-08-20T06:12:05.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 184.575281] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f23eb1415e0b71b54cb0c49","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f23eb1415e0b71b54cb0c49: start","job_status":"start","queue_duration_s":1.675056,"scheduling_latency_s":1.675069}1555gitlab # [ 184.575998] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f23eb1415e0b71b54cb0c49","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f23eb1415e0b71b54cb0c49: done: 0.009051 sec","job_status":"done","queue_duration_s":1.675056,"scheduling_latency_s":1.675069,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009051,"completed_at":"2026-08-20T06:12:05.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 184.619176] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa3939575b1faf9996d17894","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa3939575b1faf9996d17894: start","job_status":"start","queue_duration_s":1.684904,"scheduling_latency_s":1.684917}1557gitlab # [ 184.619875] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa3939575b1faf9996d17894","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa3939575b1faf9996d17894: done: 0.008914 sec","job_status":"done","queue_duration_s":1.684904,"scheduling_latency_s":1.684917,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008914,"completed_at":"2026-08-20T06:12:05.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 184.658288] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8529ae9b90d3a888ff2414c","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8529ae9b90d3a888ff2414c: start","job_status":"start","queue_duration_s":1.695075,"scheduling_latency_s":1.695088}1559gitlab # [ 184.697636] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8529ae9b90d3a888ff2414c","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8529ae9b90d3a888ff2414c: done: 0.009031 sec","job_status":"done","queue_duration_s":1.695075,"scheduling_latency_s":1.695088,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009031,"completed_at":"2026-08-20T06:12:05.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 184.698547] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6f66e3d7ec156daf31b7602","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6f66e3d7ec156daf31b7602: start","job_status":"start","queue_duration_s":1.704919,"scheduling_latency_s":1.704932}1561gitlab # [ 184.705854] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6f66e3d7ec156daf31b7602","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6f66e3d7ec156daf31b7602: done: 0.009189 sec","job_status":"done","queue_duration_s":1.704919,"scheduling_latency_s":1.704932,"redis_calls":13,"redis_duration_s":0.0015970000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009189,"completed_at":"2026-08-20T06:12:05.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 184.754288] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b963898148a895aa27311d70","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b963898148a895aa27311d70: start","job_status":"start","queue_duration_s":1.714908,"scheduling_latency_s":1.714921}1563gitlab # [ 184.755094] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b963898148a895aa27311d70","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b963898148a895aa27311d70: done: 0.00881 sec","job_status":"done","queue_duration_s":1.714908,"scheduling_latency_s":1.714921,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00881,"completed_at":"2026-08-20T06:12:05.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 184.793495] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11998a9edd5d34e6bfd5d91f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11998a9edd5d34e6bfd5d91f: start","job_status":"start","queue_duration_s":1.725052,"scheduling_latency_s":1.725065}1565gitlab # [ 184.795632] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11998a9edd5d34e6bfd5d91f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11998a9edd5d34e6bfd5d91f: done: 0.009041 sec","job_status":"done","queue_duration_s":1.725052,"scheduling_latency_s":1.725065,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009041,"completed_at":"2026-08-20T06:12:05.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 184.846273] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"531bdc5194583c1e4a6b6b90","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-531bdc5194583c1e4a6b6b90: start","job_status":"start","queue_duration_s":1.734892,"scheduling_latency_s":1.734904}1567gitlab # [ 184.847081] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"531bdc5194583c1e4a6b6b90","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-531bdc5194583c1e4a6b6b90: done: 0.008726 sec","job_status":"done","queue_duration_s":1.734892,"scheduling_latency_s":1.734904,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008726,"completed_at":"2026-08-20T06:12:05.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 184.875236] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e408d0a7e41f05c2ae8fe9","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e408d0a7e41f05c2ae8fe9: start","job_status":"start","queue_duration_s":1.744414,"scheduling_latency_s":1.744426}1569gitlab # [ 184.886506] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e408d0a7e41f05c2ae8fe9","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e408d0a7e41f05c2ae8fe9: done: 0.012215 sec","job_status":"done","queue_duration_s":1.744414,"scheduling_latency_s":1.744426,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012215,"completed_at":"2026-08-20T06:12:05.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 184.936452] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471f677c8f98b38fcd7d022e","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471f677c8f98b38fcd7d022e: start","job_status":"start","queue_duration_s":1.758025,"scheduling_latency_s":1.758038}1571gitlab # [ 184.937274] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471f677c8f98b38fcd7d022e","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471f677c8f98b38fcd7d022e: done: 0.009348 sec","job_status":"done","queue_duration_s":1.758025,"scheduling_latency_s":1.758038,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009348,"completed_at":"2026-08-20T06:12:05.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 184.985916] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6faee177f2212ece429bae4","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6faee177f2212ece429bae4: start","job_status":"start","queue_duration_s":1.768175,"scheduling_latency_s":1.768188}1573gitlab # [ 184.986627] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6faee177f2212ece429bae4","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6faee177f2212ece429bae4: done: 0.008952 sec","job_status":"done","queue_duration_s":1.768175,"scheduling_latency_s":1.768188,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008952,"completed_at":"2026-08-20T06:12:05.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 185.027782] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9afe83e5f86521fbf04ce351","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9afe83e5f86521fbf04ce351: start","job_status":"start","queue_duration_s":1.778123,"scheduling_latency_s":1.778136}1575gitlab # [ 185.028601] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9afe83e5f86521fbf04ce351","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9afe83e5f86521fbf04ce351: done: 0.009058 sec","job_status":"done","queue_duration_s":1.778123,"scheduling_latency_s":1.778136,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009058,"completed_at":"2026-08-20T06:12:05.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 185.074129] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b159d11e240920cbfe6a79fe","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b159d11e240920cbfe6a79fe: start","job_status":"start","queue_duration_s":1.787999,"scheduling_latency_s":1.788011}1577gitlab # [ 185.074824] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b159d11e240920cbfe6a79fe","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b159d11e240920cbfe6a79fe: done: 0.009305 sec","job_status":"done","queue_duration_s":1.787999,"scheduling_latency_s":1.788011,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009305,"completed_at":"2026-08-20T06:12:05.596Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 185.130405] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1edfbf7b80a151d951646263","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1edfbf7b80a151d951646263: start","job_status":"start","queue_duration_s":1.798125,"scheduling_latency_s":1.798138}1579gitlab # [ 185.131059] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1edfbf7b80a151d951646263","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1edfbf7b80a151d951646263: done: 0.009029 sec","job_status":"done","queue_duration_s":1.798125,"scheduling_latency_s":1.798138,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009029,"completed_at":"2026-08-20T06:12:05.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 185.179485] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3aa70da15b082045c29e3f0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3aa70da15b082045c29e3f0: start","job_status":"start","queue_duration_s":1.807996,"scheduling_latency_s":1.808009}1581gitlab # [ 185.180277] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3aa70da15b082045c29e3f0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3aa70da15b082045c29e3f0: done: 0.009013 sec","job_status":"done","queue_duration_s":1.807996,"scheduling_latency_s":1.808009,"redis_calls":13,"redis_duration_s":0.0015379999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009013,"completed_at":"2026-08-20T06:12:05.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 185.188584] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7987a8d82dfa9daa0e2490ee","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7987a8d82dfa9daa0e2490ee: start","job_status":"start","queue_duration_s":1.817803,"scheduling_latency_s":1.817816}1583gitlab # [ 185.228113] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7987a8d82dfa9daa0e2490ee","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7987a8d82dfa9daa0e2490ee: done: 0.009048 sec","job_status":"done","queue_duration_s":1.817803,"scheduling_latency_s":1.817816,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009048,"completed_at":"2026-08-20T06:12:05.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 185.265916] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ec09645ac10b0cca1f76be","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ec09645ac10b0cca1f76be: start","job_status":"start","queue_duration_s":1.827648,"scheduling_latency_s":1.827661}1585gitlab # [ 185.266679] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ec09645ac10b0cca1f76be","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ec09645ac10b0cca1f76be: done: 0.009001 sec","job_status":"done","queue_duration_s":1.827648,"scheduling_latency_s":1.827661,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009001,"completed_at":"2026-08-20T06:12:05.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 185.305158] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd105bf48faf725e1e64a672","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd105bf48faf725e1e64a672: start","job_status":"start","queue_duration_s":1.837467,"scheduling_latency_s":1.837479}1587gitlab # [ 185.305801] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd105bf48faf725e1e64a672","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd105bf48faf725e1e64a672: done: 0.008975 sec","job_status":"done","queue_duration_s":1.837467,"scheduling_latency_s":1.837479,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008975,"completed_at":"2026-08-20T06:12:05.645Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 185.353716] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c67240c0ca038a75c26e351","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c67240c0ca038a75c26e351: start","job_status":"start","queue_duration_s":1.847256,"scheduling_latency_s":1.847268}1589gitlab # [ 185.354483] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c67240c0ca038a75c26e351","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c67240c0ca038a75c26e351: done: 0.00921 sec","job_status":"done","queue_duration_s":1.847256,"scheduling_latency_s":1.847268,"redis_calls":13,"redis_duration_s":0.0015570000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00921,"completed_at":"2026-08-20T06:12:05.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 185.368699] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3c7770e8e458a22c5ec871b","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3c7770e8e458a22c5ec871b: start","job_status":"start","queue_duration_s":1.85728,"scheduling_latency_s":1.857292}1591gitlab # [ 185.380063] setup-gitlab-start[2198]: + systemctl restart gitlab-sidekiq.service1592gitlab # [ 185.380467] runuser[2216]: pam_unix(runuser:session): session closed for user gitlab1593gitlab # [ 185.381651] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3c7770e8e458a22c5ec871b","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3c7770e8e458a22c5ec871b: done: 0.008972 sec","job_status":"done","queue_duration_s":1.85728,"scheduling_latency_s":1.857292,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008972,"completed_at":"2026-08-20T06:12:05.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 185.426350] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bef9ec6c59088282b81753a3","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bef9ec6c59088282b81753a3: start","job_status":"start","queue_duration_s":1.86708,"scheduling_latency_s":1.867093}1595gitlab # [ 185.427275] systemd[1]: Stopping gitlab-sidekiq.service...1596gitlab # [ 185.427984] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bef9ec6c59088282b81753a3","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bef9ec6c59088282b81753a3: done: 0.008959 sec","job_status":"done","queue_duration_s":1.86708,"scheduling_latency_s":1.867093,"redis_calls":13,"redis_duration_s":0.001504,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008959,"completed_at":"2026-08-20T06:12:05.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 185.468505] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccbae0397e3627816f9c9142","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccbae0397e3627816f9c9142: start","job_status":"start","queue_duration_s":1.876868,"scheduling_latency_s":1.876881}1598gitlab # [ 185.471625] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccbae0397e3627816f9c9142","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccbae0397e3627816f9c9142: done: 0.009198 sec","job_status":"done","queue_duration_s":1.876868,"scheduling_latency_s":1.876881,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009198,"completed_at":"2026-08-20T06:12:05.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 185.540248] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dd98193e7a5c807d78a08f3","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dd98193e7a5c807d78a08f3: start","job_status":"start","queue_duration_s":1.886858,"scheduling_latency_s":1.886871}1600gitlab # [ 185.540981] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dd98193e7a5c807d78a08f3","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dd98193e7a5c807d78a08f3: done: 0.008881 sec","job_status":"done","queue_duration_s":1.886858,"scheduling_latency_s":1.886871,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008881,"completed_at":"2026-08-20T06:12:05.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 185.551700] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4a6a38953ca669402c3d113","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4a6a38953ca669402c3d113: start","job_status":"start","queue_duration_s":1.896699,"scheduling_latency_s":1.896712}1602gitlab # [ 185.562666] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4a6a38953ca669402c3d113","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4a6a38953ca669402c3d113: done: 0.008929 sec","job_status":"done","queue_duration_s":1.896699,"scheduling_latency_s":1.896712,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008929,"completed_at":"2026-08-20T06:12:05.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 185.603053] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"827696d6769c7fbf3c99b0fe","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-827696d6769c7fbf3c99b0fe: start","job_status":"start","queue_duration_s":1.906448,"scheduling_latency_s":1.906461}1604gitlab # [ 185.643092] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"827696d6769c7fbf3c99b0fe","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-827696d6769c7fbf3c99b0fe: done: 0.008973 sec","job_status":"done","queue_duration_s":1.906448,"scheduling_latency_s":1.906461,"redis_calls":13,"redis_duration_s":0.0015079999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008973,"completed_at":"2026-08-20T06:12:05.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 185.644042] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"264affbb650def47efbd3b77","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-264affbb650def47efbd3b77: start","job_status":"start","queue_duration_s":1.916274,"scheduling_latency_s":1.916286}1606gitlab # [ 185.652427] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"264affbb650def47efbd3b77","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-264affbb650def47efbd3b77: done: 0.008948 sec","job_status":"done","queue_duration_s":1.916274,"scheduling_latency_s":1.916286,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008948,"completed_at":"2026-08-20T06:12:05.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 185.692486] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54c9094c1eb864a2b6ff0cd0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54c9094c1eb864a2b6ff0cd0: start","job_status":"start","queue_duration_s":1.92603,"scheduling_latency_s":1.926042}1608gitlab # [ 185.697507] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54c9094c1eb864a2b6ff0cd0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54c9094c1eb864a2b6ff0cd0: done: 0.00901 sec","job_status":"done","queue_duration_s":1.92603,"scheduling_latency_s":1.926042,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00901,"completed_at":"2026-08-20T06:12:05.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 185.735758] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2100252d7e6afce4eae373e","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2100252d7e6afce4eae373e: start","job_status":"start","queue_duration_s":1.935894,"scheduling_latency_s":1.935907}1610gitlab # [ 185.742174] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2100252d7e6afce4eae373e","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2100252d7e6afce4eae373e: done: 0.008723 sec","job_status":"done","queue_duration_s":1.935894,"scheduling_latency_s":1.935907,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008723,"completed_at":"2026-08-20T06:12:05.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 185.786601] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e94c506ebf423dc3008fff76","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e94c506ebf423dc3008fff76: start","job_status":"start","queue_duration_s":1.945439,"scheduling_latency_s":1.945452}1612gitlab # [ 185.787246] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e94c506ebf423dc3008fff76","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e94c506ebf423dc3008fff76: done: 0.00874 sec","job_status":"done","queue_duration_s":1.945439,"scheduling_latency_s":1.945452,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00874,"completed_at":"2026-08-20T06:12:05.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 185.834309] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"582d447d0435609480763af3","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-582d447d0435609480763af3: start","job_status":"start","queue_duration_s":1.955008,"scheduling_latency_s":1.955021}1614gitlab # [ 185.835090] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"582d447d0435609480763af3","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-582d447d0435609480763af3: done: 0.008704 sec","job_status":"done","queue_duration_s":1.955008,"scheduling_latency_s":1.955021,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008704,"completed_at":"2026-08-20T06:12:05.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 185.880525] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8b74120bf2602a34fd04073","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8b74120bf2602a34fd04073: start","job_status":"start","queue_duration_s":1.964534,"scheduling_latency_s":1.964547}1616gitlab # [ 185.881329] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8b74120bf2602a34fd04073","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8b74120bf2602a34fd04073: done: 0.008761 sec","job_status":"done","queue_duration_s":1.964534,"scheduling_latency_s":1.964547,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008761,"completed_at":"2026-08-20T06:12:05.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 185.921546] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81f7b14c1eac469d9b5fbe1","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81f7b14c1eac469d9b5fbe1: start","job_status":"start","queue_duration_s":1.97412,"scheduling_latency_s":1.974133}1618gitlab # [ 185.922266] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81f7b14c1eac469d9b5fbe1","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81f7b14c1eac469d9b5fbe1: done: 0.009042 sec","job_status":"done","queue_duration_s":1.97412,"scheduling_latency_s":1.974133,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009042,"completed_at":"2026-08-20T06:12:05.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 185.962557] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b61a505caa41abf7e6ac9a2b","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b61a505caa41abf7e6ac9a2b: start","job_status":"start","queue_duration_s":1.983987,"scheduling_latency_s":1.984}1620gitlab # [ 185.966877] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b61a505caa41abf7e6ac9a2b","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b61a505caa41abf7e6ac9a2b: done: 0.008729 sec","job_status":"done","queue_duration_s":1.983987,"scheduling_latency_s":1.984,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008729,"completed_at":"2026-08-20T06:12:05.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 186.015160] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"697209305d230578e0b9228e","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-697209305d230578e0b9228e: start","job_status":"start","queue_duration_s":1.993533,"scheduling_latency_s":1.993546}1622gitlab # [ 186.016291] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"697209305d230578e0b9228e","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-697209305d230578e0b9228e: done: 0.008772 sec","job_status":"done","queue_duration_s":1.993533,"scheduling_latency_s":1.993546,"redis_calls":13,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008772,"completed_at":"2026-08-20T06:12:05.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 186.056923] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ec7b0d8453bde3700eb998b","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ec7b0d8453bde3700eb998b: start","job_status":"start","queue_duration_s":2.003132,"scheduling_latency_s":2.003144}1624gitlab # [ 186.058208] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ec7b0d8453bde3700eb998b","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ec7b0d8453bde3700eb998b: done: 0.008818 sec","job_status":"done","queue_duration_s":2.003132,"scheduling_latency_s":2.003144,"redis_calls":13,"redis_duration_s":0.0015050000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008818,"completed_at":"2026-08-20T06:12:05.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 186.100910] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"beb16513e02f00e8aaf11f2f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-beb16513e02f00e8aaf11f2f: start","job_status":"start","queue_duration_s":2.012717,"scheduling_latency_s":2.01273}1626gitlab # [ 186.103435] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"beb16513e02f00e8aaf11f2f","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-beb16513e02f00e8aaf11f2f: done: 0.008852 sec","job_status":"done","queue_duration_s":2.012717,"scheduling_latency_s":2.01273,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008852,"completed_at":"2026-08-20T06:12:05.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 186.150624] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0e9a555e970cac462315ea0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0e9a555e970cac462315ea0: start","job_status":"start","queue_duration_s":2.022523,"scheduling_latency_s":2.022536}1628gitlab # [ 186.151808] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0e9a555e970cac462315ea0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0e9a555e970cac462315ea0: done: 0.00891 sec","job_status":"done","queue_duration_s":2.022523,"scheduling_latency_s":2.022536,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00891,"completed_at":"2026-08-20T06:12:05.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 186.194944] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc38725dfa07f226b30c2bb9","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc38725dfa07f226b30c2bb9: start","job_status":"start","queue_duration_s":2.032254,"scheduling_latency_s":2.032267}1630gitlab # [ 186.195938] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc38725dfa07f226b30c2bb9","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc38725dfa07f226b30c2bb9: done: 0.008919 sec","job_status":"done","queue_duration_s":2.032254,"scheduling_latency_s":2.032267,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008919,"completed_at":"2026-08-20T06:12:05.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 186.249675] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21a4de33d5ebc909ea0ebaa0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21a4de33d5ebc909ea0ebaa0: start","job_status":"start","queue_duration_s":2.042019,"scheduling_latency_s":2.042032}1632gitlab # [ 186.250768] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21a4de33d5ebc909ea0ebaa0","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21a4de33d5ebc909ea0ebaa0: done: 0.008885 sec","job_status":"done","queue_duration_s":2.042019,"scheduling_latency_s":2.042032,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008885,"completed_at":"2026-08-20T06:12:05.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 186.296615] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c2befd00586b164f8ff708","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c2befd00586b164f8ff708: start","job_status":"start","queue_duration_s":2.051772,"scheduling_latency_s":2.051793}1634gitlab # [ 186.297631] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c2befd00586b164f8ff708","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c2befd00586b164f8ff708: done: 0.008782 sec","job_status":"done","queue_duration_s":2.051772,"scheduling_latency_s":2.051793,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008782,"completed_at":"2026-08-20T06:12:05.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 186.338711] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99df39bd5ca16779b5843700","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99df39bd5ca16779b5843700: start","job_status":"start","queue_duration_s":2.061359,"scheduling_latency_s":2.061372}1636gitlab # [ 186.339703] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99df39bd5ca16779b5843700","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99df39bd5ca16779b5843700: done: 0.008794 sec","job_status":"done","queue_duration_s":2.061359,"scheduling_latency_s":2.061372,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008794,"completed_at":"2026-08-20T06:12:05.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 186.359219] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19583ccb49a85cbe5ca71953","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19583ccb49a85cbe5ca71953: start","job_status":"start","queue_duration_s":2.070972,"scheduling_latency_s":2.070985}1638gitlab # [ 186.370295] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19583ccb49a85cbe5ca71953","created_at":"2026-08-20T06:12:03.740Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-91f5ab4009564dd7","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"92ad49b0d8403854d8243c01969f6eb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:03.798Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19583ccb49a85cbe5ca71953: done: 0.009151 sec","job_status":"done","queue_duration_s":2.070972,"scheduling_latency_s":2.070985,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009151,"completed_at":"2026-08-20T06:12:05.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 186.402230] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.879Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"09d6606ecb6b9d6c990a3e39","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-09d6606ecb6b9d6c990a3e39: start","job_status":"start","queue_duration_s":1.149429,"scheduling_latency_s":1.149443}1640gitlab # [ 186.441458] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.886Z","message":"No existing merge request to be cleaned up."}1641gitlab # [ 186.442183] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"09d6606ecb6b9d6c990a3e39","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-09d6606ecb6b9d6c990a3e39: done: 0.011852 sec","job_status":"done","queue_duration_s":1.149429,"scheduling_latency_s":1.149443,"redis_calls":10,"redis_duration_s":0.001263,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011852,"completed_at":"2026-08-20T06:12:05.891Z","load_balancing_strategy":"primary","db_duration_s":0.001534,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 186.443140] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.892Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a43ac528be7eb272b9cf4d12","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a43ac528be7eb272b9cf4d12: start","job_status":"start","queue_duration_s":1.162108,"scheduling_latency_s":1.16212}1643gitlab # [ 186.453177] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.898Z","message":"No existing merge request to be cleaned up."}1644gitlab # [ 186.454568] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.902Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a43ac528be7eb272b9cf4d12","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a43ac528be7eb272b9cf4d12: done: 0.010281 sec","job_status":"done","queue_duration_s":1.162108,"scheduling_latency_s":1.16212,"redis_calls":10,"redis_duration_s":0.001267,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010281,"completed_at":"2026-08-20T06:12:05.902Z","load_balancing_strategy":"primary","db_duration_s":0.000991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 186.513681] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.903Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1699555d0ef93f8458cc2527","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1699555d0ef93f8458cc2527: start","job_status":"start","queue_duration_s":1.173177,"scheduling_latency_s":1.17319}1646gitlab # [ 186.514435] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.909Z","message":"No existing merge request to be cleaned up."}1647gitlab # [ 186.514946] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.913Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1699555d0ef93f8458cc2527","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1699555d0ef93f8458cc2527: done: 0.010146 sec","job_status":"done","queue_duration_s":1.173177,"scheduling_latency_s":1.17319,"redis_calls":10,"redis_duration_s":0.001313,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010146,"completed_at":"2026-08-20T06:12:05.913Z","load_balancing_strategy":"primary","db_duration_s":0.000901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 186.526604] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.914Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c7d8b61f795209338ca1eea1","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c7d8b61f795209338ca1eea1: start","job_status":"start","queue_duration_s":1.184293,"scheduling_latency_s":1.18433}1649gitlab # [ 186.568311] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.920Z","message":"No existing merge request to be cleaned up."}1650gitlab # [ 186.568979] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:05.925Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c7d8b61f795209338ca1eea1","created_at":"2026-08-20T06:12:04.718Z","trace_propagation_headers":{"sentry-trace":"04f55144826c4f7ca49522501a1f3de1-67d2880246cc43d9","baggage":"sentry-trace_id=04f55144826c4f7ca49522501a1f3de1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f3787fe4040c541bd1603c1d23e5aa24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:04.730Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c7d8b61f795209338ca1eea1: done: 0.010387 sec","job_status":"done","queue_duration_s":1.184293,"scheduling_latency_s":1.18433,"redis_calls":10,"redis_duration_s":0.001267,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010387,"completed_at":"2026-08-20T06:12:05.925Z","load_balancing_strategy":"primary","db_duration_s":0.001009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 186.570156] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:06.626Z","message":"Shutting down"}1652gitlab # [ 186.570803] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:06.627Z","message":"Scheduler exiting..."}1653gitlab # [ 186.571506] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:06.628Z","message":"Terminating quiet threads for default capsule"}1654gitlab # [ 186.572146] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:06.628Z","message":"Scheduler exiting..."}1655gitlab # [ 186.572718] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:07.128Z","message":"Pausing to allow jobs to finish..."}1656gitlab # [ 189.878894] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:11.134Z","message":"Bye!"}1657gitlab # [ 189.902714] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-08-20T06:12:11.159Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1603,"worker_id":"sidekiq_0","memwd_rss_bytes":944676864,"retry":0}1658gitlab # [ 190.171597] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1659gitlab # [ 190.173185] systemd[1]: Stopped gitlab-sidekiq.service.1660gitlab # [ 190.174786] systemd[1]: gitlab-sidekiq.service: Consumed 57.318s CPU time over 1min 58.078s wall clock time, 962.6M memory peak, 4.5M read from disk.1661gitlab # [ 190.178995] systemd[1]: Started gitlab-sidekiq.service.1662gitlab # [ 190.181148] setup-gitlab-start[2198]: + mkdir -p /var/lib/secrets1663gitlab # [ 190.182645] setup-gitlab-start[2198]: + echo nixbot-test-token-of-20-chars1664gitlab # [ 190.185180] setup-gitlab-start[2198]: + chmod 644 /var/lib/secrets/gitlab-token1665gitlab # [ 190.186562] setup-gitlab-start[2198]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1666gitlab # [ 190.724580] gitaly[918]: time="2026-08-20T06:12:11.980Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:21.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:11.980" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1667gitlab # [ 190.732967] gitaly[918]: time="2026-08-20T06:12:11.982Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:21.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:11.980" grpc.time_ms=0.289 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 190.861389] gitaly[918]: time="2026-08-20T06:12:12.117Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.117" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 190.870342] gitaly[918]: time="2026-08-20T06:12:12.118Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.117" grpc.time_ms=0.48 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670gitlab # [ 190.922532] gitaly[918]: time="2026-08-20T06:12:12.179Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM diskcache=d5408ba2-a4b5-46e1-9d06-234ab8a2b13d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:12:22.020" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.131" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671gitlab # [ 190.930947] gitaly[918]: time="2026-08-20T06:12:12.187Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:12:22.020" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.131" grpc.time_ms=48.125 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 190.939816] gitaly[918]: time="2026-08-20T06:12:12.196Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.085" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.195" pid=918 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1673gitlab # [ 190.940510] gitaly[918]: time="2026-08-20T06:12:12.196Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.085" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.195" grpc.time_ms=0.635 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 190.970275] gitaly[918]: time="2026-08-20T06:12:12.226Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:12:22.107" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.217" grpc.time_ms=8.849 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 191.015258] gitaly[918]: time="2026-08-20T06:12:12.271Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.271" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 191.015851] gitaly[918]: time="2026-08-20T06:12:12.271Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.271" grpc.time_ms=0.249 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1677gitlab # [ 191.083385] gitaly[918]: time="2026-08-20T06:12:12.339Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM diskcache=8e99ac0c-5dd7-4874-9130-02c0b9911186 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:12:22.180" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.290" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 191.084161] gitaly[918]: time="2026-08-20T06:12:12.340Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T06:12:22.180" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.290" grpc.time_ms=49.293 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 191.090485] gitaly[918]: time="2026-08-20T06:12:12.347Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.346" pid=918 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1680gitlab # [ 191.091145] gitaly[918]: time="2026-08-20T06:12:12.347Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.346" grpc.time_ms=0.828 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 191.100931] gitaly[918]: time="2026-08-20T06:12:12.357Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:12:22.240" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.351" grpc.time_ms=5.993 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 191.124198] gitaly[918]: time="2026-08-20T06:12:12.380Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:12:22.269" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.380" grpc.time_ms=0.203 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 191.129070] gitaly[918]: time="2026-08-20T06:12:12.385Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:12:22.274" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.385" grpc.time_ms=0.311 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 191.561532] gitaly[918]: time="2026-08-20T06:12:12.817Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRV22SGR3FS4AA9XPAMRM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:12:22.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:12.812" grpc.time_ms=5.409 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 191.789070] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:13 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 15861686gitlab # [ 191.791029] setup-gitlab-start[2198]: + mkdir -p /tmp/test-flake1687gitlab # [ 191.792346] setup-gitlab-start[2198]: + cd /tmp/test-flake1688gitlab # [ 191.793118] setup-gitlab-start[2198]: + git init -b master1689gitlab # [ 191.809133] setup-gitlab-start[2503]: Initialized empty Git repository in /tmp/test-flake/.git/1690gitlab # [ 191.810199] setup-gitlab-start[2198]: + git config user.name test1691gitlab # [ 191.814402] setup-gitlab-start[2198]: + git config user.email test@example.com1692gitlab # [ 191.818674] setup-gitlab-start[2198]: + cat1693gitlab # [ 191.822303] setup-gitlab-start[2198]: + git add flake.nix1694gitlab # [ 191.827348] setup-gitlab-start[2198]: + git commit -m 'initial commit'1695gitlab # [ 191.838532] setup-gitlab-start[2508]: [master (root-commit) be7bf39] initial commit1696gitlab # [ 191.839441] setup-gitlab-start[2508]: 1 file changed, 10 insertions(+)1697gitlab # [ 191.840243] setup-gitlab-start[2508]: create mode 100644 flake.nix1698gitlab # [ 191.841031] setup-gitlab-start[2198]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1699gitlab # [ 191.846572] setup-gitlab-start[2198]: + git push -u origin master1700gitlab # [ 191.999175] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:13 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1321701gitlab # [ 192.227978] gitaly[918]: time="2026-08-20T06:12:13.484Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRWT885VC94HSR3M73GVD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:13.477" grpc.time_ms=6.556 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1702gitlab # [ 192.239040] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:13 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2281703gitlab # [ 192.447854] gitaly[918]: time="2026-08-20T06:12:13.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:12:23.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:13.694" grpc.time_ms=9.231 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 192.490845] gitaly[918]: time="2026-08-20T06:12:13.747Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T06:12:43.035" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T06:12:13.735" grpc.time_ms=11.287 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 192.507899] gitaly[918]: time="2026-08-20T06:12:13.764Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EWRX1X15G1M4RFF7RDB110 duration_ms=124ns method=POST pid=918 status=200 url="http://unix/api/v4/internal/allowed"1706gitlab # [ 192.528424] gitaly[918]: time="2026-08-20T06:12:13.784Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EWRX1X15G1M4RFF7RDB110 duration_ms=19ns method=POST pid=918 status=200 url="http://unix/api/v4/internal/pre_receive"1707gitlab # [ 192.531577] gitaly[918]: time="2026-08-20T06:12:13.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:13.638" grpc.time_ms=149.393 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1708gitlab # [ 192.572950] gitaly[918]: time="2026-08-20T06:12:13.829Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:13.828" grpc.time_ms=0.523 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1709gitlab # [ 192.612530] gitaly[918]: time="2026-08-20T06:12:13.869Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:13.868" grpc.time_ms=0.47 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1710gitlab # [ 192.647530] gitaly[918]: time="2026-08-20T06:12:13.904Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:13.903" grpc.time_ms=0.6 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1711gitlab # [ 192.822101] gitaly[918]: time="2026-08-20T06:12:14.078Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:12:24.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:14.068" grpc.time_ms=10.326 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 192.860674] gitaly[918]: time="2026-08-20T06:12:14.117Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1560 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:12:24.036" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:14.097" grpc.time_ms=19.997 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 192.924567] gitaly[918]: time="2026-08-20T06:12:14.179Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EWRX1X15G1M4RFF7RDB110 duration_ms=244ns method=POST pid=918 status=200 url="http://unix/api/v4/internal/post_receive"1714gitlab # [ 192.925616] gitaly[918]: time="2026-08-20T06:12:14.180Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:13.934" grpc.time_ms=246.156 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1715gitlab # [ 192.951192] gitaly[918]: time="2026-08-20T06:12:14.207Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 diskcache=f10fd286-1851-422b-90db-df3156bae8a3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:13.582" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1716gitlab # [ 192.952365] gitaly[918]: time="2026-08-20T06:12:14.207Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=206 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13824 command.oublock=32 command.real_time_ms=614 command.spawn_token_fork_ms=0 command.system_time_ms=135 command.user_time_ms=71 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:13.582" grpc.time_ms=625.3 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 192.971585] gitlab-workhorse[825]: time="2026-08-20T06:12:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521718gitlab # [ 192.972569] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:14 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7251719gitlab # [ 192.975992] setup-gitlab-start[2512]: To http://gitlab/root/test-flake.git1720gitlab # [ 192.976705] setup-gitlab-start[2512]: * [new branch] master -> master1721gitlab # [ 192.980738] setup-gitlab-start[2512]: branch 'master' set up to track 'origin/master'.1722gitlab # [ 192.984825] systemd[1]: Finished setup-gitlab.service.1723gitlab # [ 192.986814] systemd[1]: Starting nixbot CI service...1724gitlab # [ 193.270249] sidekiq-cluster[2459]: {"severity":"INFO","time":"2026-08-20T06:12:14.509Z","message":"Starting cluster with 1 processes"}1725gitlab: (finished: waiting for unit setup-gitlab.service, in 193.95 seconds)1726gitlab: waiting for unit nixbot.service1727gitlab # [ 194.160373] nixbot[2601]: {"ts": "2026-08-20T06:12:15.416Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1728gitlab # [ 194.189396] nixbot[2601]: {"ts": "2026-08-20T06:12:15.445Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1729gitlab # [ 194.201806] nixbot[2601]: {"ts": "2026-08-20T06:12:15.458Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1730gitlab # [ 194.204837] nixbot[2601]: {"ts": "2026-08-20T06:12:15.461Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1731gitlab # [ 194.207332] nixbot[2601]: {"ts": "2026-08-20T06:12:15.463Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1732gitlab # [ 194.211270] nixbot[2601]: {"ts": "2026-08-20T06:12:15.467Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1733gitlab # [ 194.213648] nixbot[2601]: {"ts": "2026-08-20T06:12:15.470Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1734gitlab # [ 194.215399] nixbot[2601]: {"ts": "2026-08-20T06:12:15.471Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1735gitlab # [ 194.220345] nixbot[2601]: {"ts": "2026-08-20T06:12:15.476Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1736gitlab # [ 194.221984] nixbot[2601]: {"ts": "2026-08-20T06:12:15.478Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1737gitlab # [ 194.225581] nixbot[2601]: {"ts": "2026-08-20T06:12:15.481Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1738gitlab # [ 194.230375] nixbot[2601]: {"ts": "2026-08-20T06:12:15.486Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1739gitlab # [ 194.233526] nixbot[2601]: {"ts": "2026-08-20T06:12:15.490Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1740gitlab # [ 194.235973] nixbot[2601]: {"ts": "2026-08-20T06:12:15.492Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1741gitlab # [ 194.240506] nixbot[2601]: {"ts": "2026-08-20T06:12:15.497Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1742gitlab # [ 194.242696] nixbot[2601]: {"ts": "2026-08-20T06:12:15.499Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1743gitlab # [ 194.244848] nixbot[2601]: {"ts": "2026-08-20T06:12:15.501Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1744gitlab # [ 194.246545] nixbot[2601]: {"ts": "2026-08-20T06:12:15.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1745gitlab # [ 194.251921] nixbot[2601]: {"ts": "2026-08-20T06:12:15.508Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1746gitlab # [ 194.254297] nixbot[2601]: {"ts": "2026-08-20T06:12:15.510Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1747gitlab # [ 194.256295] nixbot[2601]: {"ts": "2026-08-20T06:12:15.512Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1748gitlab # [ 194.259994] nixbot[2601]: {"ts": "2026-08-20T06:12:15.516Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1749gitlab # [ 194.261771] nixbot[2601]: {"ts": "2026-08-20T06:12:15.518Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1750gitlab # [ 194.263993] nixbot[2601]: {"ts": "2026-08-20T06:12:15.520Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1751gitlab # [ 194.265866] nixbot[2601]: {"ts": "2026-08-20T06:12:15.522Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1752gitlab # [ 194.616129] nixbot[2601]: INFO: Started server process [2601]1753gitlab # [ 194.617307] nixbot[2601]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1754gitlab # [ 194.631716] nixbot[2601]: INFO: ::ffff:127.0.0.1:58690 - "GET /health HTTP/1.1" 200 OK1755gitlab # [ 194.636140] systemd[1]: Started nixbot CI service.1756gitlab # [ 194.638636] systemd[1]: Reached target Multi-User System.1757gitlab # [ 194.639544] systemd[1]: Startup finished in 1.343s (kernel) + 3.531s (initrd) + 3min 9.764s (userspace) = 3min 14.639s.1758gitlab # [ 194.810889] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1761759gitlab # [ 194.811976] nixbot[2601]: {"ts": "2026-08-20T06:12:16.065Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1760gitlab # [ 194.838403] nixbot[2601]: {"ts": "2026-08-20T06:12:16.094Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1761gitlab # [ 194.889937] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 421762gitlab # [ 194.891153] nixbot[2601]: {"ts": "2026-08-20T06:12:16.146Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1763gitlab # [ 194.891907] nixbot[2601]: {"ts": "2026-08-20T06:12:16.147Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1764gitlab # [ 194.975136] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 771765gitlab # [ 194.975554] nixbot[2601]: {"ts": "2026-08-20T06:12:16.230Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1766gitlab # [ 195.151593] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1661767gitlab # [ 195.152733] nixbot[2601]: {"ts": "2026-08-20T06:12:16.408Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1768gitlab # [ 195.193763] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 331769gitlab # [ 195.197406] nixbot[2601]: {"ts": "2026-08-20T06:12:16.453Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1770gitlab: (finished: waiting for unit nixbot.service, in 2.06 seconds)1771gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1772gitlab # [ 195.380456] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 1781773gitlab # [ 195.381716] nixbot[2601]: {"ts": "2026-08-20T06:12:16.637Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1774gitlab # [ 195.411565] nixbot[2601]: INFO: ::ffff:127.0.0.1:58700 - "GET /health HTTP/1.1" 200 OK1775gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1776subtest: project discovered and webhook registered1777gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1778gitlab # [ 195.451779] gitaly[918]: time="2026-08-20T06:12:16.707Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS043Z7TB4M85SXB8BQQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T06:12:46.099" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:16.699" grpc.time_ms=8.011 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 195.462567] gitaly[918]: time="2026-08-20T06:12:16.719Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS043Z7TB4M85SXB8BQQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:12:46.118" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:16.718" grpc.time_ms=0.422 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 195.483685] gitaly[918]: time="2026-08-20T06:12:16.740Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS043Z7TB4M85SXB8BQQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T06:12:26.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:16.733" grpc.time_ms=6.637 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1782gitlab # [ 195.500874] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 671783(finished: subtest: project discovered and webhook registered, in 0.09 seconds)1784subtest: push delivers the webhook1785gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1786gitlab # [ 195.507735] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1201787gitlab # [ 195.509777] nixbot[2601]: {"ts": "2026-08-20T06:12:16.765Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1788gitlab # [ 195.555313] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 191789gitlab # [ 195.565065] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 521790gitlab # [ 195.567189] nixbot[2601]: {"ts": "2026-08-20T06:12:16.821Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1791gitlab # [ 195.569413] nixbot[2601]: {"ts": "2026-08-20T06:12:16.824Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1792gitlab # [ 195.625391] gitaly[918]: time="2026-08-20T06:12:16.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS09E6QZBYGYX805CBK5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.876" grpc.time_ms=5.846 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1793gitlab # [ 195.636497] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 681794gitlab # [ 195.642976] gitaly[918]: time="2026-08-20T06:12:16.899Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0AJXS45GPRKWZHG7EJY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.892" grpc.time_ms=5.982 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1795gitlab # [ 195.653719] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491796gitlab # Enumerating objects: 5, done.1797gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1798gitlab # Delta compression using up to 4 threads1799gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1800gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1801gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1802gitlab # [ 195.720868] gitaly[918]: time="2026-08-20T06:12:16.977Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0C5QMHQDV93DE3Y35M7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.968" pid=918 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1803gitlab # [ 195.729489] gitaly[918]: time="2026-08-20T06:12:16.977Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0C5QMHQDV93DE3Y35M7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.968" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1804gitlab # [ 195.741849] gitaly[918]: time="2026-08-20T06:12:16.988Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0C5QMHQDV93DE3Y35M7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.968" grpc.time_ms=19.198 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1805gitlab # [ 195.742542] gitlab-workhorse[825]: time="2026-08-20T06:12:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131806gitlab # [ 195.743084] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 871807gitlab # [ 195.783073] gitaly[918]: time="2026-08-20T06:12:17.039Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0EZXGDMM5TYG196RMR2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.025" pid=918 remote_ip="2001:db8:1::1" request_sha=d9ac27a2f5c51983f2daffb41baf31749cb8f3fb response_bytes=223 span.kind=server system=grpc1808gitlab # [ 195.791500] gitaly[918]: time="2026-08-20T06:12:17.039Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0EZXGDMM5TYG196RMR2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.025" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1809gitlab # [ 195.802518] gitaly[918]: time="2026-08-20T06:12:17.048Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0EZXGDMM5TYG196RMR2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.025" grpc.time_ms=22.584 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1810gitlab # [ 195.815350] gitlab-workhorse[825]: time="2026-08-20T06:12:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231811gitlab # [ 195.816174] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 621812gitlab # [ 195.842771] gitaly[918]: time="2026-08-20T06:12:17.099Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T06:12:47.088" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T06:12:17.088" grpc.time_ms=10.769 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 195.852366] gitaly[918]: time="2026-08-20T06:12:17.108Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 duration_ms=61ns method=POST pid=918 status=200 url="http://unix/api/v4/internal/allowed"1814gitlab # [ 195.881592] gitaly[918]: time="2026-08-20T06:12:17.138Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 duration_ms=28ns method=POST pid=918 status=200 url="http://unix/api/v4/internal/pre_receive"1815gitlab # [ 195.882556] gitaly[918]: time="2026-08-20T06:12:17.139Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.046" grpc.time_ms=92.611 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1816gitlab # [ 195.902626] gitaly[918]: time="2026-08-20T06:12:17.159Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0JTZRCC5KBF28YK3QF8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.149" grpc.time_ms=9.755 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1817gitlab # [ 195.913420] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551818gitlab # [ 195.914625] gitaly[918]: time="2026-08-20T06:12:17.171Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.169" grpc.time_ms=1.461 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1819gitlab # [ 195.946787] gitaly[918]: time="2026-08-20T06:12:17.203Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.202" grpc.time_ms=0.388 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1820gitlab # [ 195.975137] gitaly[918]: time="2026-08-20T06:12:17.231Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0MW7T5SJ8HGEX7PMQ0S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.220" pid=918 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1821gitlab # [ 195.975796] gitaly[918]: time="2026-08-20T06:12:17.231Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0MW7T5SJ8HGEX7PMQ0S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.220" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1822gitlab # [ 195.976868] gitlab-workhorse[825]: time="2026-08-20T06:12:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671823gitlab # [ 195.977559] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 521824gitlab # [ 195.978636] gitaly[918]: time="2026-08-20T06:12:17.231Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0MW7T5SJ8HGEX7PMQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.220" grpc.time_ms=11.032 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825gitlab # [ 195.979882] gitaly[918]: time="2026-08-20T06:12:17.236Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.235" grpc.time_ms=0.57 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1826gitlab # [ 196.027864] gitaly[918]: time="2026-08-20T06:12:17.284Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0PHK1SZ0AWC6YV4H09P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.270" pid=918 remote_ip="2001:db8:1::1" request_sha=156621f0a85d267bbffdc983eb0aad1b20853615 response_bytes=338 span.kind=server system=grpc1827gitlab # [ 196.028590] gitaly[918]: time="2026-08-20T06:12:17.284Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0PHK1SZ0AWC6YV4H09P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.270" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1828gitlab # [ 196.029364] gitaly[918]: time="2026-08-20T06:12:17.285Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0PHK1SZ0AWC6YV4H09P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.270" grpc.time_ms=14.486 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # [ 196.029948] gitlab-workhorse[825]: time="2026-08-20T06:12:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381830gitlab # [ 196.030324] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 511831gitlab # [ 196.110963] gitaly[918]: time="2026-08-20T06:12:17.367Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 duration_ms=39ns method=POST pid=918 status=200 url="http://unix/api/v4/internal/post_receive"1832gitlab # [ 196.111747] gitaly[918]: time="2026-08-20T06:12:17.368Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.327" grpc.time_ms=40.27 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1833gitlab # [ 196.131073] gitaly[918]: time="2026-08-20T06:12:17.387Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 diskcache=54def58a-4ccd-4bbf-a5e7-7c8ba6459396 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.972" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1834gitlab # [ 196.131557] gitlab-workhorse[825]: time="2026-08-20T06:12:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521835gitlab # [ 196.132035] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4661836gitlab # [ 196.132534] gitaly[918]: time="2026-08-20T06:12:17.387Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=157 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13114 command.oublock=32 command.real_time_ms=405 command.spawn_token_fork_ms=0 command.system_time_ms=118 command.user_time_ms=39 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:16.972" grpc.time_ms=414.502 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1837gitlab # To http://gitlab/root/test-flake.git1838gitlab # be7bf39..39afbb4 master -> master1839gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.66 seconds)1840gitlab: must succeed: git -C /tmp/test-flake rev-parse master1841gitlab # [ 196.166540] gitaly[918]: time="2026-08-20T06:12:17.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0TJYQ2YYP2C5XF1N2HA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.415" grpc.time_ms=7.062 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1842gitlab # [ 196.177739] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 711843gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1845gitlab # [ 196.227253] gitaly[918]: time="2026-08-20T06:12:17.483Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0WWCEV5QKDD92KKYW6D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.470" pid=918 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1846gitlab # [ 196.235881] gitaly[918]: time="2026-08-20T06:12:17.483Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0WWCEV5QKDD92KKYW6D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.470" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.07 seconds)1848gitlab # [ 196.248056] gitlab-workhorse[825]: time="2026-08-20T06:12:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091849gitlab # [ 196.248664] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 471850gitlab # [ 196.249518] nixbot[2601]: INFO: ::ffff:127.0.0.1:58702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1851gitlab # [ 196.250543] gitaly[918]: time="2026-08-20T06:12:17.483Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0WWCEV5QKDD92KKYW6D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:17.470" grpc.time_ms=12.866 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1852gitlab # [ 196.312215] gitaly[918]: time="2026-08-20T06:12:17.568Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:12:47.567" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:17.568" grpc.time_ms=0.528 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 196.341974] gitaly[918]: time="2026-08-20T06:12:17.598Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:12:47.592" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:17.592" grpc.time_ms=5.822 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 196.357241] gitaly[918]: time="2026-08-20T06:12:17.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:12:27.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:17.608" grpc.time_ms=5.491 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 196.379518] gitaly[918]: time="2026-08-20T06:12:17.636Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:12:27.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:17.630" grpc.time_ms=5.989 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 196.417666] gitaly[918]: time="2026-08-20T06:12:17.674Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:12:27.073" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:17.673" grpc.time_ms=0.233 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 196.440860] gitaly[918]: time="2026-08-20T06:12:17.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:12:27.088" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:17.688" grpc.time_ms=8.26 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 196.471832] gitaly[918]: time="2026-08-20T06:12:17.728Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.727" grpc.time_ms=0.329 pid=918 span.kind=server system=grpc1859gitlab # [ 196.497472] gitaly[918]: time="2026-08-20T06:12:17.754Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:12:17.753" grpc.time_ms=0.304 pid=918 span.kind=server system=grpc1860gitlab # [ 196.514741] gitaly[918]: time="2026-08-20T06:12:17.771Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ diskcache=257c2318-32bc-478e-a15a-ac6fbdf49303 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:12:27.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:17.700" pid=918 ref=refs/keep-around/be7bf397f1618b407188bf1fa476564a15a7048a remote_ip="2001:db8:1::1" revision=be7bf397f1618b407188bf1fa476564a15a7048a span.kind=server system=grpc username=root1861gitlab # [ 196.524081] gitaly[918]: time="2026-08-20T06:12:17.780Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5388 command.oublock=8 command.real_time_ms=63 command.spawn_token_fork_ms=0 command.system_time_ms=28 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:12:27.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:12:17.700" grpc.time_ms=71.018 pid=918 ref=refs/keep-around/be7bf397f1618b407188bf1fa476564a15a7048a remote_ip="2001:db8:1::1" revision=be7bf397f1618b407188bf1fa476564a15a7048a span.kind=server system=grpc username=root1862gitlab # [ 196.538882] gitaly[918]: time="2026-08-20T06:12:17.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:12:47.794" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:17.794" grpc.time_ms=0.341 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 196.667176] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3881864gitlab # [ 196.669146] nixbot[2601]: {"ts": "2026-08-20T06:12:17.922Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}1865gitlab # [ 196.686233] nixbot[2601]: {"ts": "2026-08-20T06:12:17.942Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-be7bf397f161-0"}1866gitlab # [ 196.736707] systemd[1]: Started Nix Daemon.1867gitlab # [ 196.801518] nix-daemon[2813]: accepted connection from pid 2807, user nixbot1868gitlab # [ 196.902348] nix-daemon[2813]: accepted connection from pid 2820, user nixbot1869gitlab # [ 196.923642] nixbot[2601]: {"ts": "2026-08-20T06:12:18.179Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-be7bf397f161-0", "argv0": "bwrap"}1870gitlab # [ 197.074218] nix-daemon[2813]: accepted connection from pid 2830, user nixbot1871gitlab # [ 197.151620] nix-daemon[2813]: accepted connection from pid 2840, user nixbot1872gitlab # [ 197.168223] nix-daemon[2813]: accepted connection from pid 2830, user nixbot1873gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1874gitlab # [ 197.286713] nixbot[2601]: INFO: ::ffff:127.0.0.1:58716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1877gitlab # [ 198.310080] nixbot[2601]: INFO: ::ffff:127.0.0.1:58724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.02 seconds)1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1880gitlab # [ 199.341990] nixbot[2601]: INFO: ::ffff:127.0.0.1:58734 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1883gitlab # [ 200.365331] nixbot[2601]: INFO: ::ffff:127.0.0.1:58744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.02 seconds)1885gitlab # [ 201.312763] nix-daemon[2813]: accepted connection from pid 2864, user nixbot1886gitlab # [ 201.343768] gitaly[918]: time="2026-08-20T06:12:22.599Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS5WBKDP811K3W2AT2EM9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:12:52.598" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:22.599" grpc.time_ms=0.661 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1888gitlab # [ 201.370319] gitaly[918]: time="2026-08-20T06:12:22.626Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS5WBKDP811K3W2AT2EM9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:12:32.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:22.620" grpc.time_ms=6.758 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 201.403990] nixbot[2601]: INFO: ::ffff:127.0.0.1:58758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1890gitlab # [ 201.406204] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1221891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1892gitlab # [ 201.408669] nixbot[2601]: {"ts": "2026-08-20T06:12:22.663Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}1893gitlab # [ 201.441098] gitaly[918]: time="2026-08-20T06:12:22.697Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS609YPG8B81W1YK65BR0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:12:52.696" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:22.696" grpc.time_ms=0.838 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 201.471626] gitaly[918]: time="2026-08-20T06:12:22.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS609YPG8B81W1YK65BR0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:12:32.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:22.720" grpc.time_ms=7.29 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 201.528515] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1181896gitlab # [ 201.529630] nixbot[2601]: {"ts": "2026-08-20T06:12:22.785Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1898gitlab # [ 202.439483] nixbot[2601]: INFO: ::ffff:127.0.0.1:58774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1901gitlab # [ 203.471110] nixbot[2601]: INFO: ::ffff:127.0.0.1:38188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1904gitlab # [ 204.504302] nixbot[2601]: INFO: ::ffff:127.0.0.1:38198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1907gitlab # [ 205.538286] nixbot[2601]: INFO: ::ffff:127.0.0.1:38210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1909gitlab # [ 205.673764] nix-daemon[2813]: accepted connection from pid 2913, user nixbot1910gitlab # [ 205.761911] gitaly[918]: time="2026-08-20T06:12:27.017Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWSA6M68ZFABBS9D38H4YG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:12:57.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:12:27.016" grpc.time_ms=0.676 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 205.802557] gitaly[918]: time="2026-08-20T06:12:27.058Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWSA6M68ZFABBS9D38H4YG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:12:37.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:12:27.051" grpc.time_ms=6.941 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 205.873749] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1641913gitlab # [ 205.875246] nixbot[2601]: {"ts": "2026-08-20T06:12:27.130Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}1914gitlab # [ 205.935790] nix-daemon[2813]: accepted connection from pid 2927, user nixbot1915gitlab # [ 206.042768] gitaly[918]: time="2026-08-20T06:12:27.298Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWSAFBH7AR7WZQPMNNCEJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:27.288" grpc.time_ms=10.138 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1916gitlab # [ 206.069136] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 561917gitlab # [ 206.127759] gitaly[918]: time="2026-08-20T06:12:27.384Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWSAHYK12P9KQ3CVV4CENG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:27.372" pid=918 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1918gitlab # [ 206.128575] gitaly[918]: time="2026-08-20T06:12:27.384Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWSAHYK12P9KQ3CVV4CENG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:27.372" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 206.166873] gitaly[918]: time="2026-08-20T06:12:27.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWSAHYK12P9KQ3CVV4CENG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:12:27.372" grpc.time_ms=51.276 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab # [ 206.168721] gitlab-workhorse[825]: time="2026-08-20T06:12:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671921gitlab # [ 206.169449] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:12:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 971922gitlab # [ 206.269309] nix-daemon[2813]: accepted connection from pid 2952, user nixbot1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1924gitlab # [ 206.579633] nixbot[2601]: INFO: ::ffff:127.0.0.1:38222 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1925gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1927gitlab # [ 207.616922] nixbot[2601]: INFO: ::ffff:127.0.0.1:38232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1930gitlab # [ 208.654345] nixbot[2601]: INFO: ::ffff:127.0.0.1:38242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1933gitlab # [ 209.691902] nixbot[2601]: INFO: ::ffff:127.0.0.1:38258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1936gitlab # [ 210.729392] nixbot[2601]: INFO: ::ffff:127.0.0.1:38272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1937gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1939gitlab # [ 211.766468] nixbot[2601]: INFO: ::ffff:127.0.0.1:38280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1942gitlab # [ 212.804447] nixbot[2601]: INFO: ::ffff:127.0.0.1:38290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1945gitlab # [ 213.841869] nixbot[2601]: INFO: ::ffff:127.0.0.1:52820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1948gitlab # [ 214.879194] nixbot[2601]: INFO: ::ffff:127.0.0.1:52830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1951gitlab # [ 215.916323] nixbot[2601]: INFO: ::ffff:127.0.0.1:52840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1954gitlab # [ 216.953354] nixbot[2601]: INFO: ::ffff:127.0.0.1:52846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1955gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1957gitlab # [ 217.988185] nixbot[2601]: INFO: ::ffff:127.0.0.1:52848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1959gitlab # [ 218.109483] sidekiq-cluster[2613]: 2026-08-20T06:12:39.364Z pid=2613 tid=xb1 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2613, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432844800}1960gitlab # [ 218.278994] sidekiq-cluster[2613]: W, [2026-08-20T06:12:39.535072 #2613] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1961gitlab # [ 218.315174] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:12:39.571Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1963gitlab # [ 219.025513] nixbot[2601]: INFO: ::ffff:127.0.0.1:52864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1965gitlab # [ 220.014767] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:12:41.270Z","message":"GitLab reliable fetch activated!"}1966gitlab # [ 220.016276] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:12:41.270Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1968gitlab # [ 220.052235] nixbot[2601]: INFO: ::ffff:127.0.0.1:52880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1969gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.02 seconds)1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1971gitlab # [ 221.088818] nixbot[2601]: INFO: ::ffff:127.0.0.1:52892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1974gitlab # [ 222.125370] nixbot[2601]: INFO: ::ffff:127.0.0.1:52900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1977gitlab # [ 223.159897] nixbot[2601]: INFO: ::ffff:127.0.0.1:60122 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1980gitlab # [ 224.195422] nixbot[2601]: INFO: ::ffff:127.0.0.1:60134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1983gitlab # [ 225.230137] nixbot[2601]: INFO: ::ffff:127.0.0.1:60144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1986gitlab # [ 226.269074] nixbot[2601]: INFO: ::ffff:127.0.0.1:60152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1989gitlab # [ 227.307635] nixbot[2601]: INFO: ::ffff:127.0.0.1:60160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1992gitlab # [ 228.345210] nixbot[2601]: INFO: ::ffff:127.0.0.1:60176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1993gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1995gitlab # [ 229.384570] nixbot[2601]: INFO: ::ffff:127.0.0.1:60188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'1998gitlab # [ 230.423723] nixbot[2601]: INFO: ::ffff:127.0.0.1:60194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2001gitlab # [ 231.460890] nixbot[2601]: INFO: ::ffff:127.0.0.1:60198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2004gitlab # [ 232.498592] nixbot[2601]: INFO: ::ffff:127.0.0.1:60214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2007gitlab # [ 233.536735] nixbot[2601]: INFO: ::ffff:127.0.0.1:58994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2010gitlab # [ 234.575575] nixbot[2601]: INFO: ::ffff:127.0.0.1:59006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2013gitlab # [ 235.615810] nixbot[2601]: INFO: ::ffff:127.0.0.1:59008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2016gitlab # [ 236.654894] nixbot[2601]: INFO: ::ffff:127.0.0.1:59012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2019gitlab # [ 237.693776] nixbot[2601]: INFO: ::ffff:127.0.0.1:59024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2022gitlab # [ 238.730460] nixbot[2601]: INFO: ::ffff:127.0.0.1:59034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2025gitlab # [ 239.762580] nixbot[2601]: INFO: ::ffff:127.0.0.1:59042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.03 seconds)2027gitlab # [ 239.898818] postgres[3071]: [3071] ERROR: relation "table_without_models" does not exist2028gitlab # [ 239.899592] postgres[3071]: [3071] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2030gitlab # [ 240.798783] nixbot[2601]: INFO: ::ffff:127.0.0.1:59050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2033gitlab # [ 241.835356] nixbot[2601]: INFO: ::ffff:127.0.0.1:59058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2035gitlab # [ 242.302677] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:03.558Z","message":"Booted Rails 7.2.3.1 application in production environment"}2036gitlab # [ 242.306726] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:03.563Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2037gitlab # [ 242.311264] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:03.563Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2038gitlab # [ 242.315079] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:03.563Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2039gitlab # [ 242.319372] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:03.565Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2041gitlab # [ 242.873939] nixbot[2601]: INFO: ::ffff:127.0.0.1:59066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2043gitlab # [ 243.656979] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:04.912Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b84be01f1401ee04ab06c531","created_at":"2026-08-20T06:12:12.234Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.257Z","job_size_bytes":2,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b84be01f1401ee04ab06c531: start","job_status":"start","queue_duration_s":52.655476,"scheduling_latency_s":52.655515}2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2045gitlab # [ 243.816774] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.072Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b84be01f1401ee04ab06c531","created_at":"2026-08-20T06:12:12.234Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.257Z","job_size_bytes":2,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b84be01f1401ee04ab06c531: done: 0.160515 sec","job_status":"done","queue_duration_s":52.655476,"scheduling_latency_s":52.655515,"redis_calls":25,"redis_duration_s":0.00614,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003518,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.085225077,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.160515,"completed_at":"2026-08-20T06:13:05.072Z","load_balancing_strategy":"primary","db_duration_s":0.063627,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2046gitlab # [ 243.819754] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.074Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"7829b54e01f0641e81fd20ee","created_at":"2026-08-20T06:12:12.264Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.268Z","job_size_bytes":2,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-7829b54e01f0641e81fd20ee: start","job_status":"start","queue_duration_s":52.80609,"scheduling_latency_s":52.806105}2047gitlab # [ 243.909704] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.153Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"7829b54e01f0641e81fd20ee","created_at":"2026-08-20T06:12:12.264Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.268Z","job_size_bytes":2,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-7829b54e01f0641e81fd20ee: done: 0.078765 sec","job_status":"done","queue_duration_s":52.80609,"scheduling_latency_s":52.806105,"redis_calls":14,"redis_duration_s":0.003476,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000751,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001595,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.062033303,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.078765,"completed_at":"2026-08-20T06:13:05.153Z","load_balancing_strategy":"primary","db_duration_s":0.025266,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048gitlab # [ 243.913839] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.154Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"039c7a987433531d03362f64","created_at":"2026-08-20T06:12:12.748Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.753Z","job_size_bytes":5,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-039c7a987433531d03362f64: start","job_status":"start","queue_duration_s":52.401197,"scheduling_latency_s":52.401212}2049gitlab # [ 243.988677] nixbot[2601]: INFO: ::ffff:127.0.0.1:42242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.11 seconds)2051gitlab # [ 244.031705] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.287Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"039c7a987433531d03362f64","created_at":"2026-08-20T06:12:12.748Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.753Z","job_size_bytes":5,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-039c7a987433531d03362f64: done: 0.133157 sec","job_status":"done","queue_duration_s":52.401197,"scheduling_latency_s":52.401212,"redis_calls":12,"redis_duration_s":0.002529,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000358,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319035,"duration_s":0.133157,"completed_at":"2026-08-20T06:13:05.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023693,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2052gitlab # [ 244.033484] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.288Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"950ca13bf509cec3c9a68869","created_at":"2026-08-20T06:12:12.770Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.773Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-950ca13bf509cec3c9a68869: start","job_status":"start","queue_duration_s":52.515655,"scheduling_latency_s":52.515669}2053gitlab # [ 244.154622] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.410Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"950ca13bf509cec3c9a68869","created_at":"2026-08-20T06:12:12.770Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.773Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-950ca13bf509cec3c9a68869: done: 0.121598 sec","job_status":"done","queue_duration_s":52.515655,"scheduling_latency_s":52.515669,"redis_calls":11,"redis_duration_s":0.001909,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000313,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.097,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.097,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000275174,"duration_s":0.121598,"completed_at":"2026-08-20T06:13:05.410Z","load_balancing_strategy":"primary","db_duration_s":0.040639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 244.157262] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.411Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"54690149b7616b41a51af39e","created_at":"2026-08-20T06:12:12.775Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.778Z","job_size_bytes":89,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-54690149b7616b41a51af39e: start","job_status":"start","queue_duration_s":52.633765,"scheduling_latency_s":52.63378}2055gitlab # [ 244.219317] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.437Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"54690149b7616b41a51af39e","created_at":"2026-08-20T06:12:12.775Z","trace_propagation_headers":{"sentry-trace":"a953de9aee0847c5a16fbb2f3f94c318-e79f0c8f2aa94655","baggage":"sentry-trace_id=a953de9aee0847c5a16fbb2f3f94c318,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRV22SGR3FS4AA9XPAMRM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:12.778Z","job_size_bytes":89,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-54690149b7616b41a51af39e: done: 0.025842 sec","job_status":"done","queue_duration_s":52.633765,"scheduling_latency_s":52.63378,"redis_calls":11,"redis_duration_s":0.002491,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000766,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000339429,"duration_s":0.025842,"completed_at":"2026-08-20T06:13:05.437Z","load_balancing_strategy":"primary","db_duration_s":0.00556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056gitlab # [ 244.229303] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.438Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 be7bf397f1618b407188bf1fa476564a15a7048a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3800db71adc3410fd35cd1a6","created_at":"2026-08-20T06:12:14.014Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-3ac8b9d695ae43a8","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:14.033Z","job_size_bytes":185,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3800db71adc3410fd35cd1a6: start","job_status":"start","queue_duration_s":51.405326,"scheduling_latency_s":51.405339}2057gitlab # [ 244.243637] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:05.450Z","message":"changes: \"0000000000000000000000000000000000000000 be7bf397f1618b407188bf1fa476564a15a7048a refs/heads/master\\n\""}2058gitlab # [ 244.246422] gitaly[918]: time="2026-08-20T06:13:05.485Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:15.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:05.473" grpc.time_ms=11.935 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 244.288809] gitaly[918]: time="2026-08-20T06:13:05.498Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:13:15.018" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:05.488" grpc.time_ms=9.86 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 244.305910] gitaly[918]: time="2026-08-20T06:13:05.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=9 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:13:15.071" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:05.542" grpc.time_ms=20.374 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 244.338708] gitaly[918]: time="2026-08-20T06:13:05.595Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:05.594" grpc.time_ms=0.481 pid=918 span.kind=server system=grpc2062gitlab # [ 244.370506] gitaly[918]: time="2026-08-20T06:13:05.627Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:05.626" grpc.time_ms=0.42 pid=918 span.kind=server system=grpc2063gitlab # [ 244.390989] gitaly[918]: time="2026-08-20T06:13:05.647Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 diskcache=26a12f2a-0693-4b87-8069-1706b9de88a4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:13:15.103" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:05.574" pid=918 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2064gitlab # [ 244.392207] gitaly[918]: time="2026-08-20T06:13:05.647Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4991 command.oublock=8 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:13:15.103" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:05.574" grpc.time_ms=73.443 pid=918 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2065gitlab # [ 244.407312] gitaly[918]: time="2026-08-20T06:13:05.663Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:13:15.193" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:05.663" grpc.time_ms=0.175 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 244.422080] gitaly[918]: time="2026-08-20T06:13:05.678Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=939 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:13:15.195" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:05.666" grpc.time_ms=12.483 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 244.501869] gitaly[918]: time="2026-08-20T06:13:05.758Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T06:13:35.048" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:05.749" grpc.time_ms=8.754 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 244.566841] gitaly[918]: time="2026-08-20T06:13:05.823Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:13:15.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:05.822" grpc.time_ms=0.509 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 244.597825] gitaly[918]: time="2026-08-20T06:13:05.854Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:13:15.024" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:13:05.845" grpc.time_ms=8.832 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 244.628339] gitaly[918]: time="2026-08-20T06:13:05.884Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:15.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:05.871" grpc.time_ms=12.763 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 244.658118] gitaly[918]: time="2026-08-20T06:13:05.914Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:15.085" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:05.905" grpc.time_ms=8.501 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 244.689351] gitaly[918]: time="2026-08-20T06:13:05.945Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:13:35.229" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:05.929" grpc.time_ms=16.205 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2074gitlab # [ 245.034568] nixbot[2601]: INFO: ::ffff:127.0.0.1:42256 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.05 seconds)2076gitlab # [ 245.053270] gitaly[918]: time="2026-08-20T06:13:06.309Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:13:16.007" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:06.308" grpc.time_ms=1.045 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 245.121715] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.376Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 be7bf397f1618b407188bf1fa476564a15a7048a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3800db71adc3410fd35cd1a6","created_at":"2026-08-20T06:12:14.014Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-3ac8b9d695ae43a8","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:14.033Z","job_size_bytes":185,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3800db71adc3410fd35cd1a6: done: 0.937536 sec","job_status":"done","queue_duration_s":51.405326,"scheduling_latency_s":51.405339,"gitaly_calls":13,"gitaly_duration_s":0.320006,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.042687,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.003918,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007719,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001882,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003283,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.015528,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010357,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.183,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.207,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.531368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000454527,"exclusive_lock_hold_duration_s":0.027588421999999998,"duration_s":0.937536,"completed_at":"2026-08-20T06:13:06.376Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093846,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2078gitlab # [ 245.185923] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.379Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","be7bf397f1618b407188bf1fa476564a15a7048a 39afbb420d3c072741c5e86fdbb6fac3439384f4 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"56bfaa918137f9c40353dd3d","created_at":"2026-08-20T06:12:17.353Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-13d0678c7ffb45a5","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.355Z","job_size_bytes":185,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-56bfaa918137f9c40353dd3d: start","job_status":"start","queue_duration_s":49.023734,"scheduling_latency_s":49.023765}2079gitlab # [ 245.186834] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.394Z","message":"changes: \"be7bf397f1618b407188bf1fa476564a15a7048a 39afbb420d3c072741c5e86fdbb6fac3439384f4 refs/heads/master\\n\""}2080gitlab # [ 245.187671] gitaly[918]: time="2026-08-20T06:13:06.425Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:16.113" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:06.414" grpc.time_ms=11.003 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 245.188599] gitaly[918]: time="2026-08-20T06:13:06.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:13:16.128" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:06.428" grpc.time_ms=9.548 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 245.189598] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.444Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"97bcb327b7f358bd8b44a211","created_at":"2026-08-20T06:13:06.441Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"78f25cd1df9cb21af2a8bdb4","job_size_bytes":46,"pid":2613,"job_status":"deduplicated","message":"ProjectCacheWorker JID-97bcb327b7f358bd8b44a211: deduplicated: until executing","deduplication.type":"until executing"}2083gitlab # [ 245.207234] gitaly[918]: time="2026-08-20T06:13:06.463Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:13:16.157" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:06.457" grpc.time_ms=5.867 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 245.220548] gitaly[918]: time="2026-08-20T06:13:06.477Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=658 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T06:13:36.067" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:06.468" grpc.time_ms=8.729 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 245.236065] gitaly[918]: time="2026-08-20T06:13:06.492Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:13:16.015" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:13:06.486" grpc.time_ms=6.396 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 245.249576] gitaly[918]: time="2026-08-20T06:13:06.505Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:16.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:06.500" grpc.time_ms=5.553 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 245.304674] gitaly[918]: time="2026-08-20T06:13:06.561Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:13:16.089" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:06.560" grpc.time_ms=0.66 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 245.318770] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.575Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","be7bf397f1618b407188bf1fa476564a15a7048a 39afbb420d3c072741c5e86fdbb6fac3439384f4 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"56bfaa918137f9c40353dd3d","created_at":"2026-08-20T06:12:17.353Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-13d0678c7ffb45a5","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.355Z","job_size_bytes":185,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-56bfaa918137f9c40353dd3d: done: 0.195957 sec","job_status":"done","queue_duration_s":49.023734,"scheduling_latency_s":49.023765,"gitaly_calls":7,"gitaly_duration_s":0.063992,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.019244,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.001956,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.00103,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003254,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007125,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005879,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000742832,"exclusive_lock_hold_duration_s":0.02075599,"duration_s":0.195957,"completed_at":"2026-08-20T06:13:06.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019028,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2089gitlab # [ 245.322680] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.576Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c5f1dbf5c6bdc85f74bdca5f","created_at":"2026-08-20T06:12:17.809Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.815Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c5f1dbf5c6bdc85f74bdca5f: start","job_status":"start","queue_duration_s":48.760421,"scheduling_latency_s":48.760438}2090gitlab # [ 245.438877] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.694Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c5f1dbf5c6bdc85f74bdca5f","created_at":"2026-08-20T06:12:17.809Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.815Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c5f1dbf5c6bdc85f74bdca5f: done: 0.118581 sec","job_status":"done","queue_duration_s":48.760421,"scheduling_latency_s":48.760438,"redis_calls":16,"redis_duration_s":0.0039169999999999995,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002162,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367644,"duration_s":0.118581,"completed_at":"2026-08-20T06:13:06.694Z","load_balancing_strategy":"primary","db_duration_s":0.021574,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 245.441351] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.696Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2cbe61538bd9716b64070ce8","created_at":"2026-08-20T06:12:17.816Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.821Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2cbe61538bd9716b64070ce8: start","job_status":"start","queue_duration_s":48.874769,"scheduling_latency_s":48.874783}2092gitlab # [ 245.555935] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.811Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2cbe61538bd9716b64070ce8","created_at":"2026-08-20T06:12:17.816Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.821Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2cbe61538bd9716b64070ce8: done: 0.115454 sec","job_status":"done","queue_duration_s":48.874769,"scheduling_latency_s":48.874783,"redis_calls":21,"redis_duration_s":0.0067800000000000004,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003439,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000430781,"duration_s":0.115454,"completed_at":"2026-08-20T06:13:06.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093gitlab # [ 245.604237] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:06.860Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"de4960a8b905faf4d8557b3a","created_at":"2026-08-20T06:12:17.904Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.908Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-de4960a8b905faf4d8557b3a: start","job_status":"start","queue_duration_s":48.951676,"scheduling_latency_s":48.951724}2094gitlab # [ 245.776090] gitaly[918]: time="2026-08-20T06:13:07.032Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:07.030" grpc.time_ms=1.53 pid=918 span.kind=server system=grpc2095gitlab # [ 245.833156] gitaly[918]: time="2026-08-20T06:13:07.089Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:07.088" grpc.time_ms=0.591 pid=918 span.kind=server system=grpc2096gitlab # [ 245.872696] gitaly[918]: time="2026-08-20T06:13:07.129Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:07.128" grpc.time_ms=0.544 pid=918 span.kind=server system=grpc2097gitlab # [ 245.890211] gitaly[918]: time="2026-08-20T06:13:07.146Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ diskcache=529f50e1-6a08-4bcc-9c91-41b7d1cb93fc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:37.001" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:07.002" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 245.898398] gitaly[918]: time="2026-08-20T06:13:07.154Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=137 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7510 command.oublock=0 command.real_time_ms=136 command.spawn_token_fork_ms=0 command.system_time_ms=90 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:37.001" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:07.002" grpc.time_ms=144.5 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 246.007525] gitaly[918]: time="2026-08-20T06:13:07.264Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:37.262" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.262" grpc.time_ms=1.399 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2101gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.04 seconds)2102gitlab # [ 246.075591] nixbot[2601]: INFO: ::ffff:127.0.0.1:42258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2103gitlab # [ 246.080113] gitaly[918]: time="2026-08-20T06:13:07.331Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:37.329" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.330" grpc.time_ms=0.685 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 246.089542] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.345Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"de4960a8b905faf4d8557b3a","created_at":"2026-08-20T06:12:17.904Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.908Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2613,"job_status":"rescheduled","message":"PipelineProcessWorker JID-de4960a8b905faf4d8557b3a: rescheduled"}2105gitlab # [ 246.099632] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.355Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"de4960a8b905faf4d8557b3a","created_at":"2026-08-20T06:12:17.904Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-28ae8f1e45f148a5","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:12:17.908Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-de4960a8b905faf4d8557b3a: done: 0.495679 sec","job_status":"done","queue_duration_s":48.951676,"scheduling_latency_s":48.951724,"gitaly_calls":3,"gitaly_duration_s":0.186889,"redis_calls":121,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.029716,"redis_read_bytes":336,"redis_write_bytes":29500,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001412,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001554,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":41,"redis_feature_flag_duration_s":0.011702,"redis_feature_flag_read_bytes":168,"redis_feature_flag_write_bytes":6785,"redis_queues_calls":27,"redis_queues_duration_s":0.004302,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005844,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000513,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000707,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00227,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":53,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":53,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":36,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.213153,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.42017993899999995,"duration_s":0.495679,"completed_at":"2026-08-20T06:13:07.355Z","load_balancing_strategy":"primary","db_duration_s":0.073672,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2106gitlab # [ 246.148145] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.357Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"78f25cd1df9cb21af2a8bdb4","created_at":"2026-08-20T06:13:05.500Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:05.513Z","job_size_bytes":46,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-78f25cd1df9cb21af2a8bdb4: start","job_status":"start","queue_duration_s":1.844463,"scheduling_latency_s":1.844531}2107gitlab # [ 246.148697] gitaly[918]: time="2026-08-20T06:13:07.391Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T12:13:07.385" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:07.386" grpc.time_ms=4.801 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 246.153994] gitaly[918]: time="2026-08-20T06:13:07.404Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:13:37.396" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.396" grpc.time_ms=7.341 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 246.179992] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.436Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"78f25cd1df9cb21af2a8bdb4","created_at":"2026-08-20T06:13:05.500Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:05.513Z","job_size_bytes":46,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-78f25cd1df9cb21af2a8bdb4: done: 0.078418 sec","job_status":"done","queue_duration_s":1.844463,"scheduling_latency_s":1.844531,"gitaly_calls":2,"gitaly_duration_s":0.016049,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006069,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001134,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000565,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002466,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364292,"duration_s":0.078418,"completed_at":"2026-08-20T06:13:07.436Z","load_balancing_strategy":"primary","db_duration_s":0.008336,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2110gitlab # [ 246.202714] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.437Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1caba101bca77b3bae6a2c4d","created_at":"2026-08-20T06:13:05.531Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:05.537Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1caba101bca77b3bae6a2c4d: start","job_status":"start","queue_duration_s":1.900308,"scheduling_latency_s":1.900335}2111gitlab # [ 246.266834] gitaly[918]: time="2026-08-20T06:13:07.523Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 diskcache=7dedc9b0-a7db-40bb-be9f-eebc7e5d2f0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:13:07.455" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.455" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 246.267551] gitaly[918]: time="2026-08-20T06:13:07.523Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=112 command.spawn_token_fork_ms=47 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:13:07.455" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.455" grpc.time_ms=67.681 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 246.292370] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.548Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1caba101bca77b3bae6a2c4d","created_at":"2026-08-20T06:13:05.531Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:05.537Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1caba101bca77b3bae6a2c4d: done: 0.111014 sec","job_status":"done","queue_duration_s":1.900308,"scheduling_latency_s":1.900335,"gitaly_calls":1,"gitaly_duration_s":0.069585,"redis_calls":15,"redis_duration_s":0.002286,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000337,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.092495276,"duration_s":0.111014,"completed_at":"2026-08-20T06:13:07.548Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab # [ 246.330717] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.586Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5118e6e9d88ea4929eb15f10","created_at":"2026-08-20T06:13:05.658Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:05.661Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5118e6e9d88ea4929eb15f10: start","job_status":"start","queue_duration_s":1.925868,"scheduling_latency_s":1.925889}2115gitlab # [ 246.378279] gitaly[918]: time="2026-08-20T06:13:07.634Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:13:37.623" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.623" grpc.time_ms=10.855 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 246.400807] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.656Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5118e6e9d88ea4929eb15f10","created_at":"2026-08-20T06:13:05.658Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:05.661Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5118e6e9d88ea4929eb15f10: done: 0.069785 sec","job_status":"done","queue_duration_s":1.925868,"scheduling_latency_s":1.925889,"gitaly_calls":1,"gitaly_duration_s":0.01313,"redis_calls":16,"redis_duration_s":0.012255,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.00031,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.01058,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069785,"completed_at":"2026-08-20T06:13:07.656Z","load_balancing_strategy":"primary","db_duration_s":0.003592,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2117gitlab # [ 246.438901] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:07.695Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"be268c63e447a15b8aff85e0","created_at":"2026-08-20T06:13:06.171Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25dc1860bea68645631045abf7e82ed7891eca8eecb0ded0c0842aaa9bd86312","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.179Z","job_size_bytes":467,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-be268c63e447a15b8aff85e0: start","job_status":"start","queue_duration_s":1.515744,"scheduling_latency_s":1.515774}2118gitlab # [ 246.471881] gitaly[918]: time="2026-08-20T06:13:07.728Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:37.726" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.727" grpc.time_ms=0.777 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 246.492077] gitaly[918]: time="2026-08-20T06:13:07.748Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:13:17.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:07.739" grpc.time_ms=8.919 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 246.604919] gitaly[918]: time="2026-08-20T06:13:07.861Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:37.859" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.860" grpc.time_ms=0.952 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 246.610461] gitaly[918]: time="2026-08-20T06:13:07.866Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=19 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:13:37.863" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:07.863" grpc.time_ms=2.875 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 246.732408] gitaly[918]: time="2026-08-20T06:13:07.988Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:17.248" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:07.978" grpc.time_ms=9.982 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2124gitlab # [ 247.118372] nixbot[2601]: INFO: ::ffff:127.0.0.1:42270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2125gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.05 seconds)2126gitlab # [ 247.185648] gitaly[918]: time="2026-08-20T06:13:08.442Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:13:38.424" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.424" grpc.time_ms=17.136 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 247.215525] gitaly[918]: time="2026-08-20T06:13:08.459Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EWRX1X15G1M4RFF7RDB110 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:13:38.443" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.444" grpc.time_ms=15.684 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 247.235760] sidekiq-cluster[2613]: {"severity":"WARN","time":"2026-08-20T06:13:08.480Z","class":"CreatePipelineWorker","correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"be7bf397f1618b407188bf1fa476564a15a7048a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"be7bf397f1618b407188bf1fa476564a15a7048a","ref":"refs/heads/master"},"retry":0}2129gitlab # [ 247.241600] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:08.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"be268c63e447a15b8aff85e0","created_at":"2026-08-20T06:13:06.171Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25dc1860bea68645631045abf7e82ed7891eca8eecb0ded0c0842aaa9bd86312","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.179Z","job_size_bytes":467,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-be268c63e447a15b8aff85e0: done: 0.790335 sec","job_status":"done","queue_duration_s":1.515744,"scheduling_latency_s":1.515774,"gitaly_calls":7,"gitaly_duration_s":0.127252,"redis_calls":51,"redis_duration_s":0.036778,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00115,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005038,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.028242,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.571562,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282997,"duration_s":0.790335,"completed_at":"2026-08-20T06:13:08.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052671,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2130gitlab # [ 247.261080] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:08.486Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f5717c56-c0a5-45fb-86ee-279a7cc96a20\"}"],"class":"WebHookWorker","jid":"8a95e210dd71ccbf03194002","created_at":"2026-08-20T06:13:06.284Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6a99a67ce40f0a80462b26b2a6c921b948915f2d100ceb9d67b173e6f67f4078","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.289Z","job_size_bytes":1751,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8a95e210dd71ccbf03194002: start","job_status":"start","queue_duration_s":2.197346,"scheduling_latency_s":2.19736}2131gitlab # [ 247.340898] nixbot[2601]: INFO: ::ffff:127.0.0.1:42272 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2132gitlab # [ 247.355495] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:08.611Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f5717c56-c0a5-45fb-86ee-279a7cc96a20\"}"],"class":"WebHookWorker","jid":"8a95e210dd71ccbf03194002","created_at":"2026-08-20T06:13:06.284Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-09c22189ca4342e9","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6a99a67ce40f0a80462b26b2a6c921b948915f2d100ceb9d67b173e6f67f4078","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.289Z","job_size_bytes":1751,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8a95e210dd71ccbf03194002: done: 0.124971 sec","job_status":"done","queue_duration_s":2.197346,"scheduling_latency_s":2.19736,"redis_calls":19,"redis_duration_s":0.003819,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000777,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000472,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.054711701999991647,"cpu_s":0.058454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000337194,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.124971,"completed_at":"2026-08-20T06:13:08.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 247.405652] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:08.661Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"54192e0a9d73472bf126876c","created_at":"2026-08-20T06:13:06.450Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"1caba101bca77b3bae6a2c4d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.453Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-54192e0a9d73472bf126876c: start","job_status":"start","queue_duration_s":2.208658,"scheduling_latency_s":2.208689}2134gitlab # [ 247.419609] gitaly[918]: time="2026-08-20T06:13:08.663Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTJWH5Y6PR7Q0A898QBTE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:08.657" grpc.time_ms=5.923 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2135gitlab # [ 247.431403] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 382136gitlab # [ 247.433645] gitaly[918]: time="2026-08-20T06:13:08.690Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 diskcache=1733d585-cf81-48bb-a287-3c9ffda7bc69 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:13:08.676" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.677" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 247.442096] gitaly[918]: time="2026-08-20T06:13:08.698Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:13:08.676" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.677" grpc.time_ms=13.052 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 247.455492] gitaly[918]: time="2026-08-20T06:13:08.712Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTJXVXB8EM8T69ZMSKEWJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:08.701" pid=918 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2139gitlab # [ 247.457984] gitaly[918]: time="2026-08-20T06:13:08.712Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTJXVXB8EM8T69ZMSKEWJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:08.701" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2140gitlab # [ 247.458901] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:08.713Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"54192e0a9d73472bf126876c","created_at":"2026-08-20T06:13:06.450Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"1caba101bca77b3bae6a2c4d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.453Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-54192e0a9d73472bf126876c: done: 0.05137 sec","job_status":"done","queue_duration_s":2.208658,"scheduling_latency_s":2.208689,"gitaly_calls":1,"gitaly_duration_s":0.023156,"redis_calls":12,"redis_duration_s":0.002546,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000651,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.036022456,"duration_s":0.05137,"completed_at":"2026-08-20T06:13:08.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 247.476295] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:08.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c63ccc11d7c64459824c5442","created_at":"2026-08-20T06:13:06.534Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0489a3004cfd9fe5cc0c1fd2d760c09b15cff7980edffcc136a32992d20b6551","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.535Z","job_size_bytes":467,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c63ccc11d7c64459824c5442: start","job_status":"start","queue_duration_s":2.17959,"scheduling_latency_s":2.179605}2142gitlab # [ 247.490477] gitlab-workhorse[825]: time="2026-08-20T06:13:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672143gitlab # [ 247.491652] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 452144gitlab # [ 247.528207] gitaly[918]: time="2026-08-20T06:13:08.712Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTJXVXB8EM8T69ZMSKEWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:08.701" grpc.time_ms=10.819 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2145gitlab # [ 247.528852] nixbot[2601]: {"ts": "2026-08-20T06:13:08.740Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2146gitlab # [ 247.529402] gitaly[918]: time="2026-08-20T06:13:08.785Z" level=info msg="finished unary call with code OK" catfile.duration_ms=50 catfile.flush_count=1 catfile.flush_ms=30 catfile.read_object_count=1 catfile.read_object_ms=20 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:38.733" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.733" grpc.time_ms=51.321 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 247.537538] gitaly[918]: time="2026-08-20T06:13:08.794Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:13:18.057" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:08.787" grpc.time_ms=6.253 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 247.559474] gitaly[918]: time="2026-08-20T06:13:08.816Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:38.814" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.815" grpc.time_ms=0.959 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 247.563555] gitaly[918]: time="2026-08-20T06:13:08.820Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=63 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:13:38.818" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.818" grpc.time_ms=1.741 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 247.573972] gitaly[918]: time="2026-08-20T06:13:08.830Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK0C0CK6HDDC2XZ6STD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:38.829" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.829" grpc.time_ms=0.498 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab # [ 247.583670] gitaly[918]: time="2026-08-20T06:13:08.840Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:18.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:08.834" grpc.time_ms=5.731 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 247.613758] gitaly[918]: time="2026-08-20T06:13:08.870Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK0C0CK6HDDC2XZ6STD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:18.265" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:08.865" grpc.time_ms=4.926 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 247.653724] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1612154gitlab # [ 247.657174] nixbot[2601]: {"ts": "2026-08-20T06:13:08.913Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}2155gitlab # [ 247.699990] gitaly[918]: time="2026-08-20T06:13:08.956Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:38.355" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:08.955" grpc.time_ms=0.51 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 247.867362] gitaly[918]: time="2026-08-20T06:13:09.123Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:13:39.112" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:09.113" grpc.time_ms=10.405 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 247.882065] gitaly[918]: time="2026-08-20T06:13:09.138Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0CRPFQ2FTBZE8KSAEW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:13:39.125" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:09.126" grpc.time_ms=12.331 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 247.891353] sidekiq-cluster[2613]: {"severity":"WARN","time":"2026-08-20T06:13:09.147Z","class":"CreatePipelineWorker","correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"be7bf397f1618b407188bf1fa476564a15a7048a","after":"39afbb420d3c072741c5e86fdbb6fac3439384f4","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"39afbb420d3c072741c5e86fdbb6fac3439384f4","ref":"refs/heads/master"},"retry":0}2159gitlab # [ 247.895220] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c63ccc11d7c64459824c5442","created_at":"2026-08-20T06:13:06.534Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0489a3004cfd9fe5cc0c1fd2d760c09b15cff7980edffcc136a32992d20b6551","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.535Z","job_size_bytes":467,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c63ccc11d7c64459824c5442: done: 0.436338 sec","job_status":"done","queue_duration_s":2.17959,"scheduling_latency_s":2.179605,"gitaly_calls":7,"gitaly_duration_s":0.101218,"redis_calls":33,"redis_duration_s":0.005638,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000473,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002285,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.314944,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.436338,"completed_at":"2026-08-20T06:13:09.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012704,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2160gitlab # [ 247.949792] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.152Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ff16483b-e464-4c9f-bcd6-f3a8e855b613\"}"],"class":"WebHookWorker","jid":"0e5eaa5bf9051e14f2841c5c","created_at":"2026-08-20T06:13:06.550Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d72e6494ebbee09ac5096d1314241a88e08c885b07adeaaf0798830245cc972","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.552Z","job_size_bytes":1749,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0e5eaa5bf9051e14f2841c5c: start","job_status":"start","queue_duration_s":2.599931,"scheduling_latency_s":2.599948}2161gitlab # [ 247.950565] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.177Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ff16483b-e464-4c9f-bcd6-f3a8e855b613\"}"],"class":"WebHookWorker","jid":"0e5eaa5bf9051e14f2841c5c","created_at":"2026-08-20T06:13:06.550Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-d69b0721e6b24dcb","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d72e6494ebbee09ac5096d1314241a88e08c885b07adeaaf0798830245cc972","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.552Z","job_size_bytes":1749,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0e5eaa5bf9051e14f2841c5c: done: 0.024468 sec","job_status":"done","queue_duration_s":2.599931,"scheduling_latency_s":2.599948,"redis_calls":14,"redis_duration_s":0.0022919999999999998,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004804799999988063,"cpu_s":0.014081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.024468,"completed_at":"2026-08-20T06:13:09.177Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2162gitlab # [ 247.996306] nixbot[2601]: INFO: ::ffff:127.0.0.1:42284 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2163gitlab # [ 247.996966] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 412164gitlab # [ 247.997514] gitaly[918]: time="2026-08-20T06:13:09.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKE3TV3817S47PGR1VJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.221" grpc.time_ms=7.068 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2165gitlab # [ 247.998449] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.178Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8547d359d083dc69ff8f14b9","created_at":"2026-08-20T06:13:06.990Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.993Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8547d359d083dc69ff8f14b9: start","job_status":"start","queue_duration_s":2.184184,"scheduling_latency_s":2.184197}2166gitlab # [ 248.033620] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8547d359d083dc69ff8f14b9","created_at":"2026-08-20T06:13:06.990Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:06.993Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8547d359d083dc69ff8f14b9: done: 0.053479 sec","job_status":"done","queue_duration_s":2.184184,"scheduling_latency_s":2.184197,"redis_calls":10,"redis_duration_s":0.001424,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000601473,"duration_s":0.053479,"completed_at":"2026-08-20T06:13:09.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01438,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2167gitlab # [ 248.069607] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.232Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4e13ed0999b2e3a144788187","created_at":"2026-08-20T06:13:07.159Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.163Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4e13ed0999b2e3a144788187: start","job_status":"start","queue_duration_s":2.069041,"scheduling_latency_s":2.069063}2168gitlab # [ 248.070168] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.253Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4e13ed0999b2e3a144788187","created_at":"2026-08-20T06:13:07.159Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.163Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4e13ed0999b2e3a144788187: done: 0.020889 sec","job_status":"done","queue_duration_s":2.069041,"scheduling_latency_s":2.069063,"redis_calls":10,"redis_duration_s":0.001242,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203936,"duration_s":0.020889,"completed_at":"2026-08-20T06:13:09.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab # [ 248.085681] gitlab-workhorse[825]: time="2026-08-20T06:13:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672170gitlab # [ 248.086745] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 422171gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2172gitlab # [ 248.088204] gitaly[918]: time="2026-08-20T06:13:09.272Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKFE32896WVRX1CPCTDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.266" pid=918 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2173gitlab # [ 248.127313] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ce0ee22073a8163bfd441634","created_at":"2026-08-20T06:13:07.173Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.181Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ce0ee22073a8163bfd441634: start","job_status":"start","queue_duration_s":2.072489,"scheduling_latency_s":2.072555}2174gitlab # [ 248.127853] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.276Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ce0ee22073a8163bfd441634","created_at":"2026-08-20T06:13:07.173Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.181Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ce0ee22073a8163bfd441634: done: 0.022324 sec","job_status":"done","queue_duration_s":2.072489,"scheduling_latency_s":2.072555,"redis_calls":10,"redis_duration_s":0.001482,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000365,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240533,"duration_s":0.022324,"completed_at":"2026-08-20T06:13:09.276Z","load_balancing_strategy":"primary","db_duration_s":0.004484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2175gitlab # [ 248.163279] nix-daemon[2813]: accepted connection from pid 3288, user nixbot2176gitlab # [ 248.163905] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 662177gitlab # [ 248.164452] gitaly[918]: time="2026-08-20T06:13:09.272Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKFE32896WVRX1CPCTDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.266" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2178gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.08 seconds)2179gitlab # [ 248.165105] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b029dcea87a3f3f21aab3a73","created_at":"2026-08-20T06:13:07.200Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.206Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b029dcea87a3f3f21aab3a73: start","job_status":"start","queue_duration_s":2.071162,"scheduling_latency_s":2.071184}2180gitlab # [ 248.167046] gitaly[918]: time="2026-08-20T06:13:09.272Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKFE32896WVRX1CPCTDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.266" grpc.time_ms=5.99 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2181gitlab # [ 248.178613] gitaly[918]: time="2026-08-20T06:13:09.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKHG667P4RRRNEEKETT3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.353" grpc.time_ms=8.392 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab # [ 248.214919] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.368Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b029dcea87a3f3f21aab3a73","created_at":"2026-08-20T06:13:07.200Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.206Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b029dcea87a3f3f21aab3a73: done: 0.091266 sec","job_status":"done","queue_duration_s":2.071162,"scheduling_latency_s":2.071184,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000428,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195835,"duration_s":0.091266,"completed_at":"2026-08-20T06:13:09.368Z","load_balancing_strategy":"primary","db_duration_s":0.004603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 248.224562] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"396f9e7127df27220094096a","created_at":"2026-08-20T06:13:07.207Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.213Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-396f9e7127df27220094096a: start","job_status":"start","queue_duration_s":2.227504,"scheduling_latency_s":2.227529}2184gitlab # [ 248.268184] gitlab-workhorse[825]: time="2026-08-20T06:13:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672185gitlab # [ 248.268679] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 912186gitlab # [ 248.269110] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 402187gitlab # [ 248.269579] gitaly[918]: time="2026-08-20T06:13:09.453Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKKKCFV2M4W00ZCXJ8CC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.445" pid=918 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2188gitlab # [ 248.270523] nixbot[2601]: INFO: ::ffff:127.0.0.1:42298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2189gitlab # [ 248.271351] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"396f9e7127df27220094096a","created_at":"2026-08-20T06:13:07.207Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.213Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-396f9e7127df27220094096a: done: 0.031319 sec","job_status":"done","queue_duration_s":2.227504,"scheduling_latency_s":2.227529,"redis_calls":10,"redis_duration_s":0.002768,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.031319,"completed_at":"2026-08-20T06:13:09.472Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2190gitlab # [ 248.286607] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a89af32937e092b60c5f9f00","created_at":"2026-08-20T06:13:07.214Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.220Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a89af32937e092b60c5f9f00: start","job_status":"start","queue_duration_s":2.255924,"scheduling_latency_s":2.255939}2191gitlab # [ 248.299149] gitaly[918]: time="2026-08-20T06:13:09.454Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKKKCFV2M4W00ZCXJ8CC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.445" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2192gitlab # [ 248.336652] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a89af32937e092b60c5f9f00","created_at":"2026-08-20T06:13:07.214Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.220Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a89af32937e092b60c5f9f00: done: 0.024337 sec","job_status":"done","queue_duration_s":2.255924,"scheduling_latency_s":2.255939,"redis_calls":11,"redis_duration_s":0.003459,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002206,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227403,"duration_s":0.024337,"completed_at":"2026-08-20T06:13:09.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 248.344627] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.501Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8d10d5fec0f8d12f4900229d","created_at":"2026-08-20T06:13:07.223Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.227Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8d10d5fec0f8d12f4900229d: start","job_status":"start","queue_duration_s":2.273573,"scheduling_latency_s":2.273896}2194gitlab # [ 248.358362] gitlab-workhorse[825]: time="2026-08-20T06:13:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212195gitlab # [ 248.392499] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 542196gitlab # [ 248.393194] gitaly[918]: time="2026-08-20T06:13:09.454Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKKKCFV2M4W00ZCXJ8CC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.445" grpc.time_ms=8.795 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2197gitlab # [ 248.393790] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.523Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8d10d5fec0f8d12f4900229d","created_at":"2026-08-20T06:13:07.223Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.227Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8d10d5fec0f8d12f4900229d: done: 0.022671 sec","job_status":"done","queue_duration_s":2.273573,"scheduling_latency_s":2.273896,"redis_calls":10,"redis_duration_s":0.001544,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000228241,"duration_s":0.022671,"completed_at":"2026-08-20T06:13:09.523Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 248.428905] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.524Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f45cdbe218fd30565a5d7215","created_at":"2026-08-20T06:13:07.229Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.232Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f45cdbe218fd30565a5d7215: start","job_status":"start","queue_duration_s":2.292371,"scheduling_latency_s":2.292385}2199gitlab # [ 248.429891] gitaly[918]: time="2026-08-20T06:13:09.522Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKQ90VZW6YT1J61KCA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.515" grpc.time_ms=6.061 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2200gitlab # [ 248.430419] gitaly[918]: time="2026-08-20T06:13:09.577Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKRK61VCD2K37PCRXBJV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.564" pid=918 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2201gitlab # [ 248.438176] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f45cdbe218fd30565a5d7215","created_at":"2026-08-20T06:13:07.229Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.232Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f45cdbe218fd30565a5d7215: done: 0.025944 sec","job_status":"done","queue_duration_s":2.292371,"scheduling_latency_s":2.292385,"redis_calls":10,"redis_duration_s":0.001327,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000332,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200584,"duration_s":0.025944,"completed_at":"2026-08-20T06:13:09.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 248.486901] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.551Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3572359d0425e272f9ad624f","created_at":"2026-08-20T06:13:07.236Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.239Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3572359d0425e272f9ad624f: start","job_status":"start","queue_duration_s":2.312384,"scheduling_latency_s":2.312408}2203gitlab # [ 248.487748] gitaly[918]: time="2026-08-20T06:13:09.577Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1177 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKRK61VCD2K37PCRXBJV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.564" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2204gitlab # [ 248.496749] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.578Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3572359d0425e272f9ad624f","created_at":"2026-08-20T06:13:07.236Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.239Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3572359d0425e272f9ad624f: done: 0.027227 sec","job_status":"done","queue_duration_s":2.312384,"scheduling_latency_s":2.312408,"redis_calls":10,"redis_duration_s":0.003339,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000761,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267073,"duration_s":0.027227,"completed_at":"2026-08-20T06:13:09.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 248.538271] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e3b80d04bbb4f809a9e9b3fc","created_at":"2026-08-20T06:13:07.239Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.242Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e3b80d04bbb4f809a9e9b3fc: start","job_status":"start","queue_duration_s":2.339558,"scheduling_latency_s":2.339575}2206gitlab # [ 248.544061] gitaly[918]: time="2026-08-20T06:13:09.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1177 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKRK61VCD2K37PCRXBJV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:09.564" grpc.time_ms=13.203 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2207gitlab # [ 248.580454] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e3b80d04bbb4f809a9e9b3fc","created_at":"2026-08-20T06:13:07.239Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.242Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e3b80d04bbb4f809a9e9b3fc: done: 0.015049 sec","job_status":"done","queue_duration_s":2.339558,"scheduling_latency_s":2.339575,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203099,"duration_s":0.015049,"completed_at":"2026-08-20T06:13:09.597Z","load_balancing_strategy":"primary","db_duration_s":0.001479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 248.590088] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e36d5452dd41f5be5f7d312b","created_at":"2026-08-20T06:13:07.242Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.245Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e36d5452dd41f5be5f7d312b: start","job_status":"start","queue_duration_s":2.352566,"scheduling_latency_s":2.35258}2209gitlab # [ 248.602549] gitaly[918]: time="2026-08-20T06:13:09.656Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:39.055" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:09.656" grpc.time_ms=0.441 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210gitlab # [ 248.640961] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.621Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e36d5452dd41f5be5f7d312b","created_at":"2026-08-20T06:13:07.242Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.245Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e36d5452dd41f5be5f7d312b: done: 0.023932 sec","job_status":"done","queue_duration_s":2.352566,"scheduling_latency_s":2.35258,"redis_calls":10,"redis_duration_s":0.001366,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220698,"duration_s":0.023932,"completed_at":"2026-08-20T06:13:09.621Z","load_balancing_strategy":"primary","db_duration_s":0.004804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 248.646028] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.622Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"4e449313d9e08d4564c75253","created_at":"2026-08-20T06:13:07.249Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.252Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-4e449313d9e08d4564c75253: start","job_status":"start","queue_duration_s":2.370383,"scheduling_latency_s":2.370398}2212gitlab # [ 248.687252] gitaly[918]: time="2026-08-20T06:13:09.680Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:13:39.074" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:09.675" grpc.time_ms=5.681 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 248.687876] nixbot[2601]: {"ts": "2026-08-20T06:13:09.918Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 \"HTTP/1.1 201 Created\""}2214gitlab # [ 248.688386] nixbot[2601]: {"ts": "2026-08-20T06:13:09.923Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-39afbb420d3c-4"}2215gitlab # [ 248.688848] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.671Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"4e449313d9e08d4564c75253","created_at":"2026-08-20T06:13:07.249Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.252Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-4e449313d9e08d4564c75253: done: 0.048485 sec","job_status":"done","queue_duration_s":2.370383,"scheduling_latency_s":2.370398,"redis_calls":14,"redis_duration_s":0.003856,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001577,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00085,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265117,"duration_s":0.048485,"completed_at":"2026-08-20T06:13:09.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 248.728310] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.672Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d86a33612747b3565a5cf014","created_at":"2026-08-20T06:13:07.346Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.348Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d86a33612747b3565a5cf014: start","job_status":"start","queue_duration_s":2.32355,"scheduling_latency_s":2.323565}2217gitlab # [ 248.729225] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3022218gitlab # [ 248.729706] gitaly[918]: time="2026-08-20T06:13:09.694Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:19.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:09.688" grpc.time_ms=6.857 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 248.731815] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.874Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d86a33612747b3565a5cf014","created_at":"2026-08-20T06:13:07.346Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.348Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2613,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d86a33612747b3565a5cf014: rescheduled"}2220gitlab # [ 248.743590] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.879Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d86a33612747b3565a5cf014","created_at":"2026-08-20T06:13:07.346Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-730789c734814dcc","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.348Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d86a33612747b3565a5cf014: done: 0.20714 sec","job_status":"done","queue_duration_s":2.32355,"scheduling_latency_s":2.323565,"gitaly_calls":3,"gitaly_duration_s":0.085261,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013261,"redis_read_bytes":151,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000545,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001014,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002927,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.00449,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000673,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000381,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002686,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082957,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.17933201,"duration_s":0.20714,"completed_at":"2026-08-20T06:13:09.879Z","load_balancing_strategy":"primary","db_duration_s":0.027764,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2221gitlab # [ 248.787989] nix-daemon[2813]: accepted connection from pid 3379, user nixbot2222gitlab # [ 248.788604] nix-daemon[2813]: accepted connection from pid 3387, user nixbot2223gitlab # [ 248.789687] gitaly[918]: time="2026-08-20T06:13:09.720Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:13:19.040" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:09.720" grpc.time_ms=0.215 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 248.793389] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"73f25acadf63f6b86dd923c7","created_at":"2026-08-20T06:13:07.416Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-10c3e31b1f0049f4","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.422Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-73f25acadf63f6b86dd923c7: start","job_status":"start","queue_duration_s":2.458869,"scheduling_latency_s":2.458885}2225gitlab # [ 248.827931] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.923Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"73f25acadf63f6b86dd923c7","created_at":"2026-08-20T06:13:07.416Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-10c3e31b1f0049f4","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:07.422Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-73f25acadf63f6b86dd923c7: done: 0.042208 sec","job_status":"done","queue_duration_s":2.458869,"scheduling_latency_s":2.458885,"redis_calls":19,"redis_duration_s":0.004313,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001143,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000321,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002243,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006562845,"duration_s":0.042208,"completed_at":"2026-08-20T06:13:09.923Z","load_balancing_strategy":"primary","db_duration_s":0.012939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 248.840799] nixbot[2601]: {"ts": "2026-08-20T06:13:10.037Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-39afbb420d3c-4", "argv0": "bwrap"}2227gitlab # [ 248.842736] gitaly[918]: time="2026-08-20T06:13:09.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:13:19.043" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:09.723" grpc.time_ms=5.304 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2228gitlab # [ 248.853415] gitaly[918]: time="2026-08-20T06:13:09.750Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:09.750" grpc.time_ms=0.25 pid=918 span.kind=server system=grpc2229gitlab # [ 248.890741] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.925Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8a95e210dd71ccbf03194002"],"class":"WebHooks::LogExecutionWorker","jid":"88a40cf0cf3c270c7905386f","created_at":"2026-08-20T06:13:08.599Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-b6e59050571a46bb","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:21aff9760bac0fcc8b834e90ad0de78ae9634feaa7f52168e60fb5cd6d4b0a9f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.604Z","job_size_bytes":2593,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-88a40cf0cf3c270c7905386f: start","job_status":"start","queue_duration_s":1.320528,"scheduling_latency_s":1.320549}2230gitlab # [ 248.891452] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.959Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8a95e210dd71ccbf03194002"],"class":"WebHooks::LogExecutionWorker","jid":"88a40cf0cf3c270c7905386f","created_at":"2026-08-20T06:13:08.599Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-b6e59050571a46bb","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:21aff9760bac0fcc8b834e90ad0de78ae9634feaa7f52168e60fb5cd6d4b0a9f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:08.604Z","job_size_bytes":2593,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-88a40cf0cf3c270c7905386f: done: 0.034861 sec","job_status":"done","queue_duration_s":1.320528,"scheduling_latency_s":1.320549,"redis_calls":10,"redis_duration_s":0.002058,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000454248,"duration_s":0.034861,"completed_at":"2026-08-20T06:13:09.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008074,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2231gitlab # [ 248.908612] gitaly[918]: time="2026-08-20T06:13:09.764Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:09.764" grpc.time_ms=0.189 pid=918 span.kind=server system=grpc2232gitlab # [ 248.916561] gitaly[918]: time="2026-08-20T06:13:09.774Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:09.773" grpc.time_ms=0.416 pid=918 span.kind=server system=grpc2233gitlab # [ 248.924542] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.961Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0e5eaa5bf9051e14f2841c5c"],"class":"WebHooks::LogExecutionWorker","jid":"cbdc01b648ef8db06e71fc63","created_at":"2026-08-20T06:13:09.171Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-b7e63fb2ea7642f7","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b14daa16aaeb4818e04ae411c4b20553fdb1d9db86eca946893a90a09e1a0972","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.173Z","job_size_bytes":2592,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-cbdc01b648ef8db06e71fc63: start","job_status":"start","queue_duration_s":0.787931,"scheduling_latency_s":0.787952}2234gitlab # [ 248.963181] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.979Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0e5eaa5bf9051e14f2841c5c"],"class":"WebHooks::LogExecutionWorker","jid":"cbdc01b648ef8db06e71fc63","created_at":"2026-08-20T06:13:09.171Z","trace_propagation_headers":{"sentry-trace":"92ad82f2c6944e79b12fda3209dd6a5a-b7e63fb2ea7642f7","baggage":"sentry-trace_id=92ad82f2c6944e79b12fda3209dd6a5a,sentry-release=Unknown"},"correlation_id":"01M0EWS0CRPFQ2FTBZE8KSAEW6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b14daa16aaeb4818e04ae411c4b20553fdb1d9db86eca946893a90a09e1a0972","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.173Z","job_size_bytes":2592,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-cbdc01b648ef8db06e71fc63: done: 0.018897 sec","job_status":"done","queue_duration_s":0.787931,"scheduling_latency_s":0.787952,"redis_calls":7,"redis_duration_s":0.0009660000000000001,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018897,"completed_at":"2026-08-20T06:13:09.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 248.971571] gitaly[918]: time="2026-08-20T06:13:09.784Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:09.784" grpc.time_ms=0.191 pid=918 span.kind=server system=grpc2236gitlab # [ 248.979204] gitaly[918]: time="2026-08-20T06:13:09.792Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:09.792" grpc.time_ms=0.22 pid=918 span.kind=server system=grpc2237gitlab # [ 249.013572] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:09.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"952fc71e93065e995ae59dda","created_at":"2026-08-20T06:13:09.719Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.720Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-952fc71e93065e995ae59dda: start","job_status":"start","queue_duration_s":0.260593,"scheduling_latency_s":0.260621}2238gitlab # [ 249.014199] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.013Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"952fc71e93065e995ae59dda","created_at":"2026-08-20T06:13:09.719Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.720Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-952fc71e93065e995ae59dda: done: 0.031924 sec","job_status":"done","queue_duration_s":0.260593,"scheduling_latency_s":0.260621,"redis_calls":7,"redis_duration_s":0.001037,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031924,"completed_at":"2026-08-20T06:13:10.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008552,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2239gitlab # [ 249.051200] gitaly[918]: time="2026-08-20T06:13:09.793Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 diskcache=32dae723-9289-4bbb-a2dc-aca249dcd872 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:13:19.000" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:09.731" pid=918 ref=refs/keep-around/39afbb420d3c072741c5e86fdbb6fac3439384f4 remote_ip="2001:db8:1::1" revision=39afbb420d3c072741c5e86fdbb6fac3439384f4 span.kind=server system=grpc username=root2240gitlab # [ 249.051837] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.014Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3bc4854df1bcf441054dd38c","created_at":"2026-08-20T06:13:09.803Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-35536653073449ac","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.806Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3bc4854df1bcf441054dd38c: start","job_status":"start","queue_duration_s":0.207554,"scheduling_latency_s":0.207569}2241gitlab # [ 249.054788] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.035Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3bc4854df1bcf441054dd38c","created_at":"2026-08-20T06:13:09.803Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-35536653073449ac","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.806Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3bc4854df1bcf441054dd38c: done: 0.020684 sec","job_status":"done","queue_duration_s":0.207554,"scheduling_latency_s":0.207569,"redis_calls":7,"redis_duration_s":0.000991,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020684,"completed_at":"2026-08-20T06:13:10.035Z","load_balancing_strategy":"primary","db_duration_s":0.004008,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2242gitlab # [ 249.091945] gitaly[918]: time="2026-08-20T06:13:09.793Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5129 command.oublock=8 command.real_time_ms=54 command.spawn_token_fork_ms=1 command.system_time_ms=29 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:13:19.000" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:13:09.731" grpc.time_ms=61.992 pid=918 ref=refs/keep-around/39afbb420d3c072741c5e86fdbb6fac3439384f4 remote_ip="2001:db8:1::1" revision=39afbb420d3c072741c5e86fdbb6fac3439384f4 span.kind=server system=grpc username=root2243gitlab # [ 249.100159] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.036Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9a3b128c42c0c64498d65c09","created_at":"2026-08-20T06:13:09.807Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-35536653073449ac","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.808Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9a3b128c42c0c64498d65c09: start","job_status":"start","queue_duration_s":0.227265,"scheduling_latency_s":0.227286}2244gitlab # [ 249.114143] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.068Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9a3b128c42c0c64498d65c09","created_at":"2026-08-20T06:13:09.807Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-35536653073449ac","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.808Z","job_size_bytes":65,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9a3b128c42c0c64498d65c09: done: 0.032732 sec","job_status":"done","queue_duration_s":0.227265,"scheduling_latency_s":0.227286,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032732,"completed_at":"2026-08-20T06:13:10.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 249.169284] gitaly[918]: time="2026-08-20T06:13:09.797Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:39.196" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:09.797" grpc.time_ms=0.229 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 249.169878] gitaly[918]: time="2026-08-20T06:13:09.803Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ diskcache=1d5b21dd-d4cb-4d8f-b933-ef1fb60f07ec grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:39.724" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:09.724" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4'2248gitlab # [ 249.170605] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.069Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"03796c90009938e968c80e1a","created_at":"2026-08-20T06:13:09.807Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.809Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-03796c90009938e968c80e1a: start","job_status":"start","queue_duration_s":0.260068,"scheduling_latency_s":0.260082}2249gitlab # [ 249.208739] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.085Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"03796c90009938e968c80e1a","created_at":"2026-08-20T06:13:09.807Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.809Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-03796c90009938e968c80e1a: done: 0.015621 sec","job_status":"done","queue_duration_s":0.260068,"scheduling_latency_s":0.260082,"redis_calls":7,"redis_duration_s":0.000913,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015621,"completed_at":"2026-08-20T06:13:10.085Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2250gitlab # [ 249.212149] gitaly[918]: time="2026-08-20T06:13:09.803Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7250 command.oublock=0 command.real_time_ms=69 command.spawn_token_fork_ms=1 command.system_time_ms=34 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:39.724" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:09.724" grpc.time_ms=78.452 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2251gitlab # [ 249.247524] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.086Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"697aab70e5f341a0de8901d1","created_at":"2026-08-20T06:13:09.815Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.818Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-697aab70e5f341a0de8901d1: start","job_status":"start","queue_duration_s":0.268072,"scheduling_latency_s":0.268086}2252gitlab # [ 249.248144] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"697aab70e5f341a0de8901d1","created_at":"2026-08-20T06:13:09.815Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.818Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-697aab70e5f341a0de8901d1: done: 0.01635 sec","job_status":"done","queue_duration_s":0.268072,"scheduling_latency_s":0.268086,"redis_calls":7,"redis_duration_s":0.000911,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01635,"completed_at":"2026-08-20T06:13:10.102Z","load_balancing_strategy":"primary","db_duration_s":0.002899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2253gitlab # [ 249.286042] gitaly[918]: time="2026-08-20T06:13:09.846Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:39.844" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:09.845" grpc.time_ms=0.885 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 249.286963] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.103Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0fa4aace349137436ef2779d","created_at":"2026-08-20T06:13:09.824Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.825Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0fa4aace349137436ef2779d: start","job_status":"start","queue_duration_s":0.278205,"scheduling_latency_s":0.278219}2255gitlab # [ 249.288161] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0fa4aace349137436ef2779d","created_at":"2026-08-20T06:13:09.824Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.825Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0fa4aace349137436ef2779d: done: 0.017354 sec","job_status":"done","queue_duration_s":0.278205,"scheduling_latency_s":0.278219,"redis_calls":10,"redis_duration_s":0.001176,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000336,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017354,"completed_at":"2026-08-20T06:13:10.120Z","load_balancing_strategy":"primary","db_duration_s":0.002551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2256gitlab # [ 249.331342] gitaly[918]: time="2026-08-20T06:13:09.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWS0ZVQJAY67PE8Z8WR9NZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:39.868" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:09.869" grpc.time_ms=0.447 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 249.332101] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.121Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"31869f880e868fff33fe5f6f","created_at":"2026-08-20T06:13:09.825Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.826Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-31869f880e868fff33fe5f6f: start","job_status":"start","queue_duration_s":0.295189,"scheduling_latency_s":0.295203}2258gitlab # [ 249.373106] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"31869f880e868fff33fe5f6f","created_at":"2026-08-20T06:13:09.825Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.826Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-31869f880e868fff33fe5f6f: done: 0.014668 sec","job_status":"done","queue_duration_s":0.295189,"scheduling_latency_s":0.295203,"redis_calls":7,"redis_duration_s":0.0009009999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014668,"completed_at":"2026-08-20T06:13:10.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 249.410231] gitaly[918]: time="2026-08-20T06:13:10.267Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:40.266" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:10.266" grpc.time_ms=0.752 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 249.410818] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d3b80e6b87755011ec92409e","created_at":"2026-08-20T06:13:09.826Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.828Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d3b80e6b87755011ec92409e: start","job_status":"start","queue_duration_s":0.308703,"scheduling_latency_s":0.308717}2261gitlab # [ 249.411368] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d3b80e6b87755011ec92409e","created_at":"2026-08-20T06:13:09.826Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.828Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d3b80e6b87755011ec92409e: done: 0.013795 sec","job_status":"done","queue_duration_s":0.308703,"scheduling_latency_s":0.308717,"redis_calls":8,"redis_duration_s":0.001044,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013795,"completed_at":"2026-08-20T06:13:10.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2262gitlab # [ 249.449782] gitaly[918]: time="2026-08-20T06:13:10.289Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTKVE34BCM746GJTBPJ04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:40.288" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:10.288" grpc.time_ms=0.553 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 249.450463] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.151Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"316d97d34c47bd26285bc209","created_at":"2026-08-20T06:13:09.829Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.830Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-316d97d34c47bd26285bc209: start","job_status":"start","queue_duration_s":0.321708,"scheduling_latency_s":0.321721}2264gitlab # [ 249.457573] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.164Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"316d97d34c47bd26285bc209","created_at":"2026-08-20T06:13:09.829Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.830Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-316d97d34c47bd26285bc209: done: 0.012781 sec","job_status":"done","queue_duration_s":0.321708,"scheduling_latency_s":0.321721,"redis_calls":7,"redis_duration_s":0.000875,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012781,"completed_at":"2026-08-20T06:13:10.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 249.492734] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.165Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4b0ef686904dbbb4ba69729a","created_at":"2026-08-20T06:13:09.830Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.831Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4b0ef686904dbbb4ba69729a: start","job_status":"start","queue_duration_s":0.334168,"scheduling_latency_s":0.33418}2266gitlab # [ 249.533512] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.180Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4b0ef686904dbbb4ba69729a","created_at":"2026-08-20T06:13:09.830Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.831Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4b0ef686904dbbb4ba69729a: done: 0.015331 sec","job_status":"done","queue_duration_s":0.334168,"scheduling_latency_s":0.33418,"redis_calls":7,"redis_duration_s":0.000909,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015331,"completed_at":"2026-08-20T06:13:10.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 249.539275] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0faeb91e319ebbde3343afa4","created_at":"2026-08-20T06:13:09.831Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.832Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0faeb91e319ebbde3343afa4: start","job_status":"start","queue_duration_s":0.349312,"scheduling_latency_s":0.349326}2268gitlab # [ 249.551874] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0faeb91e319ebbde3343afa4","created_at":"2026-08-20T06:13:09.831Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.832Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0faeb91e319ebbde3343afa4: done: 0.008313 sec","job_status":"done","queue_duration_s":0.349312,"scheduling_latency_s":0.349326,"redis_calls":7,"redis_duration_s":0.000896,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008313,"completed_at":"2026-08-20T06:13:10.190Z","load_balancing_strategy":"primary","db_duration_s":0.000234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 249.605724] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.191Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a1da5efcb8e3d0fecccac163","created_at":"2026-08-20T06:13:09.832Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.833Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a1da5efcb8e3d0fecccac163: start","job_status":"start","queue_duration_s":0.357384,"scheduling_latency_s":0.357397}2270gitlab # [ 249.606406] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.204Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a1da5efcb8e3d0fecccac163","created_at":"2026-08-20T06:13:09.832Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.833Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a1da5efcb8e3d0fecccac163: done: 0.013268 sec","job_status":"done","queue_duration_s":0.357384,"scheduling_latency_s":0.357397,"redis_calls":7,"redis_duration_s":0.000926,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013268,"completed_at":"2026-08-20T06:13:10.204Z","load_balancing_strategy":"primary","db_duration_s":0.001802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 249.647663] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.206Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f5f1a70aecc8abb375628e02","created_at":"2026-08-20T06:13:09.874Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.875Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f5f1a70aecc8abb375628e02: start","job_status":"start","queue_duration_s":0.330699,"scheduling_latency_s":0.330713}2272gitlab # [ 249.648368] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.221Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f5f1a70aecc8abb375628e02","created_at":"2026-08-20T06:13:09.874Z","trace_propagation_headers":{"sentry-trace":"3683e9a6798c49388d9da94705907ed6-7bc70e6ac7074493","baggage":"sentry-trace_id=3683e9a6798c49388d9da94705907ed6,sentry-release=Unknown"},"correlation_id":"01M0EWS0ZVQJAY67PE8Z8WR9NZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.875Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f5f1a70aecc8abb375628e02: done: 0.014938 sec","job_status":"done","queue_duration_s":0.330699,"scheduling_latency_s":0.330713,"redis_calls":8,"redis_duration_s":0.001086,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014938,"completed_at":"2026-08-20T06:13:10.221Z","load_balancing_strategy":"primary","db_duration_s":0.00205,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2273gitlab # [ 249.689738] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.222Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"053b016e485ceb6e92627d79","created_at":"2026-08-20T06:13:09.897Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-35536653073449ac","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.900Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-053b016e485ceb6e92627d79: start","job_status":"start","queue_duration_s":0.321669,"scheduling_latency_s":0.321683}2274gitlab # [ 249.690413] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.295Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"053b016e485ceb6e92627d79","created_at":"2026-08-20T06:13:09.897Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-35536653073449ac","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.900Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-053b016e485ceb6e92627d79: done: 0.073637 sec","job_status":"done","queue_duration_s":0.321669,"scheduling_latency_s":0.321683,"gitaly_calls":2,"gitaly_duration_s":0.004347,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004457,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000603,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000846,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000178,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000148,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000281,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052576,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05621748,"duration_s":0.073637,"completed_at":"2026-08-20T06:13:10.295Z","load_balancing_strategy":"primary","db_duration_s":0.016111,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2275gitlab # [ 249.738070] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e6bf4c8564eadbe905b5ed20","created_at":"2026-08-20T06:13:09.911Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-bc5825432e5a4286","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.916Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e6bf4c8564eadbe905b5ed20: start","job_status":"start","queue_duration_s":0.380794,"scheduling_latency_s":0.380809}2276gitlab # [ 249.740860] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e6bf4c8564eadbe905b5ed20","created_at":"2026-08-20T06:13:09.911Z","trace_propagation_headers":{"sentry-trace":"0e9e2f25b47744ef8bb3146d0157106a-bc5825432e5a4286","baggage":"sentry-trace_id=0e9e2f25b47744ef8bb3146d0157106a,sentry-release=Unknown"},"correlation_id":"01M0EWRX1X15G1M4RFF7RDB110","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:09.916Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e6bf4c8564eadbe905b5ed20: done: 0.058577 sec","job_status":"done","queue_duration_s":0.380794,"scheduling_latency_s":0.380809,"redis_calls":11,"redis_duration_s":0.001479,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225727,"duration_s":0.058577,"completed_at":"2026-08-20T06:13:10.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 249.796329] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"45ce780c879f7432c8cd4c5e","created_at":"2026-08-20T06:13:10.256Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-b488767fde1f4e72","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:10.258Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-45ce780c879f7432c8cd4c5e: start","job_status":"start","queue_duration_s":0.098956,"scheduling_latency_s":0.098969}2278gitlab # [ 249.797028] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:10.378Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"45ce780c879f7432c8cd4c5e","created_at":"2026-08-20T06:13:10.256Z","trace_propagation_headers":{"sentry-trace":"1227c2bd344d4425991185c88ef36cab-b488767fde1f4e72","baggage":"sentry-trace_id=1227c2bd344d4425991185c88ef36cab,sentry-release=Unknown"},"correlation_id":"01M0EWTKVE34BCM746GJTBPJ04","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:10.258Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-45ce780c879f7432c8cd4c5e: done: 0.021593 sec","job_status":"done","queue_duration_s":0.098956,"scheduling_latency_s":0.098969,"redis_calls":7,"redis_duration_s":0.001053,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021593,"completed_at":"2026-08-20T06:13:10.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 249.873486] nixbot[2601]: INFO: ::ffff:127.0.0.1:42310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 200 OK2280gitlab # [ 249.875692] gitaly[918]: time="2026-08-20T06:13:11.131Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:21.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.121" grpc.time_ms=10.29 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2281gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=39afbb420d3c072741c5e86fdbb6fac3439384f4', in 0.69 seconds)2282(finished: subtest: push delivers the webhook, in 54.39 seconds)2283subtest: eval and build post commit statuses2284gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses2285gitlab # [ 249.906793] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.163Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2443ded4fdd2382951019b6e","created_at":"2026-08-20T06:13:11.158Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-6c539f8fa4b64d81","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.161Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2443ded4fdd2382951019b6e: start","job_status":"start","queue_duration_s":0.001911,"scheduling_latency_s":0.001942}2286gitlab # [ 249.915041] nix-daemon[2813]: accepted connection from pid 3403, user nixbot2287gitlab # [ 249.915876] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 22552288gitlab # [ 249.916764] nixbot[2601]: {"ts": "2026-08-20T06:13:11.172Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}2289gitlab # [ 249.954345] gitaly[918]: time="2026-08-20T06:13:11.210Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNC6AHZW8HAC4AJPG823 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:41.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.210" grpc.time_ms=0.462 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 249.958214] gitaly[918]: time="2026-08-20T06:13:11.214Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNC9F4C8EKNHS1TRFD1P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:41.213" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.214" grpc.time_ms=0.425 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 249.983461] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 642292gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses, in 0.10 seconds)2293gitlab # [ 249.990117] gitaly[918]: time="2026-08-20T06:13:11.246Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNC9F4C8EKNHS1TRFD1P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:21.190" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.240" grpc.time_ms=5.906 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 249.990619] nix-daemon[2813]: accepted connection from pid 3419, user nixbot2295gitlab # [ 250.002589] gitaly[918]: time="2026-08-20T06:13:11.259Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:41.257" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.257" grpc.time_ms=1.155 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 250.023106] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1012297gitlab # [ 250.023773] nixbot[2601]: {"ts": "2026-08-20T06:13:11.280Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/be7bf397f1618b407188bf1fa476564a15a7048a \"HTTP/1.1 201 Created\""}2298gitlab # [ 250.026746] gitaly[918]: time="2026-08-20T06:13:11.283Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:41.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.282" grpc.time_ms=0.634 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 250.032812] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.289Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f2ae76e034af88ee4b376b5b","created_at":"2026-08-20T06:13:11.287Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-a500bfc883e24061","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"2443ded4fdd2382951019b6e","job_size_bytes":3,"pid":2613,"job_status":"deduplicated","message":"PipelineProcessWorker JID-f2ae76e034af88ee4b376b5b: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2300gitlab # [ 250.033895] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.290Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2443ded4fdd2382951019b6e","created_at":"2026-08-20T06:13:11.158Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-6c539f8fa4b64d81","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.161Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2613,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2443ded4fdd2382951019b6e: rescheduled"}2301gitlab # [ 250.038358] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.294Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2443ded4fdd2382951019b6e","created_at":"2026-08-20T06:13:11.158Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-6c539f8fa4b64d81","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.161Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2443ded4fdd2382951019b6e: done: 0.131675 sec","job_status":"done","queue_duration_s":0.001911,"scheduling_latency_s":0.001942,"gitaly_calls":2,"gitaly_duration_s":0.006223,"redis_calls":37,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012336,"redis_read_bytes":139,"redis_write_bytes":6671,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001228,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001441,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":4,"redis_queues_duration_s":0.000403,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2221,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.00465,"redis_queues_metadata_read_bytes":89,"redis_queues_metadata_write_bytes":1432,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000825,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000149,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073902,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.084918335,"duration_s":0.131675,"completed_at":"2026-08-20T06:13:11.294Z","load_balancing_strategy":"primary","db_duration_s":0.031842,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2302gitlab # [ 250.067216] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"246e32282032c5750d3388e5","created_at":"2026-08-20T06:13:11.239Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-a500bfc883e24061","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.244Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-246e32282032c5750d3388e5: start","job_status":"start","queue_duration_s":0.051632,"scheduling_latency_s":0.051647}2303gitlab # [ 250.106682] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.316Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"246e32282032c5750d3388e5","created_at":"2026-08-20T06:13:11.239Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-a500bfc883e24061","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.244Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-246e32282032c5750d3388e5: done: 0.020664 sec","job_status":"done","queue_duration_s":0.051632,"scheduling_latency_s":0.051647,"redis_calls":7,"redis_duration_s":0.001023,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020664,"completed_at":"2026-08-20T06:13:11.316Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 250.113673] nix-daemon[2813]: accepted connection from pid 3428, user nixbot2305gitlab # [ 250.114384] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.317Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7d6dd75dd9977940eacf94bc","created_at":"2026-08-20T06:13:11.290Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-a500bfc883e24061","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.291Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7d6dd75dd9977940eacf94bc: start","job_status":"start","queue_duration_s":0.025925,"scheduling_latency_s":0.025939}2306gitlab # [ 250.126944] nix-daemon[2813]: accepted connection from pid 3403, user nixbot2307gitlab # [ 250.134684] gitaly[918]: time="2026-08-20T06:13:11.391Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:11.390" grpc.time_ms=0.364 pid=918 span.kind=server system=grpc2308gitlab # [ 250.188930] gitaly[918]: time="2026-08-20T06:13:11.445Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:11.445" grpc.time_ms=0.316 pid=918 span.kind=server system=grpc2309gitlab # [ 250.220808] gitaly[918]: time="2026-08-20T06:13:11.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:11.476" grpc.time_ms=0.35 pid=918 span.kind=server system=grpc2310gitlab # [ 250.230911] gitaly[918]: time="2026-08-20T06:13:11.487Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:41.362" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.362" operations="[repack_refs]" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab # [ 250.239623] gitaly[918]: time="2026-08-20T06:13:11.488Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:41.487" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.487" grpc.time_ms=0.398 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 250.240258] gitaly[918]: time="2026-08-20T06:13:11.489Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:41.362" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.362" pid=918 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 06:12:12.159515364 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2313gitlab # [ 250.240597] gitaly[918]: time="2026-08-20T06:13:11.494Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW diskcache=99e925a8-ed11-4f51-bc6a-f58d4e03b1ce grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:41.362" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.362" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab # [ 250.241212] gitaly[918]: time="2026-08-20T06:13:11.494Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7442 command.oublock=0 command.real_time_ms=125 command.spawn_token_fork_ms=0 command.system_time_ms=36 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:41.362" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.362" grpc.time_ms=131.331 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2315gitlab # [ 250.249398] gitaly[918]: time="2026-08-20T06:13:11.505Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:41.362" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.362" pid=918 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2316gitlab # [ 250.252731] gitaly[918]: time="2026-08-20T06:13:11.506Z" level=info msg="optimized repository" clean_stale_data_time=16.254022ms clean_work_trees_time="123.2µs" commit_graph_time="3.353µs" correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=918 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.469µs" storage_name=default system=housekeeping total_time=16.481425ms2317gitlab # [ 250.257692] gitaly[918]: time="2026-08-20T06:13:11.506Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:41.362" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:11.362" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab # [ 250.279993] gitaly[918]: time="2026-08-20T06:13:11.536Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:41.535" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.535" grpc.time_ms=0.703 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 250.298351] gitaly[918]: time="2026-08-20T06:13:11.554Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTK5KCV2D9GXVTQZH9YKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:41.554" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:11.554" grpc.time_ms=0.467 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 250.305911] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.561Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7d6dd75dd9977940eacf94bc","created_at":"2026-08-20T06:13:11.290Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-a500bfc883e24061","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.291Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7d6dd75dd9977940eacf94bc: done: 0.244583 sec","job_status":"done","queue_duration_s":0.025925,"scheduling_latency_s":0.025939,"gitaly_calls":3,"gitaly_duration_s":0.137043,"redis_calls":71,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010201,"redis_read_bytes":151,"redis_write_bytes":19881,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000585,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000524,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":23,"redis_queues_duration_s":0.001929,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13383,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003112,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000139,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000325,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003002,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080803,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.225366073,"duration_s":0.244583,"completed_at":"2026-08-20T06:13:11.561Z","load_balancing_strategy":"primary","db_duration_s":0.020737,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2321gitlab # [ 250.342699] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.562Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"603d372f5cafd2d79da7489e","created_at":"2026-08-20T06:13:11.357Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.359Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-603d372f5cafd2d79da7489e: start","job_status":"start","queue_duration_s":0.203529,"scheduling_latency_s":0.203544}2322gitlab # [ 250.343417] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"603d372f5cafd2d79da7489e","created_at":"2026-08-20T06:13:11.357Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.359Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-603d372f5cafd2d79da7489e: done: 0.023628 sec","job_status":"done","queue_duration_s":0.203529,"scheduling_latency_s":0.203544,"redis_calls":7,"redis_duration_s":0.000905,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023628,"completed_at":"2026-08-20T06:13:11.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00464,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2323gitlab # [ 250.383470] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.587Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9be5dc8d1cd30eaac20f8212","created_at":"2026-08-20T06:13:11.498Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.500Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9be5dc8d1cd30eaac20f8212: start","job_status":"start","queue_duration_s":0.086949,"scheduling_latency_s":0.086963}2324gitlab # [ 250.384516] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.602Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9be5dc8d1cd30eaac20f8212","created_at":"2026-08-20T06:13:11.498Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.500Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9be5dc8d1cd30eaac20f8212: done: 0.015122 sec","job_status":"done","queue_duration_s":0.086949,"scheduling_latency_s":0.086963,"redis_calls":7,"redis_duration_s":0.0008669999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015122,"completed_at":"2026-08-20T06:13:11.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 250.446704] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"446548960d3fb2c021276a33","created_at":"2026-08-20T06:13:11.507Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.510Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-446548960d3fb2c021276a33: start","job_status":"start","queue_duration_s":0.092998,"scheduling_latency_s":0.093011}2326gitlab # [ 250.447424] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"446548960d3fb2c021276a33","created_at":"2026-08-20T06:13:11.507Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.510Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-446548960d3fb2c021276a33: done: 0.01548 sec","job_status":"done","queue_duration_s":0.092998,"scheduling_latency_s":0.093011,"redis_calls":7,"redis_duration_s":0.0009040000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01548,"completed_at":"2026-08-20T06:13:11.618Z","load_balancing_strategy":"primary","db_duration_s":0.002695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 250.488878] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8f29cb727a2324d3f68ade08","created_at":"2026-08-20T06:13:11.516Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.517Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8f29cb727a2324d3f68ade08: start","job_status":"start","queue_duration_s":0.102383,"scheduling_latency_s":0.102397}2328gitlab # [ 250.489588] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8f29cb727a2324d3f68ade08","created_at":"2026-08-20T06:13:11.516Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.517Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8f29cb727a2324d3f68ade08: done: 0.016724 sec","job_status":"done","queue_duration_s":0.102383,"scheduling_latency_s":0.102397,"redis_calls":10,"redis_duration_s":0.001245,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000372,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016724,"completed_at":"2026-08-20T06:13:11.636Z","load_balancing_strategy":"primary","db_duration_s":0.002512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2329gitlab # [ 250.539595] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.637Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a82e9dfa2e228d8f6e70210e","created_at":"2026-08-20T06:13:11.517Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.518Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a82e9dfa2e228d8f6e70210e: start","job_status":"start","queue_duration_s":0.118464,"scheduling_latency_s":0.118477}2330gitlab # [ 250.540160] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a82e9dfa2e228d8f6e70210e","created_at":"2026-08-20T06:13:11.517Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.518Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a82e9dfa2e228d8f6e70210e: done: 0.01489 sec","job_status":"done","queue_duration_s":0.118464,"scheduling_latency_s":0.118477,"redis_calls":7,"redis_duration_s":0.001317,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01489,"completed_at":"2026-08-20T06:13:11.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 250.586565] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"09758d72a973f55a36f08d1c","created_at":"2026-08-20T06:13:11.519Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.520Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-09758d72a973f55a36f08d1c: start","job_status":"start","queue_duration_s":0.132617,"scheduling_latency_s":0.13263}2332gitlab # [ 250.587187] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.666Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"09758d72a973f55a36f08d1c","created_at":"2026-08-20T06:13:11.519Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.520Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-09758d72a973f55a36f08d1c: done: 0.013469 sec","job_status":"done","queue_duration_s":0.132617,"scheduling_latency_s":0.13263,"redis_calls":8,"redis_duration_s":0.001022,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013469,"completed_at":"2026-08-20T06:13:11.666Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2333gitlab # [ 250.633802] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.667Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7dd6d6cb78fa81409d7c549a","created_at":"2026-08-20T06:13:11.520Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.522Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7dd6d6cb78fa81409d7c549a: start","job_status":"start","queue_duration_s":0.145237,"scheduling_latency_s":0.14525}2334gitlab # [ 250.634565] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.679Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7dd6d6cb78fa81409d7c549a","created_at":"2026-08-20T06:13:11.520Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.522Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7dd6d6cb78fa81409d7c549a: done: 0.012559 sec","job_status":"done","queue_duration_s":0.145237,"scheduling_latency_s":0.14525,"redis_calls":7,"redis_duration_s":0.000879,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012559,"completed_at":"2026-08-20T06:13:11.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2335gitlab # [ 250.652898] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"02177bcdc1d900698d0ffee8","created_at":"2026-08-20T06:13:11.522Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.523Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-02177bcdc1d900698d0ffee8: start","job_status":"start","queue_duration_s":0.15718,"scheduling_latency_s":0.157198}2336gitlab # [ 250.666026] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"02177bcdc1d900698d0ffee8","created_at":"2026-08-20T06:13:11.522Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.523Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-02177bcdc1d900698d0ffee8: done: 0.018578 sec","job_status":"done","queue_duration_s":0.15718,"scheduling_latency_s":0.157198,"redis_calls":7,"redis_duration_s":0.000864,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018578,"completed_at":"2026-08-20T06:13:11.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 250.702024] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.700Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3298aa846a6de580388d01b3","created_at":"2026-08-20T06:13:11.525Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.526Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3298aa846a6de580388d01b3: start","job_status":"start","queue_duration_s":0.173291,"scheduling_latency_s":0.173305}2338gitlab # [ 250.712354] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.714Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3298aa846a6de580388d01b3","created_at":"2026-08-20T06:13:11.525Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.526Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3298aa846a6de580388d01b3: done: 0.014649 sec","job_status":"done","queue_duration_s":0.173291,"scheduling_latency_s":0.173305,"redis_calls":7,"redis_duration_s":0.000866,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014649,"completed_at":"2026-08-20T06:13:11.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 250.778762] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8da45ec57e74027ee36c108e","created_at":"2026-08-20T06:13:11.527Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.527Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8da45ec57e74027ee36c108e: start","job_status":"start","queue_duration_s":0.187632,"scheduling_latency_s":0.187646}2340gitlab # [ 250.779564] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8da45ec57e74027ee36c108e","created_at":"2026-08-20T06:13:11.527Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.527Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8da45ec57e74027ee36c108e: done: 0.00796 sec","job_status":"done","queue_duration_s":0.187632,"scheduling_latency_s":0.187646,"redis_calls":7,"redis_duration_s":0.000838,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00796,"completed_at":"2026-08-20T06:13:11.723Z","load_balancing_strategy":"primary","db_duration_s":0.00023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 250.792257] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.724Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"047dc44a3e406a9b0e2683a5","created_at":"2026-08-20T06:13:11.528Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.529Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-047dc44a3e406a9b0e2683a5: start","job_status":"start","queue_duration_s":0.195167,"scheduling_latency_s":0.19518}2342gitlab # [ 250.830565] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:11.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"047dc44a3e406a9b0e2683a5","created_at":"2026-08-20T06:13:11.528Z","trace_propagation_headers":{"sentry-trace":"36ee4fe62b324e318834175240be09ed-2dd51fbabdb74e82","baggage":"sentry-trace_id=36ee4fe62b324e318834175240be09ed,sentry-release=Unknown"},"correlation_id":"01M0EWTK5KCV2D9GXVTQZH9YKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:11.529Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-047dc44a3e406a9b0e2683a5: done: 0.012775 sec","job_status":"done","queue_duration_s":0.195167,"scheduling_latency_s":0.19518,"redis_calls":7,"redis_duration_s":0.000912,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012775,"completed_at":"2026-08-20T06:13:11.737Z","load_balancing_strategy":"primary","db_duration_s":0.001766,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2343gitlab # [ 250.896497] gitaly[918]: time="2026-08-20T06:13:12.152Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:22.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:12.147" grpc.time_ms=5.504 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab # [ 250.931130] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.187Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a8240cad27b0b690fd1a1e23","created_at":"2026-08-20T06:13:12.183Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-5ee958027235406a","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.185Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a8240cad27b0b690fd1a1e23: start","job_status":"start","queue_duration_s":0.001634,"scheduling_latency_s":0.00168}2345gitlab # [ 250.954921] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 7642346gitlab # [ 250.956327] nixbot[2601]: {"ts": "2026-08-20T06:13:12.212Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 \"HTTP/1.1 201 Created\""}2347gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses2348gitlab # [ 251.034107] gitaly[918]: time="2026-08-20T06:13:12.290Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:12.290" grpc.time_ms=0.319 pid=918 span.kind=server system=grpc2349gitlab # [ 251.061492] gitaly[918]: time="2026-08-20T06:13:12.318Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTPEZ0RG0WGT10A8HN9Y8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:42.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:12.317" grpc.time_ms=0.536 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 251.073421] gitaly[918]: time="2026-08-20T06:13:12.329Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:12.328" grpc.time_ms=1.351 pid=918 span.kind=server system=grpc2351gitlab # [ 251.087373] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses HTTP/1.1" 200 659 "" "curl/8.21.0" 562352gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses, in 0.10 seconds)2353gitlab # [ 251.102387] gitaly[918]: time="2026-08-20T06:13:12.358Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:12.357" grpc.time_ms=1.228 pid=918 span.kind=server system=grpc2354gitlab # [ 251.119059] gitaly[918]: time="2026-08-20T06:13:12.375Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T diskcache=0a11ff08-9ac5-474d-8ed2-6c7e8f58c4b8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:42.266" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:12.267" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 251.119831] gitaly[918]: time="2026-08-20T06:13:12.375Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7412 command.oublock=0 command.real_time_ms=101 command.spawn_token_fork_ms=0 command.system_time_ms=59 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:42.266" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:12.267" grpc.time_ms=108.555 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 251.127141] gitaly[918]: time="2026-08-20T06:13:12.383Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTPCRVMRERB15KH3BC3X8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:42.382" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:12.383" grpc.time_ms=0.407 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 251.154547] gitaly[918]: time="2026-08-20T06:13:12.411Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTPCRVMRERB15KH3BC3X8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:22.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:12.405" grpc.time_ms=5.081 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2358gitlab # [ 251.186725] gitaly[918]: time="2026-08-20T06:13:12.443Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:42.442" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:12.442" grpc.time_ms=0.606 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 251.205380] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2452360gitlab # [ 251.206172] nixbot[2601]: {"ts": "2026-08-20T06:13:12.462Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 \"HTTP/1.1 201 Created\""}2361gitlab # [ 251.227152] gitaly[918]: time="2026-08-20T06:13:12.483Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:42.482" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:12.482" grpc.time_ms=0.612 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 251.237302] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.491Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4833167acc8f837975dadf4d","created_at":"2026-08-20T06:13:12.490Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"a8240cad27b0b690fd1a1e23","job_size_bytes":3,"pid":2613,"job_status":"deduplicated","message":"PipelineProcessWorker JID-4833167acc8f837975dadf4d: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2363gitlab # [ 251.249675] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.493Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a8240cad27b0b690fd1a1e23","created_at":"2026-08-20T06:13:12.183Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-5ee958027235406a","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.185Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2613,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a8240cad27b0b690fd1a1e23: rescheduled"}2364gitlab # [ 251.250388] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.497Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a8240cad27b0b690fd1a1e23","created_at":"2026-08-20T06:13:12.183Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-5ee958027235406a","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.185Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a8240cad27b0b690fd1a1e23: done: 0.310436 sec","job_status":"done","queue_duration_s":0.001634,"scheduling_latency_s":0.00168,"gitaly_calls":3,"gitaly_duration_s":0.152951,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011861,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000726,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001056,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.00242,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003962,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000181,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000389,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002401,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096641,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.255204502,"duration_s":0.310436,"completed_at":"2026-08-20T06:13:12.497Z","load_balancing_strategy":"primary","db_duration_s":0.042396,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2365gitlab # [ 251.293650] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"024fd355d359541218472593","created_at":"2026-08-20T06:13:12.261Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.263Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-024fd355d359541218472593: start","job_status":"start","queue_duration_s":0.235235,"scheduling_latency_s":0.235251}2366gitlab # [ 251.294385] gitaly[918]: time="2026-08-20T06:13:12.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTPMRRR5RH9VNFF69JAXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:42.516" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:12.516" grpc.time_ms=0.545 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 251.361597] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"024fd355d359541218472593","created_at":"2026-08-20T06:13:12.261Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.263Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-024fd355d359541218472593: done: 0.118263 sec","job_status":"done","queue_duration_s":0.235235,"scheduling_latency_s":0.235251,"redis_calls":7,"redis_duration_s":0.001591,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.073,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.118263,"completed_at":"2026-08-20T06:13:12.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.079549,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2368gitlab # [ 251.396986] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.653Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7f4ae6b463f6f6ff66f46cda","created_at":"2026-08-20T06:13:12.407Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.409Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7f4ae6b463f6f6ff66f46cda: start","job_status":"start","queue_duration_s":0.243439,"scheduling_latency_s":0.243483}2369gitlab # [ 251.425553] gitaly[918]: time="2026-08-20T06:13:12.681Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTPMRRR5RH9VNFF69JAXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:13:22.070" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:12.670" grpc.time_ms=10.906 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2370gitlab # [ 251.453486] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.709Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7f4ae6b463f6f6ff66f46cda","created_at":"2026-08-20T06:13:12.407Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.409Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7f4ae6b463f6f6ff66f46cda: done: 0.056404 sec","job_status":"done","queue_duration_s":0.243439,"scheduling_latency_s":0.243483,"redis_calls":7,"redis_duration_s":0.002399,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056404,"completed_at":"2026-08-20T06:13:12.709Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 251.473071] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"001e3d6f84dccaa9ead4617d","created_at":"2026-08-20T06:13:12.414Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.417Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-001e3d6f84dccaa9ead4617d: start","job_status":"start","queue_duration_s":0.29468,"scheduling_latency_s":0.294727}2372gitlab # [ 251.497699] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2812373gitlab # [ 251.499099] nixbot[2601]: {"ts": "2026-08-20T06:13:12.755Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/39afbb420d3c072741c5e86fdbb6fac3439384f4 \"HTTP/1.1 201 Created\""}2374gitlab # [ 251.529695] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"001e3d6f84dccaa9ead4617d","created_at":"2026-08-20T06:13:12.414Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.417Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-001e3d6f84dccaa9ead4617d: done: 0.073246 sec","job_status":"done","queue_duration_s":0.29468,"scheduling_latency_s":0.294727,"redis_calls":7,"redis_duration_s":0.0019429999999999998,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073246,"completed_at":"2026-08-20T06:13:12.785Z","load_balancing_strategy":"primary","db_duration_s":0.037239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 251.549638] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.787Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"f2c66b3208441740d4569272","created_at":"2026-08-20T06:13:12.423Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.424Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f2c66b3208441740d4569272: start","job_status":"start","queue_duration_s":0.363193,"scheduling_latency_s":0.363223}2376gitlab # [ 251.558529] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"f2c66b3208441740d4569272","created_at":"2026-08-20T06:13:12.423Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.424Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f2c66b3208441740d4569272: done: 0.026783 sec","job_status":"done","queue_duration_s":0.363193,"scheduling_latency_s":0.363223,"redis_calls":10,"redis_duration_s":0.0019450000000000001,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000555,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026783,"completed_at":"2026-08-20T06:13:12.814Z","load_balancing_strategy":"primary","db_duration_s":0.005417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 251.595217] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"42b57f1fc6c26c9924b7da9a","created_at":"2026-08-20T06:13:12.424Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.425Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-42b57f1fc6c26c9924b7da9a: start","job_status":"start","queue_duration_s":0.390601,"scheduling_latency_s":0.390632}2378gitlab # [ 251.595870] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"42b57f1fc6c26c9924b7da9a","created_at":"2026-08-20T06:13:12.424Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.425Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-42b57f1fc6c26c9924b7da9a: done: 0.018159 sec","job_status":"done","queue_duration_s":0.390601,"scheduling_latency_s":0.390632,"redis_calls":7,"redis_duration_s":0.000961,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018159,"completed_at":"2026-08-20T06:13:12.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 251.656028] nix-daemon[2813]: accepted connection from pid 3511, user nixbot2380gitlab # [ 251.656645] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"90cefdaa92d1da21d954c657","created_at":"2026-08-20T06:13:12.426Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.427Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-90cefdaa92d1da21d954c657: start","job_status":"start","queue_duration_s":0.408107,"scheduling_latency_s":0.408121}2381gitlab # [ 251.657213] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.851Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"90cefdaa92d1da21d954c657","created_at":"2026-08-20T06:13:12.426Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.427Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-90cefdaa92d1da21d954c657: done: 0.016111 sec","job_status":"done","queue_duration_s":0.408107,"scheduling_latency_s":0.408121,"redis_calls":8,"redis_duration_s":0.001058,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016111,"completed_at":"2026-08-20T06:13:12.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 251.675185] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.852Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dc36e87d4753a020c21ca8be","created_at":"2026-08-20T06:13:12.428Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.428Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dc36e87d4753a020c21ca8be: start","job_status":"start","queue_duration_s":0.423591,"scheduling_latency_s":0.423606}2383gitlab # [ 251.685557] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.867Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dc36e87d4753a020c21ca8be","created_at":"2026-08-20T06:13:12.428Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.428Z","job_size_bytes":66,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dc36e87d4753a020c21ca8be: done: 0.014734 sec","job_status":"done","queue_duration_s":0.423591,"scheduling_latency_s":0.423606,"redis_calls":7,"redis_duration_s":0.001088,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014734,"completed_at":"2026-08-20T06:13:12.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 251.722224] gitaly[918]: time="2026-08-20T06:13:12.922Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTQ1B0K39GXDY2BWXK259 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:12.912" grpc.time_ms=8.988 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2385gitlab # [ 251.729198] gitaly[918]: time="2026-08-20T06:13:12.972Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTQ2VPZ7H719FTT44SW9Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:12.966" pid=918 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2386gitlab # [ 251.765996] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 472387gitlab # [ 251.766300] gitlab-workhorse[825]: time="2026-08-20T06:13:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672388gitlab # [ 251.766837] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:06:13:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 492389gitlab # [ 251.767504] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"848a026c5ce59e4e6589e02b","created_at":"2026-08-20T06:13:12.429Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.430Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-848a026c5ce59e4e6589e02b: start","job_status":"start","queue_duration_s":0.437844,"scheduling_latency_s":0.437857}2390gitlab # [ 251.768108] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.889Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"848a026c5ce59e4e6589e02b","created_at":"2026-08-20T06:13:12.429Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.430Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-848a026c5ce59e4e6589e02b: done: 0.021741 sec","job_status":"done","queue_duration_s":0.437844,"scheduling_latency_s":0.437857,"redis_calls":7,"redis_duration_s":0.001499,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021741,"completed_at":"2026-08-20T06:13:12.889Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2391gitlab # [ 251.792515] gitaly[918]: time="2026-08-20T06:13:12.972Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTQ2VPZ7H719FTT44SW9Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:12.966" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2392gitlab # [ 251.800708] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.892Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"c51e662f678db816ca4c7e29","created_at":"2026-08-20T06:13:12.432Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.433Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c51e662f678db816ca4c7e29: start","job_status":"start","queue_duration_s":0.459217,"scheduling_latency_s":0.459259}2393gitlab # [ 251.812503] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.913Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"c51e662f678db816ca4c7e29","created_at":"2026-08-20T06:13:12.432Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.433Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c51e662f678db816ca4c7e29: done: 0.02051 sec","job_status":"done","queue_duration_s":0.459217,"scheduling_latency_s":0.459259,"redis_calls":7,"redis_duration_s":0.003027,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02051,"completed_at":"2026-08-20T06:13:12.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 251.867657] gitaly[918]: time="2026-08-20T06:13:12.973Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTQ2VPZ7H719FTT44SW9Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:13:12.966" grpc.time_ms=6.485 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc2395gitlab # [ 251.868291] nix-daemon[2813]: accepted connection from pid 3536, user nixbot2396gitlab # [ 251.869028] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.920Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cbbeba9904cae63468db8737","created_at":"2026-08-20T06:13:12.433Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.434Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cbbeba9904cae63468db8737: start","job_status":"start","queue_duration_s":0.485521,"scheduling_latency_s":0.485554}2397gitlab # [ 251.871947] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.933Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cbbeba9904cae63468db8737","created_at":"2026-08-20T06:13:12.433Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.434Z","job_size_bytes":6,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cbbeba9904cae63468db8737: done: 0.013226 sec","job_status":"done","queue_duration_s":0.485521,"scheduling_latency_s":0.485554,"redis_calls":7,"redis_duration_s":0.001031,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000332,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013226,"completed_at":"2026-08-20T06:13:12.933Z","load_balancing_strategy":"primary","db_duration_s":0.000335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 251.913082] gitaly[918]: time="2026-08-20T06:13:13.079Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:13.078" grpc.time_ms=0.283 pid=918 span.kind=server system=grpc2399gitlab # [ 251.913599] gitaly[918]: time="2026-08-20T06:13:13.101Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:13.100" grpc.time_ms=0.506 pid=918 span.kind=server system=grpc2400gitlab # [ 251.921315] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.934Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"4a42ef9813b4e28512e90c4e","created_at":"2026-08-20T06:13:12.434Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.435Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4a42ef9813b4e28512e90c4e: start","job_status":"start","queue_duration_s":0.498519,"scheduling_latency_s":0.498532}2401gitlab # [ 251.933566] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"4a42ef9813b4e28512e90c4e","created_at":"2026-08-20T06:13:12.434Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.435Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4a42ef9813b4e28512e90c4e: done: 0.014028 sec","job_status":"done","queue_duration_s":0.498519,"scheduling_latency_s":0.498532,"redis_calls":7,"redis_duration_s":0.000887,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014028,"completed_at":"2026-08-20T06:13:12.948Z","load_balancing_strategy":"primary","db_duration_s":0.001967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 251.967065] gitaly[918]: time="2026-08-20T06:13:13.117Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:13:13.117" grpc.time_ms=0.417 pid=918 span.kind=server system=grpc2403gitlab # [ 252.002210] gitaly[918]: time="2026-08-20T06:13:13.125Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T diskcache=fdcf3284-847e-4e88-9e9c-ba9670946e9f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:43.056" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:13.056" pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2404gitlab # [ 252.002910] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:12.949Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"eb4e13f6fe94979ca9a0ce42","created_at":"2026-08-20T06:13:12.493Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.494Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eb4e13f6fe94979ca9a0ce42: start","job_status":"start","queue_duration_s":0.454885,"scheduling_latency_s":0.454899}2405gitlab # [ 252.003533] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.184Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"eb4e13f6fe94979ca9a0ce42","created_at":"2026-08-20T06:13:12.493Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.494Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2613,"job_status":"rescheduled","message":"PipelineProcessWorker JID-eb4e13f6fe94979ca9a0ce42: rescheduled"}2406gitlab # [ 252.005706] gitaly[918]: time="2026-08-20T06:13:13.125Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7038 command.oublock=0 command.real_time_ms=62 command.spawn_token_fork_ms=1 command.system_time_ms=41 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:13:43.056" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:13:13.056" grpc.time_ms=69.048 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2407gitlab # [ 252.016387] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.188Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"eb4e13f6fe94979ca9a0ce42","created_at":"2026-08-20T06:13:12.493Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-7c6bc09bd42b4ea0","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:12.494Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eb4e13f6fe94979ca9a0ce42: done: 0.239435 sec","job_status":"done","queue_duration_s":0.454885,"scheduling_latency_s":0.454899,"gitaly_calls":3,"gitaly_duration_s":0.074516,"redis_calls":68,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017038,"redis_read_bytes":149,"redis_write_bytes":18167,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.002815,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001965,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":22,"redis_queues_duration_s":0.004536,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.002792,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000563,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000354,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.057,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.057,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077858,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.218998784,"duration_s":0.239435,"completed_at":"2026-08-20T06:13:13.188Z","load_balancing_strategy":"primary","db_duration_s":0.072561,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2408gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses2409gitlab # [ 252.058734] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9ddb5f4d4a055c6046e17ed1","created_at":"2026-08-20T06:13:13.047Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.048Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9ddb5f4d4a055c6046e17ed1: start","job_status":"start","queue_duration_s":0.140534,"scheduling_latency_s":0.140549}2410gitlab # [ 252.098053] gitaly[918]: time="2026-08-20T06:13:13.160Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:13:43.160" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:13.160" grpc.time_ms=0.539 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2411gitlab # [ 252.098623] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9ddb5f4d4a055c6046e17ed1","created_at":"2026-08-20T06:13:13.047Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.048Z","job_size_bytes":23,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9ddb5f4d4a055c6046e17ed1: done: 0.023786 sec","job_status":"done","queue_duration_s":0.140534,"scheduling_latency_s":0.140549,"redis_calls":7,"redis_duration_s":0.000931,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023786,"completed_at":"2026-08-20T06:13:13.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004195,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2412gitlab # [ 252.134688] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.214Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4b3874e45a3196a1acf14dca","created_at":"2026-08-20T06:13:13.129Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.131Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4b3874e45a3196a1acf14dca: start","job_status":"start","queue_duration_s":0.082428,"scheduling_latency_s":0.082443}2413gitlab # [ 252.135430] gitaly[918]: time="2026-08-20T06:13:13.179Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EWTNMNRKCCV8F4YN2ZXJ6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:13:43.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:13:13.178" grpc.time_ms=0.534 pid=918 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2414gitlab # [ 252.136062] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.229Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4b3874e45a3196a1acf14dca","created_at":"2026-08-20T06:13:13.129Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.131Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4b3874e45a3196a1acf14dca: done: 0.015186 sec","job_status":"done","queue_duration_s":0.082428,"scheduling_latency_s":0.082443,"redis_calls":7,"redis_duration_s":0.0009089999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015186,"completed_at":"2026-08-20T06:13:13.229Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2415gitlab # [ 252.168537] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2bd6ba15a09186ad9a1b61a0","created_at":"2026-08-20T06:13:13.136Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.138Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2bd6ba15a09186ad9a1b61a0: start","job_status":"start","queue_duration_s":0.091512,"scheduling_latency_s":0.091526}2416gitlab # [ 252.181245] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.245Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2bd6ba15a09186ad9a1b61a0","created_at":"2026-08-20T06:13:13.136Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.138Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2bd6ba15a09186ad9a1b61a0: done: 0.015702 sec","job_status":"done","queue_duration_s":0.091512,"scheduling_latency_s":0.091526,"redis_calls":7,"redis_duration_s":0.0008780000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015702,"completed_at":"2026-08-20T06:13:13.245Z","load_balancing_strategy":"primary","db_duration_s":0.002489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2417gitlab # [ 252.222696] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.246Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"ac49c866b9506b412bb7ddc4","created_at":"2026-08-20T06:13:13.144Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.145Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ac49c866b9506b412bb7ddc4: start","job_status":"start","queue_duration_s":0.10135,"scheduling_latency_s":0.101363}2418gitlab # [ 252.226404] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"ac49c866b9506b412bb7ddc4","created_at":"2026-08-20T06:13:13.144Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.145Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ac49c866b9506b412bb7ddc4: done: 0.017275 sec","job_status":"done","queue_duration_s":0.10135,"scheduling_latency_s":0.101363,"redis_calls":10,"redis_duration_s":0.001266,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00037,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017275,"completed_at":"2026-08-20T06:13:13.264Z","load_balancing_strategy":"primary","db_duration_s":0.002699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2419gitlab # [ 252.292316] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.265Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"82bbcf79d5b379a0cf1cf3ce","created_at":"2026-08-20T06:13:13.145Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.146Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-82bbcf79d5b379a0cf1cf3ce: start","job_status":"start","queue_duration_s":0.118192,"scheduling_latency_s":0.118205}2420gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/39afbb420d3c072741c5e86fdbb6fac3439384f4/statuses, in 0.22 seconds)2421(finished: subtest: eval and build post commit statuses, in 2.43 seconds)2422(finished: run the VM test script, in 303.86 seconds)2423gitlab # [ 252.293034] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"82bbcf79d5b379a0cf1cf3ce","created_at":"2026-08-20T06:13:13.145Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.146Z","job_size_bytes":3,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-82bbcf79d5b379a0cf1cf3ce: done: 0.014576 sec","job_status":"done","queue_duration_s":0.118192,"scheduling_latency_s":0.118205,"redis_calls":7,"redis_duration_s":0.000883,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014576,"completed_at":"2026-08-20T06:13:13.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424test script finished in 303.90s2425cleanup2426kill QemuMachine (pid 46)2427gitlab # [ 252.346388] sidekiq-cluster[2613]: {"severity":"INFO","time":"2026-08-20T06:13:13.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b60792973dbadcff0a52a08f","created_at":"2026-08-20T06:13:13.147Z","trace_propagation_headers":{"sentry-trace":"dde1c6566dbd425a93d742d17576d659-a0da490cdd8d44a1","baggage":"sentry-trace_id=dde1c6566dbd425a93d742d17576d659,sentry-release=Unknown"},"correlation_id":"01M0EWTNMNRKCCV8F4YN2ZXJ6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T06:13:13.148Z","job_size_bytes":19,"pid":2613,"sidekiq_tid":"m82p","sidekiq_thread_namqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2428gitlab # e2429(finished: cleanup, in 1.62 seconds)2430additionally exposed symbols:2431 gitlab,2432 vlan1,2433 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2434[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T06:12:16.215Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '39afbb420d3c072741c5e86fdbb6fac3439384f4', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T06:13:09.607792Z', 'started_at': '2026-08-20T06:13:09.919610Z', 'finished_at': None}]2487[{'id': 4, 'sha': '39afbb420d3c072741c5e86fdbb6fac3439384f4', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:13:09.890Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2488[{'id': 4, 'sha': '39afbb420d3c072741c5e86fdbb6fac3439384f4', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T06:13:09.890Z', 'started_at': None, 'finished_at': '2026-08-20T06:13:12.177Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2489[{'id': 4, 'sha': '39afbb420d3c072741c5e86fdbb6fac3439384f4', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T06:13:09.890Z', 'started_at': None, 'finished_at': '2026-08-20T06:13:12.177Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '39afbb420d3c072741c5e86fdbb6fac3439384f4', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T06:13:12.444Z', 'started_at': None, 'finished_at': '2026-08-20T06:13:12.719Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]