vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #238
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.jfvTNSP10Q', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: ac71240e-f640-4dc6-ab41-bda4dec8fb8916gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23gitlab # 24gitlab # Virtualisation disk image created.25gitlab # Creating Nix store image...26gitlab # Created Nix store image.27(finished: start all VMs, in 49.79 seconds)28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sxp3n59nbpmqb0xwi8jhscqwmgkh21ny-nixos-system-gitlab-test/init regInfo=/nix/store/ib037n1hx76q7br57ls2wrv688v71bxz-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 523862079 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002734] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002745] Using GB pages for direct mapping73gitlab # [ 0.002829] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002837] ACPI: Early table checksum verification disabled75gitlab # [ 0.002839] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002843] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002847] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002853] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002855] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002857] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002858] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002860] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002861] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002862] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002863] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002863] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002864] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002864] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003075] No NUMA configuration found90gitlab # [ 0.003076] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003078] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005395] Zone ranges:93gitlab # [ 0.005396] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005397] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005399] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005400] Device empty97gitlab # [ 0.005400] Movable zone start for each node98gitlab # [ 0.005401] Early memory node ranges99gitlab # [ 0.005401] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005402] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005403] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005404] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005425] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005693] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115981] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116394] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116408] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116439] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116441] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116443] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116444] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116445] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116446] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116448] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116449] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116454] TSC deadline timer available117gitlab # [ 0.116458] CPU topo: Max. logical packages: 1118gitlab # [ 0.116459] CPU topo: Max. logical dies: 1119gitlab # [ 0.116459] CPU topo: Max. dies per package: 1120gitlab # [ 0.116463] CPU topo: Max. threads per core: 1121gitlab # [ 0.116464] CPU topo: Num. cores per package: 4122gitlab # [ 0.116464] CPU topo: Num. threads per package: 4123gitlab # [ 0.116464] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116488] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116505] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116508] kvm-guest: setup PV sched yield127gitlab # [ 0.116524] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116525] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116526] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116528] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116529] Booting paravirtualized kernel on KVM132gitlab # [ 0.116533] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.121035] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.123296] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.123345] kvm-guest: PV spinlocks enabled136gitlab # [ 0.123346] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.123349] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sxp3n59nbpmqb0xwi8jhscqwmgkh21ny-nixos-system-gitlab-test/init regInfo=/nix/store/ib037n1hx76q7br57ls2wrv688v71bxz-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123443] Unknown kernel command line parameters "regInfo=/nix/store/ib037n1hx76q7br57ls2wrv688v71bxz-closure-info/registration", will be passed to user space.139gitlab # [ 0.123457] random: crng init done140gitlab # [ 0.123457] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.132472] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.136807] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.136885] software IO TLB: area num 4.144gitlab # [ 0.212613] Fallback order for Node 0: 0145gitlab # [ 0.212621] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.212622] Policy zone: Normal147gitlab # [ 0.215163] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.224716] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.238352] allocated 12582912 bytes of page_ext150gitlab # [ 0.248671] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.248673] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.249566] Dynamic Preempt: lazy153gitlab # [ 0.249757] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.249757] rcu: RCU event tracing is enabled.155gitlab # [ 0.249758] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.249760] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.249760] Rude variant of Tasks RCU enabled.158gitlab # [ 0.249761] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.249761] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.249762] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.249791] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.249793] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.249794] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.254194] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.254495] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.254504] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.254616] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.258172] Console: colour VGA+ 80x25169gitlab # [ 0.258175] printk: legacy console [tty0] enabled170gitlab # [ 0.288984] printk: legacy console [ttyS0] enabled171gitlab # [ 0.386952] ACPI: Core revision 20250807172gitlab # [ 0.387869] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.389342] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.390336] x2apic enabled175gitlab # [ 0.391115] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.392001] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.393222] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.394656] kvm-guest: setup PV IPIs179gitlab # [ 0.396205] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.397225] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.398961] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.401042] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.402076] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.403708] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.404774] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.405958] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.407959] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.408958] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.409958] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.410958] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.411965] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.412959] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.413959] active return thunk: srso_alias_return_thunk194gitlab # [ 0.415655] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.416926] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.417958] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.418958] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.419958] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.420958] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.421958] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.422959] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.424732] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.425739] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.426744] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.427744] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.428744] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.458624] Freeing SMP alternatives memory: 44K208gitlab # [ 0.458962] pid_max: default: 32768 minimum: 301209gitlab # [ 0.460079] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.461059] landlock: Up and running.211gitlab # [ 0.461959] Yama: becoming mindful.212gitlab # [ 0.463006] LSM support for eBPF active213gitlab # [ 0.463906] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.465119] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.467910] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.468516] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.468963] ... version: 2218gitlab # [ 0.469700] ... bit width: 48219gitlab # [ 0.469961] ... generic counters: 6220gitlab # [ 0.470717] ... generic bitmap: 000000000000003f221gitlab # [ 0.471007] ... fixed-purpose counters: 0222gitlab # [ 0.471761] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.472678] ... value mask: 0000ffffffffffff224gitlab # [ 0.472960] ... max period: 00007fffffffffff225gitlab # [ 0.473884] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.474776] signal: max sigframe size: 3376227gitlab # [ 0.475568] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.475964] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.477037] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.482610] smp: Bringing up secondary CPUs ...231gitlab # [ 0.483357] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.483969] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.487079] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.488675] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.489307] Memory: 6011624K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.491961] devtmpfs: initialized237gitlab # [ 0.492822] x86/mm: Memory block size: 128MB238gitlab # [ 0.496026] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.497042] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.498065] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.499248] PM: RTC time: 07:17:57, date: 2026-08-17242gitlab # [ 0.502920] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.505345] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.506015] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.508084] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.508971] audit: initializing netlink subsys (disabled)247gitlab # [ 0.510021] audit: type=2000 audit(1786951077.710:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.510224] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.511962] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.512962] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.513961] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.514960] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.515978] cpuidle: using governor menu254gitlab # [ 0.518193] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.519212] PCI: Using configuration type 1 for base access256gitlab # [ 0.519962] PCI: Using configuration type 1 for extended access257gitlab # [ 0.521149] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.524392] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.524962] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.525962] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.526961] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.532634] ACPI: Added _OSI(Module Device)263gitlab # [ 0.533971] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.535967] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.542992] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.550931] ACPI: Interpreter enabled267gitlab # [ 0.552038] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.553969] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.556033] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.559970] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.562303] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.575488] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.577976] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.581808] acpiphp: Slot [3] registered275gitlab # [ 0.582992] acpiphp: Slot [4] registered276gitlab # [ 0.584060] acpiphp: Slot [5] registered277gitlab # [ 0.586062] acpiphp: Slot [6] registered278gitlab # [ 0.587046] acpiphp: Slot [7] registered279gitlab # [ 0.588046] acpiphp: Slot [8] registered280gitlab # [ 0.590059] acpiphp: Slot [9] registered281gitlab # [ 0.591038] acpiphp: Slot [10] registered282gitlab # [ 0.592045] acpiphp: Slot [11] registered283gitlab # [ 0.594054] acpiphp: Slot [12] registered284gitlab # [ 0.595051] acpiphp: Slot [13] registered285gitlab # [ 0.597007] acpiphp: Slot [14] registered286gitlab # [ 0.598003] acpiphp: Slot [15] registered287gitlab # [ 0.599004] acpiphp: Slot [16] registered288gitlab # [ 0.599921] acpiphp: Slot [17] registered289gitlab # [ 0.601533] acpiphp: Slot [18] registered290gitlab # [ 0.601980] acpiphp: Slot [19] registered291gitlab # [ 0.602691] acpiphp: Slot [20] registered292gitlab # [ 0.602991] acpiphp: Slot [21] registered293gitlab # [ 0.603749] acpiphp: Slot [22] registered294gitlab # [ 0.604981] acpiphp: Slot [23] registered295gitlab # [ 0.605706] acpiphp: Slot [24] registered296gitlab # [ 0.605981] acpiphp: Slot [25] registered297gitlab # [ 0.606724] acpiphp: Slot [26] registered298gitlab # [ 0.607982] acpiphp: Slot [27] registered299gitlab # [ 0.608708] acpiphp: Slot [28] registered300gitlab # [ 0.608981] acpiphp: Slot [29] registered301gitlab # [ 0.609710] acpiphp: Slot [30] registered302gitlab # [ 0.611002] acpiphp: Slot [31] registered303gitlab # [ 0.611723] PCI host bridge to bus 0000:00304gitlab # [ 0.611968] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.612962] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.613964] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.614962] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.616961] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.617962] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.619212] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.621439] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.623418] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.627020] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.627930] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.628817] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.629722] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.630962] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.632173] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.635014] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.637322] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.639258] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.639967] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.642181] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.664054] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.664976] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.665967] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.667163] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.669825] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.674994] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.675969] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.676982] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.689987] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.697438] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.709003] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.710982] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.713030] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.719083] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.729006] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.730982] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.733021] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.740059] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.746980] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.748978] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.751016] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.755302] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.760004] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.760917] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.761756] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.765281] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.770165] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.771663] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.771985] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.775264] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.778995] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.779903] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.780742] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.781932] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.785138] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.787975] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.788982] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.791219] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.795005] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.795909] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.796796] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.799235] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.803811] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.804644] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.805983] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.810727] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.812124] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.814106] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.815089] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.816032] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.819318] iommu: Default domain type: Translated375gitlab # [ 0.819817] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.822625] ACPI: bus type USB registered377gitlab # [ 0.825414] usbcore: registered new interface driver usbfs378gitlab # [ 0.827239] usbcore: registered new interface driver hub379gitlab # [ 0.830024] usbcore: registered new device driver usb380gitlab # [ 0.835634] NetLabel: Initializing381gitlab # [ 0.836966] NetLabel: domain hash size = 128382gitlab # [ 0.838966] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.841087] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.842989] PCI: Using ACPI for IRQ routing385gitlab # [ 0.846012] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.846957] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.846957] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.852974] vgaarb: loaded389gitlab # [ 0.855533] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.856965] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.863164] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.869633] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.871328] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.875130] pnp: PnP ACPI init395gitlab # [ 0.878019] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.892853] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.895753] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.897825] NET: Registered PF_INET protocol family399gitlab # [ 0.902179] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.925797] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.927305] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.928780] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.933226] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.934550] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.935717] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.937057] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.938218] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.939626] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.940619] NET: Registered PF_XDP protocol family410gitlab # [ 0.941498] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.942528] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.943518] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.944643] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.945797] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.947178] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.948225] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.950743] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.953479] PCI: CLS 0 bytes, default 64419gitlab # [ 0.954280] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.954823] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.955361] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.958220] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.979410] Initialise system trusted keyrings424gitlab # [ 0.980740] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.992438] Key type asymmetric registered426gitlab # [ 0.993202] Asymmetric key parser 'x509' registered427gitlab # [ 0.994129] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.995911] io scheduler mq-deadline registered429gitlab # [ 0.996780] io scheduler kyber registered430gitlab # [ 1.001220] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.002586] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.005166] Linux agpgart interface v0.103433gitlab # [ 1.006008] ACPI: bus type drm_connector registered434gitlab # [ 1.008127] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.009237] usbserial: USB Serial support registered for generic436gitlab # [ 1.010279] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.010279] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.012584] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.014063] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.015280] NET: Registered PF_INET6 protocol family441gitlab # [ 1.018127] Segment Routing with IPv6442gitlab # [ 1.019894] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.023521] IPI shorthand broadcast: enabled444gitlab # [ 1.034797] sched_clock: Marking stable (898035466, 136453668)->(1058213463, -23724329)445gitlab # [ 1.039338] registered taskstats version 1446gitlab # [ 1.042102] Loading compiled-in X.509 certificates447gitlab # [ 1.064387] Demotion targets for Node 0: null448gitlab # [ 1.066205] Key type .fscrypt registered449gitlab # [ 1.067541] Key type fscrypt-provisioning registered450gitlab # [ 1.069371] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.071126] ima: Allocated hash algorithm: sha1452gitlab # [ 1.072657] ima: No architecture policies found453gitlab # [ 1.074600] PM: Magic number: 6:749:268454gitlab # [ 1.078100] RAS: Correctable Errors collector initialized.455gitlab # [ 1.087252] clk: Disabling unused clocks456gitlab # [ 1.088668] PM: genpd: Disabling unused power domains457gitlab # [ 1.261224] Freeing initrd memory: 29392K458gitlab # [ 1.269414] Freeing unused decrypted memory: 2028K459gitlab # [ 1.276056] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.278791] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.283863] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.287843] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.356161] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.357317] Run /init as init process465gitlab # [ 1.371863] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.395695] fuse: init (API version 7.45)467gitlab # [ 1.404283] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.411499] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.414929] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.458907] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.795863] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.836609] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.838756] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.840822] systemd[1]: Running in initrd.475gitlab # [ 1.843246] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.846119] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.956765] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.002361] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.019115] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.020365] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.021820] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.023005] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.024165] systemd[1]: Reached target Path Units.484gitlab # [ 2.025062] systemd[1]: Reached target Slice Units.485gitlab # [ 2.025971] systemd[1]: Reached target Swaps.486gitlab # [ 2.026812] systemd[1]: Reached target Timer Units.487gitlab # [ 2.027829] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.029095] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.030281] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.031321] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.032385] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.033359] systemd[1]: Reached target Socket Units.493gitlab # [ 2.035426] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.037507] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.039630] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.043546] systemd[1]: Starting Journal Service...497gitlab # [ 2.051545] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.052547] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.058294] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.086986] netfs: FS-Cache loaded501gitlab # [ 2.087554] systemd-journald[92]: Collecting audit messages is disabled.502gitlab # [ 2.093227] systemd[1]: Finished Create List of Static Device Nodes.503gitlab # [ 2.096839] 9pnet: Installing 9P2000 support504gitlab # [ 2.097039] systemd[1]: modprobe@configfs.service: Deactivated successfully.505gitlab # [ 2.102585] systemd[1]: Finished Load Kernel Module configfs.506gitlab # [ 2.106082] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.507gitlab # [ 2.109157] systemd[1]: Finished Load Kernel Module 9pnet_virtio.508gitlab # [ 2.115981] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config509gitlab # [ 2.122771] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...510gitlab # [ 2.130224] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.511gitlab # [ 2.133982] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.512gitlab # [ 2.134494] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev513gitlab # [ 2.135769] systemd[1]: Started Journal Service.514gitlab # [ 1.999434] systemd-modules-load[94]: Using 4 probe threads515gitlab # [ 2.002612] systemd-modules-load[94]: Inserted module 'virtio_gpu'516gitlab # [ 2.003698] systemd-modules-load[94]: Inserted module 'virtio_balloon'517gitlab # [ 2.004730] systemd-modules-load[94]: Inserted module 'dm_mod'518gitlab # [ 2.005896] systemd[1]: Starting Create Static Device Nodes in /dev...519gitlab # [ 2.006940] systemd[1]: Finished Load Kernel Modules.520gitlab # [ 2.010350] systemd[1]: Starting Apply Kernel Variables...521gitlab # [ 2.016426] systemd[1]: Finished Create Static Device Nodes in /dev.522gitlab # [ 2.017830] systemd[1]: Reached target Preparation for Local File Systems.523gitlab # [ 2.018750] systemd[1]: Reached target Local File Systems.524gitlab # [ 2.019555] systemd[1]: Starting Create System Files and Directories...525gitlab # [ 2.021167] systemd[1]: Starting Rule-based Manager for Device Events and Files...526gitlab # [ 2.022285] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 2.029807] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.042239] systemd-udevd[112]: Using default interface naming scheme 'v261'.529gitlab # [ 2.053082] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.106089] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.107162] systemd[1]: Reached target System Initialization.532gitlab # [ 2.107912] systemd[1]: Reached target Basic System.533gitlab # [ 2.318873] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.323070] SCSI subsystem initialized535gitlab # [ 2.330964] uhci_hcd 0000:00:01.2: UHCI Host Controller536gitlab # [ 2.335522] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1537gitlab # [ 2.336658] uhci_hcd 0000:00:01.2: detected 2 ports538gitlab # [ 2.337500] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140539gitlab # [ 2.338493] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18540gitlab # [ 2.339652] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1541gitlab # [ 2.340729] usb usb1: Product: UHCI Host Controller542gitlab # [ 2.341664] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.342557] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.345893] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)545gitlab # [ 2.359372] hub 1-0:1.0: USB hub found546gitlab # [ 2.360150] hub 1-0:1.0: 2 ports detected547gitlab # [ 2.360943] virtio_blk virtio5: 4/0/0 default/read/poll queues548gitlab # [ 2.362535] scsi host0: ata_piix549gitlab # [ 2.363647] virtio_blk virtio5: [vdb] 11830760 512-byte logical blocks (6.06 GB/5.64 GiB)550gitlab # [ 2.363780] scsi host1: ata_piix551gitlab # [ 2.366402] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0552gitlab # [ 2.367431] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0553gitlab # [ 2.369822] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12554gitlab # [ 2.371771] serio: i8042 KBD port at 0x60,0x64 irq 1555gitlab # [ 2.372438] serio: i8042 AUX port at 0x60,0x64 irq 12556gitlab # [ 2.259876] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 2.262026] (udev-worker)[134]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.263990] (udev-worker)[134]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.266100] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.279683] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.282598] systemd-vconsole-setup[152]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.284144] systemd[1]: Found device /dev/disk/by-label/nix-store.563gitlab # [ 2.285058] systemd[1]: Finished Virtual Console Setup.564gitlab # [ 2.285824] systemd[1]: Reached target Initrd Root Device.565gitlab # [ 2.286644] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...566gitlab # [ 2.311614] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.315439] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.527129] ata2: found unknown device (class 0)569gitlab # [ 2.528709] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.531088] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.565928] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0572gitlab # [ 2.583536] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.596819] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.624186] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.752511] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.755438] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.757966] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.759537] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.760948] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.795364] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.808980] usbcore: registered new interface driver usbhid582gitlab # [ 2.811034] usbhid: USB HID core driver583gitlab # [ 2.820745] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.823898] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.958722] systemd[1]: Mounting /sysroot...586gitlab # [ 3.251628] EXT4-fs (vda): mounted filesystem ac71240e-f640-4dc6-ab41-bda4dec8fb89 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.122063] systemd[1]: Mounted /sysroot.588gitlab # [ 3.124666] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.130094] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.133868] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.141457] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.145863] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.153763] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.158526] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.298578] 9p: Installing v9fs 9p2000 file system support596gitlab # [ 3.166686] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.169689] systemd[1]: Mounted /sysroot/tmp/shared.598gitlab # [ 3.307183] erofs (device vdb): mounted with root inode @ nid 128.599gitlab # [ 3.172134] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.600gitlab # [ 3.174916] systemd[1]: Mounted /sysroot/run.601gitlab # [ 3.176092] systemd[1]: Mounted /sysroot/nix/.ro-store.602gitlab # [ 3.187289] systemd[1]: Starting rw-sysroot-nix-store.service...603gitlab # [ 3.189090] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...604gitlab # [ 3.191969] systemd[1]: Reloading...605gitlab # [ 3.248470] systemd[1]: Reloading finished in 60 ms.606gitlab # [ 3.279609] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...607gitlab # [ 3.282625] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.284512] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.287263] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.289416] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.291976] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.294165] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.296507] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.298836] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.307158] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.309823] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.959397] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 4.012758] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 4.014878] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 4.016936] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.019212] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.044291] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.047104] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.061708] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.063481] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.065310] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.099476] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.101467] systemd[1]: Stopped target Basic System.629gitlab # [ 4.103186] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.104922] systemd[1]: Stopped target Path Units.631gitlab # [ 4.106477] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.108839] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.111615] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.114289] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.115911] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.118314] systemd[1]: Stopped target Swaps.637gitlab # [ 4.120839] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.123170] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.125226] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.127387] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.129976] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.132875] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.136804] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.138725] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.140671] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.142281] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.144121] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.145425] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.147336] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.149244] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.151051] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.152661] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.154212] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.155881] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.157698] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.159095] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.160279] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.161396] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.162204] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.163198] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.164077] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.164988] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.165784] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.166599] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.167486] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.168428] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.169075] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.169785] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.170705] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.171481] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.172564] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.173654] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.174590] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.194946] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.195964] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.196920] systemd[1]: Reached target Switch Root.677gitlab # [ 4.198767] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.335541] initrd-nixos-activation-start[227]: booting system configuration /nix/store/sxp3n59nbpmqb0xwi8jhscqwmgkh21ny-nixos-system-gitlab-test679gitlab # [ 4.385493] initrd-nixos-activation-start[227]: running activation script...680gitlab # [ 4.631407] initrd-nixos-activation-start[250]: setting up /etc...681gitlab # [ 4.742332] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.744717] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.747105] systemd[1]: Starting Switch Root...684gitlab # [ 4.785073] systemd[1]: Switching root.685gitlab # [ 4.984841] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.085660] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.452115] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.461973] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.463896] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.465745] systemd[1]: Detected first boot.691gitlab # [ 5.468319] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.622471] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.705349] systemd[1]: Applying preset policy.694gitlab # [ 5.862154] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.964375] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.965699] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.968090] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.970119] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.971522] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.972917] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.973941] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.975124] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.976180] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.976889] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.977657] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.978423] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.979142] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.979935] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.980795] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.981726] systemd[1]: Reached target Path Units.711gitlab # [ 5.982402] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.983207] systemd[1]: Reached target Slice Units.713gitlab # [ 5.983929] systemd[1]: Reached target Swaps.714gitlab # [ 5.985321] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.987292] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.988686] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.990251] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.991279] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.993821] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.995133] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.997119] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.998301] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.999421] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 6.000710] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 6.003564] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 6.004595] systemd[1]: Listening on udev Control Socket.727gitlab # [ 6.005416] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 6.008091] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.010243] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.012247] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.014783] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.017907] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.018932] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.023719] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.026233] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.029906] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.033633] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.040438] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.042912] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.078391] systemd[1]: Starting Journal Service...741gitlab # [ 6.081935] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.086116] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.091638] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.094366] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.101510] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.103421] loop: module loaded747gitlab # [ 6.106635] EXT4-fs (vda): re-mounted ac71240e-f640-4dc6-ab41-bda4dec8fb89.748gitlab # [ 6.108972] systemd-journald[320]: Collecting audit messages is enabled.749gitlab # [ 6.110425] systemd[1]: Listening on Journal Log Access Socket.750gitlab # [ 6.111574] systemd[1]: Mounted Huge Pages File System.751gitlab # [ 6.112543] systemd[1]: Mounted POSIX Message Queue File System.752gitlab # [ 6.113619] systemd[1]: Mounted Kernel Debug File System.753gitlab # [ 6.114523] systemd[1]: Mounted Kernel Trace File System.754gitlab # [ 6.115895] systemd[1]: Finished Create List of Static Device Nodes.755gitlab # [ 6.117119] systemd[1]: modprobe@configfs.service: Deactivated successfully.756gitlab # [ 6.118608] systemd[1]: Finished Load Kernel Module configfs.757gitlab # [ 6.119666] systemd[1]: Mounted FUSE Control File System.758gitlab # [ 6.121059] systemd[1]: Finished Load Kernel Modules.759gitlab # [ 5.984817] systemd[1]: Queued start job for [ 6.121943] systemd[1]: Started Journal Service.760gitlab # default target Multi-User System.761gitlab # [ 5.987362] systemd[1]: Unnecessary job was removed for /dev/vdb.762gitlab # [ 5.988427] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 5.989659] systemd-modules-load[321]: Using 3 probe threads764gitlab # [ 5.990554] systemd-modules-load[321]: Inserted module 'loop'765gitlab # [ 5.991424] systemd-modules-load[321]: Inserted module 'tls'766gitlab # [ 5.992276] systemd[1]: Finished Remount Root and Kernel File Systems.767gitlab # [ 5.995764] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.996749] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 5.997721] systemd[1]: Starting Firewall...770gitlab # [ 6.001089] systemd[1]: Starting Flush Journal to Persistent Storage...771gitlab # [ 6.002087] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 6.004383] systemd-oomd[323]: No swap; memory pressure usage will be degraded773gitlab # [ 6.005663] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 6.009185] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 6.151300] systemd-journald[320]: Received client request to flush runtime journal.776gitlab # [ 6.064433] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...777gitlab # [ 6.065935] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os778gitlab # [ 6.067386] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 6.068440] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 6.069460] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 6.070238] systemd[1]: Reached target First Boot Complete.782gitlab # [ 6.071457] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 6.072235] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 6.073208] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 6.074065] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 6.075160] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 6.076130] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 6.077112] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 6.090303] systemd-udevd[357]: Using default interface naming scheme 'v261'.790gitlab # [ 6.122446] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 6.127552] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 6.205033] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.215097] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.237935] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.795gitlab # [ 6.267435] (udev-worker)[440]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.291217] (udev-worker)[423]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.293479] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.435498] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input3799gitlab # [ 6.435608] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4800gitlab # [ 6.438538] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console801gitlab # [ 6.456215] Console: switching to colour dummy device 80x25802gitlab # [ 6.457030] [drm] Found bochs VGA, ID 0xb0c5.803gitlab # [ 6.457033] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.804gitlab # [ 6.459384] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic805gitlab # [ 6.460215] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0806gitlab # [ 6.460266] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0807gitlab # [ 6.460521] ACPI: button: Power Button [PWRF]808gitlab # [ 6.461114] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD809gitlab # [ 6.475120] Console: switching to colour frame buffer device 160x50810gitlab # [ 6.481505] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device811gitlab # [ 6.488904] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6812gitlab # [ 6.358414] systemd[1]: Condition check resulted in Virtio network device being skipped.813gitlab # [ 6.359680] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore814gitlab # [ 6.361357] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67815gitlab # [ 6.365211] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore816gitlab # [ 6.366723] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os817gitlab # [ 6.368018] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os818gitlab # [ 6.508800] Floppy drive(s): fd0 is 2.88M AMI BIOS819gitlab # [ 6.515610] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5820gitlab # [ 6.515850] rtc_cmos 00:05: RTC can wake from S4821gitlab # [ 6.522819] FDC 0 is a S82078B822gitlab # [ 6.525653] parport_pc 00:03: reported by Plug and Play ACPI823gitlab # [ 6.526265] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]824gitlab # [ 6.526990] rtc_cmos 00:05: registered as rtc0825gitlab # [ 6.527576] rtc_cmos 00:05: setting system clock to 2026-08-17T07:18:03 UTC (1786951083)826gitlab # [ 6.528954] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs827gitlab # [ 6.533845] systemd-journald[320]: Time jumped backwards, rotating.828gitlab # [ 6.419158] systemd[1]: Finished Firewall.829gitlab # [ 6.583089] mousedev: PS/2 mouse device common for all mice830gitlab # [ 6.457146] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.613735] erofs (device vdb): failed to read inode meta block (nid: 128515687): -4832gitlab # [ 6.479879] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 6.480923] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 6.484025] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.496792] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 6.497879] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 6.502212] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.666267] ppdev: user-space parallel port driver839gitlab # [ 6.568519] systemd-vconsole-setup[496]: Configuration of first virtual console was skipped, ignoring remaining ones.840gitlab # [ 6.572106] systemd[1]: Finished Virtual Console Setup.841gitlab # [ 6.734905] kvm_amd: TSC scaling supported842gitlab # [ 6.735351] kvm_amd: Nested Virtualization enabled843gitlab # [ 6.735903] kvm_amd: Nested Paging enabled844gitlab # [ 6.736281] kvm_amd: LBR virtualization supported845gitlab # [ 6.736806] kvm_amd: Virtual VMLOAD VMSAVE supported846gitlab # [ 6.737253] kvm_amd: Virtual GIF supported847gitlab # [ 6.737748] kvm_amd: Virtual NMI enabled848gitlab # [ 6.772622] EDAC MC: Ver: 3.0.0849gitlab # [ 6.833307] systemd[1]: Mounting /run/wrappers...850gitlab # [ 6.859256] systemd[1]: Mounted /run/wrappers.851gitlab # [ 6.860923] systemd[1]: Reached target Local File Systems.852gitlab # [ 6.862744] systemd[1]: Listening on Boot Loader Control Service Socket.853gitlab # [ 6.864875] systemd[1]: Starting register-nix-paths.service...854gitlab # [ 6.867308] systemd[1]: Starting Create SUID/SGID Wrappers...855gitlab # [ 6.869190] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.856gitlab # [ 6.872079] systemd[1]: Starting Save Transient machine-id to Disk...857gitlab # [ 6.882161] systemd[1]: Starting Create System Files and Directories...858gitlab # [ 6.909867] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.859gitlab # [ 6.914489] systemd[1]: Finished Save Transient machine-id to Disk.860gitlab # [ 6.919410] systemd[1]: Finished Create System Files and Directories.861gitlab # [ 6.927079] systemd[1]: Starting Rebuild Journal Catalog...862gitlab # [ 6.932104] systemd[1]: Starting Record System Boot/Shutdown in UTMP...863gitlab # [ 6.950379] systemd[1]: Finished Record System Boot/Shutdown in UTMP.864gitlab # [ 6.964220] systemd[1]: Finished Rebuild Journal Catalog.865gitlab # [ 6.966522] systemd[1]: Starting Update is Completed...866gitlab # [ 6.984296] systemd[1]: Finished Update is Completed.867gitlab # [ 7.033984] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.868gitlab # [ 7.035873] systemd[1]: Finished Create SUID/SGID Wrappers.869gitlab # [ 7.269749] systemd[1]: Finished register-nix-paths.service.870gitlab # [ 7.270840] systemd[1]: Reached target System Initialization.871gitlab # [ 7.271686] systemd[1]: Started Discard unused filesystem blocks once a week.872gitlab # [ 7.272697] systemd[1]: Started logrotate.timer.873gitlab # [ 7.273386] systemd[1]: Started Daily Cleanup of Temporary Directories.874gitlab # [ 7.274306] systemd[1]: Reached target Timer Units.875gitlab # [ 7.274990] systemd[1]: Listening on D-Bus System Message Bus Socket.876gitlab # [ 7.275900] systemd[1]: Listening on Nix Daemon Socket.877gitlab # [ 7.282438] systemd[1]: Starting nixbot CI service socket...878gitlab # [ 7.283323] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.879gitlab # [ 7.285082] systemd[1]: Listening on nixbot CI service socket.880gitlab # [ 7.285933] systemd[1]: Reached target Socket Units.881gitlab # [ 7.289297] systemd[1]: Starting D-Bus System Message Bus...882gitlab # [ 7.339378] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...883gitlab # [ 7.342179] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'884gitlab # [ 7.344606] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"885gitlab # [ 7.349265] systemd[1]: Started D-Bus System Message Bus.886gitlab # [ 7.365887] dbus-broker-launch[578]: Ready887gitlab # [ 7.368352] systemd[1]: Reached target Basic System.888gitlab # [ 7.371477] systemd[1]: Started backdoor.service.889gitlab # [ 7.376856] systemd[1]: Starting gitlab-config.service...890gitlab # [ 7.378993] systemd[1]: Starting Import lastlog data into lastlog2 database...891gitlab # [ 7.384693] systemd[1]: Starting Logrotate configuration check...892gitlab # [ 7.391213] systemd[1]: Starting Name Service Cache Daemon (nsncd)...893gitlab # [ 7.401071] systemd[1]: Starting Post-Boot Actions...894gitlab # [ 7.406108] systemd[1]: Started Reset console on configuration changes.895gitlab # connecting to host...896gitlab # [ 7.413296] systemd[1]: Starting resolvconf update...897gitlab # [ 7.414247] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.898gitlab # [ 7.415221] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf899gitlab # [ 7.417173] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'900gitlab # [ 7.418691] logrotate[583]: Reading state from file: /var/lib/logrotate.status901gitlab: Guest shell says: b'Spawning backdoor root shell...\n'902gitlab # [ 7.419733] logrotate[583]: state file /var/lib/logrotate.status does not exist903gitlab # [ 7.420856] logrotate[583]: Allocating hash table for state file, size 64 entries904gitlab: connected to guest root shell905gitlab # [ 7.422025] logrotate[583]: Handling 4 logs906gitlab: (connecting took 8.09 seconds)907gitlab # [ 7.422579] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed908gitlab: (finished: waiting for the VM to finish booting, in 8.09 seconds)909gitlab # [ 7.423179] logrotate[583]: considering log /var/log/btmp910gitlab # [ 7.423699] logrotate[583]: Creating new state911gitlab # [ 7.424137] logrotate[583]: Now: 2026-08-17 07:18912gitlab # [ 7.424558] logrotate[583]: Last rotated at 2026-08-17 07:00913gitlab # [ 7.424966] logrotate[583]: log does not need rotating (log has already been rotated)914gitlab # [ 7.425526] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed915gitlab # [ 7.425978] logrotate[583]: considering log /var/log/wtmp916gitlab # [ 7.426503] logrotate[583]: Creating new state917gitlab # [ 7.426920] logrotate[583]: Now: 2026-08-17 07:18918gitlab # [ 7.427463] logrotate[583]: Last rotated at 2026-08-17 07:00919gitlab # [ 7.427921] logrotate[583]: log does not need rotating (log has already been rotated)920gitlab # [ 7.428466] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed921gitlab # [ 7.428886] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)922gitlab # [ 7.429437] logrotate[583]: considering log /var/gitlab/state/log/*.log923gitlab # [ 7.429856] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping924gitlab # [ 7.430412] logrotate[583]: Creating new state925gitlab # [ 7.430822] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)926gitlab # [ 7.431378] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed927gitlab # [ 7.431801] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)928gitlab # [ 7.432339] logrotate[583]: considering log /var/log/nginx/*.log929gitlab # [ 7.432762] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping930gitlab # [ 7.433180] logrotate[583]: Creating new state931gitlab # [ 7.433598] logrotate[583]: not running postrotate script, since no logs were rotated932gitlab # [ 7.434045] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)933gitlab # [ 7.455129] systemd[1]: Finished Logrotate configuration check.934gitlab # [ 7.466744] systemd[1]: Finished Post-Boot Actions.935gitlab # [ 7.468269] systemd[1]: Finished Import lastlog data into lastlog2 database.936gitlab # [ 7.469800] systemd[1]: Started Name Service Cache Daemon (nsncd).937gitlab # [ 7.471681] nsncd[584]: Aug 17 07:18:04.580 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"938gitlab # [ 7.475202] systemd[1]: Reached target Host and Network Name Lookups.939gitlab # [ 7.476131] systemd[1]: Reached target User and Group Name Lookups.940gitlab # [ 7.480630] systemd[1]: Starting User Login Management...941gitlab # [ 7.518264] systemd[1]: Stopped target Host and Network Name Lookups.942gitlab # [ 7.518585] systemd[1]: Stopping Host and Network Name Lookups...943gitlab # [ 7.520034] systemd[1]: Stopped target User and Group Name Lookups.944gitlab # [ 7.520931] systemd[1]: Stopping User and Group Name Lookups...945gitlab # [ 7.521801] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...946gitlab # [ 7.523968] systemd-logind[625]: New seat seat0.947gitlab # [ 7.525988] systemd[1]: nscd.service: Deactivated successfully.948gitlab # [ 7.529734] systemd[1]: Stopped Name Service Cache Daemon (nsncd).949gitlab # [ 7.530699] systemd[1]: nscd.service: Consumed 51ms CPU time over 132ms wall clock time, 7.6M memory peak, 5.5M read from disk.950gitlab # [ 7.532961] systemd[1]: Starting Name Service Cache Daemon (nsncd)...951gitlab # [ 7.533885] systemd-logind[625]: Watching system buttons on /dev/input/event3 (Power Button)952gitlab # [ 7.534963] systemd-logind[625]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard)953gitlab # [ 7.536171] systemd-logind[625]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)954gitlab # [ 7.537508] systemd[1]: Started User Login Management.955gitlab # [ 7.539028] systemd[1]: Starting linger-users.service...956gitlab # [ 7.544900] systemd[1]: Started Name Service Cache Daemon (nsncd).957gitlab # [ 7.545613] nsncd[673]: Aug 17 07:18:04.653 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"958gitlab # [ 7.545898] systemd[1]: Reached target Host and Network Name Lookups.959gitlab # [ 7.546647] systemd[1]: Reached target User and Group Name Lookups.960gitlab # [ 7.557248] systemd[1]: linger-users.service: Deactivated successfully.961gitlab # [ 7.557745] systemd[1]: Finished linger-users.service.962gitlab # [ 7.564262] systemd[1]: Finished resolvconf update.963gitlab # [ 7.565064] systemd[1]: Reached target Preparation for Network.964gitlab # [ 7.569070] systemd[1]: Starting DHCP Client...965gitlab # [ 7.570121] systemd[1]: Starting Address configuration of eth1...966gitlab # [ 7.573327] systemd[1]: Starting Extra networking commands....967gitlab # [ 7.600215] network-addresses-eth1-start[701]: adding address 192.168.1.1/24... done968gitlab # [ 7.602830] network-addresses-eth1-start[701]: adding address 2001:db8:1::1/64... done969gitlab # [ 7.608121] systemd[1]: Finished Address configuration of eth1.970gitlab # [ 7.637309] dhcpcd[712]: dhcpcd-10.3.2 starting971gitlab # [ 7.639503] dhcpcd[761]: dev: loaded udev972gitlab # [ 7.644865] s[ 7.781352] 8021q: 802.1Q VLAN Support v1.8973gitlab # ystemd[1]: Finished Extra networking commands..974gitlab # [ 7.781958] 8021q: adding VLAN 0 to HW filter on device eth1975gitlab # [ 7.646662] systemd[1]: Reached target Network.976gitlab # [ 7.648255] systemd[1]: Starting gitlab-workhorse.service...977gitlab # [ 7.653044] systemd[1]: Starting Nginx Web Server...978gitlab # [ 7.659090] systemd[1]: Starting PostgreSQL Server...979gitlab # [ 7.661523] systemd[1]: Starting Redis Server - redis-gitlab...980gitlab # [ 7.664277] systemd[1]: Starting Permit User Sessions...981gitlab # [ 7.677270] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.982gitlab # [ 7.682224] systemd[1]: Finished Permit User Sessions.983gitlab # [ 7.694883] systemd[1]: Started Getty on tty1.984gitlab # [ 7.695227] systemd[1]: Reached target Login Prompts.985gitlab # [ 7.869409] cfg80211: Loading compiled-in X.509 certificates for regulatory database986gitlab # [ 7.875160] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'987gitlab # [ 7.877305] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'988gitlab # [ 7.879198] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2989gitlab # [ 7.880276] cfg80211: failed to load regulatory.db990gitlab # [ 7.906294] 8021q: adding VLAN 0 to HW filter on device eth0991gitlab # [ 7.771562] dhcpcd[761]: eth0: waiting for carrier992gitlab # [ 7.771805] dhcpcd[761]: eth0: carrier acquired993gitlab # [ 7.775804] dhcpcd[761]: DUID 00:01:00:01:32:15:72:2c:52:54:00:12:34:56994gitlab # [ 7.776123] dhcpcd[761]: eth0: IAID 00:12:34:56995gitlab # [ 7.776454] dhcpcd[761]: eth0: adding address fe80::5054:ff:fe12:3456996gitlab # [ 7.792188] nginx-pre-start[794]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok997gitlab # [ 7.792846] nginx-pre-start[794]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful998gitlab # [ 7.799061] systemd[1]: Started Nginx Web Server.999gitlab # [ 7.808318] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1000gitlab # [ 7.808726] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1001gitlab # [ 7.809804] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started1002gitlab # [ 7.810888] redis-server[789]: Configuration loaded1003gitlab # [ 7.811381] redis[789]: monotonic clock: POSIX clock_gettime1004gitlab # [ 7.811776] redis[789]: Running mode=standalone, port=0.1005gitlab # [ 7.812348] redis[789]: Server initialized1006gitlab # [ 7.812742] systemd[1]: Started Redis Server - redis-gitlab.1007gitlab # [ 7.813494] redis[789]: Ready to accept connections unix1008gitlab # [ 7.814157] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1009gitlab # [ 7.824984] postgresql-pre-start[800]: The files belonging to this database system will be owned by user "postgres".1010gitlab # [ 7.825431] postgresql-pre-start[800]: This user must also own the server process.1011gitlab # [ 7.829401] postgresql-pre-start[800]: The database cluster will be initialized with locale "en_US.UTF-8".1012gitlab # [ 7.830948] postgresql-pre-start[800]: The default database encoding has accordingly been set to "UTF8".1013gitlab # [ 7.831582] postgresql-pre-start[800]: The default text search configuration will be set to "english".1014gitlab # [ 7.832171] postgresql-pre-start[800]: Data page checksums are enabled.1015gitlab # [ 7.834448] postgresql-pre-start[800]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1016gitlab # [ 7.836582] postgresql-pre-start[800]: creating subdirectories ... ok1017gitlab # [ 7.836895] postgresql-pre-start[800]: selecting dynamic shared memory implementation ... posix1018gitlab # [ 7.868103] postgresql-pre-start[800]: selecting default "max_connections" ... 1001019gitlab # [ 7.907403] postgresql-pre-start[800]: selecting default "shared_buffers" ... 128MB1020gitlab # [ 8.133061] systemd[1]: Started gitlab-workhorse.service.1021gitlab # [ 8.243405] dhcpcd[761]: eth0: soliciting a DHCP lease1022gitlab # [ 8.389307] NET: Registered PF_PACKET protocol family1023gitlab # [ 8.264528] dhcpcd[761]: eth0: offered 10.0.2.15 from 10.0.2.21024gitlab # [ 8.269344] dhcpcd[761]: eth0: probing address 10.0.2.15/241025gitlab # [ 8.310413] postgresql-pre-start[800]: selecting default time zone ... UTC1026gitlab # [ 8.312217] postgresql-pre-start[800]: creating configuration files ... ok1027gitlab # [ 8.324232] gitlab-workhorse[826]: time="2026-08-17T07:18:05Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41028gitlab # [ 8.325164] gitlab-workhorse[826]: time="2026-08-17T07:18:05Z" level=info msg="Using redis/go-redis"1029gitlab # [ 8.326242] gitlab-workhorse[826]: time="2026-08-17T07:18:05Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1030gitlab # [ 8.475722] postgresql-pre-start[800]: running bootstrap script ... ok1031gitlab # [ 8.932919] postgresql-pre-start[800]: performing post-bootstrap initialization ... ok1032gitlab # [ 9.189521] dhcpcd[761]: eth0: soliciting an IPv6 router1033gitlab # [ 9.189926] dhcpcd[761]: eth0: Router Advertisement from fe80::21034gitlab # [ 9.192319] dhcpcd[761]: eth0: adding address fec0::5054:ff:fe12:3456/641035gitlab # [ 9.196278] dhcpcd[761]: eth0: adding route to fec0::/641036gitlab # [ 9.199087] dhcpcd[761]: eth0: adding default route via fe80::21037gitlab # [ 9.219850] postgresql-pre-start[800]: syncing data to disk ... ok1038gitlab # [ 9.220995] postgresql-pre-start[800]: initdb: warning: enabling "trust" authentication for local connections1039gitlab # [ 9.221950] postgresql-pre-start[800]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1040gitlab # [ 9.223117] postgresql-pre-start[800]: Success. You can now start the database server using:1041gitlab # [ 9.224166] postgresql-pre-start[800]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1042gitlab # [ 9.350351] postgres[856]: [856] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1043gitlab # [ 9.354796] postgres[856]: [856] LOG: listening on IPv6 address "::1", port 54321044gitlab # [ 9.355132] postgres[856]: [856] LOG: listening on IPv4 address "127.0.0.1", port 54321045gitlab # [ 9.361422] postgres[856]: [856] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1046gitlab # [ 9.374810] postgres[866]: [866] LOG: database system was shut down at 2026-08-17 07:18:06 GMT1047gitlab # [ 9.383335] postgres[856]: [856] LOG: database system is ready to accept connections1048gitlab # [ 9.389177] systemd[1]: Started PostgreSQL Server.1049gitlab # [ 9.391973] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: mkdir -p /var/gitlab/state/home/.ssh: OK1050gitlab # [ 9.393043] systemd[1]: Starting PostgreSQL Setup Scripts...1051gitlab # [ 9.397191] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: chmod 700 /var/gitlab/state/home/.ssh: OK1052gitlab # [ 9.464142] systemd[1]: Finished gitlab-config.service.1053gitlab # [ 9.466504] systemd[1]: Started gitaly.service.1054gitlab # [ 9.571314] postgresql-setup-start[888]: CREATE DATABASE1055gitlab # [ 9.591092] postgresql-setup-start[905]: CREATE ROLE1056gitlab # [ 9.601836] postgresql-setup-start[907]: ALTER DATABASE1057gitlab # [ 9.621259] postgresql-setup-start[912]: CREATE ROLE1058gitlab # [ 9.624343] systemd[1]: Finished PostgreSQL Setup Scripts.1059gitlab # [ 9.625104] systemd[1]: Reached target PostgreSQL.1060gitlab # [ 9.626507] systemd[1]: Starting gitlab-db-config.service...1061gitlab # [ 9.629064] systemd[1]: Starting gitlab-postgresql.service...1062gitlab # [ 9.716074] gitlab-postgresql-start[927]: CREATE DATABASE1063gitlab # [ 9.756360] gitlab-postgresql-start[933]: CREATE EXTENSION1064gitlab # [ 9.838515] gitlab-postgresql-start[935]: CREATE EXTENSION1065gitlab # [ 9.841945] systemd[1]: Finished gitlab-postgresql.service.1066gitlab # [ 9.971050] gitaly[891]: time="2026-08-17T07:18:07.079Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8911067gitlab # [ 9.971302] gitaly[891]: time="2026-08-17T07:18:07.079Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8911068gitlab # [ 9.971681] gitaly[891]: time="2026-08-17T07:18:07.079Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8911069gitlab # [ 9.972115] gitaly[891]: time="2026-08-17T07:18:07.079Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8911070gitlab # [ 9.972565] gitaly[891]: time="2026-08-17T07:18:07.079Z" level=info msg="Starting Gitaly" pid=891 version=1071gitlab # [ 10.166123] gitaly[891]: time="2026-08-17T07:18:07.274Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=186 pid=8911072gitlab # [ 10.167730] gitaly[891]: time="2026-08-17T07:18:07.274Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8911073gitlab # [ 10.169080] gitaly[891]: time="2026-08-17T07:18:07.275Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8911074gitlab # [ 10.170511] gitaly[891]: time="2026-08-17T07:18:07.275Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-891/git-exec-972157073.d/git pid=8911075gitlab # [ 10.172179] gitaly[891]: time="2026-08-17T07:18:07.280Z" level=info msg="finished detecting git version" duration_ms=5 pid=8911076gitlab # [ 10.173592] gitaly[891]: time="2026-08-17T07:18:07.280Z" level=info msg="using Git version" pid=891 version=2.53.g1077gitlab # [ 10.174798] gitaly[891]: time="2026-08-17T07:18:07.281Z" level=info msg="clearing disk cache object folder" pid=891 storage=default1078gitlab # [ 10.176142] gitaly[891]: time="2026-08-17T07:18:07.281Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2550075255 pid=891 storage=default1079gitlab # [ 10.178145] gitaly[891]: time="2026-08-17T07:18:07.281Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2550075255 pid=891 storage=default1080gitlab # [ 10.180444] gitaly[891]: time="2026-08-17T07:18:07.281Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8911081gitlab # [ 10.182504] gitaly[891]: time="2026-08-17T07:18:07.281Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8911082gitlab # [ 10.184672] gitaly[891]: time="2026-08-17T07:18:07.281Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2550075255 clear_duration_ms=0 pid=891 storage=default1083gitlab # [ 10.210253] gitaly[891]: time="2026-08-17T07:18:07.318Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8911084gitlab # [ 10.212657] gitaly[891]: time="2026-08-17T07:18:07.319Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=891 schema=unix1085gitlab # [ 10.214732] gitaly[891]: time="2026-08-17T07:18:07.319Z" level=info msg="finished tempdir cleaner walk" pid=891 storage=default time_ms=01086gitlab # [ 10.216568] gitaly[891]: time="2026-08-17T07:18:07.319Z" level=info msg="listening at address" address=/run/gitaly/gitaly-891/sock.d/intern pid=891 schema=unix1087gitlab # [ 10.218600] gitaly[891]: time="2026-08-17T07:18:07.318Z" level=info msg="counting repositories" pid=8911088gitlab # [ 10.219934] gitaly[891]: time="2026-08-17T07:18:07.319Z" level=info msg="starting to count repositories" pid=891 storage_path=/var/gitlab/state/repositories1089gitlab # [ 10.221851] gitaly[891]: time="2026-08-17T07:18:07.319Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=891 storage_path=/var/gitlab/state/repositories1090gitlab # [ 10.224146] gitaly[891]: time="2026-08-17T07:18:07.319Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8911091gitlab # [ 10.227726] gitaly[891]: time="2026-08-17T07:18:07.336Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8911092gitlab # [ 10.229562] gitaly[891]: time="2026-08-17T07:18:07.336Z" level=info msg="Started Gitaly" duration_ms=256 pid=8911093gitlab # [ 10.231227] gitaly[891]: time="2026-08-17T07:18:07.336Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8911094gitlab # [ 10.231573] gitaly[891]: time="2026-08-17T07:18:07.336Z" level=info msg="maintenance: daily scheduled" pid=891 scheduled="2026-08-17 12:00:00 +0000 UTC"1095gitlab # [ 11.022991] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1096gitlab # [ 11.029333] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1097gitlab # [ 11.054794] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1098gitlab # [ 12.142267] gitaly[891]: time="2026-08-17T07:18:09.249Z" level=info msg="License database preloaded" duration_ms=2170 pid=8911099gitlab # [ 13.013319] dhcpcd[761]: eth0: leased 10.0.2.15 for 86400 seconds1100gitlab # [ 13.013922] dhcpcd[761]: eth0: adding route to 10.0.2.0/241101gitlab # [ 13.014418] dhcpcd[761]: eth0: adding default route via 10.0.2.21102gitlab # [ 13.137675] systemd[1]: Started DHCP Client.1103gitlab # [ 13.140157] systemd[1]: Reached target Network is Online.1104gitlab # [ 41.451774] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: W, [2026-08-17T07:18:38.559677 #922] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1105gitlab # [ 43.884534] postgres[1318]: [1318] ERROR: relation "feature_gates" does not exist at character 5231106gitlab # [ 43.884799] postgres[1318]: [1318] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1107gitlab # [ 43.885450] postgres[1318]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1108gitlab # [ 43.886837] postgres[1318]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1109gitlab # [ 43.888568] postgres[1318]: attidentity AS identity,1110gitlab # [ 43.889926] postgres[1318]: attgenerated as attgenerated1111gitlab # [ 43.891361] postgres[1318]: FROM pg_attribute a1112gitlab # [ 43.892404] postgres[1318]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1113gitlab # [ 43.893779] postgres[1318]: LEFT JOIN pg_type t ON a.atttypid = t.oid1114gitlab # [ 43.895146] postgres[1318]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1115gitlab # [ 43.896557] postgres[1318]: WHERE a.attrelid = '"feature_gates"'::regclass1116gitlab # [ 43.897257] postgres[1318]: AND a.attnum > 0 AND NOT a.attisdropped1117gitlab # [ 43.897939] postgres[1318]: ORDER BY a.attnum1118gitlab # [ 43.899365] postgres[1318]:1119gitlab # [ 47.383422] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1120gitlab # [ 47.383855] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1121gitlab # [ 48.387204] gitlab-workhorse[826]: time="2026-08-17T07:18:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 58.397100] gitlab-workhorse[826]: time="2026-08-17T07:18:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 63.049588] postgres[1426]: [1426] ERROR: relation "table_without_models" does not exist1124gitlab # [ 63.049937] postgres[1426]: [1426] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1125gitlab # [ 68.406379] gitlab-workhorse[826]: time="2026-08-17T07:19:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1126gitlab # [ 74.940527] systemd[1]: Finished gitlab-db-config.service.1127gitlab # [ 74.944204] systemd[1]: Started gitlab-sidekiq.service.1128gitlab # [ 74.947897] systemd[1]: Starting gitlab.service...1129gitlab # [ 75.341094] bundle[1602]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1130gitlab # [ 75.341970] bundle[1602]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1131gitlab # [ 75.342818] bundle[1602]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1132gitlab # [ 78.089477] sidekiq-cluster[1601]: {"severity":"INFO","time":"2026-08-17T07:19:15.180Z","message":"Starting cluster with 1 processes"}1133gitlab # [ 78.417237] gitlab-workhorse[826]: time="2026-08-17T07:19:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1134gitlab # [ 78.423291] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.509Z","pid":1602,"message":"* Enabling systemd notification integration"}1135gitlab # [ 78.423921] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"Puma starting in cluster mode..."}1136gitlab # [ 78.424722] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1137gitlab # [ 78.425568] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1138gitlab # [ 78.426291] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Min threads: 0"}1139gitlab # [ 78.426874] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Max threads: 4"}1140gitlab # [ 78.427639] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Environment: production"}1141gitlab # [ 78.428266] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Master PID: 1602"}1142gitlab # [ 78.428923] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Workers: 2"}1143gitlab # [ 78.429728] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1144gitlab # [ 78.430483] bundle[1602]: {"timestamp":"2026-08-17T07:19:15.531Z","pid":1602,"message":"* Preloading application"}1145gitlab # [ 88.426755] gitlab-workhorse[826]: time="2026-08-17T07:19:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 98.437196] gitlab-workhorse[826]: time="2026-08-17T07:19:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 102.737854] bundle[1602]: W, [2026-08-17T07:19:39.845671 #1602] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 105.178216] sidekiq-cluster[1632]: 2026-08-17T07:19:42.285Z pid=1632 tid=wjs INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1632, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>436797440}1149gitlab # [ 105.365320] sidekiq-cluster[1632]: W, [2026-08-17T07:19:42.473818 #1632] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1150gitlab # [ 105.407708] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:42.516Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1151gitlab # [ 107.665180] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.772Z","message":"GitLab reliable fetch activated!"}1152gitlab # [ 107.668872] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.773Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1153gitlab # [ 107.703632] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.812Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1154gitlab # [ 107.708576] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.814Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1155gitlab # [ 107.713728] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.817Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1156gitlab # [ 107.718399] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.820Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1157gitlab # [ 107.723689] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.822Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1158gitlab # [ 107.728402] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.825Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1159gitlab # [ 107.733279] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.827Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1160gitlab # [ 107.737758] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.829Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1161gitlab # [ 107.742325] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.831Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1162gitlab # [ 107.747087] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.834Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1163gitlab # [ 107.751780] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.836Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1164gitlab # [ 107.755502] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.839Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1165gitlab # [ 107.758918] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.842Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1166gitlab # [ 107.762625] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.844Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1167gitlab # [ 107.766225] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.847Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1168gitlab # [ 107.769105] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.849Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1169gitlab # [ 107.770970] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.852Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1170gitlab # [ 107.772723] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.855Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1171gitlab # [ 107.774694] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.858Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1172gitlab # [ 107.776537] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.861Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1173gitlab # [ 107.778566] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.864Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1174gitlab # [ 107.780649] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.866Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1175gitlab # [ 107.782559] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.869Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1176gitlab # [ 107.784493] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.871Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1177gitlab # [ 107.786419] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.873Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1178gitlab # [ 107.788258] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.876Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1179gitlab # [ 107.789982] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.878Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1180gitlab # [ 107.791863] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.881Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1181gitlab # [ 107.793736] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.885Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1182gitlab # [ 107.795597] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.890Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1183gitlab # [ 107.797341] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.893Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1184gitlab # [ 107.799323] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.897Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1185gitlab # [ 107.801084] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.900Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1186gitlab # [ 107.803035] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.902Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1187gitlab # [ 107.804931] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.903Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1188gitlab # [ 107.806733] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.905Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1189gitlab # [ 107.808592] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.907Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1190gitlab # [ 107.810392] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.909Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1191gitlab # [ 107.812169] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.910Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1192gitlab # [ 107.813917] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.912Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1193gitlab # [ 107.815820] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.914Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1194gitlab # [ 107.817648] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.915Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1195gitlab # [ 107.819519] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.917Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1196gitlab # [ 107.821299] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.918Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1197gitlab # [ 107.823166] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.920Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1198gitlab # [ 107.825371] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.922Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1199gitlab # [ 107.825713] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.924Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1200gitlab # [ 107.826125] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.927Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1201gitlab # [ 107.826539] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.929Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1202gitlab # [ 107.826960] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.931Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1203gitlab # [ 107.827518] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.933Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1204gitlab # [ 107.827960] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.936Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1205gitlab # [ 107.836135] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.944Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1206gitlab # [ 107.838506] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.947Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1207gitlab # [ 107.840689] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.949Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1208gitlab # [ 107.842809] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.951Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1209gitlab # [ 107.844666] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.953Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1210gitlab # [ 107.846977] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.955Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1211gitlab # [ 107.850624] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.959Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1212gitlab # [ 107.854264] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.963Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1213gitlab # [ 107.858209] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.967Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1214gitlab # [ 107.861711] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.970Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1215gitlab # [ 107.865740] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.974Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1216gitlab # [ 107.869704] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.978Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1217gitlab # [ 107.873579] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.982Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1218gitlab # [ 107.877664] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.986Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1219gitlab # [ 107.881095] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.989Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1220gitlab # [ 107.884463] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.993Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1221gitlab # [ 107.887981] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:44.996Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1222gitlab # [ 107.891690] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.000Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1223gitlab # [ 107.895560] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.004Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1224gitlab # [ 107.899510] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.008Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1225gitlab # [ 107.903370] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.012Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1226gitlab # [ 107.906940] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.015Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1227gitlab # [ 107.910506] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.019Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1228gitlab # [ 107.914102] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.022Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1229gitlab # [ 107.917770] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.026Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1230gitlab # [ 107.920905] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.029Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1231gitlab # [ 107.924591] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.033Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1232gitlab # [ 107.927749] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.036Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1233gitlab # [ 107.931421] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.040Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1234gitlab # [ 107.934895] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.043Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1235gitlab # [ 107.938976] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.047Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1236gitlab # [ 107.943176] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.051Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1237gitlab # [ 107.945583] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.054Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1238gitlab # [ 107.952955] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.061Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1239gitlab # [ 107.958768] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.067Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1240gitlab # [ 107.962312] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.071Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1241gitlab # [ 107.966168] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.074Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1242gitlab # [ 107.969974] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.078Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1243gitlab # [ 107.973302] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.082Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1244gitlab # [ 107.976228] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.084Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1245gitlab # [ 107.978982] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.087Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1246gitlab # [ 107.981963] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.090Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1247gitlab # [ 107.986247] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.095Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1248gitlab # [ 107.989391] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.098Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1249gitlab # [ 107.991185] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.099Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1250gitlab # [ 107.993441] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.102Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1251gitlab # [ 108.002872] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.111Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1252gitlab # [ 108.004857] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.113Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1253gitlab # [ 108.006818] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.115Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1254gitlab # [ 108.009683] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.118Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1255gitlab # [ 108.011971] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.120Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1256gitlab # [ 108.014468] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.123Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1257gitlab # [ 108.016868] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.125Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1258gitlab # [ 108.018915] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.127Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1259gitlab # [ 108.020671] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.129Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1260gitlab # [ 108.023628] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.132Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1261gitlab # [ 108.025586] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:19:45.134Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1262gitlab # [ 108.446944] gitlab-workhorse[826]: time="2026-08-17T07:19:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 118.456951] gitlab-workhorse[826]: time="2026-08-17T07:19:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1264gitlab # [ 128.458469] gitlab-workhorse[826]: time="2026-08-17T07:20:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1265gitlab # [ 130.691054] postgres[2106]: [2106] ERROR: relation "table_without_models" does not exist1266gitlab # [ 130.691469] postgres[2106]: [2106] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 131.412079] postgres[2128]: [2128] ERROR: relation "table_without_models" does not exist1268gitlab # [ 131.412858] postgres[2128]: [2128] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1269gitlab # [ 133.379872] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:10.488Z","message":"Booted Rails 7.2.3.1 application in production environment"}1270gitlab # [ 133.382871] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:10.491Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1271gitlab # [ 133.383159] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:10.491Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1272gitlab # [ 133.383630] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:10.491Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1273gitlab # [ 133.389793] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:10.498Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1274gitlab # [ 134.317764] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.425Z","pid":1602,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1275gitlab # [ 134.318429] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.425Z","pid":1602,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1276gitlab # [ 134.319139] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.425Z","pid":1602,"message":"! #\u003cThread:0x00007e98e2d6ce38 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1277gitlab # [ 134.319873] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.425Z","pid":1602,"message":"! #\u003cThread:0x00007e98e2fec1b8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1278gitlab # [ 134.320680] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.425Z","pid":1602,"message":"Use Ctrl-C to stop"}1279gitlab # [ 134.321273] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.426Z","pid":1602,"message":"Sending status to systemd every 1.0 sec"}1280gitlab # [ 134.747306] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.855Z","pid":1602,"message":"- Worker 0 (PID: 2175) booted in 0.39s, phase: 0"}1281gitlab # [ 134.786359] bundle[1602]: {"timestamp":"2026-08-17T07:20:11.894Z","pid":1602,"message":"- Worker 1 (PID: 2179) booted in 0.41s, phase: 0"}1282gitlab # [ 134.792748] systemd[1]: Started gitlab.service.1283gitlab # [ 134.792938] systemd[1]: Reached target Common target for all GitLab services..1284gitlab # [ 134.796167] systemd[1]: Starting setup-gitlab.service...1285gitlab # [ 134.817376] setup-gitlab-start[2212]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1286gitlab # [ 135.365923] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:12.473Z","message":"Cleaning working queues"}1287gitlab # [ 135.371108] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:12.479Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0e0fa54f32732dd8af0d2d77","created_at":"2026-08-17T07:19:11.608Z","trace_propagation_headers":{"sentry-trace":"6ad9a2a4c2a540d9a54e4eabbdce977f-db76b8962bf44141","baggage":"sentry-trace_id=6ad9a2a4c2a540d9a54e4eabbdce977f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b2127aca1f9c4db663c2da9adb0000e1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:19:11.615Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0e0fa54f32732dd8af0d2d77: start","job_status":"start","queue_duration_s":60.863473,"scheduling_latency_s":60.863552}1288gitlab # [ 135.616580] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:12.724Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0e0fa54f32732dd8af0d2d77","created_at":"2026-08-17T07:19:11.608Z","trace_propagation_headers":{"sentry-trace":"6ad9a2a4c2a540d9a54e4eabbdce977f-db76b8962bf44141","baggage":"sentry-trace_id=6ad9a2a4c2a540d9a54e4eabbdce977f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b2127aca1f9c4db663c2da9adb0000e1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:19:11.615Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0e0fa54f32732dd8af0d2d77: done: 0.245773 sec","job_status":"done","queue_duration_s":60.863473,"scheduling_latency_s":60.863552,"redis_calls":26,"redis_duration_s":0.008562,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004705,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002297,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00156,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.119654314,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.245773,"completed_at":"2026-08-17T07:20:12.724Z","load_balancing_strategy":"primary","db_duration_s":0.066332,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1289gitlab # [ 137.493225] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:20:14 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 26511290gitlab # [ 137.500618] setup-gitlab-start[2212]: + TOKEN=nixbot-test-token-of-20-chars1291gitlab # [ 137.500768] setup-gitlab-start[2212]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1292gitlab # [ 137.525775] runuser[2237]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1293gitlab # [ 137.903908] setup-gitlab-start[2238]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1294gitlab # [ 137.904440] setup-gitlab-start[2238]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1295gitlab # [ 137.905493] setup-gitlab-start[2238]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1296gitlab # [ 138.492766] setup-gitlab-start[2238]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1297gitlab # [ 138.493355] setup-gitlab-start[2238]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1298gitlab # [ 138.494942] setup-gitlab-start[2238]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1299gitlab # [ 146.479141] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:23.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"98c344c85a3048a02369e458","created_at":"2026-08-17T07:20:23.550Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"383ea3d8cbc13864cb04de609b8b45d7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.583Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-98c344c85a3048a02369e458: start","job_status":"start","queue_duration_s":0.002752,"scheduling_latency_s":0.002792}1300gitlab # [ 146.606287] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:23.714Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"98c344c85a3048a02369e458","created_at":"2026-08-17T07:20:23.550Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"383ea3d8cbc13864cb04de609b8b45d7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.583Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-98c344c85a3048a02369e458: done: 0.127609 sec","job_status":"done","queue_duration_s":0.002752,"scheduling_latency_s":0.002792,"redis_calls":16,"redis_duration_s":0.014279,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.006015,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000795073,"duration_s":0.127609,"completed_at":"2026-08-17T07:20:23.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 146.666489] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:23.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7585c5cfd1415041e2fb19e3","created_at":"2026-08-17T07:20:23.622Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beb0dd07d0d564fd0c482336f619d2fd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.641Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7585c5cfd1415041e2fb19e3: start","job_status":"start","queue_duration_s":0.080748,"scheduling_latency_s":0.080796}1302gitlab # [ 146.696892] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:23.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7585c5cfd1415041e2fb19e3","created_at":"2026-08-17T07:20:23.622Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beb0dd07d0d564fd0c482336f619d2fd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.641Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7585c5cfd1415041e2fb19e3: done: 0.082869 sec","job_status":"done","queue_duration_s":0.080748,"scheduling_latency_s":0.080796,"redis_calls":13,"redis_duration_s":0.022484,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002854,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.015644,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003986,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.019681272,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.082869,"completed_at":"2026-08-17T07:20:23.805Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009574,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1303gitlab # [ 146.716302] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:23.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2e7cf45e8a06aa7a753c86d8","created_at":"2026-08-17T07:20:23.656Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4caf6a3969764ddd7de23cc7e04cd876","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.693Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2e7cf45e8a06aa7a753c86d8: start","job_status":"start","queue_duration_s":0.117948,"scheduling_latency_s":0.117979}1304gitlab # [ 146.878664] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:23.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2e7cf45e8a06aa7a753c86d8","created_at":"2026-08-17T07:20:23.656Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4caf6a3969764ddd7de23cc7e04cd876","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.693Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2e7cf45e8a06aa7a753c86d8: done: 0.174883 sec","job_status":"done","queue_duration_s":0.117948,"scheduling_latency_s":0.117979,"redis_calls":12,"redis_duration_s":0.013566,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001849,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003601,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001725079,"exclusive_lock_hold_duration_s":0.104388966,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.174883,"completed_at":"2026-08-17T07:20:23.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 146.935940] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f9b0ce501d72ffc533131df2","created_at":"2026-08-17T07:20:23.710Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f80ce0211021192d8b4216f177253a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:20:23.724Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f9b0ce501d72ffc533131df2: start","job_status":"start","queue_duration_s":0.319013,"scheduling_latency_s":0.319071}1306gitlab # [ 147.029193] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f9b0ce501d72ffc533131df2","created_at":"2026-08-17T07:20:23.710Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f80ce0211021192d8b4216f177253a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:20:23.724Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f9b0ce501d72ffc533131df2: done: 0.093916 sec","job_status":"done","queue_duration_s":0.319013,"scheduling_latency_s":0.319071,"redis_calls":10,"redis_duration_s":0.013651,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002121,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049727,"duration_s":0.093916,"completed_at":"2026-08-17T07:20:24.137Z","load_balancing_strategy":"primary","db_duration_s":0.024042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 147.031578] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"0fc5b0e74636243575f5ae2f","created_at":"2026-08-17T07:20:23.749Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54a924b2fe49e87226ae63c15f52ece8","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.777Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-0fc5b0e74636243575f5ae2f: start","job_status":"start","queue_duration_s":0.362204,"scheduling_latency_s":0.36223}1308gitlab # [ 147.079159] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"0fc5b0e74636243575f5ae2f","created_at":"2026-08-17T07:20:23.749Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54a924b2fe49e87226ae63c15f52ece8","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.777Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-0fc5b0e74636243575f5ae2f: done: 0.027809 sec","job_status":"done","queue_duration_s":0.362204,"scheduling_latency_s":0.36223,"redis_calls":13,"redis_duration_s":0.00435,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000314,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.003218,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400051,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.027809,"completed_at":"2026-08-17T07:20:24.167Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 147.082834] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.168Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"1c551cd86b330708c56641a3","created_at":"2026-08-17T07:20:23.790Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e80ee5bbc8ce9d718036a6e0d6900ef4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.807Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-1c551cd86b330708c56641a3: start","job_status":"start","queue_duration_s":0.361405,"scheduling_latency_s":0.36142}1310gitlab # [ 147.092328] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"1c551cd86b330708c56641a3","created_at":"2026-08-17T07:20:23.790Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e80ee5bbc8ce9d718036a6e0d6900ef4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.807Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-1c551cd86b330708c56641a3: done: 0.022664 sec","job_status":"done","queue_duration_s":0.361405,"scheduling_latency_s":0.36142,"redis_calls":10,"redis_duration_s":0.001562,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254501,"duration_s":0.022664,"completed_at":"2026-08-17T07:20:24.191Z","load_balancing_strategy":"primary","db_duration_s":0.002246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 147.144916] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6c98fa8cb3cecde0f96c38de","created_at":"2026-08-17T07:20:23.818Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be47f25bac860aa9f23c4f7e91dc4cfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:20:23.833Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6c98fa8cb3cecde0f96c38de: start","job_status":"start","queue_duration_s":0.361124,"scheduling_latency_s":0.361168}1312gitlab # [ 147.145717] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.229Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1313gitlab # [ 147.146472] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6c98fa8cb3cecde0f96c38de","created_at":"2026-08-17T07:20:23.818Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be47f25bac860aa9f23c4f7e91dc4cfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:20:23.833Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6c98fa8cb3cecde0f96c38de: done: 0.047663 sec","job_status":"done","queue_duration_s":0.361124,"scheduling_latency_s":0.361168,"redis_calls":10,"redis_duration_s":0.004786,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00185247,"duration_s":0.047663,"completed_at":"2026-08-17T07:20:24.242Z","load_balancing_strategy":"primary","db_duration_s":0.000832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 147.172145] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryCheck::DispatchWorker","jid":"8bfac08b6ca7c726c4da0655","created_at":"2026-08-17T07:20:23.844Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c49266b76f673cb5f5d310db9e3e9138","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:bce0277309dfde25386eb0f6b49415f8ec269d6e1b0147ad102f2a38c86bd6e2","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.854Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::DispatchWorker JID-8bfac08b6ca7c726c4da0655: start","job_status":"start","queue_duration_s":0.390482,"scheduling_latency_s":0.390499}1315gitlab # [ 147.210179] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryCheck::DispatchWorker","jid":"8bfac08b6ca7c726c4da0655","created_at":"2026-08-17T07:20:23.844Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c49266b76f673cb5f5d310db9e3e9138","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:bce0277309dfde25386eb0f6b49415f8ec269d6e1b0147ad102f2a38c86bd6e2","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.854Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::DispatchWorker JID-8bfac08b6ca7c726c4da0655: done: 0.034432 sec","job_status":"done","queue_duration_s":0.390482,"scheduling_latency_s":0.390499,"gitaly_calls":1,"gitaly_duration_s":0.009362,"redis_calls":26,"redis_duration_s":0.003459,"redis_read_bytes":45,"redis_write_bytes":3470,"redis_cache_calls":5,"redis_cache_duration_s":0.000636,"redis_cache_read_bytes":23,"redis_cache_write_bytes":95,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001105,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1190,"redis_queues_calls":2,"redis_queues_duration_s":0.000175,"redis_queues_read_bytes":3,"redis_queues_write_bytes":918,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":758,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":509,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018584484999999998,"duration_s":0.034432,"completed_at":"2026-08-17T07:20:24.279Z","load_balancing_strategy":"primary","db_duration_s":0.002177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 147.217431] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d407710cd6c11f319c053925","created_at":"2026-08-17T07:20:23.856Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74d3cea195a59689c26f468e2f111e71","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.861Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d407710cd6c11f319c053925: start","job_status":"start","queue_duration_s":0.418221,"scheduling_latency_s":0.418235}1317gitlab # [ 147.651139] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d407710cd6c11f319c053925","created_at":"2026-08-17T07:20:23.856Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74d3cea195a59689c26f468e2f111e71","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.861Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d407710cd6c11f319c053925: done: 0.478518 sec","job_status":"done","queue_duration_s":0.418221,"scheduling_latency_s":0.418235,"redis_calls":565,"redis_duration_s":0.26371100000000003,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.261045,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.244085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000537498,"duration_s":0.478518,"completed_at":"2026-08-17T07:20:24.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 147.685933] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"03e9f13f767138ac29ce2c68","created_at":"2026-08-17T07:20:23.889Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c78a82e484b8355e8cce683b897dd65","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.895Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-03e9f13f767138ac29ce2c68: start","job_status":"start","queue_duration_s":0.899036,"scheduling_latency_s":0.899071}1319gitlab # [ 147.741675] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"03e9f13f767138ac29ce2c68","created_at":"2026-08-17T07:20:23.889Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c78a82e484b8355e8cce683b897dd65","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.895Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-03e9f13f767138ac29ce2c68: done: 0.05532 sec","job_status":"done","queue_duration_s":0.899036,"scheduling_latency_s":0.899071,"redis_calls":12,"redis_duration_s":0.003663,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000923301,"exclusive_lock_hold_duration_s":0.00988757,"duration_s":0.05532,"completed_at":"2026-08-17T07:20:24.849Z","load_balancing_strategy":"primary","db_duration_s":0.004627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 147.777740] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"26dc510d11f80ceb8ea0790b","created_at":"2026-08-17T07:20:23.904Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dd98c9c8be160f4098aae46e790fcba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.908Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-26dc510d11f80ceb8ea0790b: start","job_status":"start","queue_duration_s":0.977225,"scheduling_latency_s":0.977267}1321gitlab # [ 147.814472] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"26dc510d11f80ceb8ea0790b","created_at":"2026-08-17T07:20:23.904Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dd98c9c8be160f4098aae46e790fcba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.908Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-26dc510d11f80ceb8ea0790b: done: 0.036777 sec","job_status":"done","queue_duration_s":0.977225,"scheduling_latency_s":0.977267,"redis_calls":12,"redis_duration_s":0.0042970000000000005,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001399,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000584432,"duration_s":0.036777,"completed_at":"2026-08-17T07:20:24.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 147.851204] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9ab9a9a7d5c9639a3def3c14","created_at":"2026-08-17T07:20:23.912Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f8aed13c3a5876ab6497303681c4e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.917Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9ab9a9a7d5c9639a3def3c14: start","job_status":"start","queue_duration_s":1.042104,"scheduling_latency_s":1.042142}1323gitlab # [ 147.885954] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:24.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9ab9a9a7d5c9639a3def3c14","created_at":"2026-08-17T07:20:23.912Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f8aed13c3a5876ab6497303681c4e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.917Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9ab9a9a7d5c9639a3def3c14: done: 0.034736 sec","job_status":"done","queue_duration_s":1.042104,"scheduling_latency_s":1.042142,"redis_calls":10,"redis_duration_s":0.003042,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000596,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000483861,"duration_s":0.034736,"completed_at":"2026-08-17T07:20:24.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 147.922463] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"75e7d151a713761f6c8f37fb","created_at":"2026-08-17T07:20:23.926Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.943Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-75e7d151a713761f6c8f37fb: start","job_status":"start","queue_duration_s":1.087105,"scheduling_latency_s":1.087147}1325gitlab # [ 148.016093] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.124Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"75e7d151a713761f6c8f37fb","created_at":"2026-08-17T07:20:23.926Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.943Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-75e7d151a713761f6c8f37fb: done: 0.094239 sec","job_status":"done","queue_duration_s":1.087105,"scheduling_latency_s":1.087147,"redis_calls":71,"redis_duration_s":0.017337,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00271,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001205,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012524,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376305,"duration_s":0.094239,"completed_at":"2026-08-17T07:20:25.124Z","load_balancing_strategy":"primary","db_duration_s":0.002462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 148.082359] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"6be222d71aff950f73662700","created_at":"2026-08-17T07:20:23.954Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.971Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-6be222d71aff950f73662700: start","job_status":"start","queue_duration_s":1.219378,"scheduling_latency_s":1.21941}1327gitlab # [ 148.114456] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"6be222d71aff950f73662700","created_at":"2026-08-17T07:20:23.954Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:23.971Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-6be222d71aff950f73662700: done: 0.032526 sec","job_status":"done","queue_duration_s":1.219378,"scheduling_latency_s":1.21941,"redis_calls":19,"redis_duration_s":0.004343,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001004,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00045,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002191,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300597,"duration_s":0.032526,"completed_at":"2026-08-17T07:20:25.222Z","load_balancing_strategy":"primary","db_duration_s":0.002676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 148.150159] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.258Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"439847390ac471d8531d1e00","created_at":"2026-08-17T07:20:23.984Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9827b4f32ba4136f9e98c544b0d4ac2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.051Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-439847390ac471d8531d1e00: start","job_status":"start","queue_duration_s":1.207441,"scheduling_latency_s":1.207463}1329gitlab # [ 148.340931] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"439847390ac471d8531d1e00","created_at":"2026-08-17T07:20:23.984Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9827b4f32ba4136f9e98c544b0d4ac2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.051Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-439847390ac471d8531d1e00: done: 0.190707 sec","job_status":"done","queue_duration_s":1.207441,"scheduling_latency_s":1.207463,"redis_calls":14,"redis_duration_s":0.0035510000000000003,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000915,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.135363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000445308,"exclusive_lock_hold_duration_s":0.168909736,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.190707,"completed_at":"2026-08-17T07:20:25.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 148.378053] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"d96f5730e37550daee354ee7","created_at":"2026-08-17T07:20:24.074Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcfa85e3d0792cc876425cfb1add1219","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.100Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-d96f5730e37550daee354ee7: start","job_status":"start","queue_duration_s":1.386013,"scheduling_latency_s":1.386038}1331gitlab # [ 148.427153] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"d96f5730e37550daee354ee7","created_at":"2026-08-17T07:20:24.074Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcfa85e3d0792cc876425cfb1add1219","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.100Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-d96f5730e37550daee354ee7: done: 0.0488 sec","job_status":"done","queue_duration_s":1.386013,"scheduling_latency_s":1.386038,"redis_calls":10,"redis_duration_s":0.003163,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000720762,"duration_s":0.0488,"completed_at":"2026-08-17T07:20:25.535Z","load_balancing_strategy":"primary","db_duration_s":0.003514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 148.463874] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1169a914bed20e3b716ea630","created_at":"2026-08-17T07:20:24.109Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09da4232db721e443f2279eae167d2f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.134Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1169a914bed20e3b716ea630: start","job_status":"start","queue_duration_s":1.437104,"scheduling_latency_s":1.437157}1333gitlab # [ 148.492744] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.601Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1334gitlab # [ 148.504527] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1169a914bed20e3b716ea630","created_at":"2026-08-17T07:20:24.109Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09da4232db721e443f2279eae167d2f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.134Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1169a914bed20e3b716ea630: done: 0.041005 sec","job_status":"done","queue_duration_s":1.437104,"scheduling_latency_s":1.437157,"redis_calls":10,"redis_duration_s":0.0028120000000000003,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000555,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0006,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000605943,"duration_s":0.041005,"completed_at":"2026-08-17T07:20:25.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 148.539374] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"repository_check","args":["default"],"class":"RepositoryCheck::BatchWorker","jid":"df8e4bf3ad8eca06c9367ad4","created_at":"2026-08-17T07:20:24.270Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ba6ed25917764ed9","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"RepositoryCheck::DispatchWorker","correlation_id":"c49266b76f673cb5f5d310db9e3e9138","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b22e99a0acd71e0cf2962b3ba955d6f34621628300baf74d4c861b087bc17605","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.274Z","job_size_bytes":11,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::BatchWorker JID-df8e4bf3ad8eca06c9367ad4: start","job_status":"start","queue_duration_s":1.340939,"scheduling_latency_s":1.34097}1336gitlab # [ 148.561937] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"repository_check","args":["default"],"class":"RepositoryCheck::BatchWorker","jid":"df8e4bf3ad8eca06c9367ad4","created_at":"2026-08-17T07:20:24.270Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ba6ed25917764ed9","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"RepositoryCheck::DispatchWorker","correlation_id":"c49266b76f673cb5f5d310db9e3e9138","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b22e99a0acd71e0cf2962b3ba955d6f34621628300baf74d4c861b087bc17605","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.274Z","job_size_bytes":11,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::BatchWorker JID-df8e4bf3ad8eca06c9367ad4: done: 0.054961 sec","job_status":"done","queue_duration_s":1.340939,"scheduling_latency_s":1.34097,"redis_calls":13,"redis_duration_s":0.004152,"redis_read_bytes":12,"redis_write_bytes":1387,"redis_cache_calls":1,"redis_cache_duration_s":0.000447,"redis_cache_read_bytes":1,"redis_cache_write_bytes":37,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":513,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.023866721,"duration_s":0.054961,"completed_at":"2026-08-17T07:20:25.669Z","load_balancing_strategy":"primary","db_duration_s":0.01223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 148.597888] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2a2355f9d5163610a1a20ebd","created_at":"2026-08-17T07:20:24.235Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5da3315a4019f2a289ac6c3a2a5049c7","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.291Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2a2355f9d5163610a1a20ebd: start","job_status":"start","queue_duration_s":1.414808,"scheduling_latency_s":1.414846}1338gitlab # [ 148.647421] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2a2355f9d5163610a1a20ebd","created_at":"2026-08-17T07:20:24.235Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5da3315a4019f2a289ac6c3a2a5049c7","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.291Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2a2355f9d5163610a1a20ebd: done: 0.048617 sec","job_status":"done","queue_duration_s":1.414808,"scheduling_latency_s":1.414846,"redis_calls":12,"redis_duration_s":0.002623,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000753169,"exclusive_lock_hold_duration_s":0.004525994,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.048617,"completed_at":"2026-08-17T07:20:25.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 148.684781] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cf59539b4f4f4ee0e2413dc2","created_at":"2026-08-17T07:20:24.297Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9c00024b577d022b092307c8f024991","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.303Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cf59539b4f4f4ee0e2413dc2: start","job_status":"start","queue_duration_s":1.488491,"scheduling_latency_s":1.488534}1340gitlab # [ 148.705534] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.813Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1341gitlab # [ 148.721514] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.828Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cf59539b4f4f4ee0e2413dc2","created_at":"2026-08-17T07:20:24.297Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9c00024b577d022b092307c8f024991","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.303Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cf59539b4f4f4ee0e2413dc2: done: 0.03673 sec","job_status":"done","queue_duration_s":1.488491,"scheduling_latency_s":1.488534,"redis_calls":10,"redis_duration_s":0.004144,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001027225,"duration_s":0.03673,"completed_at":"2026-08-17T07:20:25.828Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 148.757492] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"88ef344ec6fb18a125e9ca64","created_at":"2026-08-17T07:20:24.308Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a764cc885a28db0d6a2a72eca7f2aabe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.313Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-88ef344ec6fb18a125e9ca64: start","job_status":"start","queue_duration_s":1.552116,"scheduling_latency_s":1.552159}1343gitlab # [ 148.841476] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:25.949Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"88ef344ec6fb18a125e9ca64","created_at":"2026-08-17T07:20:24.308Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a764cc885a28db0d6a2a72eca7f2aabe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.313Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-88ef344ec6fb18a125e9ca64: done: 0.083736 sec","job_status":"done","queue_duration_s":1.552116,"scheduling_latency_s":1.552159,"redis_calls":14,"redis_duration_s":0.005491,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001374,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0013024,"exclusive_lock_hold_duration_s":0.033950125,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.083736,"completed_at":"2026-08-17T07:20:25.949Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 148.910840] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"594370a6386638f352ce579b","created_at":"2026-08-17T07:20:24.318Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89b3153db49bcb7a01f7b5c912ddbd02","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.335Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-594370a6386638f352ce579b: start","job_status":"start","queue_duration_s":1.683177,"scheduling_latency_s":1.683228}1345gitlab # [ 148.950383] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"594370a6386638f352ce579b","created_at":"2026-08-17T07:20:24.318Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89b3153db49bcb7a01f7b5c912ddbd02","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.335Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-594370a6386638f352ce579b: done: 0.03983 sec","job_status":"done","queue_duration_s":1.683177,"scheduling_latency_s":1.683228,"redis_calls":10,"redis_duration_s":0.003269,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000526882,"duration_s":0.03983,"completed_at":"2026-08-17T07:20:26.058Z","load_balancing_strategy":"primary","db_duration_s":0.000803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 148.990616] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::CleanupPackageRegistryWorker","jid":"015c67d850a883d44b970c7d","created_at":"2026-08-17T07:20:24.341Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f963ba4ab6145189dcd4e609723ceb8f","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31163b2078644913f89feb2245c5fa62ac9118d29e04cf14ce0b5def57bba8ea","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.352Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::CleanupPackageRegistryWorker JID-015c67d850a883d44b970c7d: start","job_status":"start","queue_duration_s":1.746377,"scheduling_latency_s":1.746417}1347gitlab # [ 149.077883] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::CleanupPackageRegistryWorker","jid":"015c67d850a883d44b970c7d","created_at":"2026-08-17T07:20:24.341Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f963ba4ab6145189dcd4e609723ceb8f","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31163b2078644913f89feb2245c5fa62ac9118d29e04cf14ce0b5def57bba8ea","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.352Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::CleanupPackageRegistryWorker JID-015c67d850a883d44b970c7d: done: 0.0873 sec","job_status":"done","queue_duration_s":1.746377,"scheduling_latency_s":1.746417,"redis_calls":10,"redis_duration_s":0.00402,"redis_read_bytes":9,"redis_write_bytes":1125,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001187,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000541968,"extra.packages_cleanup_package_registry_worker.pending_destruction_package_files_count":0,"extra.packages_cleanup_package_registry_worker.processing_package_files_count":0,"extra.packages_cleanup_package_registry_worker.error_package_files_count":0,"extra.packages_cleanup_package_registry_worker.pending_cleanup_policies_count":0,"duration_s":0.0873,"completed_at":"2026-08-17T07:20:26.185Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 149.149067] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.257Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"edbf47fb330eb8fe55f515df","created_at":"2026-08-17T07:20:24.354Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a19ac8959145451c059725005034c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.361Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-edbf47fb330eb8fe55f515df: start","job_status":"start","queue_duration_s":1.89551,"scheduling_latency_s":1.895545}1349gitlab # [ 149.181056] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"edbf47fb330eb8fe55f515df","created_at":"2026-08-17T07:20:24.354Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a19ac8959145451c059725005034c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.361Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-edbf47fb330eb8fe55f515df: done: 0.032102 sec","job_status":"done","queue_duration_s":1.89551,"scheduling_latency_s":1.895545,"redis_calls":20,"redis_duration_s":0.004093,"redis_read_bytes":23,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001323,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000571,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001701,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000287746,"duration_s":0.032102,"completed_at":"2026-08-17T07:20:26.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 149.217529] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"427c6c81a3f06e58a7fcfeb1","created_at":"2026-08-17T07:20:24.365Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"002e28093f93252c18cc8a4d638284bb","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.371Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-427c6c81a3f06e58a7fcfeb1: start","job_status":"start","queue_duration_s":1.954108,"scheduling_latency_s":1.954131}1351gitlab # [ 149.278152] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"427c6c81a3f06e58a7fcfeb1","created_at":"2026-08-17T07:20:24.365Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"002e28093f93252c18cc8a4d638284bb","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.371Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-427c6c81a3f06e58a7fcfeb1: done: 0.059875 sec","job_status":"done","queue_duration_s":1.954108,"scheduling_latency_s":1.954131,"redis_calls":10,"redis_duration_s":0.003086,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000537498,"duration_s":0.059875,"completed_at":"2026-08-17T07:20:26.385Z","load_balancing_strategy":"primary","db_duration_s":0.008682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 149.323815] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"0bc206e144df111c73ad799a","created_at":"2026-08-17T07:20:24.386Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa4c0fe3d336e01a34f460e4bfa0d149","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.391Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-0bc206e144df111c73ad799a: start","job_status":"start","queue_duration_s":2.040312,"scheduling_latency_s":2.040354}1353gitlab # [ 149.359693] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"0bc206e144df111c73ad799a","created_at":"2026-08-17T07:20:24.386Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa4c0fe3d336e01a34f460e4bfa0d149","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.391Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-0bc206e144df111c73ad799a: done: 0.035706 sec","job_status":"done","queue_duration_s":2.040312,"scheduling_latency_s":2.040354,"redis_calls":11,"redis_duration_s":0.003856,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000317,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001004318,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.035706,"completed_at":"2026-08-17T07:20:26.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 149.397295] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"256384287e78c6432277c8ea","created_at":"2026-08-17T07:20:24.400Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c5fa6d04ff9157a250aea61a92c7f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.406Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-256384287e78c6432277c8ea: start","job_status":"start","queue_duration_s":2.098828,"scheduling_latency_s":2.098868}1355gitlab # [ 149.431438] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"256384287e78c6432277c8ea","created_at":"2026-08-17T07:20:24.400Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c5fa6d04ff9157a250aea61a92c7f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.406Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-256384287e78c6432277c8ea: done: 0.034114 sec","job_status":"done","queue_duration_s":2.098828,"scheduling_latency_s":2.098868,"redis_calls":10,"redis_duration_s":0.00321,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000681,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000484698,"duration_s":0.034114,"completed_at":"2026-08-17T07:20:26.539Z","load_balancing_strategy":"primary","db_duration_s":0.000635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 149.469164] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a647a50aed1c50bb9760aa13","created_at":"2026-08-17T07:20:24.414Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9db4d49de128ab15e83c30abb768632","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.420Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a647a50aed1c50bb9760aa13: start","job_status":"start","queue_duration_s":2.154385,"scheduling_latency_s":2.154451}1357gitlab # [ 149.500674] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a647a50aed1c50bb9760aa13","created_at":"2026-08-17T07:20:24.414Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9db4d49de128ab15e83c30abb768632","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.420Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a647a50aed1c50bb9760aa13: done: 0.033902 sec","job_status":"done","queue_duration_s":2.154385,"scheduling_latency_s":2.154451,"redis_calls":10,"redis_duration_s":0.003131,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000434692,"duration_s":0.033902,"completed_at":"2026-08-17T07:20:26.608Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 149.536426] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.644Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"81393eb1750cd50e99fbee9b","created_at":"2026-08-17T07:20:24.427Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"9b22d06d336ad606f1936f88f8f29704","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.433Z","job_size_bytes":3,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-81393eb1750cd50e99fbee9b: start","job_status":"start","queue_duration_s":2.211504,"scheduling_latency_s":2.211539}1359gitlab # [ 149.563511] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"81393eb1750cd50e99fbee9b","created_at":"2026-08-17T07:20:24.427Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"9b22d06d336ad606f1936f88f8f29704","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.433Z","job_size_bytes":3,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-81393eb1750cd50e99fbee9b: done: 0.026862 sec","job_status":"done","queue_duration_s":2.211504,"scheduling_latency_s":2.211539,"redis_calls":10,"redis_duration_s":0.002804,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000557,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000451454,"duration_s":0.026862,"completed_at":"2026-08-17T07:20:26.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 149.598166] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"4af39eb8e282d4f00e8f8e2f","created_at":"2026-08-17T07:20:24.440Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ff5404b80b82e5b76df075a1d53bc5f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.445Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-4af39eb8e282d4f00e8f8e2f: start","job_status":"start","queue_duration_s":2.261047,"scheduling_latency_s":2.26107}1361gitlab # [ 149.625476] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"4af39eb8e282d4f00e8f8e2f","created_at":"2026-08-17T07:20:24.440Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ff5404b80b82e5b76df075a1d53bc5f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.445Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-4af39eb8e282d4f00e8f8e2f: done: 0.027501 sec","job_status":"done","queue_duration_s":2.261047,"scheduling_latency_s":2.26107,"redis_calls":12,"redis_duration_s":0.003186,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001525,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000688914,"exclusive_lock_hold_duration_s":0.006313372,"duration_s":0.027501,"completed_at":"2026-08-17T07:20:26.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 149.660917] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"c703c7f203e46eaff7b4fb9c","created_at":"2026-08-17T07:20:24.452Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17ce937b3f4bda9c44d16ecdf1775b10","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.457Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-c703c7f203e46eaff7b4fb9c: start","job_status":"start","queue_duration_s":2.311946,"scheduling_latency_s":2.311981}1363gitlab # [ 149.717812] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"c703c7f203e46eaff7b4fb9c","created_at":"2026-08-17T07:20:24.452Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17ce937b3f4bda9c44d16ecdf1775b10","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.457Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-c703c7f203e46eaff7b4fb9c: done: 0.055681 sec","job_status":"done","queue_duration_s":2.311946,"scheduling_latency_s":2.311981,"redis_calls":10,"redis_duration_s":0.0032830000000000003,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000487213,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.002720457},"duration_s":0.055681,"completed_at":"2026-08-17T07:20:26.824Z","load_balancing_strategy":"primary","db_duration_s":0.013877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 149.762153] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"453efb5f0eda592c48cbad9b","created_at":"2026-08-17T07:20:24.462Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720ba6b75e79fde9fddfec0c6eaf2740","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:20:24.468Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-453efb5f0eda592c48cbad9b: start","job_status":"start","queue_duration_s":2.402182,"scheduling_latency_s":2.402232}1365gitlab # [ 149.794112] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.902Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1366gitlab # [ 149.808516] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"453efb5f0eda592c48cbad9b","created_at":"2026-08-17T07:20:24.462Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720ba6b75e79fde9fddfec0c6eaf2740","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:20:24.468Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-453efb5f0eda592c48cbad9b: done: 0.046328 sec","job_status":"done","queue_duration_s":2.402182,"scheduling_latency_s":2.402232,"redis_calls":10,"redis_duration_s":0.004784,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001050972,"duration_s":0.046328,"completed_at":"2026-08-17T07:20:26.916Z","load_balancing_strategy":"primary","db_duration_s":0.000984,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 149.843756] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1b205bd2971071f254a49184","created_at":"2026-08-17T07:20:24.479Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c205dd982caf598e4fd5e598477cfbca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.486Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1b205bd2971071f254a49184: start","job_status":"start","queue_duration_s":2.464871,"scheduling_latency_s":2.464911}1368gitlab # [ 149.871450] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.979Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1369gitlab # [ 149.885505] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:26.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1b205bd2971071f254a49184","created_at":"2026-08-17T07:20:24.479Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c205dd982caf598e4fd5e598477cfbca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.486Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1b205bd2971071f254a49184: done: 0.041768 sec","job_status":"done","queue_duration_s":2.464871,"scheduling_latency_s":2.464911,"redis_calls":10,"redis_duration_s":0.004122,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000468496,"duration_s":0.041768,"completed_at":"2026-08-17T07:20:26.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 149.922075] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2bf2c28b4ee1b4452377a113","created_at":"2026-08-17T07:20:24.505Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15bdb526023fc196fd924948f5c6dfec","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.510Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2bf2c28b4ee1b4452377a113: start","job_status":"start","queue_duration_s":2.519346,"scheduling_latency_s":2.519398}1371gitlab # [ 149.976329] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2bf2c28b4ee1b4452377a113","created_at":"2026-08-17T07:20:24.505Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15bdb526023fc196fd924948f5c6dfec","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.510Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2bf2c28b4ee1b4452377a113: done: 0.053911 sec","job_status":"done","queue_duration_s":2.519346,"scheduling_latency_s":2.519398,"redis_calls":10,"redis_duration_s":0.003571,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000774,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000564038,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.053911,"completed_at":"2026-08-17T07:20:27.083Z","load_balancing_strategy":"primary","db_duration_s":0.014412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 150.023534] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2a37bb7ff1a38569fab11af0","created_at":"2026-08-17T07:20:24.518Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a309a6807f028b8ca783393563f8d45","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.523Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2a37bb7ff1a38569fab11af0: start","job_status":"start","queue_duration_s":2.608045,"scheduling_latency_s":2.608096}1373gitlab # [ 150.057248] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2a37bb7ff1a38569fab11af0","created_at":"2026-08-17T07:20:24.518Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a309a6807f028b8ca783393563f8d45","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.523Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2a37bb7ff1a38569fab11af0: done: 0.033864 sec","job_status":"done","queue_duration_s":2.608045,"scheduling_latency_s":2.608096,"redis_calls":12,"redis_duration_s":0.003645,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000607,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000646,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000514591,"duration_s":0.033864,"completed_at":"2026-08-17T07:20:27.165Z","load_balancing_strategy":"primary","db_duration_s":0.000692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 150.093170] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fbeb35c952accf10e462eeba","created_at":"2026-08-17T07:20:24.529Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"701b31ade44388926ceb4e0b2be6fb30","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.540Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fbeb35c952accf10e462eeba: start","job_status":"start","queue_duration_s":2.660858,"scheduling_latency_s":2.660898}1375gitlab # [ 150.121497] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.230Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1376gitlab # [ 150.135395] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fbeb35c952accf10e462eeba","created_at":"2026-08-17T07:20:24.529Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"701b31ade44388926ceb4e0b2be6fb30","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.540Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fbeb35c952accf10e462eeba: done: 0.04265 sec","job_status":"done","queue_duration_s":2.660858,"scheduling_latency_s":2.660898,"redis_calls":10,"redis_duration_s":0.003763,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000459556,"duration_s":0.04265,"completed_at":"2026-08-17T07:20:27.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 150.171326] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8a83958e01b884bc86c8ae34","created_at":"2026-08-17T07:20:24.548Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99956a33ff548ff9d313e0ff788cfe7e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.557Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8a83958e01b884bc86c8ae34: start","job_status":"start","queue_duration_s":2.722484,"scheduling_latency_s":2.722525}1378gitlab # [ 150.219748] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8a83958e01b884bc86c8ae34","created_at":"2026-08-17T07:20:24.548Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99956a33ff548ff9d313e0ff788cfe7e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:24.557Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8a83958e01b884bc86c8ae34: done: 0.048104 sec","job_status":"done","queue_duration_s":2.722484,"scheduling_latency_s":2.722525,"redis_calls":10,"redis_duration_s":0.002463,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000418768,"duration_s":0.048104,"completed_at":"2026-08-17T07:20:27.327Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 150.257268] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e48cede8e7abd9c09888b16e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e48cede8e7abd9c09888b16e: start","job_status":"start","queue_duration_s":2.249676,"scheduling_latency_s":2.249714}1380gitlab # [ 150.309420] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e48cede8e7abd9c09888b16e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e48cede8e7abd9c09888b16e: done: 0.051698 sec","job_status":"done","queue_duration_s":2.249676,"scheduling_latency_s":2.249714,"redis_calls":16,"redis_duration_s":0.003569,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040927,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.051698,"completed_at":"2026-08-17T07:20:27.416Z","load_balancing_strategy":"primary","db_duration_s":0.000587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 150.348478] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5aaf2ebd79132611db482b71","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5aaf2ebd79132611db482b71: start","job_status":"start","queue_duration_s":2.340797,"scheduling_latency_s":2.340834}1382gitlab # [ 150.387201] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5aaf2ebd79132611db482b71","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5aaf2ebd79132611db482b71: done: 0.038455 sec","job_status":"done","queue_duration_s":2.340797,"scheduling_latency_s":2.340834,"redis_calls":13,"redis_duration_s":0.003823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038455,"completed_at":"2026-08-17T07:20:27.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 150.420931] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdfa1ff4c8abe1e8af7b15a0","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdfa1ff4c8abe1e8af7b15a0: start","job_status":"start","queue_duration_s":2.413541,"scheduling_latency_s":2.413576}1384gitlab # [ 150.442131] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdfa1ff4c8abe1e8af7b15a0","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdfa1ff4c8abe1e8af7b15a0: done: 0.021151 sec","job_status":"done","queue_duration_s":2.413541,"scheduling_latency_s":2.413576,"redis_calls":13,"redis_duration_s":0.0033420000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021151,"completed_at":"2026-08-17T07:20:27.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 150.445126] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e12174fbfb68a59839f0a4aa","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e12174fbfb68a59839f0a4aa: start","job_status":"start","queue_duration_s":2.437833,"scheduling_latency_s":2.43786}1386gitlab # [ 150.466050] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e12174fbfb68a59839f0a4aa","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e12174fbfb68a59839f0a4aa: done: 0.020914 sec","job_status":"done","queue_duration_s":2.437833,"scheduling_latency_s":2.43786,"redis_calls":13,"redis_duration_s":0.0037740000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002566,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020914,"completed_at":"2026-08-17T07:20:27.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 150.507241] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd2599203618a6929d6703be","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd2599203618a6929d6703be: start","job_status":"start","queue_duration_s":2.464656,"scheduling_latency_s":2.464673}1388gitlab # [ 150.508238] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd2599203618a6929d6703be","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd2599203618a6929d6703be: done: 0.014281 sec","job_status":"done","queue_duration_s":2.464656,"scheduling_latency_s":2.464673,"redis_calls":13,"redis_duration_s":0.002721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014281,"completed_at":"2026-08-17T07:20:27.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 150.556341] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38395666f33320d36929166b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38395666f33320d36929166b: start","job_status":"start","queue_duration_s":2.479889,"scheduling_latency_s":2.479901}1390gitlab # [ 150.556595] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38395666f33320d36929166b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38395666f33320d36929166b: done: 0.011143 sec","job_status":"done","queue_duration_s":2.479889,"scheduling_latency_s":2.479901,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011143,"completed_at":"2026-08-17T07:20:27.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 150.594993] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f8df3ebd8b2df8ce74d2bdf","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f8df3ebd8b2df8ce74d2bdf: start","job_status":"start","queue_duration_s":2.492138,"scheduling_latency_s":2.492152}1392gitlab # [ 150.595668] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f8df3ebd8b2df8ce74d2bdf","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f8df3ebd8b2df8ce74d2bdf: done: 0.012812 sec","job_status":"done","queue_duration_s":2.492138,"scheduling_latency_s":2.492152,"redis_calls":13,"redis_duration_s":0.004202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012812,"completed_at":"2026-08-17T07:20:27.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 150.602260] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4409b9b50d585fc63500d485","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4409b9b50d585fc63500d485: start","job_status":"start","queue_duration_s":2.506059,"scheduling_latency_s":2.506073}1394gitlab # [ 150.642145] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4409b9b50d585fc63500d485","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4409b9b50d585fc63500d485: done: 0.011563 sec","job_status":"done","queue_duration_s":2.506059,"scheduling_latency_s":2.506073,"redis_calls":13,"redis_duration_s":0.002992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011563,"completed_at":"2026-08-17T07:20:27.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 150.643040] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27503382b06b0a9a5b9ce6a3","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27503382b06b0a9a5b9ce6a3: start","job_status":"start","queue_duration_s":2.518936,"scheduling_latency_s":2.518949}1396gitlab # [ 150.652980] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27503382b06b0a9a5b9ce6a3","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27503382b06b0a9a5b9ce6a3: done: 0.023086 sec","job_status":"done","queue_duration_s":2.518936,"scheduling_latency_s":2.518949,"redis_calls":13,"redis_duration_s":0.002904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023086,"completed_at":"2026-08-17T07:20:27.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 150.689294] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb6bf634fb464820ea76d469","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb6bf634fb464820ea76d469: start","job_status":"start","queue_duration_s":2.543941,"scheduling_latency_s":2.543972}1398gitlab # [ 150.746339] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb6bf634fb464820ea76d469","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb6bf634fb464820ea76d469: done: 0.193945 sec","job_status":"done","queue_duration_s":2.543941,"scheduling_latency_s":2.543972,"redis_calls":13,"redis_duration_s":0.175108,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.173217,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.193945,"completed_at":"2026-08-17T07:20:27.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 150.747654] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83c9f690d3c72d0ff9530888","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83c9f690d3c72d0ff9530888: start","job_status":"start","queue_duration_s":2.739687,"scheduling_latency_s":2.739718}1400gitlab # [ 150.767140] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83c9f690d3c72d0ff9530888","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83c9f690d3c72d0ff9530888: done: 0.019741 sec","job_status":"done","queue_duration_s":2.739687,"scheduling_latency_s":2.739718,"redis_calls":13,"redis_duration_s":0.003423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002312,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019741,"completed_at":"2026-08-17T07:20:27.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 150.812154] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d7a4e1edf139bb4f7e0f53b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d7a4e1edf139bb4f7e0f53b: start","job_status":"start","queue_duration_s":2.76186,"scheduling_latency_s":2.761887}1402gitlab # [ 150.812879] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d7a4e1edf139bb4f7e0f53b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d7a4e1edf139bb4f7e0f53b: done: 0.01357 sec","job_status":"done","queue_duration_s":2.76186,"scheduling_latency_s":2.761887,"redis_calls":13,"redis_duration_s":0.002493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01357,"completed_at":"2026-08-17T07:20:27.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 150.855975] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96ab68ca4eafda804f2e2606","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96ab68ca4eafda804f2e2606: start","job_status":"start","queue_duration_s":2.776665,"scheduling_latency_s":2.77668}1404gitlab # [ 150.856896] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96ab68ca4eafda804f2e2606","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96ab68ca4eafda804f2e2606: done: 0.010955 sec","job_status":"done","queue_duration_s":2.776665,"scheduling_latency_s":2.77668,"redis_calls":13,"redis_duration_s":0.002493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001696,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010955,"completed_at":"2026-08-17T07:20:27.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 150.903724] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31e064c527241e87cd2a5c64","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31e064c527241e87cd2a5c64: start","job_status":"start","queue_duration_s":2.78887,"scheduling_latency_s":2.788884}1406gitlab # [ 150.904721] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31e064c527241e87cd2a5c64","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31e064c527241e87cd2a5c64: done: 0.010962 sec","job_status":"done","queue_duration_s":2.78887,"scheduling_latency_s":2.788884,"redis_calls":13,"redis_duration_s":0.002525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010962,"completed_at":"2026-08-17T07:20:27.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 150.912064] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ffd88db9c3e012e311762f","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ffd88db9c3e012e311762f: start","job_status":"start","queue_duration_s":2.801049,"scheduling_latency_s":2.801062}1408gitlab # [ 150.923079] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ffd88db9c3e012e311762f","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ffd88db9c3e012e311762f: done: 0.010413 sec","job_status":"done","queue_duration_s":2.801049,"scheduling_latency_s":2.801062,"redis_calls":13,"redis_duration_s":0.0018859999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001277,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010413,"completed_at":"2026-08-17T07:20:27.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 150.982757] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f2cf5e1cb1d50c03e7eaffb","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f2cf5e1cb1d50c03e7eaffb: start","job_status":"start","queue_duration_s":2.812378,"scheduling_latency_s":2.812391}1410gitlab # [ 150.983582] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f2cf5e1cb1d50c03e7eaffb","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f2cf5e1cb1d50c03e7eaffb: done: 0.01108 sec","job_status":"done","queue_duration_s":2.812378,"scheduling_latency_s":2.812391,"redis_calls":13,"redis_duration_s":0.00249,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001682,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01108,"completed_at":"2026-08-17T07:20:27.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 150.997082] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8443a8c0dc2601e5c06abceb","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8443a8c0dc2601e5c06abceb: start","job_status":"start","queue_duration_s":2.824587,"scheduling_latency_s":2.824601}1412gitlab # [ 151.007470] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8443a8c0dc2601e5c06abceb","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8443a8c0dc2601e5c06abceb: done: 0.011157 sec","job_status":"done","queue_duration_s":2.824587,"scheduling_latency_s":2.824601,"redis_calls":13,"redis_duration_s":0.002579,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011157,"completed_at":"2026-08-17T07:20:27.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 151.060812] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94de7a0c8639d97cae1abae2","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94de7a0c8639d97cae1abae2: start","job_status":"start","queue_duration_s":2.836848,"scheduling_latency_s":2.836861}1414gitlab # [ 151.061585] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94de7a0c8639d97cae1abae2","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94de7a0c8639d97cae1abae2: done: 0.011279 sec","job_status":"done","queue_duration_s":2.836848,"scheduling_latency_s":2.836861,"redis_calls":13,"redis_duration_s":0.002473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011279,"completed_at":"2026-08-17T07:20:27.963Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 151.110117] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"550242c46e37d5623f56f806","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-550242c46e37d5623f56f806: start","job_status":"start","queue_duration_s":2.849079,"scheduling_latency_s":2.849093}1416gitlab # [ 151.110807] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"550242c46e37d5623f56f806","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-550242c46e37d5623f56f806: done: 0.010106 sec","job_status":"done","queue_duration_s":2.849079,"scheduling_latency_s":2.849093,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010106,"completed_at":"2026-08-17T07:20:27.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 151.153162] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"382278be27706da1bc125e11","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-382278be27706da1bc125e11: start","job_status":"start","queue_duration_s":2.860046,"scheduling_latency_s":2.860061}1418gitlab # [ 151.153874] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"382278be27706da1bc125e11","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-382278be27706da1bc125e11: done: 0.010977 sec","job_status":"done","queue_duration_s":2.860046,"scheduling_latency_s":2.860061,"redis_calls":13,"redis_duration_s":0.00251,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010977,"completed_at":"2026-08-17T07:20:27.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 151.164635] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81464447814a694071db0502","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81464447814a694071db0502: start","job_status":"start","queue_duration_s":2.872152,"scheduling_latency_s":2.872165}1420gitlab # [ 151.203957] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:27.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81464447814a694071db0502","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81464447814a694071db0502: done: 0.011058 sec","job_status":"done","queue_duration_s":2.872152,"scheduling_latency_s":2.872165,"redis_calls":13,"redis_duration_s":0.00273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011058,"completed_at":"2026-08-17T07:20:27.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 151.206114] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6512f22ee886bfbde7fa33e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6512f22ee886bfbde7fa33e: start","job_status":"start","queue_duration_s":2.884566,"scheduling_latency_s":2.884578}1422gitlab # [ 151.243963] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6512f22ee886bfbde7fa33e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6512f22ee886bfbde7fa33e: done: 0.016696 sec","job_status":"done","queue_duration_s":2.884566,"scheduling_latency_s":2.884578,"redis_calls":13,"redis_duration_s":0.002563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001699,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016696,"completed_at":"2026-08-17T07:20:28.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 151.247757] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c28e9010c4e1a81c4aacca2","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c28e9010c4e1a81c4aacca2: start","job_status":"start","queue_duration_s":2.902377,"scheduling_latency_s":2.902391}1424gitlab # [ 151.284283] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c28e9010c4e1a81c4aacca2","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c28e9010c4e1a81c4aacca2: done: 0.010557 sec","job_status":"done","queue_duration_s":2.902377,"scheduling_latency_s":2.902391,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010557,"completed_at":"2026-08-17T07:20:28.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 151.288723] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"717c7f8809097e12cb696089","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-717c7f8809097e12cb696089: start","job_status":"start","queue_duration_s":2.913996,"scheduling_latency_s":2.91401}1426gitlab # [ 151.323560] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"717c7f8809097e12cb696089","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-717c7f8809097e12cb696089: done: 0.010509 sec","job_status":"done","queue_duration_s":2.913996,"scheduling_latency_s":2.91401,"redis_calls":13,"redis_duration_s":0.0016190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010509,"completed_at":"2026-08-17T07:20:28.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 151.329688] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f87fe17836ccd295f9b52c","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f87fe17836ccd295f9b52c: start","job_status":"start","queue_duration_s":2.925545,"scheduling_latency_s":2.925559}1428gitlab # [ 151.372898] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f87fe17836ccd295f9b52c","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f87fe17836ccd295f9b52c: done: 0.010241 sec","job_status":"done","queue_duration_s":2.925545,"scheduling_latency_s":2.925559,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010241,"completed_at":"2026-08-17T07:20:28.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 151.373824] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"039423bd7fdee9ae704f0bc9","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-039423bd7fdee9ae704f0bc9: start","job_status":"start","queue_duration_s":2.93744,"scheduling_latency_s":2.937454}1430gitlab # [ 151.380172] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"039423bd7fdee9ae704f0bc9","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-039423bd7fdee9ae704f0bc9: done: 0.010281 sec","job_status":"done","queue_duration_s":2.93744,"scheduling_latency_s":2.937454,"redis_calls":13,"redis_duration_s":0.0018189999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010281,"completed_at":"2026-08-17T07:20:28.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 151.416049] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef94cbb1485c0c38cae02a3e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef94cbb1485c0c38cae02a3e: start","job_status":"start","queue_duration_s":2.948643,"scheduling_latency_s":2.948662}1432gitlab # [ 151.450777] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef94cbb1485c0c38cae02a3e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef94cbb1485c0c38cae02a3e: done: 0.010099 sec","job_status":"done","queue_duration_s":2.948643,"scheduling_latency_s":2.948662,"redis_calls":13,"redis_duration_s":0.0017239999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010099,"completed_at":"2026-08-17T07:20:28.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 151.484983] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4db0aa4a07de1652d1c7f702","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4db0aa4a07de1652d1c7f702: start","job_status":"start","queue_duration_s":2.959608,"scheduling_latency_s":2.959622}1434gitlab # [ 151.485618] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4db0aa4a07de1652d1c7f702","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4db0aa4a07de1652d1c7f702: done: 0.010145 sec","job_status":"done","queue_duration_s":2.959608,"scheduling_latency_s":2.959622,"redis_calls":13,"redis_duration_s":0.001719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010145,"completed_at":"2026-08-17T07:20:28.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 151.525595] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9209cdf5b279d459c0a8e6b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9209cdf5b279d459c0a8e6b: start","job_status":"start","queue_duration_s":2.970795,"scheduling_latency_s":2.970807}1436gitlab # [ 151.526434] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9209cdf5b279d459c0a8e6b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9209cdf5b279d459c0a8e6b: done: 0.010554 sec","job_status":"done","queue_duration_s":2.970795,"scheduling_latency_s":2.970807,"redis_calls":13,"redis_duration_s":0.002078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010554,"completed_at":"2026-08-17T07:20:28.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 151.533730] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e53a5b3ff6360c5678dc4d","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e53a5b3ff6360c5678dc4d: start","job_status":"start","queue_duration_s":2.982262,"scheduling_latency_s":2.982276}1438gitlab # [ 151.543947] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e53a5b3ff6360c5678dc4d","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e53a5b3ff6360c5678dc4d: done: 0.010497 sec","job_status":"done","queue_duration_s":2.982262,"scheduling_latency_s":2.982276,"redis_calls":13,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010497,"completed_at":"2026-08-17T07:20:28.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 151.579902] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5aeb92dd8a9dad8b5457d899","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5aeb92dd8a9dad8b5457d899: start","job_status":"start","queue_duration_s":2.993821,"scheduling_latency_s":2.993834}1440gitlab # [ 151.585201] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5aeb92dd8a9dad8b5457d899","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5aeb92dd8a9dad8b5457d899: done: 0.010525 sec","job_status":"done","queue_duration_s":2.993821,"scheduling_latency_s":2.993834,"redis_calls":13,"redis_duration_s":0.001656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010525,"completed_at":"2026-08-17T07:20:28.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 151.624675] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32e14f57e3f635c657a3243b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32e14f57e3f635c657a3243b: start","job_status":"start","queue_duration_s":3.005372,"scheduling_latency_s":3.005387}1442gitlab # [ 151.625823] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32e14f57e3f635c657a3243b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32e14f57e3f635c657a3243b: done: 0.010344 sec","job_status":"done","queue_duration_s":3.005372,"scheduling_latency_s":3.005387,"redis_calls":13,"redis_duration_s":0.0016940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010344,"completed_at":"2026-08-17T07:20:28.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 151.661284] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf7ea020b6de13f8eb3842e6","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf7ea020b6de13f8eb3842e6: start","job_status":"start","queue_duration_s":3.016963,"scheduling_latency_s":3.016977}1444gitlab # [ 151.699749] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf7ea020b6de13f8eb3842e6","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf7ea020b6de13f8eb3842e6: done: 0.010936 sec","job_status":"done","queue_duration_s":3.016963,"scheduling_latency_s":3.016977,"redis_calls":13,"redis_duration_s":0.001954,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010936,"completed_at":"2026-08-17T07:20:28.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 151.700617] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91796dd0233e73331c7c5321","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91796dd0233e73331c7c5321: start","job_status":"start","queue_duration_s":3.028943,"scheduling_latency_s":3.028956}1446gitlab # [ 151.737687] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91796dd0233e73331c7c5321","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91796dd0233e73331c7c5321: done: 0.010222 sec","job_status":"done","queue_duration_s":3.028943,"scheduling_latency_s":3.028956,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010222,"completed_at":"2026-08-17T07:20:28.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 151.738616] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a2aca3b48292d7b78c7237b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a2aca3b48292d7b78c7237b: start","job_status":"start","queue_duration_s":3.040432,"scheduling_latency_s":3.040445}1448gitlab # [ 151.748646] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a2aca3b48292d7b78c7237b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a2aca3b48292d7b78c7237b: done: 0.010297 sec","job_status":"done","queue_duration_s":3.040432,"scheduling_latency_s":3.040445,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010297,"completed_at":"2026-08-17T07:20:28.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 151.784673] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a3b82f9ce0a83d2b48492cc","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a3b82f9ce0a83d2b48492cc: start","job_status":"start","queue_duration_s":3.051799,"scheduling_latency_s":3.051812}1450gitlab # [ 151.790156] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a3b82f9ce0a83d2b48492cc","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a3b82f9ce0a83d2b48492cc: done: 0.010458 sec","job_status":"done","queue_duration_s":3.051799,"scheduling_latency_s":3.051812,"redis_calls":13,"redis_duration_s":0.001784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010458,"completed_at":"2026-08-17T07:20:28.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 151.848114] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccfa0d4ce40a2f332819a332","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccfa0d4ce40a2f332819a332: start","job_status":"start","queue_duration_s":3.063322,"scheduling_latency_s":3.06346}1452gitlab # [ 151.848808] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccfa0d4ce40a2f332819a332","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccfa0d4ce40a2f332819a332: done: 0.010482 sec","job_status":"done","queue_duration_s":3.063322,"scheduling_latency_s":3.06346,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010482,"completed_at":"2026-08-17T07:20:28.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 151.890811] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34148ae5014166cb9c143311","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34148ae5014166cb9c143311: start","job_status":"start","queue_duration_s":3.074657,"scheduling_latency_s":3.07467}1454gitlab # [ 151.891635] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34148ae5014166cb9c143311","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34148ae5014166cb9c143311: done: 0.01045 sec","job_status":"done","queue_duration_s":3.074657,"scheduling_latency_s":3.07467,"redis_calls":13,"redis_duration_s":0.0015329999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01045,"completed_at":"2026-08-17T07:20:28.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 151.902854] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fb4c3d2eac8229072983b4b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fb4c3d2eac8229072983b4b: start","job_status":"start","queue_duration_s":3.085959,"scheduling_latency_s":3.085972}1456gitlab # [ 151.940131] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fb4c3d2eac8229072983b4b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fb4c3d2eac8229072983b4b: done: 0.010502 sec","job_status":"done","queue_duration_s":3.085959,"scheduling_latency_s":3.085972,"redis_calls":13,"redis_duration_s":0.001528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010502,"completed_at":"2026-08-17T07:20:28.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 151.943477] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b90e292c3db00014b4bd59","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b90e292c3db00014b4bd59: start","job_status":"start","queue_duration_s":3.097349,"scheduling_latency_s":3.097364}1458gitlab # [ 151.953524] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b90e292c3db00014b4bd59","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b90e292c3db00014b4bd59: done: 0.010605 sec","job_status":"done","queue_duration_s":3.097349,"scheduling_latency_s":3.097364,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010605,"completed_at":"2026-08-17T07:20:28.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 152.002936] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b77b59fb89336bf789199d7c","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b77b59fb89336bf789199d7c: start","job_status":"start","queue_duration_s":3.108842,"scheduling_latency_s":3.108856}1460gitlab # [ 152.003582] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b77b59fb89336bf789199d7c","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b77b59fb89336bf789199d7c: done: 0.010712 sec","job_status":"done","queue_duration_s":3.108842,"scheduling_latency_s":3.108856,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010712,"completed_at":"2026-08-17T07:20:28.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 152.049919] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6311cecc1c50387577b869ca","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6311cecc1c50387577b869ca: start","job_status":"start","queue_duration_s":3.120579,"scheduling_latency_s":3.120591}1462gitlab # [ 152.050597] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6311cecc1c50387577b869ca","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6311cecc1c50387577b869ca: done: 0.010335 sec","job_status":"done","queue_duration_s":3.120579,"scheduling_latency_s":3.120591,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010335,"completed_at":"2026-08-17T07:20:28.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 152.094724] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f6004d3a9c031443a3be006","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f6004d3a9c031443a3be006: start","job_status":"start","queue_duration_s":3.13195,"scheduling_latency_s":3.131963}1464gitlab # [ 152.095465] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f6004d3a9c031443a3be006","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f6004d3a9c031443a3be006: done: 0.010766 sec","job_status":"done","queue_duration_s":3.13195,"scheduling_latency_s":3.131963,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010766,"completed_at":"2026-08-17T07:20:28.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 152.106957] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f3c4b36842fa26a97f54384","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f3c4b36842fa26a97f54384: start","job_status":"start","queue_duration_s":3.143895,"scheduling_latency_s":3.143908}1466gitlab # [ 152.144381] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f3c4b36842fa26a97f54384","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f3c4b36842fa26a97f54384: done: 0.010733 sec","job_status":"done","queue_duration_s":3.143895,"scheduling_latency_s":3.143908,"redis_calls":13,"redis_duration_s":0.001862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010733,"completed_at":"2026-08-17T07:20:28.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 152.181357] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e62827ac33ca0fd7575f0bf","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e62827ac33ca0fd7575f0bf: start","job_status":"start","queue_duration_s":3.155854,"scheduling_latency_s":3.155868}1468gitlab # [ 152.182058] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e62827ac33ca0fd7575f0bf","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e62827ac33ca0fd7575f0bf: done: 0.014426 sec","job_status":"done","queue_duration_s":3.155854,"scheduling_latency_s":3.155868,"redis_calls":13,"redis_duration_s":0.002098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001453,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014426,"completed_at":"2026-08-17T07:20:28.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 152.190042] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b72226a9c8410a0612d56f53","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b72226a9c8410a0612d56f53: start","job_status":"start","queue_duration_s":3.171778,"scheduling_latency_s":3.171799}1470gitlab # [ 152.200169] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b72226a9c8410a0612d56f53","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b72226a9c8410a0612d56f53: done: 0.011243 sec","job_status":"done","queue_duration_s":3.171778,"scheduling_latency_s":3.171799,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011243,"completed_at":"2026-08-17T07:20:28.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 152.240471] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a427f30b1963afdd5c38afc","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a427f30b1963afdd5c38afc: start","job_status":"start","queue_duration_s":3.184045,"scheduling_latency_s":3.184058}1472gitlab # [ 152.241147] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a427f30b1963afdd5c38afc","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a427f30b1963afdd5c38afc: done: 0.012075 sec","job_status":"done","queue_duration_s":3.184045,"scheduling_latency_s":3.184058,"redis_calls":13,"redis_duration_s":0.0018110000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012075,"completed_at":"2026-08-17T07:20:28.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 152.272436] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a78d472687dbe1f73921f4e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a78d472687dbe1f73921f4e: start","job_status":"start","queue_duration_s":3.197424,"scheduling_latency_s":3.197441}1474gitlab # [ 152.308830] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a78d472687dbe1f73921f4e","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a78d472687dbe1f73921f4e: done: 0.011283 sec","job_status":"done","queue_duration_s":3.197424,"scheduling_latency_s":3.197441,"redis_calls":13,"redis_duration_s":0.0016680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011283,"completed_at":"2026-08-17T07:20:28.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 152.345261] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c7ea89a12aeece12725822","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c7ea89a12aeece12725822: start","job_status":"start","queue_duration_s":3.209602,"scheduling_latency_s":3.209615}1476gitlab # [ 152.345907] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c7ea89a12aeece12725822","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c7ea89a12aeece12725822: done: 0.010415 sec","job_status":"done","queue_duration_s":3.209602,"scheduling_latency_s":3.209615,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010415,"completed_at":"2026-08-17T07:20:28.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 152.385099] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c50aaa360956310d60968e1b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c50aaa360956310d60968e1b: start","job_status":"start","queue_duration_s":3.221049,"scheduling_latency_s":3.221064}1478gitlab # [ 152.385766] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c50aaa360956310d60968e1b","created_at":"2026-08-17T07:20:25.057Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-cb866def1ecb4c24","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"203c1276f6d07eb7d93dc36df78128fc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.115Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c50aaa360956310d60968e1b: done: 0.01083 sec","job_status":"done","queue_duration_s":3.221049,"scheduling_latency_s":3.221064,"redis_calls":13,"redis_duration_s":0.0019370000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01083,"completed_at":"2026-08-17T07:20:28.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 152.396148] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.348Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cada836ad8bfade3299659d7","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cada836ad8bfade3299659d7: start","job_status":"start","queue_duration_s":3.131983,"scheduling_latency_s":3.131997}1480gitlab # [ 152.443682] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.539Z","message":"No existing merge request to be cleaned up."}1481gitlab # [ 152.444612] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.548Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cada836ad8bfade3299659d7","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cada836ad8bfade3299659d7: done: 0.200288 sec","job_status":"done","queue_duration_s":3.131983,"scheduling_latency_s":3.131997,"redis_calls":13,"redis_duration_s":0.0023759999999999996,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000507,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.176,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.176,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257854,"duration_s":0.200288,"completed_at":"2026-08-17T07:20:28.548Z","load_balancing_strategy":"primary","db_duration_s":0.177506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 152.448564] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.549Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"db771fb9391e923b4b86c5ed","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-db771fb9391e923b4b86c5ed: start","job_status":"start","queue_duration_s":3.333462,"scheduling_latency_s":3.333478}1483gitlab # [ 152.453992] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.647Z","message":"No existing merge request to be cleaned up."}1484gitlab # [ 152.458131] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.656Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"db771fb9391e923b4b86c5ed","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-db771fb9391e923b4b86c5ed: done: 0.1062 sec","job_status":"done","queue_duration_s":3.333462,"scheduling_latency_s":3.333478,"redis_calls":10,"redis_duration_s":0.008919,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003731,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.1062,"completed_at":"2026-08-17T07:20:28.656Z","load_balancing_strategy":"primary","db_duration_s":0.003634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 152.490155] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.657Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6296c0637f08d492cb990d0d","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6296c0637f08d492cb990d0d: start","job_status":"start","queue_duration_s":3.44078,"scheduling_latency_s":3.440801}1486gitlab # [ 152.537728] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.664Z","message":"No existing merge request to be cleaned up."}1487gitlab # [ 152.538515] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.669Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6296c0637f08d492cb990d0d","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6296c0637f08d492cb990d0d: done: 0.012217 sec","job_status":"done","queue_duration_s":3.44078,"scheduling_latency_s":3.440801,"redis_calls":10,"redis_duration_s":0.001297,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000769,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012217,"completed_at":"2026-08-17T07:20:28.669Z","load_balancing_strategy":"primary","db_duration_s":0.001032,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 152.539599] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.670Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ae868864208e34064eae49ec","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ae868864208e34064eae49ec: start","job_status":"start","queue_duration_s":3.453853,"scheduling_latency_s":3.453866}1489gitlab # [ 152.579708] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.677Z","message":"No existing merge request to be cleaned up."}1490gitlab # [ 152.580459] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.681Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ae868864208e34064eae49ec","created_at":"2026-08-17T07:20:25.206Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-5b701f3d2ddc4dac","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e15f959ff947a590b6b392dc05d6e825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:20:25.216Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ae868864208e34064eae49ec: done: 0.011203 sec","job_status":"done","queue_duration_s":3.453853,"scheduling_latency_s":3.453866,"redis_calls":10,"redis_duration_s":0.0013770000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011203,"completed_at":"2026-08-17T07:20:28.681Z","load_balancing_strategy":"primary","db_duration_s":0.000971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 152.581426] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.682Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"665d5ef5c5f9925e209592b4","created_at":"2026-08-17T07:20:26.272Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-12e5ed8ef8c94c5a","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"a19ac8959145451c059725005034c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:26.279Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-665d5ef5c5f9925e209592b4: start","job_status":"start","queue_duration_s":2.403214,"scheduling_latency_s":2.403227}1492gitlab # [ 152.623654] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.702Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"665d5ef5c5f9925e209592b4","created_at":"2026-08-17T07:20:26.272Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-12e5ed8ef8c94c5a","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"a19ac8959145451c059725005034c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:26.279Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-665d5ef5c5f9925e209592b4: done: 0.020539 sec","job_status":"done","queue_duration_s":2.403214,"scheduling_latency_s":2.403227,"redis_calls":10,"redis_duration_s":0.002137,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"duration_s":0.020539,"completed_at":"2026-08-17T07:20:28.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 152.662701] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.703Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"4e525f7543ff2ebfb586c9c2","created_at":"2026-08-17T07:20:26.279Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-12e5ed8ef8c94c5a","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"a19ac8959145451c059725005034c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:26.283Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-4e525f7543ff2ebfb586c9c2: start","job_status":"start","queue_duration_s":2.420779,"scheduling_latency_s":2.420792}1494gitlab # [ 152.663590] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:20:28.717Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"4e525f7543ff2ebfb586c9c2","created_at":"2026-08-17T07:20:26.279Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-12e5ed8ef8c94c5a","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"a19ac8959145451c059725005034c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-17T07:20:26.283Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-4e525f7543ff2ebfb586c9c2: done: 0.014117 sec","job_status":"done","queue_duration_s":2.420779,"scheduling_latency_s":2.420792,"redis_calls":10,"redis_duration_s":0.001318,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205334,"duration_s":0.014117,"completed_at":"2026-08-17T07:20:28.717Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 152.856152] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2450045755 wd_nsec: 24500458631496gitlab # [ 164.856818] setup-gitlab-start[2238]: W, [2026-08-17T07:20:41.964757 #2238] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1497gitlab # [ 185.998654] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b23f4b3a64f4cd24d89b857a","created_at":"2026-08-17T07:21:03.052Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"716b994ea9aebcca292810ef6a1f0dc9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.101Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b23f4b3a64f4cd24d89b857a: start","job_status":"start","queue_duration_s":0.003265,"scheduling_latency_s":0.00332}1498gitlab # [ 186.106642] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.214Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b23f4b3a64f4cd24d89b857a","created_at":"2026-08-17T07:21:03.052Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"716b994ea9aebcca292810ef6a1f0dc9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.101Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b23f4b3a64f4cd24d89b857a: done: 0.109579 sec","job_status":"done","queue_duration_s":0.003265,"scheduling_latency_s":0.00332,"redis_calls":7,"redis_duration_s":0.014922999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012887,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109579,"completed_at":"2026-08-17T07:21:03.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 186.115682] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"53d19051e76a54909ab7374a","created_at":"2026-08-17T07:21:03.129Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ff5cc07e175f79652b3750a21dee67c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.136Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-53d19051e76a54909ab7374a: start","job_status":"start","queue_duration_s":0.087329,"scheduling_latency_s":0.087371}1500gitlab # [ 186.162982] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"53d19051e76a54909ab7374a","created_at":"2026-08-17T07:21:03.129Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ff5cc07e175f79652b3750a21dee67c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.136Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-53d19051e76a54909ab7374a: done: 0.047312 sec","job_status":"done","queue_duration_s":0.087329,"scheduling_latency_s":0.087371,"redis_calls":10,"redis_duration_s":0.012053000000000001,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010727,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013576586,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.047312,"completed_at":"2026-08-17T07:21:03.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1501gitlab # [ 186.164972] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1f44f153db8004a5586fc503","created_at":"2026-08-17T07:21:03.153Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d3042ad6c1478ed93e9680c79f67064","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.158Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1f44f153db8004a5586fc503: start","job_status":"start","queue_duration_s":0.115357,"scheduling_latency_s":0.115384}1502gitlab # [ 186.272933] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1f44f153db8004a5586fc503","created_at":"2026-08-17T07:21:03.153Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d3042ad6c1478ed93e9680c79f67064","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.158Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1f44f153db8004a5586fc503: done: 0.107827 sec","job_status":"done","queue_duration_s":0.115357,"scheduling_latency_s":0.115384,"redis_calls":10,"redis_duration_s":0.012626,"redis_read_bytes":11,"redis_write_bytes":1173,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009309,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":558,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000985321,"exclusive_lock_hold_duration_s":0.05870802,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.107827,"completed_at":"2026-08-17T07:21:03.381Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 186.310652] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e55698d6f6b829b5392840ff","created_at":"2026-08-17T07:21:03.165Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ba060b1dd0fa9c4a670bb4e949681ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:21:03.170Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e55698d6f6b829b5392840ff: start","job_status":"start","queue_duration_s":0.248392,"scheduling_latency_s":0.248418}1504gitlab # [ 186.375646] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e55698d6f6b829b5392840ff","created_at":"2026-08-17T07:21:03.165Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ba060b1dd0fa9c4a670bb4e949681ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-17T07:21:03.170Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e55698d6f6b829b5392840ff: done: 0.064873 sec","job_status":"done","queue_duration_s":0.248392,"scheduling_latency_s":0.248418,"redis_calls":7,"redis_duration_s":0.018382,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010595,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064873,"completed_at":"2026-08-17T07:21:03.483Z","load_balancing_strategy":"primary","db_duration_s":0.002606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 186.412534] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1faaf71b41a052e234fc9407","created_at":"2026-08-17T07:21:03.182Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a9ef8876ae6b8406e4f575579a41bf5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:21:03.184Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1faaf71b41a052e234fc9407: start","job_status":"start","queue_duration_s":0.336582,"scheduling_latency_s":0.336612}1506gitlab # [ 186.451914] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.560Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1507gitlab # [ 186.468995] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1faaf71b41a052e234fc9407","created_at":"2026-08-17T07:21:03.182Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a9ef8876ae6b8406e4f575579a41bf5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-17T07:21:03.184Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1faaf71b41a052e234fc9407: done: 0.055758 sec","job_status":"done","queue_duration_s":0.336582,"scheduling_latency_s":0.336612,"redis_calls":7,"redis_duration_s":0.010329,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004972,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055758,"completed_at":"2026-08-17T07:21:03.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 186.501976] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3e9eef1b4833d6e5447a56ff","created_at":"2026-08-17T07:21:03.190Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3294043d82afd30c2d77cbdbcccf345b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.191Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3e9eef1b4833d6e5447a56ff: start","job_status":"start","queue_duration_s":0.418535,"scheduling_latency_s":0.418569}1509gitlab # [ 186.757912] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3e9eef1b4833d6e5447a56ff","created_at":"2026-08-17T07:21:03.190Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3294043d82afd30c2d77cbdbcccf345b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.191Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3e9eef1b4833d6e5447a56ff: done: 0.256233 sec","job_status":"done","queue_duration_s":0.418535,"scheduling_latency_s":0.418569,"redis_calls":562,"redis_duration_s":0.073864,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.072532,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.195878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.256233,"completed_at":"2026-08-17T07:21:03.866Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 186.791500] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d303e99d3b15bf268308139f","created_at":"2026-08-17T07:21:03.209Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04901d56068e6263d5524c7780e6f1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.212Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d303e99d3b15bf268308139f: start","job_status":"start","queue_duration_s":0.687271,"scheduling_latency_s":0.687298}1511gitlab # [ 186.830794] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d303e99d3b15bf268308139f","created_at":"2026-08-17T07:21:03.209Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04901d56068e6263d5524c7780e6f1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.212Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d303e99d3b15bf268308139f: done: 0.038707 sec","job_status":"done","queue_duration_s":0.687271,"scheduling_latency_s":0.687298,"redis_calls":9,"redis_duration_s":0.00326,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001356,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000868825,"exclusive_lock_hold_duration_s":0.005968635,"duration_s":0.038707,"completed_at":"2026-08-17T07:21:03.938Z","load_balancing_strategy":"primary","db_duration_s":0.002132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 186.864867] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:03.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a82794db227cef150b094807","created_at":"2026-08-17T07:21:03.223Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0c27c496582369cd481399a721271f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.226Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a82794db227cef150b094807: start","job_status":"start","queue_duration_s":0.746251,"scheduling_latency_s":0.746296}1513gitlab # [ 186.896131] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a82794db227cef150b094807","created_at":"2026-08-17T07:21:03.223Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0c27c496582369cd481399a721271f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.226Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a82794db227cef150b094807: done: 0.031065 sec","job_status":"done","queue_duration_s":0.746251,"scheduling_latency_s":0.746296,"redis_calls":7,"redis_duration_s":0.001814,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031065,"completed_at":"2026-08-17T07:21:04.004Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 186.930702] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"841720ac2679c7cc24983763","created_at":"2026-08-17T07:21:03.241Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d832228ecbc0638998eee4f5b6fa38d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.247Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-841720ac2679c7cc24983763: start","job_status":"start","queue_duration_s":0.791237,"scheduling_latency_s":0.791289}1515gitlab # [ 186.959749] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"841720ac2679c7cc24983763","created_at":"2026-08-17T07:21:03.241Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d832228ecbc0638998eee4f5b6fa38d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.247Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-841720ac2679c7cc24983763: done: 0.028945 sec","job_status":"done","queue_duration_s":0.791237,"scheduling_latency_s":0.791289,"redis_calls":7,"redis_duration_s":0.002595,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028945,"completed_at":"2026-08-17T07:21:04.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 186.994601] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3b63d7b10c035dad93a031b8","created_at":"2026-08-17T07:21:03.261Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.265Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3b63d7b10c035dad93a031b8: start","job_status":"start","queue_duration_s":0.836851,"scheduling_latency_s":0.836899}1517gitlab # [ 187.099482] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3b63d7b10c035dad93a031b8","created_at":"2026-08-17T07:21:03.261Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.265Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3b63d7b10c035dad93a031b8: done: 0.104613 sec","job_status":"done","queue_duration_s":0.836851,"scheduling_latency_s":0.836899,"redis_calls":60,"redis_duration_s":0.013684,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000531,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.012454,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000699,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.104613,"completed_at":"2026-08-17T07:21:04.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 187.160245] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"48ea965b378baf6ec0ecefff","created_at":"2026-08-17T07:21:03.278Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.281Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-48ea965b378baf6ec0ecefff: start","job_status":"start","queue_duration_s":0.986915,"scheduling_latency_s":0.986952}1519gitlab # [ 187.211888] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"48ea965b378baf6ec0ecefff","created_at":"2026-08-17T07:21:03.278Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.281Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-48ea965b378baf6ec0ecefff: done: 0.051265 sec","job_status":"done","queue_duration_s":0.986915,"scheduling_latency_s":0.986952,"redis_calls":14,"redis_duration_s":0.00384,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000412,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002582,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051265,"completed_at":"2026-08-17T07:21:04.319Z","load_balancing_strategy":"primary","db_duration_s":0.001913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 187.258650] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9a39ae7565466dddfd320536","created_at":"2026-08-17T07:21:03.290Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df2e202deabf04e888a657b23d10eea4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.292Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9a39ae7565466dddfd320536: start","job_status":"start","queue_duration_s":1.073807,"scheduling_latency_s":1.073853}1521gitlab # [ 187.504630] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9a39ae7565466dddfd320536","created_at":"2026-08-17T07:21:03.290Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df2e202deabf04e888a657b23d10eea4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.292Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9a39ae7565466dddfd320536: done: 0.246167 sec","job_status":"done","queue_duration_s":1.073807,"scheduling_latency_s":1.073853,"redis_calls":9,"redis_duration_s":0.00313,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001174451,"exclusive_lock_hold_duration_s":0.215675736,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.246167,"completed_at":"2026-08-17T07:21:04.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 187.545887] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"68625774fd78688ddaf39f12","created_at":"2026-08-17T07:21:03.303Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11981f4e15336349cfcfeffc08bd4bc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.305Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-68625774fd78688ddaf39f12: start","job_status":"start","queue_duration_s":1.308466,"scheduling_latency_s":1.308482}1523gitlab # [ 187.557685] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.626Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1524gitlab # [ 187.560973] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"68625774fd78688ddaf39f12","created_at":"2026-08-17T07:21:03.303Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11981f4e15336349cfcfeffc08bd4bc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.305Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-68625774fd78688ddaf39f12: done: 0.020661 sec","job_status":"done","queue_duration_s":1.308466,"scheduling_latency_s":1.308482,"redis_calls":7,"redis_duration_s":0.003483,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020661,"completed_at":"2026-08-17T07:21:04.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 187.593764] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c99e074a9a123f817d6c923d","created_at":"2026-08-17T07:21:03.313Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b903c036ca74d8b7cf5f7c83f98f43c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.315Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c99e074a9a123f817d6c923d: start","job_status":"start","queue_duration_s":1.329348,"scheduling_latency_s":1.329372}1526gitlab # [ 187.605656] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c99e074a9a123f817d6c923d","created_at":"2026-08-17T07:21:03.313Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b903c036ca74d8b7cf5f7c83f98f43c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.315Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c99e074a9a123f817d6c923d: done: 0.016165 sec","job_status":"done","queue_duration_s":1.329348,"scheduling_latency_s":1.329372,"redis_calls":9,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000454248,"exclusive_lock_hold_duration_s":0.003748242,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016165,"completed_at":"2026-08-17T07:21:04.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 187.639290] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f965bbc7890b7fad9209de25","created_at":"2026-08-17T07:21:03.318Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18bfef1619fdf558b0776a4bdf30a360","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.320Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f965bbc7890b7fad9209de25: start","job_status":"start","queue_duration_s":1.341615,"scheduling_latency_s":1.341631}1528gitlab # [ 187.651264] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.667Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1529gitlab # [ 187.651577] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f965bbc7890b7fad9209de25","created_at":"2026-08-17T07:21:03.318Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18bfef1619fdf558b0776a4bdf30a360","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.320Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f965bbc7890b7fad9209de25: done: 0.008569 sec","job_status":"done","queue_duration_s":1.341615,"scheduling_latency_s":1.341631,"redis_calls":7,"redis_duration_s":0.0010609999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008569,"completed_at":"2026-08-17T07:21:04.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 187.653062] postgres[2454]: [2454] ERROR: relation "table_without_models" does not exist1531gitlab # [ 187.653735] postgres[2454]: [2454] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1532gitlab # [ 187.654172] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bd20abaa7996b97beaba0989","created_at":"2026-08-17T07:21:03.322Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82a23cb82960995b04ee88aab1744f32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.323Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bd20abaa7996b97beaba0989: start","job_status":"start","queue_duration_s":1.348028,"scheduling_latency_s":1.34804}1533gitlab # [ 187.664473] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.693Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bd20abaa7996b97beaba0989","created_at":"2026-08-17T07:21:03.322Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82a23cb82960995b04ee88aab1744f32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.323Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bd20abaa7996b97beaba0989: done: 0.022156 sec","job_status":"done","queue_duration_s":1.348028,"scheduling_latency_s":1.34804,"redis_calls":9,"redis_duration_s":0.001494,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000346692,"exclusive_lock_hold_duration_s":0.013237437,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.022156,"completed_at":"2026-08-17T07:21:04.693Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 187.714694] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f93fe10def1b177350501349","created_at":"2026-08-17T07:21:03.362Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68caed8fa3d35224dfa9185e7efdc5c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.366Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f93fe10def1b177350501349: start","job_status":"start","queue_duration_s":1.328312,"scheduling_latency_s":1.328326}1535gitlab # [ 187.715383] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f93fe10def1b177350501349","created_at":"2026-08-17T07:21:03.362Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68caed8fa3d35224dfa9185e7efdc5c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.366Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f93fe10def1b177350501349: done: 0.008078 sec","job_status":"done","queue_duration_s":1.328312,"scheduling_latency_s":1.328326,"redis_calls":7,"redis_duration_s":0.00106,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008078,"completed_at":"2026-08-17T07:21:04.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 187.759759] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0491978809eb624947e7ebe4","created_at":"2026-08-17T07:21:03.378Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55c4a04532d7f05590d1a16db5c1d291","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:21:03.383Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0491978809eb624947e7ebe4: start","job_status":"start","queue_duration_s":1.320687,"scheduling_latency_s":1.3207}1537gitlab # [ 187.760597] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.708Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1538gitlab # [ 187.761386] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0491978809eb624947e7ebe4","created_at":"2026-08-17T07:21:03.378Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55c4a04532d7f05590d1a16db5c1d291","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-17T07:21:03.383Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0491978809eb624947e7ebe4: done: 0.007716 sec","job_status":"done","queue_duration_s":1.320687,"scheduling_latency_s":1.3207,"redis_calls":7,"redis_duration_s":0.001084,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007716,"completed_at":"2026-08-17T07:21:04.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 187.789265] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"40cc8f032fd540b79722b7b4","created_at":"2026-08-17T07:21:03.444Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b39374b72e4d55527bd1da55fb142807","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.469Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-40cc8f032fd540b79722b7b4: start","job_status":"start","queue_duration_s":1.242809,"scheduling_latency_s":1.242823}1540gitlab # [ 187.826893] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"40cc8f032fd540b79722b7b4","created_at":"2026-08-17T07:21:03.444Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b39374b72e4d55527bd1da55fb142807","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.469Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-40cc8f032fd540b79722b7b4: done: 0.097257 sec","job_status":"done","queue_duration_s":1.242809,"scheduling_latency_s":1.242823,"redis_calls":12,"redis_duration_s":0.0027229999999999997,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000330489,"exclusive_lock_hold_duration_s":0.083514805,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.097257,"completed_at":"2026-08-17T07:21:04.809Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010629,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1541gitlab # [ 187.867091] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1cf8793e0704e749e097d1e0","created_at":"2026-08-17T07:21:03.480Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91a7f04e445a19699288495b7fe92ee2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.517Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1cf8793e0704e749e097d1e0: start","job_status":"start","queue_duration_s":1.29374,"scheduling_latency_s":1.293754}1542gitlab # [ 187.867692] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.816Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1543gitlab # [ 187.868478] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1cf8793e0704e749e097d1e0","created_at":"2026-08-17T07:21:03.480Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91a7f04e445a19699288495b7fe92ee2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.517Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1cf8793e0704e749e097d1e0: done: 0.009194 sec","job_status":"done","queue_duration_s":1.29374,"scheduling_latency_s":1.293754,"redis_calls":7,"redis_duration_s":0.001596,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009194,"completed_at":"2026-08-17T07:21:04.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 187.906958] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1ee03579d78e8036f6b7b8ec","created_at":"2026-08-17T07:21:03.548Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f007ec5d6eae74df2b4ac0e7778bcc9","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.550Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1ee03579d78e8036f6b7b8ec: start","job_status":"start","queue_duration_s":1.270902,"scheduling_latency_s":1.270915}1545gitlab # [ 187.907680] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1ee03579d78e8036f6b7b8ec","created_at":"2026-08-17T07:21:03.548Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f007ec5d6eae74df2b4ac0e7778bcc9","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.550Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1ee03579d78e8036f6b7b8ec: done: 0.020322 sec","job_status":"done","queue_duration_s":1.270902,"scheduling_latency_s":1.270915,"redis_calls":7,"redis_duration_s":0.0017300000000000002,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.020322,"completed_at":"2026-08-17T07:21:04.841Z","load_balancing_strategy":"primary","db_duration_s":0.010571,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 187.929129] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"24aa2397bc991e90060f8b18","created_at":"2026-08-17T07:21:03.569Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c91331977ced8a2f73d96003350409c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.574Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-24aa2397bc991e90060f8b18: start","job_status":"start","queue_duration_s":1.268015,"scheduling_latency_s":1.268029}1547gitlab # [ 187.941416] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.847Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1548gitlab # [ 187.944236] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"24aa2397bc991e90060f8b18","created_at":"2026-08-17T07:21:03.569Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-ce6b583b13254053","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c91331977ced8a2f73d96003350409c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:03.574Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-24aa2397bc991e90060f8b18: done: 0.00827 sec","job_status":"done","queue_duration_s":1.268015,"scheduling_latency_s":1.268029,"redis_calls":7,"redis_duration_s":0.001483,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0004,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00827,"completed_at":"2026-08-17T07:21:04.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 187.982618] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abba6fe38495a31c388e08b4","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abba6fe38495a31c388e08b4: start","job_status":"start","queue_duration_s":0.65113,"scheduling_latency_s":0.651143}1550gitlab # [ 188.019712] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abba6fe38495a31c388e08b4","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abba6fe38495a31c388e08b4: done: 0.01063 sec","job_status":"done","queue_duration_s":0.65113,"scheduling_latency_s":0.651143,"redis_calls":13,"redis_duration_s":0.0027800000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01063,"completed_at":"2026-08-17T07:21:04.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 188.020646] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddb4b45fc9e12c5e2fa25689","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddb4b45fc9e12c5e2fa25689: start","job_status":"start","queue_duration_s":0.662902,"scheduling_latency_s":0.662915}1552gitlab # [ 188.056123] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddb4b45fc9e12c5e2fa25689","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddb4b45fc9e12c5e2fa25689: done: 0.010246 sec","job_status":"done","queue_duration_s":0.662902,"scheduling_latency_s":0.662915,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010246,"completed_at":"2026-08-17T07:21:04.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 188.061169] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e301010ca03779957baeed80","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e301010ca03779957baeed80: start","job_status":"start","queue_duration_s":0.674217,"scheduling_latency_s":0.674238}1554gitlab # [ 188.098284] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e301010ca03779957baeed80","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e301010ca03779957baeed80: done: 0.016211 sec","job_status":"done","queue_duration_s":0.674217,"scheduling_latency_s":0.674238,"redis_calls":13,"redis_duration_s":0.008118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016211,"completed_at":"2026-08-17T07:21:04.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 188.103535] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e6f7496e946bd4915b688d5","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e6f7496e946bd4915b688d5: start","job_status":"start","queue_duration_s":0.692348,"scheduling_latency_s":0.6924}1556gitlab # [ 188.144534] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e6f7496e946bd4915b688d5","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e6f7496e946bd4915b688d5: done: 0.023322 sec","job_status":"done","queue_duration_s":0.692348,"scheduling_latency_s":0.6924,"redis_calls":13,"redis_duration_s":0.002676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023322,"completed_at":"2026-08-17T07:21:04.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 188.145650] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcd6bc8fed7d4e508f14597e","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcd6bc8fed7d4e508f14597e: start","job_status":"start","queue_duration_s":0.717191,"scheduling_latency_s":0.717216}1558gitlab # [ 188.155627] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcd6bc8fed7d4e508f14597e","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcd6bc8fed7d4e508f14597e: done: 0.01141 sec","job_status":"done","queue_duration_s":0.717191,"scheduling_latency_s":0.717216,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01141,"completed_at":"2026-08-17T07:21:04.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 188.205951] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"988fffbb2ac308643ee5dbcb","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-988fffbb2ac308643ee5dbcb: start","job_status":"start","queue_duration_s":0.729478,"scheduling_latency_s":0.729492}1560gitlab # [ 188.206698] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"988fffbb2ac308643ee5dbcb","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-988fffbb2ac308643ee5dbcb: done: 0.009706 sec","job_status":"done","queue_duration_s":0.729478,"scheduling_latency_s":0.729492,"redis_calls":13,"redis_duration_s":0.0017919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009706,"completed_at":"2026-08-17T07:21:04.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 188.242774] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cb6f7695e72c4056fd0e1d3","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cb6f7695e72c4056fd0e1d3: start","job_status":"start","queue_duration_s":0.740244,"scheduling_latency_s":0.740257}1562gitlab # [ 188.243575] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cb6f7695e72c4056fd0e1d3","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cb6f7695e72c4056fd0e1d3: done: 0.0103 sec","job_status":"done","queue_duration_s":0.740244,"scheduling_latency_s":0.740257,"redis_calls":13,"redis_duration_s":0.002334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001611,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0103,"completed_at":"2026-08-17T07:21:04.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 188.279057] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8591b909fc767c62ceeab8a6","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8591b909fc767c62ceeab8a6: start","job_status":"start","queue_duration_s":0.751583,"scheduling_latency_s":0.751597}1564gitlab # [ 188.281724] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8591b909fc767c62ceeab8a6","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8591b909fc767c62ceeab8a6: done: 0.010213 sec","job_status":"done","queue_duration_s":0.751583,"scheduling_latency_s":0.751597,"redis_calls":13,"redis_duration_s":0.002291,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010213,"completed_at":"2026-08-17T07:21:04.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 188.338253] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f717443cdfcbfdc65ba5b17","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f717443cdfcbfdc65ba5b17: start","job_status":"start","queue_duration_s":0.762852,"scheduling_latency_s":0.762866}1566gitlab # [ 188.338875] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f717443cdfcbfdc65ba5b17","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f717443cdfcbfdc65ba5b17: done: 0.010432 sec","job_status":"done","queue_duration_s":0.762852,"scheduling_latency_s":0.762866,"redis_calls":13,"redis_duration_s":0.002574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010432,"completed_at":"2026-08-17T07:21:04.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 188.383296] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b02987b51fcd0fa29aaae38b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b02987b51fcd0fa29aaae38b: start","job_status":"start","queue_duration_s":0.774448,"scheduling_latency_s":0.774462}1568gitlab # [ 188.384288] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b02987b51fcd0fa29aaae38b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b02987b51fcd0fa29aaae38b: done: 0.011065 sec","job_status":"done","queue_duration_s":0.774448,"scheduling_latency_s":0.774462,"redis_calls":13,"redis_duration_s":0.003142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011065,"completed_at":"2026-08-17T07:21:04.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 188.426785] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c1253771664f56993d4ea7","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c1253771664f56993d4ea7: start","job_status":"start","queue_duration_s":0.786725,"scheduling_latency_s":0.786739}1570gitlab # [ 188.427705] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:04.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c1253771664f56993d4ea7","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c1253771664f56993d4ea7: done: 0.010954 sec","job_status":"done","queue_duration_s":0.786725,"scheduling_latency_s":0.786739,"redis_calls":13,"redis_duration_s":0.002908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010954,"completed_at":"2026-08-17T07:21:04.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 188.464965] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0439a778938327c176b27586","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0439a778938327c176b27586: start","job_status":"start","queue_duration_s":0.798821,"scheduling_latency_s":0.798834}1572gitlab # [ 188.465864] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0439a778938327c176b27586","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0439a778938327c176b27586: done: 0.010802 sec","job_status":"done","queue_duration_s":0.798821,"scheduling_latency_s":0.798834,"redis_calls":13,"redis_duration_s":0.002724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010802,"completed_at":"2026-08-17T07:21:05.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 188.509255] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a520e3248954fd5d763500ae","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a520e3248954fd5d763500ae: start","job_status":"start","queue_duration_s":0.810766,"scheduling_latency_s":0.810779}1574gitlab # [ 188.510080] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a520e3248954fd5d763500ae","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a520e3248954fd5d763500ae: done: 0.010644 sec","job_status":"done","queue_duration_s":0.810766,"scheduling_latency_s":0.810779,"redis_calls":13,"redis_duration_s":0.002672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010644,"completed_at":"2026-08-17T07:21:05.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 188.523710] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ea15ef9e26bd72a90ac2193","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ea15ef9e26bd72a90ac2193: start","job_status":"start","queue_duration_s":0.822526,"scheduling_latency_s":0.822541}1576gitlab # [ 188.534724] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ea15ef9e26bd72a90ac2193","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ea15ef9e26bd72a90ac2193: done: 0.010771 sec","job_status":"done","queue_duration_s":0.822526,"scheduling_latency_s":0.822541,"redis_calls":13,"redis_duration_s":0.002632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010771,"completed_at":"2026-08-17T07:21:05.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 188.575900] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"662342c06a7f03be07fbce6b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-662342c06a7f03be07fbce6b: start","job_status":"start","queue_duration_s":0.834448,"scheduling_latency_s":0.834462}1578gitlab # [ 188.576569] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"662342c06a7f03be07fbce6b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-662342c06a7f03be07fbce6b: done: 0.010774 sec","job_status":"done","queue_duration_s":0.834448,"scheduling_latency_s":0.834462,"redis_calls":13,"redis_duration_s":0.00291,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010774,"completed_at":"2026-08-17T07:21:05.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 188.611531] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f51799a461ea32ba1c4baa2","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f51799a461ea32ba1c4baa2: start","job_status":"start","queue_duration_s":0.846375,"scheduling_latency_s":0.846389}1580gitlab # [ 188.648040] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f51799a461ea32ba1c4baa2","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f51799a461ea32ba1c4baa2: done: 0.010637 sec","job_status":"done","queue_duration_s":0.846375,"scheduling_latency_s":0.846389,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010637,"completed_at":"2026-08-17T07:21:05.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 188.648880] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c58a9373f4bd13f577ba0b36","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c58a9373f4bd13f577ba0b36: start","job_status":"start","queue_duration_s":0.858148,"scheduling_latency_s":0.858161}1582gitlab # [ 188.657961] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c58a9373f4bd13f577ba0b36","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c58a9373f4bd13f577ba0b36: done: 0.010605 sec","job_status":"done","queue_duration_s":0.858148,"scheduling_latency_s":0.858161,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010605,"completed_at":"2026-08-17T07:21:05.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 188.720103] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a81dcf2dd57fe4074106f2","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a81dcf2dd57fe4074106f2: start","job_status":"start","queue_duration_s":0.8699,"scheduling_latency_s":0.869914}1584gitlab # [ 188.720805] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a81dcf2dd57fe4074106f2","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a81dcf2dd57fe4074106f2: done: 0.010615 sec","job_status":"done","queue_duration_s":0.8699,"scheduling_latency_s":0.869914,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010615,"completed_at":"2026-08-17T07:21:05.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 188.729975] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"115d126555f0d5a0a7bf80a0","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-115d126555f0d5a0a7bf80a0: start","job_status":"start","queue_duration_s":0.881645,"scheduling_latency_s":0.881658}1586gitlab # [ 188.764207] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"115d126555f0d5a0a7bf80a0","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-115d126555f0d5a0a7bf80a0: done: 0.011057 sec","job_status":"done","queue_duration_s":0.881645,"scheduling_latency_s":0.881658,"redis_calls":13,"redis_duration_s":0.003129,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011057,"completed_at":"2026-08-17T07:21:05.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 188.801151] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53ccb38c30271ad2704a6fe0","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53ccb38c30271ad2704a6fe0: start","job_status":"start","queue_duration_s":0.89393,"scheduling_latency_s":0.893944}1588gitlab # [ 188.801858] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53ccb38c30271ad2704a6fe0","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53ccb38c30271ad2704a6fe0: done: 0.010732 sec","job_status":"done","queue_duration_s":0.89393,"scheduling_latency_s":0.893944,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010732,"completed_at":"2026-08-17T07:21:05.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 188.811219] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"012053a938f7c5b389f952c8","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-012053a938f7c5b389f952c8: start","job_status":"start","queue_duration_s":0.905935,"scheduling_latency_s":0.905949}1590gitlab # [ 188.850043] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"012053a938f7c5b389f952c8","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-012053a938f7c5b389f952c8: done: 0.010602 sec","job_status":"done","queue_duration_s":0.905935,"scheduling_latency_s":0.905949,"redis_calls":13,"redis_duration_s":0.002673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010602,"completed_at":"2026-08-17T07:21:05.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 188.851658] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fea0db3644235ca6a048cb5f","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fea0db3644235ca6a048cb5f: start","job_status":"start","queue_duration_s":0.917658,"scheduling_latency_s":0.917672}1592gitlab # [ 188.861666] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fea0db3644235ca6a048cb5f","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fea0db3644235ca6a048cb5f: done: 0.010649 sec","job_status":"done","queue_duration_s":0.917658,"scheduling_latency_s":0.917672,"redis_calls":13,"redis_duration_s":0.002642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010649,"completed_at":"2026-08-17T07:21:05.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 188.908265] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56dd932fa3876f95979247ab","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56dd932fa3876f95979247ab: start","job_status":"start","queue_duration_s":0.929466,"scheduling_latency_s":0.929479}1594gitlab # [ 188.908847] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56dd932fa3876f95979247ab","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56dd932fa3876f95979247ab: done: 0.010724 sec","job_status":"done","queue_duration_s":0.929466,"scheduling_latency_s":0.929479,"redis_calls":13,"redis_duration_s":0.002813,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010724,"completed_at":"2026-08-17T07:21:05.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 188.943968] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99ba27e2b3790586cea97c0b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99ba27e2b3790586cea97c0b: start","job_status":"start","queue_duration_s":0.941312,"scheduling_latency_s":0.941326}1596gitlab # [ 188.944597] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99ba27e2b3790586cea97c0b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99ba27e2b3790586cea97c0b: done: 0.010615 sec","job_status":"done","queue_duration_s":0.941312,"scheduling_latency_s":0.941326,"redis_calls":13,"redis_duration_s":0.002632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010615,"completed_at":"2026-08-17T07:21:05.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 188.979957] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5749e18ad949e55c83ec5436","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5749e18ad949e55c83ec5436: start","job_status":"start","queue_duration_s":0.953101,"scheduling_latency_s":0.953114}1598gitlab # [ 188.982075] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5749e18ad949e55c83ec5436","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5749e18ad949e55c83ec5436: done: 0.010667 sec","job_status":"done","queue_duration_s":0.953101,"scheduling_latency_s":0.953114,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010667,"completed_at":"2026-08-17T07:21:05.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 189.017941] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f59ff091a8101f0d4bc7d1c","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f59ff091a8101f0d4bc7d1c: start","job_status":"start","queue_duration_s":0.964922,"scheduling_latency_s":0.964934}1600gitlab # [ 189.021953] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f59ff091a8101f0d4bc7d1c","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f59ff091a8101f0d4bc7d1c: done: 0.010554 sec","job_status":"done","queue_duration_s":0.964922,"scheduling_latency_s":0.964934,"redis_calls":13,"redis_duration_s":0.002662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010554,"completed_at":"2026-08-17T07:21:05.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 189.067978] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9b2ee069b98825927329282","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9b2ee069b98825927329282: start","job_status":"start","queue_duration_s":0.976575,"scheduling_latency_s":0.976588}1602gitlab # [ 189.068713] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9b2ee069b98825927329282","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9b2ee069b98825927329282: done: 0.010776 sec","job_status":"done","queue_duration_s":0.976575,"scheduling_latency_s":0.976588,"redis_calls":13,"redis_duration_s":0.0026509999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010776,"completed_at":"2026-08-17T07:21:05.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 189.106357] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c71738f3ec0f547d2fbf144","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c71738f3ec0f547d2fbf144: start","job_status":"start","queue_duration_s":0.988501,"scheduling_latency_s":0.988516}1604gitlab # [ 189.106901] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c71738f3ec0f547d2fbf144","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c71738f3ec0f547d2fbf144: done: 0.01065 sec","job_status":"done","queue_duration_s":0.988501,"scheduling_latency_s":0.988516,"redis_calls":13,"redis_duration_s":0.002776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01065,"completed_at":"2026-08-17T07:21:05.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 189.142996] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"456be2701a7659d5e629b5da","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-456be2701a7659d5e629b5da: start","job_status":"start","queue_duration_s":1.000287,"scheduling_latency_s":1.000301}1606gitlab # [ 189.143644] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"456be2701a7659d5e629b5da","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-456be2701a7659d5e629b5da: done: 0.01071 sec","job_status":"done","queue_duration_s":1.000287,"scheduling_latency_s":1.000301,"redis_calls":13,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01071,"completed_at":"2026-08-17T07:21:05.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 189.181133] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfdb91de655731da411741c9","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfdb91de655731da411741c9: start","job_status":"start","queue_duration_s":1.012157,"scheduling_latency_s":1.012171}1608gitlab # [ 189.182440] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfdb91de655731da411741c9","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfdb91de655731da411741c9: done: 0.010703 sec","job_status":"done","queue_duration_s":1.012157,"scheduling_latency_s":1.012171,"redis_calls":13,"redis_duration_s":0.002666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010703,"completed_at":"2026-08-17T07:21:05.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 189.217672] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3624e057f1f8b909682db0da","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3624e057f1f8b909682db0da: start","job_status":"start","queue_duration_s":1.02406,"scheduling_latency_s":1.024074}1610gitlab # [ 189.252662] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3624e057f1f8b909682db0da","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3624e057f1f8b909682db0da: done: 0.009522 sec","job_status":"done","queue_duration_s":1.02406,"scheduling_latency_s":1.024074,"redis_calls":13,"redis_duration_s":0.0017230000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009522,"completed_at":"2026-08-17T07:21:05.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 189.253646] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c2c294ffa99e14fd9b44073","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c2c294ffa99e14fd9b44073: start","job_status":"start","queue_duration_s":1.034788,"scheduling_latency_s":1.034802}1612gitlab # [ 189.287897] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c2c294ffa99e14fd9b44073","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c2c294ffa99e14fd9b44073: done: 0.010677 sec","job_status":"done","queue_duration_s":1.034788,"scheduling_latency_s":1.034802,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010677,"completed_at":"2026-08-17T07:21:05.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 189.292708] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f4bca1968fbcf583e3256c6","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f4bca1968fbcf583e3256c6: start","job_status":"start","queue_duration_s":1.046585,"scheduling_latency_s":1.046598}1614gitlab # [ 189.326885] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f4bca1968fbcf583e3256c6","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f4bca1968fbcf583e3256c6: done: 0.010638 sec","job_status":"done","queue_duration_s":1.046585,"scheduling_latency_s":1.046598,"redis_calls":13,"redis_duration_s":0.002666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001742,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010638,"completed_at":"2026-08-17T07:21:05.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 189.332797] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a97c9035a68b6914d25e81c2","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a97c9035a68b6914d25e81c2: start","job_status":"start","queue_duration_s":1.05837,"scheduling_latency_s":1.058384}1616gitlab # [ 189.373681] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a97c9035a68b6914d25e81c2","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a97c9035a68b6914d25e81c2: done: 0.010677 sec","job_status":"done","queue_duration_s":1.05837,"scheduling_latency_s":1.058384,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010677,"completed_at":"2026-08-17T07:21:05.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 189.374517] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"108c6416b15e630dfdfc866e","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-108c6416b15e630dfdfc866e: start","job_status":"start","queue_duration_s":1.070173,"scheduling_latency_s":1.070187}1618gitlab # [ 189.414726] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"108c6416b15e630dfdfc866e","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-108c6416b15e630dfdfc866e: done: 0.010699 sec","job_status":"done","queue_duration_s":1.070173,"scheduling_latency_s":1.070187,"redis_calls":13,"redis_duration_s":0.002575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010699,"completed_at":"2026-08-17T07:21:05.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 189.415599] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fb35d252d3df1c1d5725eba","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fb35d252d3df1c1d5725eba: start","job_status":"start","queue_duration_s":1.08199,"scheduling_latency_s":1.082004}1620gitlab # [ 189.452739] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fb35d252d3df1c1d5725eba","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fb35d252d3df1c1d5725eba: done: 0.011092 sec","job_status":"done","queue_duration_s":1.08199,"scheduling_latency_s":1.082004,"redis_calls":13,"redis_duration_s":0.003125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011092,"completed_at":"2026-08-17T07:21:05.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 189.453634] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5611c085610e3f123e87c0fc","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5611c085610e3f123e87c0fc: start","job_status":"start","queue_duration_s":1.094208,"scheduling_latency_s":1.094222}1622gitlab # [ 189.462620] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5611c085610e3f123e87c0fc","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5611c085610e3f123e87c0fc: done: 0.010566 sec","job_status":"done","queue_duration_s":1.094208,"scheduling_latency_s":1.094222,"redis_calls":13,"redis_duration_s":0.00265,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010566,"completed_at":"2026-08-17T07:21:05.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 189.500667] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45a6f3c5fb1f68adaa6cc012","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45a6f3c5fb1f68adaa6cc012: start","job_status":"start","queue_duration_s":1.106005,"scheduling_latency_s":1.106018}1624gitlab # [ 189.502871] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45a6f3c5fb1f68adaa6cc012","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45a6f3c5fb1f68adaa6cc012: done: 0.010784 sec","job_status":"done","queue_duration_s":1.106005,"scheduling_latency_s":1.106018,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010784,"completed_at":"2026-08-17T07:21:05.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 189.534255] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"273ea07ac5561d67b39d612f","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-273ea07ac5561d67b39d612f: start","job_status":"start","queue_duration_s":1.117942,"scheduling_latency_s":1.117955}1626gitlab # [ 189.571926] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"273ea07ac5561d67b39d612f","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-273ea07ac5561d67b39d612f: done: 0.010731 sec","job_status":"done","queue_duration_s":1.117942,"scheduling_latency_s":1.117955,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010731,"completed_at":"2026-08-17T07:21:05.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 189.574196] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d0071f07885002df7feee88","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d0071f07885002df7feee88: start","job_status":"start","queue_duration_s":1.129861,"scheduling_latency_s":1.129875}1628gitlab # [ 189.612673] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d0071f07885002df7feee88","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d0071f07885002df7feee88: done: 0.010684 sec","job_status":"done","queue_duration_s":1.129861,"scheduling_latency_s":1.129875,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010684,"completed_at":"2026-08-17T07:21:05.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 189.614442] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d9b822eab574d8f6d5fe1ee","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d9b822eab574d8f6d5fe1ee: start","job_status":"start","queue_duration_s":1.141723,"scheduling_latency_s":1.141737}1630gitlab # [ 189.624162] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d9b822eab574d8f6d5fe1ee","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d9b822eab574d8f6d5fe1ee: done: 0.0106 sec","job_status":"done","queue_duration_s":1.141723,"scheduling_latency_s":1.141737,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0106,"completed_at":"2026-08-17T07:21:05.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 189.665898] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbb9407d4cb20819bffda8c6","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbb9407d4cb20819bffda8c6: start","job_status":"start","queue_duration_s":1.154446,"scheduling_latency_s":1.154482}1632gitlab # [ 189.666580] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbb9407d4cb20819bffda8c6","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbb9407d4cb20819bffda8c6: done: 0.014686 sec","job_status":"done","queue_duration_s":1.154446,"scheduling_latency_s":1.154482,"redis_calls":13,"redis_duration_s":0.002685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014686,"completed_at":"2026-08-17T07:21:05.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 189.713945] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0547572d8d3d459218d16c83","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0547572d8d3d459218d16c83: start","job_status":"start","queue_duration_s":1.1702,"scheduling_latency_s":1.170213}1634gitlab # [ 189.714597] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0547572d8d3d459218d16c83","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0547572d8d3d459218d16c83: done: 0.010354 sec","job_status":"done","queue_duration_s":1.1702,"scheduling_latency_s":1.170213,"redis_calls":13,"redis_duration_s":0.002613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010354,"completed_at":"2026-08-17T07:21:05.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 189.734915] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d73ab480e7e6883c4285057c","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d73ab480e7e6883c4285057c: start","job_status":"start","queue_duration_s":1.181676,"scheduling_latency_s":1.181712}1636gitlab # [ 189.770678] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d73ab480e7e6883c4285057c","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d73ab480e7e6883c4285057c: done: 0.012933 sec","job_status":"done","queue_duration_s":1.181676,"scheduling_latency_s":1.181712,"redis_calls":13,"redis_duration_s":0.0032839999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012933,"completed_at":"2026-08-17T07:21:05.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 189.774865] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b0e48f00b51212aeb9400b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b0e48f00b51212aeb9400b: start","job_status":"start","queue_duration_s":1.195937,"scheduling_latency_s":1.195955}1638gitlab # [ 189.784721] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b0e48f00b51212aeb9400b","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b0e48f00b51212aeb9400b: done: 0.011292 sec","job_status":"done","queue_duration_s":1.195937,"scheduling_latency_s":1.195955,"redis_calls":13,"redis_duration_s":0.002763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011292,"completed_at":"2026-08-17T07:21:05.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 189.829084] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eff3fc0e3b1e2d98c9bd88e9","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eff3fc0e3b1e2d98c9bd88e9: start","job_status":"start","queue_duration_s":1.208395,"scheduling_latency_s":1.208409}1640gitlab # [ 189.829682] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eff3fc0e3b1e2d98c9bd88e9","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eff3fc0e3b1e2d98c9bd88e9: done: 0.010689 sec","job_status":"done","queue_duration_s":1.208395,"scheduling_latency_s":1.208409,"redis_calls":13,"redis_duration_s":0.002785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010689,"completed_at":"2026-08-17T07:21:05.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 189.878665] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2aef5c5bf606f13ba7c721c","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2aef5c5bf606f13ba7c721c: start","job_status":"start","queue_duration_s":1.220206,"scheduling_latency_s":1.22022}1642gitlab # [ 189.879490] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2aef5c5bf606f13ba7c721c","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2aef5c5bf606f13ba7c721c: done: 0.010174 sec","job_status":"done","queue_duration_s":1.220206,"scheduling_latency_s":1.22022,"redis_calls":13,"redis_duration_s":0.002189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010174,"completed_at":"2026-08-17T07:21:05.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 189.920660] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97e6e4b41427ca8f80d2b817","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97e6e4b41427ca8f80d2b817: start","job_status":"start","queue_duration_s":1.231284,"scheduling_latency_s":1.231299}1644gitlab # [ 189.921420] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97e6e4b41427ca8f80d2b817","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97e6e4b41427ca8f80d2b817: done: 0.009421 sec","job_status":"done","queue_duration_s":1.231284,"scheduling_latency_s":1.231299,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009421,"completed_at":"2026-08-17T07:21:05.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 189.935663] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9ccd54b561aa5e135be307d","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9ccd54b561aa5e135be307d: start","job_status":"start","queue_duration_s":1.241584,"scheduling_latency_s":1.241597}1646gitlab # [ 189.945484] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9ccd54b561aa5e135be307d","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9ccd54b561aa5e135be307d: done: 0.010559 sec","job_status":"done","queue_duration_s":1.241584,"scheduling_latency_s":1.241597,"redis_calls":13,"redis_duration_s":0.002706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010559,"completed_at":"2026-08-17T07:21:05.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 189.997660] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb26ca41fa2bed32a7048f45","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb26ca41fa2bed32a7048f45: start","job_status":"start","queue_duration_s":1.253292,"scheduling_latency_s":1.253306}1648gitlab # [ 189.998266] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb26ca41fa2bed32a7048f45","created_at":"2026-08-17T07:21:04.126Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-9530762957b54142","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f508eac549fb40a6033e21fbd5570394","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.201Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb26ca41fa2bed32a7048f45: done: 0.010749 sec","job_status":"done","queue_duration_s":1.253292,"scheduling_latency_s":1.253306,"redis_calls":13,"redis_duration_s":0.002628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010749,"completed_at":"2026-08-17T07:21:05.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 190.016605] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.466Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8db2a95d56c6d52d329d8bcb","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8db2a95d56c6d52d329d8bcb: start","job_status":"start","queue_duration_s":1.153814,"scheduling_latency_s":1.153829}1650gitlab # [ 190.059131] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.475Z","message":"No existing merge request to be cleaned up."}1651gitlab # [ 190.059770] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.481Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8db2a95d56c6d52d329d8bcb","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8db2a95d56c6d52d329d8bcb: done: 0.015014 sec","job_status":"done","queue_duration_s":1.153814,"scheduling_latency_s":1.153829,"redis_calls":11,"redis_duration_s":0.002439,"redis_read_bytes":136,"redis_write_bytes":1071,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00021,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015014,"completed_at":"2026-08-17T07:21:05.481Z","load_balancing_strategy":"primary","db_duration_s":0.001837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 190.060604] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.482Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0a0de4f10a72646d2e212ffb","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0a0de4f10a72646d2e212ffb: start","job_status":"start","queue_duration_s":1.169974,"scheduling_latency_s":1.169989}1653gitlab # [ 190.068949] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.489Z","message":"No existing merge request to be cleaned up."}1654gitlab # [ 190.070239] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.498Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0a0de4f10a72646d2e212ffb","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0a0de4f10a72646d2e212ffb: done: 0.015484 sec","job_status":"done","queue_duration_s":1.169974,"scheduling_latency_s":1.169989,"redis_calls":10,"redis_duration_s":0.002659,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015484,"completed_at":"2026-08-17T07:21:05.497Z","load_balancing_strategy":"primary","db_duration_s":0.000983,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 190.104676] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.499Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e956f45026dc7b5b5bb71452","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e956f45026dc7b5b5bb71452: start","job_status":"start","queue_duration_s":1.186724,"scheduling_latency_s":1.186746}1656gitlab # [ 190.140901] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.509Z","message":"No existing merge request to be cleaned up."}1657gitlab # [ 190.141719] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.514Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e956f45026dc7b5b5bb71452","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e956f45026dc7b5b5bb71452: done: 0.015227 sec","job_status":"done","queue_duration_s":1.186724,"scheduling_latency_s":1.186746,"redis_calls":10,"redis_duration_s":0.002447,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015227,"completed_at":"2026-08-17T07:21:05.514Z","load_balancing_strategy":"primary","db_duration_s":0.001625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 190.142615] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.515Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9b0f0eb232aa7ddf8762695","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9b0f0eb232aa7ddf8762695: start","job_status":"start","queue_duration_s":1.203116,"scheduling_latency_s":1.203131}1659gitlab # [ 190.151384] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.522Z","message":"No existing merge request to be cleaned up."}1660gitlab # [ 190.152240] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:05.527Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9b0f0eb232aa7ddf8762695","created_at":"2026-08-17T07:21:04.299Z","trace_propagation_headers":{"sentry-trace":"918e125c07eb479fb681038cd8194120-a5824035a93542c5","baggage":"sentry-trace_id=918e125c07eb479fb681038cd8194120,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4fd4100e5850734a9c8d710b14b9c66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:04.312Z","job_size_bytes":2,"pid":1632,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9b0f0eb232aa7ddf8762695: done: 0.011854 sec","job_status":"done","queue_duration_s":1.203116,"scheduling_latency_s":1.203131,"redis_calls":10,"redis_duration_s":0.002146,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011854,"completed_at":"2026-08-17T07:21:05.527Z","load_balancing_strategy":"primary","db_duration_s":0.001081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 194.558938] runuser[2237]: pam_unix(runuser:session): session closed for user gitlab1662gitlab # [ 194.559906] setup-gitlab-start[2212]: + systemctl restart gitlab-sidekiq.service1663gitlab # [ 194.589127] systemd[1]: Stopping gitlab-sidekiq.service...1664gitlab # [ 194.597923] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:11.705Z","message":"Shutting down"}1665gitlab # [ 194.598094] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:11.706Z","message":"Scheduler exiting..."}1666gitlab # [ 194.598789] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:11.707Z","message":"Terminating quiet threads for default capsule"}1667gitlab # [ 194.599822] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:11.707Z","message":"Scheduler exiting..."}1668gitlab # [ 195.107324] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:12.215Z","message":"Pausing to allow jobs to finish..."}1669gitlab # [ 198.613486] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:15.721Z","message":"Bye!"}1670gitlab # [ 198.646143] sidekiq-cluster[1632]: {"severity":"INFO","time":"2026-08-17T07:21:15.754Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1632,"worker_id":"sidekiq_0","memwd_rss_bytes":976445440,"retry":0}1671gitlab # [ 199.129604] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1672gitlab # [ 199.132180] systemd[1]: Stopped gitlab-sidekiq.service.1673gitlab # [ 199.133794] systemd[1]: gitlab-sidekiq.service: Consumed 1min 4.291s CPU time over 2min 4.185s wall clock time, 972.9M memory peak, 5.2M read from disk.1674gitlab # [ 199.143940] systemd[1]: Started gitlab-sidekiq.service.1675gitlab # [ 199.146419] setup-gitlab-start[2212]: + mkdir -p /var/lib/secrets1676gitlab # [ 199.148405] setup-gitlab-start[2212]: + echo nixbot-test-token-of-20-chars1677gitlab # [ 199.150499] setup-gitlab-start[2212]: + chmod 644 /var/lib/secrets/gitlab-token1678gitlab # [ 199.152880] setup-gitlab-start[2212]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1679gitlab # [ 200.229815] gitaly[891]: time="2026-08-17T07:21:17.337Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.337" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 200.230985] gitaly[891]: time="2026-08-17T07:21:17.338Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.337" grpc.time_ms=0.378 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 200.393917] gitaly[891]: time="2026-08-17T07:21:17.502Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.502" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 200.414998] gitaly[891]: time="2026-08-17T07:21:17.502Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.502" grpc.time_ms=0.39 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 200.468489] gitaly[891]: time="2026-08-17T07:21:17.577Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 diskcache=a16a3280-85f7-4b66-a836-b21dae9f157b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:21:27.198" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.528" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 200.488903] gitaly[891]: time="2026-08-17T07:21:17.577Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:21:27.198" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.528" grpc.time_ms=48.771 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 200.489114] gitaly[891]: time="2026-08-17T07:21:17.588Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.257" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.588" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1686gitlab # [ 200.489755] gitaly[891]: time="2026-08-17T07:21:17.589Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.257" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.588" grpc.time_ms=0.71 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687gitlab # [ 200.532058] gitaly[891]: time="2026-08-17T07:21:17.640Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:21:27.261" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.592" grpc.time_ms=47.984 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688gitlab # [ 200.600692] gitaly[891]: time="2026-08-17T07:21:17.709Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.708" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 200.621160] gitaly[891]: time="2026-08-17T07:21:17.709Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.708" grpc.time_ms=0.792 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1690gitlab # [ 200.646447] gitaly[891]: time="2026-08-17T07:21:17.755Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 diskcache=d4d8ecb1-f3a7-49a3-8149-4f1b8a9b5320 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:21:27.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.711" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691gitlab # [ 200.647232] gitaly[891]: time="2026-08-17T07:21:17.755Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1581 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-17T07:21:27.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.711" grpc.time_ms=43.587 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1692gitlab # [ 200.673281] gitaly[891]: time="2026-08-17T07:21:17.781Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.081" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.781" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1693gitlab # [ 200.682072] gitaly[891]: time="2026-08-17T07:21:17.782Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.081" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.781" grpc.time_ms=0.618 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1694gitlab # [ 200.683613] gitaly[891]: time="2026-08-17T07:21:17.792Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:21:27.085" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.785" grpc.time_ms=6.674 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1695gitlab # [ 200.707163] gitaly[891]: time="2026-08-17T07:21:17.815Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:21:27.115" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.815" grpc.time_ms=0.106 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 200.711417] gitaly[891]: time="2026-08-17T07:21:17.820Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:21:27.119" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:17.819" grpc.time_ms=0.161 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 201.145849] gitaly[891]: time="2026-08-17T07:21:18.254Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H5QP3MXZNWD78PR1XJ76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:21:28.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:18.243" grpc.time_ms=11.022 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 201.586646] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:18 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 24151699gitlab # [ 201.591229] setup-gitlab-start[2212]: + mkdir -p /tmp/test-flake1700gitlab # [ 201.593462] setup-gitlab-start[2212]: + cd /tmp/test-flake1701gitlab # [ 201.595326] setup-gitlab-start[2212]: + git init -b master1702gitlab # [ 201.623738] setup-gitlab-start[2568]: Initialized empty Git repository in /tmp/test-flake/.git/1703gitlab # [ 201.626462] setup-gitlab-start[2212]: + git config user.name test1704gitlab # [ 201.628505] setup-gitlab-start[2212]: + git config user.email test@example.com1705gitlab # [ 201.632328] setup-gitlab-start[2212]: + cat1706gitlab # [ 201.635824] setup-gitlab-start[2212]: + git add flake.nix1707gitlab # [ 201.641079] setup-gitlab-start[2212]: + git commit -m 'initial commit'1708gitlab # [ 201.665255] setup-gitlab-start[2573]: [master (root-commit) 281df16] initial commit1709gitlab # [ 201.665386] setup-gitlab-start[2573]: 1 file changed, 10 insertions(+)1710gitlab # [ 201.666557] setup-gitlab-start[2573]: create mode 100644 flake.nix1711gitlab # [ 201.668115] setup-gitlab-start[2212]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1712gitlab # [ 201.673960] setup-gitlab-start[2212]: + git push -u origin master1713gitlab # [ 201.741106] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 441714gitlab # [ 202.056845] gitaly[891]: time="2026-08-17T07:21:19.164Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8877H7882T1ZM89K798 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:19.153" grpc.time_ms=11.481 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1715gitlab # [ 202.057715] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 3091716gitlab # [ 202.346314] gitaly[891]: time="2026-08-17T07:21:19.454Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:21:29.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:19.443" grpc.time_ms=10.63 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717gitlab # [ 202.385982] gitaly[891]: time="2026-08-17T07:21:19.494Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-17T07:21:49.081" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-17T07:21:19.481" grpc.time_ms=12.721 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1718gitlab # [ 202.408132] gitaly[891]: time="2026-08-17T07:21:19.516Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M079H8K8W0SJXHSXZEAN591K duration_ms=158ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1719gitlab # [ 202.435804] gitaly[891]: time="2026-08-17T07:21:19.544Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M079H8K8W0SJXHSXZEAN591K duration_ms=25ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1720gitlab # [ 202.440926] gitaly[891]: time="2026-08-17T07:21:19.549Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:19.357" grpc.time_ms=191.597 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1721gitlab # [ 202.443818] sidekiq-cluster[2520]: {"severity":"INFO","time":"2026-08-17T07:21:19.533Z","message":"Starting cluster with 1 processes"}1722gitlab # [ 202.481514] gitaly[891]: time="2026-08-17T07:21:19.590Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:19.589" grpc.time_ms=0.517 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1723gitlab # [ 202.514056] gitaly[891]: time="2026-08-17T07:21:19.622Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:19.622" grpc.time_ms=0.542 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1724gitlab # [ 202.543084] gitaly[891]: time="2026-08-17T07:21:19.651Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:19.651" grpc.time_ms=0.434 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 202.624148] gitaly[891]: time="2026-08-17T07:21:19.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:21:29.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:19.725" grpc.time_ms=6.751 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 202.639333] gitaly[891]: time="2026-08-17T07:21:19.748Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1569 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-17T07:21:29.037" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:19.737" grpc.time_ms=10.32 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727gitlab # [ 202.652381] gitaly[891]: time="2026-08-17T07:21:19.761Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M079H8K8W0SJXHSXZEAN591K duration_ms=82ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1728gitlab # [ 202.653050] gitaly[891]: time="2026-08-17T07:21:19.761Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:19.677" grpc.time_ms=83.54 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 202.675392] gitaly[891]: time="2026-08-17T07:21:19.784Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K diskcache=cd960599-876a-4f3d-9814-bee119ebe0ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:19.280" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 202.683683] gitaly[891]: time="2026-08-17T07:21:19.784Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=179 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=864256 command.minflt=13954 command.oublock=32 command.real_time_ms=494 command.spawn_token_fork_ms=2 command.system_time_ms=123 command.user_time_ms=56 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:19.280" grpc.time_ms=504.135 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1731gitlab # [ 202.684216] gitlab-workhorse[826]: time="2026-08-17T07:21:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521732gitlab # [ 202.684737] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:19 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5761733gitlab # [ 202.685403] setup-gitlab-start[2577]: To http://gitlab/root/test-flake.git1734gitlab # [ 202.685979] setup-gitlab-start[2577]: * [new branch] master -> master1735gitlab # [ 202.700951] setup-gitlab-start[2577]: branch 'master' set up to track 'origin/master'.1736gitlab # [ 202.703314] systemd[1]: Finished setup-gitlab.service.1737gitlab # [ 202.707055] systemd[1]: Starting nixbot CI service...1738gitlab: (finished: waiting for unit setup-gitlab.service, in 203.66 seconds)1739gitlab: waiting for unit nixbot.service1740gitlab # [ 203.878906] nixbot[2669]: {"ts": "2026-08-17T07:21:20.986Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1741gitlab # [ 203.911108] nixbot[2669]: {"ts": "2026-08-17T07:21:21.019Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1742gitlab # [ 203.939763] nixbot[2669]: {"ts": "2026-08-17T07:21:21.048Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1743gitlab # [ 203.946915] nixbot[2669]: {"ts": "2026-08-17T07:21:21.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1744gitlab # [ 203.954862] nixbot[2669]: {"ts": "2026-08-17T07:21:21.063Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1745gitlab # [ 203.966481] nixbot[2669]: {"ts": "2026-08-17T07:21:21.075Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1746gitlab # [ 203.974950] nixbot[2669]: {"ts": "2026-08-17T07:21:21.083Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1747gitlab # [ 203.981396] nixbot[2669]: {"ts": "2026-08-17T07:21:21.089Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1748gitlab # [ 203.992967] nixbot[2669]: {"ts": "2026-08-17T07:21:21.101Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1749gitlab # [ 203.997309] nixbot[2669]: {"ts": "2026-08-17T07:21:21.105Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1750gitlab # [ 204.008318] nixbot[2669]: {"ts": "2026-08-17T07:21:21.116Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1751gitlab # [ 204.020367] nixbot[2669]: {"ts": "2026-08-17T07:21:21.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1752gitlab # [ 204.029694] nixbot[2669]: {"ts": "2026-08-17T07:21:21.138Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1753gitlab # [ 204.033423] nixbot[2669]: {"ts": "2026-08-17T07:21:21.141Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1754gitlab # [ 204.038937] nixbot[2669]: {"ts": "2026-08-17T07:21:21.147Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1755gitlab # [ 204.042368] nixbot[2669]: {"ts": "2026-08-17T07:21:21.151Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1756gitlab # [ 204.045464] nixbot[2669]: {"ts": "2026-08-17T07:21:21.154Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1757gitlab # [ 204.048431] nixbot[2669]: {"ts": "2026-08-17T07:21:21.157Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1758gitlab # [ 204.057148] nixbot[2669]: {"ts": "2026-08-17T07:21:21.164Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1759gitlab # [ 204.060106] nixbot[2669]: {"ts": "2026-08-17T07:21:21.168Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1760gitlab # [ 204.062826] nixbot[2669]: {"ts": "2026-08-17T07:21:21.171Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1761gitlab # [ 204.069827] nixbot[2669]: {"ts": "2026-08-17T07:21:21.178Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1762gitlab # [ 204.072491] nixbot[2669]: {"ts": "2026-08-17T07:21:21.181Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1763gitlab # [ 204.077140] nixbot[2669]: {"ts": "2026-08-17T07:21:21.184Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1764gitlab # [ 204.078257] nixbot[2669]: {"ts": "2026-08-17T07:21:21.186Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1765gitlab # [ 204.423443] nixbot[2669]: INFO: Started server process [2669]1766gitlab # [ 204.425579] nixbot[2669]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1767gitlab # [ 204.439127] nixbot[2669]: INFO: ::ffff:127.0.0.1:50284 - "GET /health HTTP/1.1" 200 OK1768gitlab # [ 204.445698] systemd[1]: Started nixbot CI service.1769gitlab # [ 204.449062] systemd[1]: Reached target Multi-User System.1770gitlab # [ 204.451100] systemd[1]: Startup finished in 1.225s (kernel) + 3.692s (initrd) + 3min 19.532s (userspace) = 3min 24.450s.1771gitlab # [ 204.631106] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:21 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1871772gitlab # [ 204.635994] nixbot[2669]: {"ts": "2026-08-17T07:21:21.740Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1773gitlab # [ 204.655062] nixbot[2669]: {"ts": "2026-08-17T07:21:21.763Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1774gitlab # [ 204.712771] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 501775gitlab # [ 204.714698] nixbot[2669]: {"ts": "2026-08-17T07:21:21.823Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1776gitlab # [ 204.717058] nixbot[2669]: {"ts": "2026-08-17T07:21:21.825Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1777gitlab # [ 204.933981] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2071778gitlab # [ 204.935526] nixbot[2669]: {"ts": "2026-08-17T07:21:22.043Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1779gitlab # [ 205.084603] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1361780gitlab # [ 205.090297] nixbot[2669]: {"ts": "2026-08-17T07:21:22.194Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1781gitlab: (finished: waiting for unit nixbot.service, in 2.12 seconds)1782gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1783gitlab # [ 205.145613] nixbot[2669]: INFO: ::ffff:127.0.0.1:36562 - "GET /health HTTP/1.1" 200 OK1784gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1785subtest: project discovered and webhook registered1786gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1787gitlab # [ 205.167807] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 711788gitlab # [ 205.171919] nixbot[2669]: {"ts": "2026-08-17T07:21:22.277Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1789gitlab # [ 205.228974] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 551790gitlab # [ 205.233982] nixbot[2669]: {"ts": "2026-08-17T07:21:22.338Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1791gitlab # [ 205.260580] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 901792gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1793(finished: subtest: project discovered and webhook registered, in 0.11 seconds)1794subtest: push delivers the webhook1795gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1796gitlab # [ 205.296367] gitaly[891]: time="2026-08-17T07:21:22.402Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBNBE9PBVTQJBPQCDRJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-17T07:21:52.092" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:22.392" grpc.time_ms=9.445 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 205.327730] gitaly[891]: time="2026-08-17T07:21:22.435Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBNBE9PBVTQJBPQCDRJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:21:52.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:22.434" grpc.time_ms=0.593 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 205.349112] gitaly[891]: time="2026-08-17T07:21:22.457Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBNBE9PBVTQJBPQCDRJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-17T07:21:32.020" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:22.450" grpc.time_ms=7.098 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 205.371975] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 271800gitlab # [ 205.373851] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1331801gitlab # [ 205.375734] nixbot[2669]: {"ts": "2026-08-17T07:21:22.482Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1802gitlab # [ 205.440137] gitaly[891]: time="2026-08-17T07:21:22.548Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBSNR40C64K2XPXGM5MG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.542" grpc.time_ms=6.399 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1803gitlab # [ 205.441436] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 641804gitlab # Enumerating objects: 5, done.1805gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1806gitlab # Delta compression using up to 4 threads1807gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1808gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1809gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1810gitlab # [ 205.586608] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2081811gitlab # [ 205.587771] nixbot[2669]: {"ts": "2026-08-17T07:21:22.696Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1812gitlab # [ 205.591058] nixbot[2669]: {"ts": "2026-08-17T07:21:22.699Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1813gitlab # [ 205.699902] gitaly[891]: time="2026-08-17T07:21:22.808Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079HC1K0KH7D41Z15PKK248 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.792" grpc.time_ms=16.35 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1814gitlab # [ 205.701324] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 691815gitlab # [ 205.751984] gitaly[891]: time="2026-08-17T07:21:22.860Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-17T07:21:52.452" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-17T07:21:22.852" grpc.time_ms=7.837 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 205.764928] gitaly[891]: time="2026-08-17T07:21:22.873Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M079HBX3M939BD0W0B679G02 duration_ms=149ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1817gitlab # [ 205.787576] gitaly[891]: time="2026-08-17T07:21:22.896Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M079HBX3M939BD0W0B679G02 duration_ms=21ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1818gitlab # [ 205.788161] gitaly[891]: time="2026-08-17T07:21:22.896Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:22.723" grpc.time_ms=172.865 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1819gitlab # [ 205.825573] gitaly[891]: time="2026-08-17T07:21:22.934Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:22.933" grpc.time_ms=0.415 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1820gitlab # [ 205.832538] gitaly[891]: time="2026-08-17T07:21:22.941Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079HC4NDDDNHMS71SAJ8ZC9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.932" pid=891 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1821gitlab # [ 205.833224] gitaly[891]: time="2026-08-17T07:21:22.941Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HC4NDDDNHMS71SAJ8ZC9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.932" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1822gitlab # [ 205.834257] gitaly[891]: time="2026-08-17T07:21:22.942Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HC4NDDDNHMS71SAJ8ZC9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.932" grpc.time_ms=9.768 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1823gitlab # [ 205.835164] gitlab-workhorse[826]: time="2026-08-17T07:21:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131824gitlab # [ 205.835875] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1061825gitlab # [ 205.893293] gitaly[891]: time="2026-08-17T07:21:23.002Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:23.001" grpc.time_ms=0.38 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1826gitlab # [ 205.924769] gitaly[891]: time="2026-08-17T07:21:23.033Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:23.033" grpc.time_ms=0.35 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1827gitlab # [ 205.934408] gitaly[891]: time="2026-08-17T07:21:23.042Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079HC828522ER8RT0J5RTQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.023" pid=891 remote_ip="2001:db8:1::1" request_sha=aef3a753c2cc55e4c9bb1f665534232a9d979197 response_bytes=223 span.kind=server system=grpc1828gitlab # [ 205.934726] gitaly[891]: time="2026-08-17T07:21:23.042Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1204 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HC828522ER8RT0J5RTQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.023" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # [ 205.935448] gitlab-workhorse[826]: time="2026-08-17T07:21:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231830gitlab # [ 205.935804] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 961831gitlab # [ 205.936398] gitaly[891]: time="2026-08-17T07:21:23.043Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1204 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HC828522ER8RT0J5RTQP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.023" grpc.time_ms=19.866 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1832gitlab # [ 206.031911] gitaly[891]: time="2026-08-17T07:21:23.140Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M079HBX3M939BD0W0B679G02 duration_ms=45ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1833gitlab # [ 206.032846] gitaly[891]: time="2026-08-17T07:21:23.141Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:23.094" grpc.time_ms=46.651 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1834gitlab # [ 206.051321] gitaly[891]: time="2026-08-17T07:21:23.160Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HCD0XBQSH1FYM9R64389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.153" grpc.time_ms=6.848 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1835gitlab # [ 206.052022] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551836gitlab # [ 206.053684] gitaly[891]: time="2026-08-17T07:21:23.161Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 diskcache=63b9f4e0-878d-4d6c-aa4b-82a2b5b3ba66 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.647" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1837gitlab # [ 206.055939] gitaly[891]: time="2026-08-17T07:21:23.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=179 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=868352 command.minflt=13655 command.oublock=32 command.real_time_ms=503 command.spawn_token_fork_ms=3 command.system_time_ms=121 command.user_time_ms=58 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:22.647" grpc.time_ms=514.796 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1838gitlab # [ 206.056630] gitlab-workhorse[826]: time="2026-08-17T07:21:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521839gitlab # [ 206.057078] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5671840gitlab # To http://gitlab/root/test-flake.git1841gitlab # 281df16..fdfcc97 master -> master1842gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.83 seconds)1843gitlab: must succeed: git -C /tmp/test-flake rev-parse master1844gitlab # [ 206.102564] gitaly[891]: time="2026-08-17T07:21:23.211Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCET9TZEXX0MNP0QHD4F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.204" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1845gitlab # [ 206.102920] gitaly[891]: time="2026-08-17T07:21:23.211Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCET9TZEXX0MNP0QHD4F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.204" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1846gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1848gitlab # [ 206.121249] gitaly[891]: time="2026-08-17T07:21:23.230Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCET9TZEXX0MNP0QHD4F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.204" grpc.time_ms=25.093 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1849gitlab # [ 206.132556] gitlab-workhorse[826]: time="2026-08-17T07:21:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671850gitlab # [ 206.134170] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 721851gitlab # [ 206.181566] nixbot[2669]: INFO: ::ffff:127.0.0.1:36568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1852gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.06 seconds)1853gitlab # [ 206.187701] gitaly[891]: time="2026-08-17T07:21:23.296Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCH5S2ZP43PVWQMA8H0Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.282" pid=891 remote_ip="2001:db8:1::1" request_sha=5e1089b0f5494fb663b6854ed0dbf39b02891337 response_bytes=338 span.kind=server system=grpc1854gitlab # [ 206.195697] gitaly[891]: time="2026-08-17T07:21:23.296Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCH5S2ZP43PVWQMA8H0Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.282" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1855gitlab # [ 206.206650] gitaly[891]: time="2026-08-17T07:21:23.315Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCH5S2ZP43PVWQMA8H0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.282" grpc.time_ms=32.794 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1856gitlab # [ 206.218439] gitlab-workhorse[826]: time="2026-08-17T07:21:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381857gitlab # [ 206.220024] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 891858gitlab # [ 206.304721] gitaly[891]: time="2026-08-17T07:21:23.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HCN6TEQCCJTV9STSXBA3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.402" grpc.time_ms=9.806 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 206.310176] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 501860gitlab # [ 206.405216] gitaly[891]: time="2026-08-17T07:21:23.513Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCQGEE1GHT9N6EKF7WBR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.493" pid=891 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1861gitlab # [ 206.405489] gitaly[891]: time="2026-08-17T07:21:23.514Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCQGEE1GHT9N6EKF7WBR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.493" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1862gitlab # [ 206.406421] gitaly[891]: time="2026-08-17T07:21:23.514Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCQGEE1GHT9N6EKF7WBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:23.493" grpc.time_ms=20.592 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1863gitlab # [ 206.464021] gitlab-workhorse[826]: time="2026-08-17T07:21:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091864gitlab # [ 206.465770] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1321865gitlab # [ 206.567725] gitaly[891]: time="2026-08-17T07:21:23.676Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:21:53.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:23.675" grpc.time_ms=0.836 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 206.602904] gitaly[891]: time="2026-08-17T07:21:23.711Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-17T07:21:53.103" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:23.704" grpc.time_ms=7.072 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 206.655654] gitaly[891]: time="2026-08-17T07:21:23.764Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:21:33.054" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:23.754" grpc.time_ms=9.626 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 206.700451] gitaly[891]: time="2026-08-17T07:21:23.807Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:21:33.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:23.797" grpc.time_ms=10.031 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 206.779059] gitaly[891]: time="2026-08-17T07:21:23.887Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:21:33.186" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:23.887" grpc.time_ms=0.389 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870gitlab # [ 206.826089] gitaly[891]: time="2026-08-17T07:21:23.934Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:21:33.222" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:23.922" grpc.time_ms=11.444 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 206.879289] gitaly[891]: time="2026-08-17T07:21:23.987Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:23.986" grpc.time_ms=0.657 pid=891 span.kind=server system=grpc1872gitlab # [ 206.920897] gitaly[891]: time="2026-08-17T07:21:24.028Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:21:24.026" grpc.time_ms=0.788 pid=891 span.kind=server system=grpc1873gitlab # [ 206.945354] gitaly[891]: time="2026-08-17T07:21:24.054Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR diskcache=44478a74-71a1-4060-b763-1434a4ac1643 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:21:33.238" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:23.939" pid=891 ref=refs/keep-around/281df16484beff8653f326c0abac7309a7a3bef2 remote_ip="2001:db8:1::1" revision=281df16484beff8653f326c0abac7309a7a3bef2 span.kind=server system=grpc username=root1874gitlab # [ 206.954745] gitaly[891]: time="2026-08-17T07:21:24.054Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5320 command.oublock=8 command.real_time_ms=105 command.spawn_token_fork_ms=1 command.system_time_ms=39 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:21:33.238" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:21:23.939" grpc.time_ms=115.2 pid=891 ref=refs/keep-around/281df16484beff8653f326c0abac7309a7a3bef2 remote_ip="2001:db8:1::1" revision=281df16484beff8653f326c0abac7309a7a3bef2 span.kind=server system=grpc username=root1875gitlab # [ 206.955025] gitaly[891]: time="2026-08-17T07:21:24.059Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:21:54.059" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:24.059" grpc.time_ms=0.375 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 207.106635] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5941877gitlab # [ 207.107288] nixbot[2669]: {"ts": "2026-08-17T07:21:24.215Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}1878gitlab # [ 207.116120] nixbot[2669]: {"ts": "2026-08-17T07:21:24.224Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-281df16484be-0"}1879gitlab # [ 207.173320] systemd[1]: Started Nix Daemon.1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1881gitlab # [ 207.211727] nix-daemon[2878]: accepted connection from pid 2872, user nixbot1882gitlab # [ 207.222317] nixbot[2669]: INFO: ::ffff:127.0.0.1:36580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1884gitlab # [ 207.274408] nix-daemon[2878]: accepted connection from pid 2888, user nixbot1885gitlab # [ 207.287707] nixbot[2669]: {"ts": "2026-08-17T07:21:24.396Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-281df16484be-0", "argv0": "bwrap"}1886gitlab # [ 207.404750] nix-daemon[2878]: accepted connection from pid 2898, user nixbot1887gitlab # [ 207.454276] nix-daemon[2878]: accepted connection from pid 2908, user nixbot1888gitlab # [ 207.472574] nix-daemon[2878]: accepted connection from pid 2898, user nixbot1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1890gitlab # [ 208.265186] nixbot[2669]: INFO: ::ffff:127.0.0.1:36594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1893gitlab # [ 209.296526] nixbot[2669]: INFO: ::ffff:127.0.0.1:36598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1894gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1896gitlab # [ 210.331661] nixbot[2669]: INFO: ::ffff:127.0.0.1:36608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1897gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1898gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1899gitlab # [ 211.370699] nixbot[2669]: INFO: ::ffff:127.0.0.1:36622 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1900gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1901gitlab # [ 212.193882] nix-daemon[2878]: accepted connection from pid 2937, user nixbot1902gitlab # [ 212.237820] gitaly[891]: time="2026-08-17T07:21:29.346Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HJE4HDY4RWP0SGDQ0PSZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:21:59.344" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:29.345" grpc.time_ms=0.788 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903gitlab # [ 212.269734] gitaly[891]: time="2026-08-17T07:21:29.378Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HJE4HDY4RWP0SGDQ0PSZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:21:39.041" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:29.372" grpc.time_ms=5.89 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 212.305365] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1281905gitlab # [ 212.305943] nixbot[2669]: {"ts": "2026-08-17T07:21:29.414Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}1906gitlab # [ 212.349690] gitaly[891]: time="2026-08-17T07:21:29.458Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HJJEKRAVABYMQGBZJARG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:21:59.457" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:29.457" grpc.time_ms=0.673 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1908gitlab # [ 212.394708] nixbot[2669]: INFO: ::ffff:127.0.0.1:36638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.02 seconds)1910gitlab # [ 212.420257] gitaly[891]: time="2026-08-17T07:21:29.528Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HJJEKRAVABYMQGBZJARG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:21:39.189" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:29.520" grpc.time_ms=8.208 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 212.487457] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1721912gitlab # [ 212.493428] nixbot[2669]: {"ts": "2026-08-17T07:21:29.602Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1914gitlab # [ 213.431937] nixbot[2669]: INFO: ::ffff:127.0.0.1:55480 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1917gitlab # [ 214.471068] nixbot[2669]: INFO: ::ffff:127.0.0.1:55482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1920gitlab # [ 215.510190] nixbot[2669]: INFO: ::ffff:127.0.0.1:55498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1923gitlab # [ 216.547561] nixbot[2669]: INFO: ::ffff:127.0.0.1:55500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1924gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1925gitlab # [ 216.949883] nix-daemon[2878]: accepted connection from pid 2981, user nixbot1926gitlab # [ 217.026714] gitaly[891]: time="2026-08-17T07:21:34.134Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HQ48BB58VVSH5AK52NAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:04.032" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:21:34.133" grpc.time_ms=0.78 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 217.190491] gitaly[891]: time="2026-08-17T07:21:34.299Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HQ48BB58VVSH5AK52NAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:21:44.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:21:34.287" grpc.time_ms=11.27 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 217.271789] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2911929gitlab # [ 217.277991] nixbot[2669]: {"ts": "2026-08-17T07:21:34.381Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}1930gitlab # [ 217.348285] nix-daemon[2878]: accepted connection from pid 2996, user nixbot1931gitlab # [ 217.460818] gitaly[891]: time="2026-08-17T07:21:34.569Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HQHKN2JXDKX4S2N1J5M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:34.557" grpc.time_ms=11.804 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1932gitlab # [ 217.489831] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 821933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1934gitlab # [ 217.547074] gitaly[891]: time="2026-08-17T07:21:34.655Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079HQMC7QJ4XGH58C152TRQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:34.644" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1935gitlab # [ 217.547324] gitaly[891]: time="2026-08-17T07:21:34.655Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HQMC7QJ4XGH58C152TRQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:34.644" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1936gitlab # [ 217.595724] gitaly[891]: time="2026-08-17T07:21:34.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HQMC7QJ4XGH58C152TRQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:21:34.644" grpc.time_ms=58.573 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 217.612084] gitlab-workhorse[826]: time="2026-08-17T07:21:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671938gitlab # [ 217.613740] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:21:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1161939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.06 seconds)1940gitlab # [ 217.615709] nixbot[2669]: INFO: ::ffff:127.0.0.1:55504 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1941gitlab # [ 217.689906] nix-daemon[2878]: accepted connection from pid 3024, user nixbot1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1943gitlab # [ 218.650219] nixbot[2669]: INFO: ::ffff:127.0.0.1:55508 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1944gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1946gitlab # [ 219.686233] nixbot[2669]: INFO: ::ffff:127.0.0.1:55514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1949gitlab # [ 220.712599] nixbot[2669]: INFO: ::ffff:127.0.0.1:55524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1952gitlab # [ 221.747242] nixbot[2669]: INFO: ::ffff:127.0.0.1:55530 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1955gitlab # [ 222.773694] nixbot[2669]: INFO: ::ffff:127.0.0.1:55532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.02 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1958gitlab # [ 223.798219] nixbot[2669]: INFO: ::ffff:127.0.0.1:47768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.02 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1961gitlab # [ 224.822919] nixbot[2669]: INFO: ::ffff:127.0.0.1:47778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.02 seconds)1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1964gitlab # [ 225.859830] nixbot[2669]: INFO: ::ffff:127.0.0.1:47790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1967gitlab # [ 226.896208] nixbot[2669]: INFO: ::ffff:127.0.0.1:47802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1970gitlab # [ 227.932967] nixbot[2669]: INFO: ::ffff:127.0.0.1:47808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1973gitlab # [ 228.970460] nixbot[2669]: INFO: ::ffff:127.0.0.1:47824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1976gitlab # [ 229.985445] sidekiq-cluster[2621]: 2026-08-17T07:21:47.093Z pid=2621 tid=xat INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2621, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433876992}1977gitlab # [ 230.002205] nixbot[2669]: INFO: ::ffff:127.0.0.1:47830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1979gitlab # [ 230.189428] sidekiq-cluster[2621]: W, [2026-08-17T07:21:47.297906 #2621] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1980gitlab # [ 230.229951] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:21:47.338Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1982gitlab # [ 231.043419] nixbot[2669]: INFO: ::ffff:127.0.0.1:47842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1986gitlab # [ 232.082882] nixbot[2669]: INFO: ::ffff:127.0.0.1:47854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1987gitlab # [ 232.306263] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:21:49.413Z","message":"GitLab reliable fetch activated!"}1988gitlab # [ 232.306901] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:21:49.414Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1990gitlab # [ 233.119557] nixbot[2669]: INFO: ::ffff:127.0.0.1:37064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1993gitlab # [ 234.155481] nixbot[2669]: INFO: ::ffff:127.0.0.1:37078 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1996gitlab # [ 235.191516] nixbot[2669]: INFO: ::ffff:127.0.0.1:37090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'1999gitlab # [ 236.216844] nixbot[2669]: INFO: ::ffff:127.0.0.1:37094 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.02 seconds)2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2002gitlab # [ 237.252371] nixbot[2669]: INFO: ::ffff:127.0.0.1:37108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2005gitlab # [ 238.289653] nixbot[2669]: INFO: ::ffff:127.0.0.1:37118 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2008gitlab # [ 239.325436] nixbot[2669]: INFO: ::ffff:127.0.0.1:37124 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2011gitlab # [ 240.361942] nixbot[2669]: INFO: ::ffff:127.0.0.1:37126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2014gitlab # [ 241.397833] nixbot[2669]: INFO: ::ffff:127.0.0.1:37134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2017gitlab # [ 242.433454] nixbot[2669]: INFO: ::ffff:127.0.0.1:37148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.03 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2020gitlab # [ 243.469174] nixbot[2669]: INFO: ::ffff:127.0.0.1:48270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2023gitlab # [ 244.505289] nixbot[2669]: INFO: ::ffff:127.0.0.1:48278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2026gitlab # [ 245.541962] nixbot[2669]: INFO: ::ffff:127.0.0.1:48294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2029gitlab # [ 246.578616] nixbot[2669]: INFO: ::ffff:127.0.0.1:48300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2032gitlab # [ 247.615400] nixbot[2669]: INFO: ::ffff:127.0.0.1:48306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2035gitlab # [ 248.652198] nixbot[2669]: INFO: ::ffff:127.0.0.1:48320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2038gitlab # [ 249.689728] nixbot[2669]: INFO: ::ffff:127.0.0.1:48322 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2041gitlab # [ 250.726620] nixbot[2669]: INFO: ::ffff:127.0.0.1:48336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2044gitlab # [ 251.763842] nixbot[2669]: INFO: ::ffff:127.0.0.1:48350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2047gitlab # [ 252.804201] nixbot[2669]: INFO: ::ffff:127.0.0.1:48364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2049gitlab # [ 253.267495] postgres[3149]: [3149] ERROR: relation "table_without_models" does not exist2050gitlab # [ 253.267895] postgres[3149]: [3149] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2052gitlab # [ 253.843561] nixbot[2669]: INFO: ::ffff:127.0.0.1:43280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2054gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2055gitlab # [ 254.879927] nixbot[2669]: INFO: ::ffff:127.0.0.1:43292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2057gitlab # [ 255.731719] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:12.840Z","message":"Booted Rails 7.2.3.1 application in production environment"}2058gitlab # [ 255.734161] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:12.842Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2059gitlab # [ 255.737183] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:12.842Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2060gitlab # [ 255.738705] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:12.842Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2061gitlab # [ 255.740445] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:12.845Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2063gitlab # [ 255.917627] nixbot[2669]: INFO: ::ffff:127.0.0.1:43298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2066gitlab # [ 256.956300] nixbot[2669]: INFO: ::ffff:127.0.0.1:43302 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2068gitlab # [ 257.744643] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:14.852Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5b5d458bdabaa991c8a46291","created_at":"2026-08-17T07:21:17.654Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:17.691Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5b5d458bdabaa991c8a46291: start","job_status":"start","queue_duration_s":57.160865,"scheduling_latency_s":57.16092}2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2070gitlab # [ 257.905867] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.014Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5b5d458bdabaa991c8a46291","created_at":"2026-08-17T07:21:17.654Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:17.691Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5b5d458bdabaa991c8a46291: done: 0.162013 sec","job_status":"done","queue_duration_s":57.160865,"scheduling_latency_s":57.16092,"redis_calls":24,"redis_duration_s":0.005822,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.003119,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.088970246,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.162013,"completed_at":"2026-08-17T07:22:15.014Z","load_balancing_strategy":"primary","db_duration_s":0.059919,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 257.982578] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.015Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"3bd7812e53dcd9246b38354c","created_at":"2026-08-17T07:21:17.700Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:17.704Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-3bd7812e53dcd9246b38354c: start","job_status":"start","queue_duration_s":57.311258,"scheduling_latency_s":57.311275}2072gitlab # [ 257.994252] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.102Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"3bd7812e53dcd9246b38354c","created_at":"2026-08-17T07:21:17.700Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:17.704Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-3bd7812e53dcd9246b38354c: done: 0.086926 sec","job_status":"done","queue_duration_s":57.311258,"scheduling_latency_s":57.311275,"redis_calls":14,"redis_duration_s":0.003528,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001546,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001242,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06785387600000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.086926,"completed_at":"2026-08-17T07:22:15.102Z","load_balancing_strategy":"primary","db_duration_s":0.024148,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2073gitlab # [ 257.997114] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.105Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3b6ea482add1b53bc156fbd5","created_at":"2026-08-17T07:21:18.140Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:18.146Z","job_size_bytes":5,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3b6ea482add1b53bc156fbd5: start","job_status":"start","queue_duration_s":56.959565,"scheduling_latency_s":56.959583}2074gitlab # [ 258.011300] nixbot[2669]: INFO: ::ffff:127.0.0.1:43312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.09 seconds)2076gitlab # [ 258.138956] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.247Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3b6ea482add1b53bc156fbd5","created_at":"2026-08-17T07:21:18.140Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:18.146Z","job_size_bytes":5,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3b6ea482add1b53bc156fbd5: done: 0.141641 sec","job_status":"done","queue_duration_s":56.959565,"scheduling_latency_s":56.959583,"redis_calls":12,"redis_duration_s":0.0056949999999999995,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001481,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003326,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048861,"duration_s":0.141641,"completed_at":"2026-08-17T07:22:15.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027789,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2077gitlab # [ 258.205631] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.313Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"19cabeb40febc77c745e423e","created_at":"2026-08-17T07:21:18.167Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:18.171Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-19cabeb40febc77c745e423e: start","job_status":"start","queue_duration_s":57.142636,"scheduling_latency_s":57.142691}2078gitlab # [ 258.445381] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.553Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"19cabeb40febc77c745e423e","created_at":"2026-08-17T07:21:18.167Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:18.171Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-19cabeb40febc77c745e423e: done: 0.240119 sec","job_status":"done","queue_duration_s":57.142636,"scheduling_latency_s":57.142691,"redis_calls":11,"redis_duration_s":0.003376,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000993,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.188,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.188,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.153027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333003,"duration_s":0.240119,"completed_at":"2026-08-17T07:22:15.553Z","load_balancing_strategy":"primary","db_duration_s":0.081824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 258.523125] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.631Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"73ae061636c3688c9f3b7559","created_at":"2026-08-17T07:21:18.173Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:18.176Z","job_size_bytes":89,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-73ae061636c3688c9f3b7559: start","job_status":"start","queue_duration_s":57.45481,"scheduling_latency_s":57.454846}2080gitlab # [ 258.589812] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.697Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"73ae061636c3688c9f3b7559","created_at":"2026-08-17T07:21:18.173Z","trace_propagation_headers":{"sentry-trace":"272f4dd1cf9a46e9aad3351ad9099967-6cfcea28e8194243","baggage":"sentry-trace_id=272f4dd1cf9a46e9aad3351ad9099967,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H5QP3MXZNWD78PR1XJ76","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:18.176Z","job_size_bytes":89,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-73ae061636c3688c9f3b7559: done: 0.066813 sec","job_status":"done","queue_duration_s":57.45481,"scheduling_latency_s":57.454846,"redis_calls":11,"redis_duration_s":0.003303,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000932,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000450058,"duration_s":0.066813,"completed_at":"2026-08-17T07:22:15.697Z","load_balancing_strategy":"primary","db_duration_s":0.007118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 258.591597] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.700Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 281df16484beff8653f326c0abac7309a7a3bef2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a0ac608256e51ebb10be1e84","created_at":"2026-08-17T07:21:19.710Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-77cf5cb7f4de4794","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:19.713Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a0ac608256e51ebb10be1e84: start","job_status":"start","queue_duration_s":55.986013,"scheduling_latency_s":55.986041}2082gitlab # [ 258.679402] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:15.787Z","message":"changes: \"0000000000000000000000000000000000000000 281df16484beff8653f326c0abac7309a7a3bef2 refs/heads/master\\n\""}2083gitlab # [ 258.740558] gitaly[891]: time="2026-08-17T07:22:15.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:25.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:15.836" grpc.time_ms=11.584 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 258.779430] gitaly[891]: time="2026-08-17T07:22:15.888Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:22:25.046" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:15.876" grpc.time_ms=11.194 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 258.859249] gitaly[891]: time="2026-08-17T07:22:15.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-17T07:22:25.123" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:15.953" grpc.time_ms=13.934 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 258.923537] gitaly[891]: time="2026-08-17T07:22:16.032Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:16.029" grpc.time_ms=2.204 pid=891 span.kind=server system=grpc2087gitlab # [ 258.987796] gitaly[891]: time="2026-08-17T07:22:16.096Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:16.095" grpc.time_ms=0.693 pid=891 span.kind=server system=grpc2088gitlab # [ 259.023612] gitaly[891]: time="2026-08-17T07:22:16.132Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K diskcache=584e2774-8f17-459c-8777-c34d2cf91010 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:22:25.156" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:15.986" pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2089gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2090gitlab # [ 259.024270] gitaly[891]: time="2026-08-17T07:22:16.132Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5127 command.oublock=8 command.real_time_ms=133 command.spawn_token_fork_ms=0 command.system_time_ms=72 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:22:25.156" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:15.986" grpc.time_ms=145.857 pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2091gitlab # [ 259.048671] gitaly[891]: time="2026-08-17T07:22:16.157Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-17T07:22:26.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:16.156" grpc.time_ms=0.237 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 259.068523] gitaly[891]: time="2026-08-17T07:22:16.177Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=945 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-17T07:22:26.011" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:16.161" grpc.time_ms=15.091 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 259.088862] nixbot[2669]: INFO: ::ffff:127.0.0.1:43326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2095gitlab # [ 259.183985] gitaly[891]: time="2026-08-17T07:22:16.292Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-17T07:22:46.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:16.283" grpc.time_ms=9.168 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 259.224752] gitaly[891]: time="2026-08-17T07:22:16.333Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:22:26.182" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:16.332" grpc.time_ms=0.441 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 259.248357] gitaly[891]: time="2026-08-17T07:22:16.344Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-17T07:22:26.186" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-17T07:22:16.336" grpc.time_ms=7.897 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 259.267642] gitaly[891]: time="2026-08-17T07:22:16.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:26.214" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:16.365" grpc.time_ms=10.784 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 259.295383] gitaly[891]: time="2026-08-17T07:22:16.403Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:26.242" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:16.393" grpc.time_ms=10.721 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 259.327205] gitaly[891]: time="2026-08-17T07:22:16.435Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-17T07:22:46.221" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:16.422" grpc.time_ms=13.524 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 259.785061] gitaly[891]: time="2026-08-17T07:22:16.892Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-17T07:22:26.060" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:16.890" grpc.time_ms=1.874 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 259.843539] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:16.950Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 281df16484beff8653f326c0abac7309a7a3bef2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a0ac608256e51ebb10be1e84","created_at":"2026-08-17T07:21:19.710Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-77cf5cb7f4de4794","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:19.713Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a0ac608256e51ebb10be1e84: done: 1.250782 sec","job_status":"done","queue_duration_s":55.986013,"scheduling_latency_s":55.986041,"gitaly_calls":13,"gitaly_duration_s":0.340178,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.066844,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.005744,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007826,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002029,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004185,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.024114,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.022946,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.131,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.189,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.226,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.131,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.70774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001159645,"exclusive_lock_hold_duration_s":0.042643688,"duration_s":1.250782,"completed_at":"2026-08-17T07:22:16.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.174288,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2103gitlab # [ 259.880186] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:16.953Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","281df16484beff8653f326c0abac7309a7a3bef2 fdfcc97151300453f4ebee748e14afb9e6dc3ca3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d7e236fe731cf8430c4be2b5","created_at":"2026-08-17T07:21:23.125Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-42646b459823478b","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:23.127Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d7e236fe731cf8430c4be2b5: start","job_status":"start","queue_duration_s":53.825917,"scheduling_latency_s":53.825946}2104gitlab # [ 259.881120] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:16.969Z","message":"changes: \"281df16484beff8653f326c0abac7309a7a3bef2 fdfcc97151300453f4ebee748e14afb9e6dc3ca3 refs/heads/master\\n\""}2105gitlab # [ 259.889201] gitaly[891]: time="2026-08-17T07:22:16.997Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:26.157" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:16.987" grpc.time_ms=10.022 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 259.924756] gitaly[891]: time="2026-08-17T07:22:17.033Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-17T07:22:27.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:17.023" grpc.time_ms=9.956 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 259.933242] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.041Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"13d7163746438443dabc641d","created_at":"2026-08-17T07:22:17.038Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"3b0dfff310df69c1a92ada75","job_size_bytes":46,"pid":2621,"job_status":"deduplicated","message":"ProjectCacheWorker JID-13d7163746438443dabc641d: deduplicated: until executing","deduplication.type":"until executing"}2108gitlab # [ 259.959839] gitaly[891]: time="2026-08-17T07:22:17.068Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-17T07:22:27.039" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:17.059" grpc.time_ms=8.754 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 259.973879] gitaly[891]: time="2026-08-17T07:22:17.082Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-17T07:22:47.072" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:17.073" grpc.time_ms=9.133 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 259.989851] gitaly[891]: time="2026-08-17T07:22:17.098Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-17T07:22:27.074" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-17T07:22:17.095" grpc.time_ms=3.449 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 260.000654] gitaly[891]: time="2026-08-17T07:22:17.109Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:27.084" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:17.104" grpc.time_ms=4.801 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 260.067691] gitaly[891]: time="2026-08-17T07:22:17.176Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-17T07:22:27.024" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:17.175" grpc.time_ms=1.065 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2114gitlab # [ 260.108859] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.216Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","281df16484beff8653f326c0abac7309a7a3bef2 fdfcc97151300453f4ebee748e14afb9e6dc3ca3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d7e236fe731cf8430c4be2b5","created_at":"2026-08-17T07:21:23.125Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-42646b459823478b","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-17T07:21:23.127Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d7e236fe731cf8430c4be2b5: done: 0.26295 sec","job_status":"done","queue_duration_s":53.825917,"scheduling_latency_s":53.825946,"gitaly_calls":7,"gitaly_duration_s":0.097755,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.022206,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.002161,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001009,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003854,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007821,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007361,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.019,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000532749,"exclusive_lock_hold_duration_s":0.039716221,"duration_s":0.26295,"completed_at":"2026-08-17T07:22:17.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022305,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2115gitlab # [ 260.153529] nixbot[2669]: INFO: ::ffff:127.0.0.1:43338 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2116gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.07 seconds)2117gitlab # [ 260.161072] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.269Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"557d2fc9088d0ae5a16c9e57","created_at":"2026-08-17T07:21:24.064Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.075Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-557d2fc9088d0ae5a16c9e57: start","job_status":"start","queue_duration_s":53.19349,"scheduling_latency_s":53.193541}2118gitlab # [ 260.283664] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.391Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"557d2fc9088d0ae5a16c9e57","created_at":"2026-08-17T07:21:24.064Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.075Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-557d2fc9088d0ae5a16c9e57: done: 0.122447 sec","job_status":"done","queue_duration_s":53.19349,"scheduling_latency_s":53.193541,"redis_calls":16,"redis_duration_s":0.004826,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002356,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000581359,"duration_s":0.122447,"completed_at":"2026-08-17T07:22:17.391Z","load_balancing_strategy":"primary","db_duration_s":0.025618,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab # [ 260.285935] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.394Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"358bc2870e15ce10ef06203c","created_at":"2026-08-17T07:21:24.076Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.081Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-358bc2870e15ce10ef06203c: start","job_status":"start","queue_duration_s":53.312881,"scheduling_latency_s":53.312918}2120gitlab # [ 260.399925] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.508Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"358bc2870e15ce10ef06203c","created_at":"2026-08-17T07:21:24.076Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.081Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-358bc2870e15ce10ef06203c: done: 0.11394 sec","job_status":"done","queue_duration_s":53.312881,"scheduling_latency_s":53.312918,"redis_calls":21,"redis_duration_s":0.006519,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003279,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00152,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000307023,"duration_s":0.11394,"completed_at":"2026-08-17T07:22:17.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2121gitlab # [ 260.401779] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.509Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"73d808ac8f528cee92ea10f1","created_at":"2026-08-17T07:21:24.180Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.190Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-73d808ac8f528cee92ea10f1: start","job_status":"start","queue_duration_s":53.318738,"scheduling_latency_s":53.318753}2122gitlab # [ 260.534506] gitaly[891]: time="2026-08-17T07:22:17.643Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:17.642" grpc.time_ms=0.303 pid=891 span.kind=server system=grpc2123gitlab # [ 260.593331] gitaly[891]: time="2026-08-17T07:22:17.701Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:17.701" grpc.time_ms=0.296 pid=891 span.kind=server system=grpc2124gitlab # [ 260.644832] gitaly[891]: time="2026-08-17T07:22:17.753Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:17.752" grpc.time_ms=0.745 pid=891 span.kind=server system=grpc2125gitlab # [ 260.674904] gitaly[891]: time="2026-08-17T07:22:17.783Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR diskcache=dd831d64-9945-4db5-a084-90aa4436a82c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:47.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:17.612" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 260.675952] gitaly[891]: time="2026-08-17T07:22:17.784Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7195 command.oublock=0 command.real_time_ms=161 command.spawn_token_fork_ms=0 command.system_time_ms=75 command.user_time_ms=57 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:47.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:17.612" grpc.time_ms=171.465 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 260.802400] gitaly[891]: time="2026-08-17T07:22:17.910Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:47.708" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:17.909" grpc.time_ms=1.379 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 260.856772] gitaly[891]: time="2026-08-17T07:22:17.965Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:47.763" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:17.964" grpc.time_ms=1.125 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 260.877534] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.984Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"73d808ac8f528cee92ea10f1","created_at":"2026-08-17T07:21:24.180Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.190Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-73d808ac8f528cee92ea10f1: rescheduled"}2130gitlab # [ 260.891596] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:17.999Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"73d808ac8f528cee92ea10f1","created_at":"2026-08-17T07:21:24.180Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-c9682aaf022949bb","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:21:24.190Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-73d808ac8f528cee92ea10f1: done: 0.490016 sec","job_status":"done","queue_duration_s":53.318738,"scheduling_latency_s":53.318753,"gitaly_calls":3,"gitaly_duration_s":0.183829,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.03201,"redis_read_bytes":462,"redis_write_bytes":29294,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001341,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001889,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010778,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005234,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15581,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007652,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000614,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000742,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002419,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.023,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.20954,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.429685337,"duration_s":0.490016,"completed_at":"2026-08-17T07:22:17.999Z","load_balancing_strategy":"primary","db_duration_s":0.075489,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 260.947664] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.002Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3b0dfff310df69c1a92ada75","created_at":"2026-08-17T07:22:15.893Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:15.921Z","job_size_bytes":46,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-3b0dfff310df69c1a92ada75: start","job_status":"start","queue_duration_s":2.080559,"scheduling_latency_s":2.080594}2132gitlab # [ 260.948253] gitaly[891]: time="2026-08-17T07:22:18.048Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-17T13:22:18.042" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:18.043" grpc.time_ms=4.962 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 260.995583] gitaly[891]: time="2026-08-17T07:22:18.104Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-17T07:22:48.094" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.094" grpc.time_ms=9.155 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 261.030267] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.138Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3b0dfff310df69c1a92ada75","created_at":"2026-08-17T07:22:15.893Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:15.921Z","job_size_bytes":46,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-3b0dfff310df69c1a92ada75: done: 0.136558 sec","job_status":"done","queue_duration_s":2.080559,"scheduling_latency_s":2.080594,"gitaly_calls":2,"gitaly_duration_s":0.067094,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007681,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001491,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000575,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001804,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002896,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000278527,"duration_s":0.136558,"completed_at":"2026-08-17T07:22:18.138Z","load_balancing_strategy":"primary","db_duration_s":0.013901,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2135gitlab # [ 261.049158] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.140Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ab45a1291eb53b89b2aa1577","created_at":"2026-08-17T07:22:15.942Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:15.947Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ab45a1291eb53b89b2aa1577: start","job_status":"start","queue_duration_s":2.192336,"scheduling_latency_s":2.192353}2136gitlab # [ 261.113699] gitaly[891]: time="2026-08-17T07:22:18.222Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K diskcache=fc01689f-21f8-418a-be8f-7ed11f202b1a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:22:18.192" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.193" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 261.114160] gitaly[891]: time="2026-08-17T07:22:18.222Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:22:18.192" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.193" grpc.time_ms=28.996 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2139gitlab # [ 261.169823] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.277Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ab45a1291eb53b89b2aa1577","created_at":"2026-08-17T07:22:15.942Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:15.947Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ab45a1291eb53b89b2aa1577: done: 0.137684 sec","job_status":"done","queue_duration_s":2.192336,"scheduling_latency_s":2.192353,"gitaly_calls":1,"gitaly_duration_s":0.0325,"redis_calls":15,"redis_duration_s":0.037605,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.033898,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.029,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.113660536,"duration_s":0.137684,"completed_at":"2026-08-17T07:22:18.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2140gitlab # [ 261.171983] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.280Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9e30d871713575d058f3c67c","created_at":"2026-08-17T07:22:16.150Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:16.153Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9e30d871713575d058f3c67c: start","job_status":"start","queue_duration_s":2.127133,"scheduling_latency_s":2.127169}2141gitlab # [ 261.218067] gitaly[891]: time="2026-08-17T07:22:18.326Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=657 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-17T07:22:48.114" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.315" grpc.time_ms=11.347 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 261.226183] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.334Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9e30d871713575d058f3c67c","created_at":"2026-08-17T07:22:16.150Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:16.153Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9e30d871713575d058f3c67c: done: 0.054334 sec","job_status":"done","queue_duration_s":2.127133,"scheduling_latency_s":2.127169,"gitaly_calls":1,"gitaly_duration_s":0.014193,"redis_calls":16,"redis_duration_s":0.004591,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000284,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002149,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054334,"completed_at":"2026-08-17T07:22:18.334Z","load_balancing_strategy":"primary","db_duration_s":0.003914,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2143gitlab # [ 261.238290] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:18.336Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0291d9404ca1a59d947fb2e7","created_at":"2026-08-17T07:22:16.697Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2181aa4850665d6455564650f8413a2c166a9a23ef4116ff4e9aba14fbb02180","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:16.702Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0291d9404ca1a59d947fb2e7: start","job_status":"start","queue_duration_s":1.633295,"scheduling_latency_s":1.633316}2144gitlab # [ 261.284780] gitaly[891]: time="2026-08-17T07:22:18.358Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:48.156" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.357" grpc.time_ms=0.834 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 261.285475] gitaly[891]: time="2026-08-17T07:22:18.371Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:22:28.210" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:18.360" grpc.time_ms=10.122 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 261.329813] nixbot[2669]: INFO: ::ffff:127.0.0.1:43354 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2147gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.18 seconds)2148gitlab # [ 261.373983] gitaly[891]: time="2026-08-17T07:22:18.482Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:48.281" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.481" grpc.time_ms=1.092 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 261.400152] gitaly[891]: time="2026-08-17T07:22:18.508Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=25 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-17T07:22:48.306" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:18.506" grpc.time_ms=2.284 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 261.510483] gitaly[891]: time="2026-08-17T07:22:18.619Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:28.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:18.607" grpc.time_ms=11.355 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab # [ 261.970258] gitaly[891]: time="2026-08-17T07:22:19.078Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-17T07:22:49.058" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.058" grpc.time_ms=19.359 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 262.020725] gitaly[891]: time="2026-08-17T07:22:19.129Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079H8K8W0SJXHSXZEAN591K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-17T07:22:49.112" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.113" grpc.time_ms=15.646 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 262.045718] sidekiq-cluster[2621]: {"severity":"WARN","time":"2026-08-17T07:22:19.153Z","class":"CreatePipelineWorker","correlation_id":"01M079H8K8W0SJXHSXZEAN591K","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"281df16484beff8653f326c0abac7309a7a3bef2","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"281df16484beff8653f326c0abac7309a7a3bef2","ref":"refs/heads/master"},"retry":0}2154gitlab # [ 262.050433] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:19.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0291d9404ca1a59d947fb2e7","created_at":"2026-08-17T07:22:16.697Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2181aa4850665d6455564650f8413a2c166a9a23ef4116ff4e9aba14fbb02180","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:16.702Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0291d9404ca1a59d947fb2e7: done: 0.822876 sec","job_status":"done","queue_duration_s":1.633295,"scheduling_latency_s":1.633316,"gitaly_calls":7,"gitaly_duration_s":0.114611,"redis_calls":51,"redis_duration_s":0.015914,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.0009,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.009835,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002853,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.623631,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302273,"duration_s":0.822876,"completed_at":"2026-08-17T07:22:19.158Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054202,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2155gitlab # [ 262.090704] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:19.160Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"901e1207-beba-4036-a016-540db57261b6\"}"],"class":"WebHookWorker","jid":"23f4b6affa736dd782d59761","created_at":"2026-08-17T07:22:16.864Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a06d8519fdc625a3cd7c1ff1a8eea766e1205d60edde44f0d8a15f154ef25840","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:16.870Z","job_size_bytes":1751,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-23f4b6affa736dd782d59761: start","job_status":"start","queue_duration_s":2.289728,"scheduling_latency_s":2.289745}2156gitlab # [ 262.172510] nixbot[2669]: INFO: ::ffff:127.0.0.1:43370 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2157gitlab # [ 262.186479] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:19.294Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"901e1207-beba-4036-a016-540db57261b6\"}"],"class":"WebHookWorker","jid":"23f4b6affa736dd782d59761","created_at":"2026-08-17T07:22:16.864Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-f04b7e1cfde34105","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a06d8519fdc625a3cd7c1ff1a8eea766e1205d60edde44f0d8a15f154ef25840","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:16.870Z","job_size_bytes":1751,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-23f4b6affa736dd782d59761: done: 0.134455 sec","job_status":"done","queue_duration_s":2.289728,"scheduling_latency_s":2.289745,"redis_calls":19,"redis_duration_s":0.00351,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000258,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03374981999996862,"cpu_s":0.087301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222374,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.134455,"completed_at":"2026-08-17T07:22:19.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2158gitlab # [ 262.248937] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:19.357Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c8ef723b11d47579048d26b6","created_at":"2026-08-17T07:22:17.049Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ab45a1291eb53b89b2aa1577","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.053Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c8ef723b11d47579048d26b6: start","job_status":"start","queue_duration_s":2.304196,"scheduling_latency_s":2.304227}2159gitlab # [ 262.279984] gitaly[891]: time="2026-08-17T07:22:19.388Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 diskcache=d0d0d055-4b9c-4492-a22f-390e1e287eef grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:22:19.372" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.373" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 262.288420] gitaly[891]: time="2026-08-17T07:22:19.388Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T13:22:19.372" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.373" grpc.time_ms=15.203 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2162gitlab # [ 262.302258] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:19.410Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c8ef723b11d47579048d26b6","created_at":"2026-08-17T07:22:17.049Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ab45a1291eb53b89b2aa1577","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.053Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c8ef723b11d47579048d26b6: done: 0.05346 sec","job_status":"done","queue_duration_s":2.304196,"scheduling_latency_s":2.304227,"gitaly_calls":1,"gitaly_duration_s":0.017848,"redis_calls":12,"redis_duration_s":0.002916,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000682,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.037140196,"duration_s":0.05346,"completed_at":"2026-08-17T07:22:19.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 262.303677] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:19.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c841dd966a8f461bbb7d2dc4","created_at":"2026-08-17T07:22:17.152Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:988e5cabc6c27d0ab7b9b255d4734d1a496ebf1ef829036d4b71fe799da1e2ce","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.154Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c841dd966a8f461bbb7d2dc4: start","job_status":"start","queue_duration_s":2.257839,"scheduling_latency_s":2.257855}2164gitlab # [ 262.352464] gitaly[891]: time="2026-08-17T07:22:19.461Z" level=info msg="finished unary call with code OK" catfile.duration_ms=21 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=21 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:49.228" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.429" grpc.time_ms=21.769 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 262.360457] gitaly[891]: time="2026-08-17T07:22:19.469Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:22:29.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:19.463" grpc.time_ms=5.941 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 262.368806] nixbot[2669]: INFO: ::ffff:127.0.0.1:43382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2167gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2168gitlab # [ 262.404443] gitaly[891]: time="2026-08-17T07:22:19.513Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:49.512" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.512" grpc.time_ms=0.715 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 262.415671] gitaly[891]: time="2026-08-17T07:22:19.524Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079K39J9J24PMFMH0R93A3R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:19.518" grpc.time_ms=6.23 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2170gitlab # [ 262.416792] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2102171gitlab # [ 262.429958] gitaly[891]: time="2026-08-17T07:22:19.538Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-17T07:22:49.536" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.537" grpc.time_ms=1.559 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 262.454147] gitaly[891]: time="2026-08-17T07:22:19.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:29.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:19.556" grpc.time_ms=6.217 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 262.466324] gitaly[891]: time="2026-08-17T07:22:19.575Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079K3G74ZCDTQ0V3CDZE93Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:19.568" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2174gitlab # [ 262.474659] gitaly[891]: time="2026-08-17T07:22:19.575Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079K3G74ZCDTQ0V3CDZE93Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:19.568" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2175gitlab # [ 262.485303] gitlab-workhorse[826]: time="2026-08-17T07:22:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672176gitlab # [ 262.485574] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 482177gitlab # [ 262.486078] gitaly[891]: time="2026-08-17T07:22:19.575Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079K3G74ZCDTQ0V3CDZE93Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:19.568" grpc.time_ms=6.558 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2178gitlab # [ 262.504691] nixbot[2669]: {"ts": "2026-08-17T07:22:19.613Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2179gitlab # [ 262.572605] gitaly[891]: time="2026-08-17T07:22:19.681Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K3K820R3VXNZJCYG46RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:49.280" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.680" grpc.time_ms=0.578 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 262.678823] gitaly[891]: time="2026-08-17T07:22:19.787Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079K3K820R3VXNZJCYG46RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:29.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:19.776" grpc.time_ms=11.28 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 262.760578] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2432182gitlab # [ 262.766179] nixbot[2669]: {"ts": "2026-08-17T07:22:19.870Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}2183gitlab # [ 262.848103] gitaly[891]: time="2026-08-17T07:22:19.956Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K3V06Y043K8E6PK8SQBK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:49.354" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.955" grpc.time_ms=0.94 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 262.879681] gitaly[891]: time="2026-08-17T07:22:19.988Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-17T07:22:49.069" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:19.970" grpc.time_ms=18.026 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 262.906629] gitaly[891]: time="2026-08-17T07:22:20.015Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M079HBX3M939BD0W0B679G02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-17T07:22:49.100" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:20.000" grpc.time_ms=14.563 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 262.923073] sidekiq-cluster[2621]: {"severity":"WARN","time":"2026-08-17T07:22:20.031Z","class":"CreatePipelineWorker","correlation_id":"01M079HBX3M939BD0W0B679G02","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"281df16484beff8653f326c0abac7309a7a3bef2","after":"fdfcc97151300453f4ebee748e14afb9e6dc3ca3","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"fdfcc97151300453f4ebee748e14afb9e6dc3ca3","ref":"refs/heads/master"},"retry":0}2187gitlab # [ 262.934414] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c841dd966a8f461bbb7d2dc4","created_at":"2026-08-17T07:22:17.152Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:988e5cabc6c27d0ab7b9b255d4734d1a496ebf1ef829036d4b71fe799da1e2ce","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.154Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c841dd966a8f461bbb7d2dc4: done: 0.630528 sec","job_status":"done","queue_duration_s":2.257839,"scheduling_latency_s":2.257855,"gitaly_calls":7,"gitaly_duration_s":0.125569,"redis_calls":33,"redis_duration_s":0.009235,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000443,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002083,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.467221,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.630528,"completed_at":"2026-08-17T07:22:20.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027621,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2188gitlab # [ 262.953834] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.044Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e317dbb2-73c6-445e-9d9a-ebeb206e8a88\"}"],"class":"WebHookWorker","jid":"c57154c0ed19e1323cbbc71b","created_at":"2026-08-17T07:22:17.164Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f98b584c2d983688817cd9c069a786a77778497b013f0c144e2899e2c411b2b6","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.166Z","job_size_bytes":1749,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c57154c0ed19e1323cbbc71b: start","job_status":"start","queue_duration_s":2.878256,"scheduling_latency_s":2.878286}2189gitlab # [ 262.960723] gitaly[891]: time="2026-08-17T07:22:20.069Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=5 command.system_time_ms=17 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079K3V06Y043K8E6PK8SQBK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:30.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:20.041" grpc.time_ms=28.309 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 262.962635] nixbot[2669]: INFO: ::ffff:127.0.0.1:43386 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2191gitlab # [ 262.973293] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.081Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e317dbb2-73c6-445e-9d9a-ebeb206e8a88\"}"],"class":"WebHookWorker","jid":"c57154c0ed19e1323cbbc71b","created_at":"2026-08-17T07:22:17.164Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-ba3a7524841a4812","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f98b584c2d983688817cd9c069a786a77778497b013f0c144e2899e2c411b2b6","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.166Z","job_size_bytes":1749,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c57154c0ed19e1323cbbc71b: done: 0.037004 sec","job_status":"done","queue_duration_s":2.878256,"scheduling_latency_s":2.878286,"redis_calls":14,"redis_duration_s":0.002339,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000577,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006675430000029792,"cpu_s":0.022622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.037004,"completed_at":"2026-08-17T07:22:20.081Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2192gitlab # [ 263.026360] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2462193gitlab # [ 263.027066] nixbot[2669]: {"ts": "2026-08-17T07:22:20.120Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}2194gitlab # [ 263.027714] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1bbd5c7015079274b2b80dd9","created_at":"2026-08-17T07:22:17.599Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.603Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1bbd5c7015079274b2b80dd9: start","job_status":"start","queue_duration_s":2.480856,"scheduling_latency_s":2.480882}2195gitlab # [ 263.044040] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1bbd5c7015079274b2b80dd9","created_at":"2026-08-17T07:22:17.599Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.603Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1bbd5c7015079274b2b80dd9: done: 0.067731 sec","job_status":"done","queue_duration_s":2.480856,"scheduling_latency_s":2.480882,"redis_calls":10,"redis_duration_s":0.001841,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257854,"duration_s":0.067731,"completed_at":"2026-08-17T07:22:20.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011945,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab # [ 263.086376] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.155Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"85e461d53e9616716dbd5b6f","created_at":"2026-08-17T07:22:17.789Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.793Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-85e461d53e9616716dbd5b6f: start","job_status":"start","queue_duration_s":2.362113,"scheduling_latency_s":2.362141}2197gitlab # [ 263.086991] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.184Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"85e461d53e9616716dbd5b6f","created_at":"2026-08-17T07:22:17.789Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.793Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-85e461d53e9616716dbd5b6f: done: 0.028399 sec","job_status":"done","queue_duration_s":2.362113,"scheduling_latency_s":2.362141,"redis_calls":10,"redis_duration_s":0.001602,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000246121,"duration_s":0.028399,"completed_at":"2026-08-17T07:22:20.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 263.135551] gitaly[891]: time="2026-08-17T07:22:20.174Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K42X99MS0QXKNM1E4ENJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:50.173" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:20.173" grpc.time_ms=0.813 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2199gitlab # [ 263.136233] nixbot[2669]: {"ts": "2026-08-17T07:22:20.238Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 \"HTTP/1.1 201 Created\""}2200gitlab # [ 263.136661] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dcbd6de167f919c862c1892b","created_at":"2026-08-17T07:22:17.804Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.814Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dcbd6de167f919c862c1892b: start","job_status":"start","queue_duration_s":2.370718,"scheduling_latency_s":2.370733}2201gitlab # [ 263.137891] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dcbd6de167f919c862c1892b","created_at":"2026-08-17T07:22:17.804Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.814Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dcbd6de167f919c862c1892b: done: 0.024123 sec","job_status":"done","queue_duration_s":2.370718,"scheduling_latency_s":2.370733,"redis_calls":10,"redis_duration_s":0.001767,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000326,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257854,"duration_s":0.024123,"completed_at":"2026-08-17T07:22:20.209Z","load_balancing_strategy":"primary","db_duration_s":0.003477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 263.174951] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/281df16484beff8653f326c0abac7309a7a3bef2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1102203gitlab # [ 263.175534] gitaly[891]: time="2026-08-17T07:22:20.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K42X99MS0QXKNM1E4ENJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:30.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:20.196" grpc.time_ms=7.541 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 263.177405] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.211Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e778c31ed0d7dec23889c79e","created_at":"2026-08-17T07:22:17.829Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.838Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e778c31ed0d7dec23889c79e: start","job_status":"start","queue_duration_s":2.372797,"scheduling_latency_s":2.372811}2205gitlab # [ 263.222362] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e778c31ed0d7dec23889c79e","created_at":"2026-08-17T07:22:17.829Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.838Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e778c31ed0d7dec23889c79e: done: 0.026751 sec","job_status":"done","queue_duration_s":2.372797,"scheduling_latency_s":2.372811,"redis_calls":13,"redis_duration_s":0.0023450000000000003,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00032,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000613,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"duration_s":0.026751,"completed_at":"2026-08-17T07:22:20.238Z","load_balancing_strategy":"primary","db_duration_s":0.003455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2206gitlab # [ 263.258655] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e02792503e953f005f2d2c0f","created_at":"2026-08-17T07:22:17.839Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.845Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e02792503e953f005f2d2c0f: start","job_status":"start","queue_duration_s":2.393772,"scheduling_latency_s":2.393786}2207gitlab # [ 263.259398] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.263Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e02792503e953f005f2d2c0f","created_at":"2026-08-17T07:22:17.839Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.845Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e02792503e953f005f2d2c0f: done: 0.024587 sec","job_status":"done","queue_duration_s":2.393772,"scheduling_latency_s":2.393786,"redis_calls":10,"redis_duration_s":0.001731,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219861,"duration_s":0.024587,"completed_at":"2026-08-17T07:22:20.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004984,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 263.297908] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7a98b2d023491f59873a9cfd","created_at":"2026-08-17T07:22:17.846Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.853Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7a98b2d023491f59873a9cfd: start","job_status":"start","queue_duration_s":2.41138,"scheduling_latency_s":2.411394}2209gitlab # [ 263.298626] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.284Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7a98b2d023491f59873a9cfd","created_at":"2026-08-17T07:22:17.846Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.853Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7a98b2d023491f59873a9cfd: done: 0.019804 sec","job_status":"done","queue_duration_s":2.41138,"scheduling_latency_s":2.411394,"redis_calls":11,"redis_duration_s":0.001682,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226565,"duration_s":0.019804,"completed_at":"2026-08-17T07:22:20.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 263.339171] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.286Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f0b90ac52f3e42ba89a7f0b0","created_at":"2026-08-17T07:22:17.857Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.863Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f0b90ac52f3e42ba89a7f0b0: start","job_status":"start","queue_duration_s":2.423096,"scheduling_latency_s":2.423111}2211gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2212gitlab # [ 263.339777] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.308Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f0b90ac52f3e42ba89a7f0b0","created_at":"2026-08-17T07:22:17.857Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.863Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f0b90ac52f3e42ba89a7f0b0: done: 0.022434 sec","job_status":"done","queue_duration_s":2.423096,"scheduling_latency_s":2.423111,"redis_calls":10,"redis_duration_s":0.002136,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000316,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226006,"duration_s":0.022434,"completed_at":"2026-08-17T07:22:20.308Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2213gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.04 seconds)2214gitlab # [ 263.395776] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"7c000e0aca6007d807c2ee81","created_at":"2026-08-17T07:22:17.864Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.869Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c000e0aca6007d807c2ee81: start","job_status":"start","queue_duration_s":2.44047,"scheduling_latency_s":2.440484}2215gitlab # [ 263.396503] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.337Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"7c000e0aca6007d807c2ee81","created_at":"2026-08-17T07:22:17.864Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.869Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c000e0aca6007d807c2ee81: done: 0.027608 sec","job_status":"done","queue_duration_s":2.44047,"scheduling_latency_s":2.440484,"redis_calls":10,"redis_duration_s":0.001384,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229359,"duration_s":0.027608,"completed_at":"2026-08-17T07:22:20.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 263.420841] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.338Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f01a65d0faf3a24135e66c10","created_at":"2026-08-17T07:22:17.877Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.882Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f01a65d0faf3a24135e66c10: start","job_status":"start","queue_duration_s":2.456072,"scheduling_latency_s":2.456086}2217gitlab # [ 263.434038] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f01a65d0faf3a24135e66c10","created_at":"2026-08-17T07:22:17.877Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.882Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f01a65d0faf3a24135e66c10: done: 0.023646 sec","job_status":"done","queue_duration_s":2.456072,"scheduling_latency_s":2.456086,"redis_calls":10,"redis_duration_s":0.001448,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231315,"duration_s":0.023646,"completed_at":"2026-08-17T07:22:20.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 263.483266] gitaly[891]: time="2026-08-17T07:22:20.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=340 command.spawn_token_fork_ms=338 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K437AWK8F4FSTN92ASK5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.186" grpc.time_ms=342.72 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2219gitlab # [ 263.483856] gitaly[891]: time="2026-08-17T07:22:20.578Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079K4FM01V5ZXK2HGBM8EDB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.570" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2220gitlab # [ 263.490035] nixbot[2669]: INFO: ::ffff:127.0.0.1:55064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2221gitlab # [ 263.494419] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3952222gitlab # [ 263.495085] gitlab-workhorse[826]: time="2026-08-17T07:22:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672223gitlab # [ 263.495453] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462224gitlab # [ 263.495922] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ba20979c86981766d518d0b6","created_at":"2026-08-17T07:22:17.882Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.886Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ba20979c86981766d518d0b6: start","job_status":"start","queue_duration_s":2.476899,"scheduling_latency_s":2.476914}2225gitlab # [ 263.507832] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.379Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ba20979c86981766d518d0b6","created_at":"2026-08-17T07:22:17.882Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.886Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ba20979c86981766d518d0b6: done: 0.016297 sec","job_status":"done","queue_duration_s":2.476899,"scheduling_latency_s":2.476914,"redis_calls":10,"redis_duration_s":0.001337,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214273,"duration_s":0.016297,"completed_at":"2026-08-17T07:22:20.379Z","load_balancing_strategy":"primary","db_duration_s":0.001494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 263.569277] gitaly[891]: time="2026-08-17T07:22:20.578Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4FM01V5ZXK2HGBM8EDB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.570" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2227gitlab # [ 263.570176] nix-daemon[2878]: accepted connection from pid 3384, user nixbot2228gitlab # [ 263.570608] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e3931139eaf4cb07df98933c","created_at":"2026-08-17T07:22:17.886Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.889Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e3931139eaf4cb07df98933c: start","job_status":"start","queue_duration_s":2.4909,"scheduling_latency_s":2.490914}2229gitlab # [ 263.571184] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.402Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e3931139eaf4cb07df98933c","created_at":"2026-08-17T07:22:17.886Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.889Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e3931139eaf4cb07df98933c: done: 0.022368 sec","job_status":"done","queue_duration_s":2.4909,"scheduling_latency_s":2.490914,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242768,"duration_s":0.022368,"completed_at":"2026-08-17T07:22:20.402Z","load_balancing_strategy":"primary","db_duration_s":0.004086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 263.608670] gitaly[891]: time="2026-08-17T07:22:20.578Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4FM01V5ZXK2HGBM8EDB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.570" grpc.time_ms=7.53 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2231gitlab # [ 263.645573] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 622232gitlab # [ 263.646120] gitlab-workhorse[826]: time="2026-08-17T07:22:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672233gitlab # [ 263.646563] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462234gitlab # [ 263.647039] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.403Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"20e116e70300a05572b6ed81","created_at":"2026-08-17T07:22:17.895Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.898Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-20e116e70300a05572b6ed81: start","job_status":"start","queue_duration_s":2.505651,"scheduling_latency_s":2.505665}2235gitlab # [ 263.647621] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.449Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"20e116e70300a05572b6ed81","created_at":"2026-08-17T07:22:17.895Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.898Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-20e116e70300a05572b6ed81: done: 0.045823 sec","job_status":"done","queue_duration_s":2.505651,"scheduling_latency_s":2.505665,"redis_calls":14,"redis_duration_s":0.002166,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286908,"duration_s":0.045823,"completed_at":"2026-08-17T07:22:20.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 263.685659] gitaly[891]: time="2026-08-17T07:22:20.600Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:20.600" grpc.time_ms=0.393 pid=891 span.kind=server system=grpc2237gitlab # [ 263.686224] gitaly[891]: time="2026-08-17T07:22:20.635Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:20.635" grpc.time_ms=0.287 pid=891 span.kind=server system=grpc2238gitlab # [ 263.686866] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:20.451Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e9bff7342c4797d15bc30cb6","created_at":"2026-08-17T07:22:17.985Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.988Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e9bff7342c4797d15bc30cb6: start","job_status":"start","queue_duration_s":2.462831,"scheduling_latency_s":2.462849}2239gitlab # [ 263.692984] gitaly[891]: time="2026-08-17T07:22:20.688Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M079K4JJNCQEYX93VRRPZW3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.682" grpc.time_ms=6.034 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2240gitlab # [ 263.737620] gitaly[891]: time="2026-08-17T07:22:20.736Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079K4MJ8V1CNS4N8BHBK6CK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.729" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2241gitlab # [ 263.738411] gitaly[891]: time="2026-08-17T07:22:20.736Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4MJ8V1CNS4N8BHBK6CK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.729" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2242gitlab # [ 263.738983] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592243gitlab # [ 263.739538] gitaly[891]: time="2026-08-17T07:22:20.737Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4MJ8V1CNS4N8BHBK6CK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.729" grpc.time_ms=7.363 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2244gitlab # [ 263.740165] gitaly[891]: time="2026-08-17T07:22:20.823Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K4PWRPD2N6NXRGC3Q4M7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.815" grpc.time_ms=7.458 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2245gitlab # [ 263.771472] gitaly[891]: time="2026-08-17T07:22:20.880Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M079K4RS1RMA4EGEY3VHADW3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.868" pid=891 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2246gitlab # [ 263.772187] gitaly[891]: time="2026-08-17T07:22:20.880Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4RS1RMA4EGEY3VHADW3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.868" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2247gitlab # [ 263.772743] gitaly[891]: time="2026-08-17T07:22:20.881Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4RS1RMA4EGEY3VHADW3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-17T07:22:20.868" grpc.time_ms=12.206 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2248gitlab # [ 263.777070] gitlab-workhorse[826]: time="2026-08-17T07:22:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162249gitlab # [ 263.778711] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 552250gitlab # [ 263.825794] gitaly[891]: time="2026-08-17T07:22:20.934Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:20.934" grpc.time_ms=0.369 pid=891 span.kind=server system=grpc2251gitlab # [ 263.841591] gitaly[891]: time="2026-08-17T07:22:20.950Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR diskcache=02c0910c-88ec-4502-b05b-53bf94b5a433 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:50.501" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:20.502" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 263.849717] gitaly[891]: time="2026-08-17T07:22:20.958Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=827392 command.minflt=6849 command.oublock=0 command.real_time_ms=442 command.spawn_token_fork_ms=0 command.system_time_ms=72 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:50.501" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:20.502" grpc.time_ms=448.403 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 263.861346] gitaly[891]: time="2026-08-17T07:22:20.970Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:50.668" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:20.969" grpc.time_ms=0.632 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 263.887590] gitaly[891]: time="2026-08-17T07:22:20.996Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-17T07:22:50.688" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:20.988" grpc.time_ms=7.39 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 263.899293] gitaly[891]: time="2026-08-17T07:22:21.008Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:51.006" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:21.007" grpc.time_ms=0.764 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 263.908433] gitaly[891]: time="2026-08-17T07:22:21.017Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:31.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:21.010" grpc.time_ms=6.285 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 263.926401] gitaly[891]: time="2026-08-17T07:22:21.035Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079HCX37PYC0DGSHSX14HMR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:51.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:21.034" grpc.time_ms=0.574 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 263.941747] gitaly[891]: time="2026-08-17T07:22:21.050Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-17T07:22:31.049" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:21.050" grpc.time_ms=0.207 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 263.946392] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.054Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e9bff7342c4797d15bc30cb6","created_at":"2026-08-17T07:22:17.985Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.988Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e9bff7342c4797d15bc30cb6: rescheduled"}2260gitlab # [ 263.952588] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.060Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e9bff7342c4797d15bc30cb6","created_at":"2026-08-17T07:22:17.985Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-5691e08abda14eba","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:17.988Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e9bff7342c4797d15bc30cb6: done: 0.609403 sec","job_status":"done","queue_duration_s":2.462831,"scheduling_latency_s":2.462849,"gitaly_calls":3,"gitaly_duration_s":0.474639,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010088999999999999,"redis_read_bytes":149,"redis_write_bytes":18010,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000392,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000644,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00258,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003825,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000171,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00038,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104092,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.577495464,"duration_s":0.609403,"completed_at":"2026-08-17T07:22:21.060Z","load_balancing_strategy":"primary","db_duration_s":0.026641,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2261gitlab # [ 263.999718] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"aa8cbcf377cce08758ab3d20","created_at":"2026-08-17T07:22:18.125Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-10a9f63d053b4461","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:18.129Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-aa8cbcf377cce08758ab3d20: start","job_status":"start","queue_duration_s":2.932844,"scheduling_latency_s":2.932869}2262gitlab # [ 264.000445] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.096Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"aa8cbcf377cce08758ab3d20","created_at":"2026-08-17T07:22:18.125Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-10a9f63d053b4461","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:18.129Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-aa8cbcf377cce08758ab3d20: done: 0.033979 sec","job_status":"done","queue_duration_s":2.932844,"scheduling_latency_s":2.932869,"redis_calls":19,"redis_duration_s":0.00261,"redis_read_bytes":22,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000578,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000339,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005820573,"duration_s":0.033979,"completed_at":"2026-08-17T07:22:21.096Z","load_balancing_strategy":"primary","db_duration_s":0.005176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2263gitlab # [ 264.036710] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.097Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","23f4b6affa736dd782d59761"],"class":"WebHooks::LogExecutionWorker","jid":"ea2aec97fe0ffbed4dad7c03","created_at":"2026-08-17T07:22:19.284Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-4ddb02a464d440c3","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c975e69708af0b80c070b26fb147ad4282a5dd0f3d17d26fc67793a85c251b70","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:19.289Z","job_size_bytes":2593,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ea2aec97fe0ffbed4dad7c03: start","job_status":"start","queue_duration_s":1.808111,"scheduling_latency_s":1.808127}2264gitlab # [ 264.037439] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.132Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","23f4b6affa736dd782d59761"],"class":"WebHooks::LogExecutionWorker","jid":"ea2aec97fe0ffbed4dad7c03","created_at":"2026-08-17T07:22:19.284Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-4ddb02a464d440c3","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c975e69708af0b80c070b26fb147ad4282a5dd0f3d17d26fc67793a85c251b70","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:19.289Z","job_size_bytes":2593,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ea2aec97fe0ffbed4dad7c03: done: 0.035199 sec","job_status":"done","queue_duration_s":1.808111,"scheduling_latency_s":1.808127,"redis_calls":10,"redis_duration_s":0.001436,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237181,"duration_s":0.035199,"completed_at":"2026-08-17T07:22:21.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 264.080195] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.133Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c57154c0ed19e1323cbbc71b"],"class":"WebHooks::LogExecutionWorker","jid":"bca44a585903058db5e0d66e","created_at":"2026-08-17T07:22:20.072Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-e4b9490acc0e4c3d","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c4d4524f8e50e1804574270e6425534e500cbd0d2105ea2cc9ddabf3e366cf6d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.075Z","job_size_bytes":2591,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bca44a585903058db5e0d66e: start","job_status":"start","queue_duration_s":1.05803,"scheduling_latency_s":1.058044}2266gitlab # [ 264.080793] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.152Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c57154c0ed19e1323cbbc71b"],"class":"WebHooks::LogExecutionWorker","jid":"bca44a585903058db5e0d66e","created_at":"2026-08-17T07:22:20.072Z","trace_propagation_headers":{"sentry-trace":"5fbd47ac366841acaab89ee1fb23cafc-e4b9490acc0e4c3d","baggage":"sentry-trace_id=5fbd47ac366841acaab89ee1fb23cafc,sentry-release=Unknown"},"correlation_id":"01M079HBX3M939BD0W0B679G02","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c4d4524f8e50e1804574270e6425534e500cbd0d2105ea2cc9ddabf3e366cf6d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.075Z","job_size_bytes":2591,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bca44a585903058db5e0d66e: done: 0.018255 sec","job_status":"done","queue_duration_s":1.05803,"scheduling_latency_s":1.058044,"redis_calls":7,"redis_duration_s":0.001311,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018255,"completed_at":"2026-08-17T07:22:21.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 264.122460] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"501214419b0684414014dc14","created_at":"2026-08-17T07:22:20.495Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.497Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-501214419b0684414014dc14: start","job_status":"start","queue_duration_s":0.65607,"scheduling_latency_s":0.656086}2268gitlab # [ 264.157879] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.186Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"501214419b0684414014dc14","created_at":"2026-08-17T07:22:20.495Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.497Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-501214419b0684414014dc14: done: 0.032794 sec","job_status":"done","queue_duration_s":0.65607,"scheduling_latency_s":0.656086,"redis_calls":7,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032794,"completed_at":"2026-08-17T07:22:21.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008539,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2269gitlab # [ 264.194646] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.187Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b668d036e466a6494c374541","created_at":"2026-08-17T07:22:20.964Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.967Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b668d036e466a6494c374541: start","job_status":"start","queue_duration_s":0.220773,"scheduling_latency_s":0.220791}2270gitlab # [ 264.195223] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.208Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b668d036e466a6494c374541","created_at":"2026-08-17T07:22:20.964Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.967Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b668d036e466a6494c374541: done: 0.020757 sec","job_status":"done","queue_duration_s":0.220773,"scheduling_latency_s":0.220791,"redis_calls":7,"redis_duration_s":0.001697,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020757,"completed_at":"2026-08-17T07:22:21.208Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 264.235753] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9a3f815662176e928bd3ab0f","created_at":"2026-08-17T07:22:20.973Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.974Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9a3f815662176e928bd3ab0f: start","job_status":"start","queue_duration_s":0.234666,"scheduling_latency_s":0.234683}2272gitlab # [ 264.236565] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9a3f815662176e928bd3ab0f","created_at":"2026-08-17T07:22:20.973Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.974Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9a3f815662176e928bd3ab0f: done: 0.02135 sec","job_status":"done","queue_duration_s":0.234666,"scheduling_latency_s":0.234683,"redis_calls":7,"redis_duration_s":0.001026,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02135,"completed_at":"2026-08-17T07:22:21.230Z","load_balancing_strategy":"primary","db_duration_s":0.005245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 264.283952] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.232Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"462e40dc3acdd46107f626d9","created_at":"2026-08-17T07:22:20.980Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.983Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-462e40dc3acdd46107f626d9: start","job_status":"start","queue_duration_s":0.248838,"scheduling_latency_s":0.248854}2274gitlab # [ 264.284558] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"462e40dc3acdd46107f626d9","created_at":"2026-08-17T07:22:20.980Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.983Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-462e40dc3acdd46107f626d9: done: 0.025836 sec","job_status":"done","queue_duration_s":0.248838,"scheduling_latency_s":0.248854,"redis_calls":10,"redis_duration_s":0.002087,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001046,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000681,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025836,"completed_at":"2026-08-17T07:22:21.258Z","load_balancing_strategy":"primary","db_duration_s":0.005491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 264.329844] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.259Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"315ed36ea8680955109144b1","created_at":"2026-08-17T07:22:20.984Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.986Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-315ed36ea8680955109144b1: start","job_status":"start","queue_duration_s":0.272572,"scheduling_latency_s":0.272589}2276gitlab # [ 264.330196] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"315ed36ea8680955109144b1","created_at":"2026-08-17T07:22:20.984Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.986Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-315ed36ea8680955109144b1: done: 0.02026 sec","job_status":"done","queue_duration_s":0.272572,"scheduling_latency_s":0.272589,"redis_calls":7,"redis_duration_s":0.001183,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02026,"completed_at":"2026-08-17T07:22:21.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 264.351763] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1f1d6ad7ed8e951a21622f5e","created_at":"2026-08-17T07:22:20.987Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.988Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1f1d6ad7ed8e951a21622f5e: start","job_status":"start","queue_duration_s":0.291734,"scheduling_latency_s":0.29175}2278gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3'2279gitlab # [ 264.392684] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1f1d6ad7ed8e951a21622f5e","created_at":"2026-08-17T07:22:20.987Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.988Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1f1d6ad7ed8e951a21622f5e: done: 0.018739 sec","job_status":"done","queue_duration_s":0.291734,"scheduling_latency_s":0.29175,"redis_calls":8,"redis_duration_s":0.001084,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00081,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018739,"completed_at":"2026-08-17T07:22:21.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004416,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 264.430986] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.300Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8185793e0d7b5ef5cd6069c7","created_at":"2026-08-17T07:22:20.989Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.990Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8185793e0d7b5ef5cd6069c7: start","job_status":"start","queue_duration_s":0.309478,"scheduling_latency_s":0.309494}2281gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3', in 0.05 seconds)2282(finished: subtest: push delivers the webhook, in 59.21 seconds)2283subtest: eval and build post commit statuses2284gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses2285gitlab # [ 264.431596] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.317Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8185793e0d7b5ef5cd6069c7","created_at":"2026-08-17T07:22:20.989Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.990Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8185793e0d7b5ef5cd6069c7: done: 0.017739 sec","job_status":"done","queue_duration_s":0.309478,"scheduling_latency_s":0.309494,"redis_calls":7,"redis_duration_s":0.002121,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017739,"completed_at":"2026-08-17T07:22:21.317Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 264.477820] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.319Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"91627878c269bbb712032abd","created_at":"2026-08-17T07:22:20.991Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.992Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-91627878c269bbb712032abd: start","job_status":"start","queue_duration_s":0.327574,"scheduling_latency_s":0.32759}2287gitlab # [ 264.478723] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.351Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"91627878c269bbb712032abd","created_at":"2026-08-17T07:22:20.991Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.992Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-91627878c269bbb712032abd: done: 0.032075 sec","job_status":"done","queue_duration_s":0.327574,"scheduling_latency_s":0.32759,"redis_calls":7,"redis_duration_s":0.001708,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032075,"completed_at":"2026-08-17T07:22:21.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 264.522652] nixbot[2669]: INFO: ::ffff:127.0.0.1:55068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 200 OK2289gitlab # [ 264.523340] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"790f21058e9c01c71e504d8e","created_at":"2026-08-17T07:22:20.992Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.993Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-790f21058e9c01c71e504d8e: start","job_status":"start","queue_duration_s":0.359137,"scheduling_latency_s":0.359155}2290gitlab # [ 264.524229] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.364Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"790f21058e9c01c71e504d8e","created_at":"2026-08-17T07:22:20.992Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.993Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-790f21058e9c01c71e504d8e: done: 0.011508 sec","job_status":"done","queue_duration_s":0.359137,"scheduling_latency_s":0.359155,"redis_calls":7,"redis_duration_s":0.001519,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011508,"completed_at":"2026-08-17T07:22:21.364Z","load_balancing_strategy":"primary","db_duration_s":0.000485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses, in 0.12 seconds)2292gitlab # [ 264.572432] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.365Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ac5917de7739611214ac4bdf","created_at":"2026-08-17T07:22:20.994Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.995Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ac5917de7739611214ac4bdf: start","job_status":"start","queue_duration_s":0.370853,"scheduling_latency_s":0.370868}2293gitlab # [ 264.573087] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ac5917de7739611214ac4bdf","created_at":"2026-08-17T07:22:20.994Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:20.995Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ac5917de7739611214ac4bdf: done: 0.019286 sec","job_status":"done","queue_duration_s":0.370853,"scheduling_latency_s":0.370868,"redis_calls":7,"redis_duration_s":0.001257,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019286,"completed_at":"2026-08-17T07:22:21.385Z","load_balancing_strategy":"primary","db_duration_s":0.003542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 264.625763] gitaly[891]: time="2026-08-17T07:22:21.667Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K5GZJ7TSXVQC7G8VESXS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:51.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:21.666" grpc.time_ms=0.842 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2295gitlab # [ 264.626764] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 932296gitlab # [ 264.627497] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.386Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"54ce855579fc70d1980086a0","created_at":"2026-08-17T07:22:21.055Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.056Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-54ce855579fc70d1980086a0: start","job_status":"start","queue_duration_s":0.329342,"scheduling_latency_s":0.329356}2297gitlab # [ 264.628072] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.406Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"54ce855579fc70d1980086a0","created_at":"2026-08-17T07:22:21.055Z","trace_propagation_headers":{"sentry-trace":"28732e1dd86848518a50179f9779038f-a00350001d2c4e50","baggage":"sentry-trace_id=28732e1dd86848518a50179f9779038f,sentry-release=Unknown"},"correlation_id":"01M079HCX37PYC0DGSHSX14HMR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.056Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-54ce855579fc70d1980086a0: done: 0.020329 sec","job_status":"done","queue_duration_s":0.329342,"scheduling_latency_s":0.329356,"redis_calls":8,"redis_duration_s":0.00163,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020329,"completed_at":"2026-08-17T07:22:21.406Z","load_balancing_strategy":"primary","db_duration_s":0.003806,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2298gitlab # [ 264.664814] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"c6341e1717b81b91bbc13759","created_at":"2026-08-17T07:22:21.086Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-738ceed17f4942c4","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.090Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-c6341e1717b81b91bbc13759: start","job_status":"start","queue_duration_s":0.318143,"scheduling_latency_s":0.318159}2299gitlab # [ 264.665562] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"c6341e1717b81b91bbc13759","created_at":"2026-08-17T07:22:21.086Z","trace_propagation_headers":{"sentry-trace":"dbe52f4611454fd49e65686c893bab28-738ceed17f4942c4","baggage":"sentry-trace_id=dbe52f4611454fd49e65686c893bab28,sentry-release=Unknown"},"correlation_id":"01M079H8K8W0SJXHSXZEAN591K","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.090Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-c6341e1717b81b91bbc13759: done: 0.079334 sec","job_status":"done","queue_duration_s":0.318143,"scheduling_latency_s":0.318159,"redis_calls":11,"redis_duration_s":0.002474,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028607,"duration_s":0.079334,"completed_at":"2026-08-17T07:22:21.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 264.754736] gitaly[891]: time="2026-08-17T07:22:21.863Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=618 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-17T07:22:31.082" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:21.853" grpc.time_ms=10.09 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 264.792896] gitaly[891]: time="2026-08-17T07:22:21.901Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:21.901" grpc.time_ms=0.437 pid=891 span.kind=server system=grpc2302gitlab # [ 264.831670] gitaly[891]: time="2026-08-17T07:22:21.940Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:21.940" grpc.time_ms=0.286 pid=891 span.kind=server system=grpc2303gitlab # [ 264.847303] gitaly[891]: time="2026-08-17T07:22:21.956Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 diskcache=502ed729-e0cf-412e-beca-6557bcbd6475 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:22:31.096" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:21.866" pid=891 ref=refs/keep-around/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 remote_ip="2001:db8:1::1" revision=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 span.kind=server system=grpc username=root2304gitlab # [ 264.847927] gitaly[891]: time="2026-08-17T07:22:21.956Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5441 command.oublock=8 command.real_time_ms=81 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-17T07:22:31.096" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-17T07:22:21.866" grpc.time_ms=89.42 pid=891 ref=refs/keep-around/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 remote_ip="2001:db8:1::1" revision=fdfcc97151300453f4ebee748e14afb9e6dc3ca3 span.kind=server system=grpc username=root2305gitlab # [ 264.852980] gitaly[891]: time="2026-08-17T07:22:21.961Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:51.860" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:21.960" grpc.time_ms=0.661 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 264.874851] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:21.983Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2e551c9c9796dd5d3104b4cc","created_at":"2026-08-17T07:22:21.971Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-7a39fb9cb0d74e55","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.979Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2e551c9c9796dd5d3104b4cc: start","job_status":"start","queue_duration_s":0.004063,"scheduling_latency_s":0.004102}2307gitlab # [ 264.903435] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.011Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2e551c9c9796dd5d3104b4cc","created_at":"2026-08-17T07:22:21.971Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-7a39fb9cb0d74e55","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.979Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2e551c9c9796dd5d3104b4cc: done: 0.028755 sec","job_status":"done","queue_duration_s":0.004063,"scheduling_latency_s":0.004102,"redis_calls":7,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028755,"completed_at":"2026-08-17T07:22:22.011Z","load_balancing_strategy":"primary","db_duration_s":0.005172,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2308gitlab # [ 264.939676] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.047Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"1e8757e271744b8cf4309a7e","created_at":"2026-08-17T07:22:21.982Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-7a39fb9cb0d74e55","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.985Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-1e8757e271744b8cf4309a7e: start","job_status":"start","queue_duration_s":0.062449,"scheduling_latency_s":0.062478}2309gitlab # [ 265.003718] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 11972310gitlab # [ 265.004918] nixbot[2669]: {"ts": "2026-08-17T07:22:22.113Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 \"HTTP/1.1 201 Created\""}2311gitlab # [ 265.011610] nixbot[2669]: {"ts": "2026-08-17T07:22:22.120Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-fdfcc9715130-4"}2312gitlab # [ 265.019177] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.127Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"1e8757e271744b8cf4309a7e","created_at":"2026-08-17T07:22:21.982Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-7a39fb9cb0d74e55","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:21.985Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-1e8757e271744b8cf4309a7e: done: 0.079705 sec","job_status":"done","queue_duration_s":0.062449,"scheduling_latency_s":0.062478,"redis_calls":10,"redis_duration_s":0.002358,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079705,"completed_at":"2026-08-17T07:22:22.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 265.020465] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.129Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7fd9a1c3800ae0ea6bf693a7","created_at":"2026-08-17T07:22:22.087Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-7a39fb9cb0d74e55","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.094Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7fd9a1c3800ae0ea6bf693a7: start","job_status":"start","queue_duration_s":0.034202,"scheduling_latency_s":0.034228}2314gitlab # [ 265.062630] nix-daemon[2878]: accepted connection from pid 3470, user nixbot2315gitlab # [ 265.081356] gitaly[891]: time="2026-08-17T07:22:22.190Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:52.188" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:22.189" grpc.time_ms=0.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 265.117753] gitaly[891]: time="2026-08-17T07:22:22.226Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K4VJCWEPK82G775PMS45 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:52.225" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:22.225" grpc.time_ms=0.552 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 265.134611] nix-daemon[2878]: accepted connection from pid 3478, user nixbot2318gitlab # [ 265.141592] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.249Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7fd9a1c3800ae0ea6bf693a7","created_at":"2026-08-17T07:22:22.087Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-7a39fb9cb0d74e55","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.094Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7fd9a1c3800ae0ea6bf693a7: done: 0.120667 sec","job_status":"done","queue_duration_s":0.034202,"scheduling_latency_s":0.034228,"gitaly_calls":2,"gitaly_duration_s":0.026254,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005046,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000668,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000892,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000198,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000162,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000505,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070063,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.093392875,"duration_s":0.120667,"completed_at":"2026-08-17T07:22:22.249Z","load_balancing_strategy":"primary","db_duration_s":0.023506,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2319gitlab # [ 265.179619] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"938edefdef674a2688724527","created_at":"2026-08-17T07:22:22.175Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-f8b97dc98090405e","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.177Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-938edefdef674a2688724527: start","job_status":"start","queue_duration_s":0.073678,"scheduling_latency_s":0.073702}2320gitlab # [ 265.180229] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.275Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"938edefdef674a2688724527","created_at":"2026-08-17T07:22:22.175Z","trace_propagation_headers":{"sentry-trace":"e3fad263a8e14904bbf4c861bf2dca2a-f8b97dc98090405e","baggage":"sentry-trace_id=e3fad263a8e14904bbf4c861bf2dca2a,sentry-release=Unknown"},"correlation_id":"01M079K4VJCWEPK82G775PMS45","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.177Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-938edefdef674a2688724527: done: 0.024415 sec","job_status":"done","queue_duration_s":0.073678,"scheduling_latency_s":0.073702,"redis_calls":7,"redis_duration_s":0.001073,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024415,"completed_at":"2026-08-17T07:22:22.275Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 265.236275] nixbot[2669]: {"ts": "2026-08-17T07:22:22.344Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-fdfcc9715130-4", "argv0": "bwrap"}2322gitlab # [ 265.347657] nix-daemon[2878]: accepted connection from pid 3488, user nixbot2323gitlab # [ 265.422385] nix-daemon[2878]: accepted connection from pid 3498, user nixbot2324gitlab # [ 265.440302] nix-daemon[2878]: accepted connection from pid 3488, user nixbot2325gitlab # [ 265.534524] gitaly[891]: time="2026-08-17T07:22:22.643Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:52.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:22.642" grpc.time_ms=0.887 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses2327gitlab # [ 265.596640] gitaly[891]: time="2026-08-17T07:22:22.705Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:32.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.693" grpc.time_ms=11.597 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 265.659148] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:22.765Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0d6255833265229a59e7e7d9","created_at":"2026-08-17T07:22:22.756Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-f758387be2724e24","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.762Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0d6255833265229a59e7e7d9: start","job_status":"start","queue_duration_s":0.003025,"scheduling_latency_s":0.003077}2329gitlab # [ 265.700204] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2272330gitlab # [ 265.701627] gitaly[891]: time="2026-08-17T07:22:22.810Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6MRKVBB0P21E5MDPWQ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:52.708" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:22.808" grpc.time_ms=1.338 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 265.716728] nixbot[2669]: {"ts": "2026-08-17T07:22:22.824Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 \"HTTP/1.1 201 Created\""}2332gitlab # [ 265.735831] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses HTTP/1.1" 200 659 "" "curl/8.21.0" 982333gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses, in 0.15 seconds)2334gitlab # [ 265.766915] gitaly[891]: time="2026-08-17T07:22:22.874Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6QCNQGPC13ED5TSF6JY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:52.274" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:22.874" grpc.time_ms=0.477 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 265.777680] gitaly[891]: time="2026-08-17T07:22:22.879Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:22.877" grpc.time_ms=1.63 pid=891 span.kind=server system=grpc2336gitlab # [ 265.794692] gitaly[891]: time="2026-08-17T07:22:22.903Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K6QCNQGPC13ED5TSF6JY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:32.206" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.896" grpc.time_ms=6.898 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 265.802318] gitaly[891]: time="2026-08-17T07:22:22.911Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:22.910" grpc.time_ms=0.478 pid=891 span.kind=server system=grpc2338gitlab # [ 265.831991] gitaly[891]: time="2026-08-17T07:22:22.940Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:22.940" grpc.time_ms=0.314 pid=891 span.kind=server system=grpc2339gitlab # [ 265.843696] gitaly[891]: time="2026-08-17T07:22:22.952Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:52.856" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.857" operations="[repack_refs]" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 265.851135] gitaly[891]: time="2026-08-17T07:22:22.959Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A diskcache=f4e41de9-7978-4f36-af5a-e005a08b5249 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:52.856" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.857" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2341gitlab # [ 265.851872] gitaly[891]: time="2026-08-17T07:22:22.960Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=80 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7352 command.oublock=0 command.real_time_ms=94 command.spawn_token_fork_ms=0 command.system_time_ms=54 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:52.856" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.857" grpc.time_ms=102.747 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 265.871290] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1512343gitlab # [ 265.873664] gitaly[891]: time="2026-08-17T07:22:22.981Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:52.856" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.857" pid=891 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-17 07:21:17.555230181 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2344gitlab # [ 265.883986] nixbot[2669]: {"ts": "2026-08-17T07:22:22.984Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 \"HTTP/1.1 201 Created\""}2345gitlab # [ 265.889476] gitaly[891]: time="2026-08-17T07:22:22.998Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:52.856" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.857" pid=891 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2346gitlab # [ 265.889672] gitaly[891]: time="2026-08-17T07:22:22.998Z" level=info msg="optimized repository" clean_stale_data_time=16.802136ms clean_work_trees_time="70.68µs" commit_graph_time="4.75µs" correlation_id=01M079K6FMXDBQ5CGP5K53H23A gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.749µs" pid=891 prune_time="4.47µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="5.867µs" storage_name=default system=housekeeping total_time=16.998529ms2347gitlab # [ 265.890267] gitaly[891]: time="2026-08-17T07:22:22.998Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:52.856" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:22.857" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2348gitlab # [ 265.905726] gitaly[891]: time="2026-08-17T07:22:23.014Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:53.013" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:23.013" grpc.time_ms=0.735 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab # [ 265.925250] gitaly[891]: time="2026-08-17T07:22:23.033Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:53.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:23.033" grpc.time_ms=0.491 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 265.936089] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ad0567c66ff99b92f053fd39","created_at":"2026-08-17T07:22:23.042Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"0d6255833265229a59e7e7d9","job_size_bytes":3,"pid":2621,"job_status":"deduplicated","message":"PipelineProcessWorker JID-ad0567c66ff99b92f053fd39: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2351gitlab # [ 265.948521] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0d6255833265229a59e7e7d9","created_at":"2026-08-17T07:22:22.756Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-f758387be2724e24","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.762Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0d6255833265229a59e7e7d9: rescheduled"}2352gitlab # [ 265.960715] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.050Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0d6255833265229a59e7e7d9","created_at":"2026-08-17T07:22:22.756Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-f758387be2724e24","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.762Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0d6255833265229a59e7e7d9: done: 0.285387 sec","job_status":"done","queue_duration_s":0.003025,"scheduling_latency_s":0.003077,"gitaly_calls":3,"gitaly_duration_s":0.109677,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015134,"redis_read_bytes":239,"redis_write_bytes":21786,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000929,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001109,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002738,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14471,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.006107,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000171,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000888,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002263,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130333,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.235626037,"duration_s":0.285387,"completed_at":"2026-08-17T07:22:23.050Z","load_balancing_strategy":"primary","db_duration_s":0.031196,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2353gitlab # [ 265.966780] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.051Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f63789d93fae40d304b4b972","created_at":"2026-08-17T07:22:22.850Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.852Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f63789d93fae40d304b4b972: start","job_status":"start","queue_duration_s":0.199439,"scheduling_latency_s":0.199486}2354gitlab # [ 266.010727] gitaly[891]: time="2026-08-17T07:22:23.083Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6WNBAFP2QG44SRBQQ6X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:53.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:23.083" grpc.time_ms=0.617 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 266.011509] gitaly[891]: time="2026-08-17T07:22:23.111Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M079K6WNBAFP2QG44SRBQQ6X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-17T07:22:33.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:23.105" grpc.time_ms=6.613 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 266.044775] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/17:07:22:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1552357gitlab # [ 266.045853] nixbot[2669]: {"ts": "2026-08-17T07:22:23.154Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fdfcc97151300453f4ebee748e14afb9e6dc3ca3 \"HTTP/1.1 201 Created\""}2358gitlab # [ 266.054738] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.163Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f63789d93fae40d304b4b972","created_at":"2026-08-17T07:22:22.850Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.852Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f63789d93fae40d304b4b972: done: 0.11134 sec","job_status":"done","queue_duration_s":0.199439,"scheduling_latency_s":0.199486,"redis_calls":7,"redis_duration_s":0.001208,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.085,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.11134,"completed_at":"2026-08-17T07:22:23.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086641,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2359gitlab # [ 266.055808] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.164Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"58033080a5c4c7a62dd2b524","created_at":"2026-08-17T07:22:22.965Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.969Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-58033080a5c4c7a62dd2b524: start","job_status":"start","queue_duration_s":0.195343,"scheduling_latency_s":0.195367}2360gitlab # [ 266.092826] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.182Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"58033080a5c4c7a62dd2b524","created_at":"2026-08-17T07:22:22.965Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.969Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-58033080a5c4c7a62dd2b524: done: 0.017878 sec","job_status":"done","queue_duration_s":0.195343,"scheduling_latency_s":0.195367,"redis_calls":7,"redis_duration_s":0.001051,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017878,"completed_at":"2026-08-17T07:22:23.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2361gitlab # [ 266.129752] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ec0c8de7a8f80d2f03555ec1","created_at":"2026-08-17T07:22:22.976Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.978Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ec0c8de7a8f80d2f03555ec1: start","job_status":"start","queue_duration_s":0.204681,"scheduling_latency_s":0.204696}2362gitlab # [ 266.130288] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ec0c8de7a8f80d2f03555ec1","created_at":"2026-08-17T07:22:22.976Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.978Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ec0c8de7a8f80d2f03555ec1: done: 0.016564 sec","job_status":"done","queue_duration_s":0.204681,"scheduling_latency_s":0.204696,"redis_calls":7,"redis_duration_s":0.00096,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016564,"completed_at":"2026-08-17T07:22:23.199Z","load_balancing_strategy":"primary","db_duration_s":0.002695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 266.173052] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"fc1da24eb7f9eda2edb35dd0","created_at":"2026-08-17T07:22:22.985Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.986Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-fc1da24eb7f9eda2edb35dd0: start","job_status":"start","queue_duration_s":0.213869,"scheduling_latency_s":0.213885}2364gitlab # [ 266.173702] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"fc1da24eb7f9eda2edb35dd0","created_at":"2026-08-17T07:22:22.985Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.986Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-fc1da24eb7f9eda2edb35dd0: done: 0.018806 sec","job_status":"done","queue_duration_s":0.213869,"scheduling_latency_s":0.213885,"redis_calls":10,"redis_duration_s":0.001393,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000432,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018806,"completed_at":"2026-08-17T07:22:23.219Z","load_balancing_strategy":"primary","db_duration_s":0.003217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 266.211748] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.220Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bc827ab31a998e0f555c8b6e","created_at":"2026-08-17T07:22:22.987Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.988Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bc827ab31a998e0f555c8b6e: start","job_status":"start","queue_duration_s":0.232211,"scheduling_latency_s":0.232228}2366gitlab # [ 266.212590] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.236Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bc827ab31a998e0f555c8b6e","created_at":"2026-08-17T07:22:22.987Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.988Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bc827ab31a998e0f555c8b6e: done: 0.015581 sec","job_status":"done","queue_duration_s":0.232211,"scheduling_latency_s":0.232228,"redis_calls":7,"redis_duration_s":0.001008,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015581,"completed_at":"2026-08-17T07:22:23.236Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 266.242367] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"999a65617257dfa6a8cf30e4","created_at":"2026-08-17T07:22:22.988Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.992Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-999a65617257dfa6a8cf30e4: start","job_status":"start","queue_duration_s":0.245034,"scheduling_latency_s":0.245049}2368gitlab # [ 266.255740] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.252Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"999a65617257dfa6a8cf30e4","created_at":"2026-08-17T07:22:22.988Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.992Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-999a65617257dfa6a8cf30e4: done: 0.015703 sec","job_status":"done","queue_duration_s":0.245034,"scheduling_latency_s":0.245049,"redis_calls":8,"redis_duration_s":0.001228,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015703,"completed_at":"2026-08-17T07:22:23.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2369gitlab # [ 266.310680] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.253Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c078e11d26922308bda1fcfa","created_at":"2026-08-17T07:22:22.992Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.993Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c078e11d26922308bda1fcfa: start","job_status":"start","queue_duration_s":0.259737,"scheduling_latency_s":0.259751}2370gitlab # [ 266.311526] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.266Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c078e11d26922308bda1fcfa","created_at":"2026-08-17T07:22:22.992Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.993Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c078e11d26922308bda1fcfa: done: 0.013277 sec","job_status":"done","queue_duration_s":0.259737,"scheduling_latency_s":0.259751,"redis_calls":7,"redis_duration_s":0.000967,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013277,"completed_at":"2026-08-17T07:22:23.266Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 266.360734] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.267Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"42861120b39e49f56006e894","created_at":"2026-08-17T07:22:22.994Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.996Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-42861120b39e49f56006e894: start","job_status":"start","queue_duration_s":0.271477,"scheduling_latency_s":0.271491}2372gitlab # [ 266.361528] gitaly[891]: time="2026-08-17T07:22:23.406Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:23.406" grpc.time_ms=0.311 pid=891 span.kind=server system=grpc2373gitlab # [ 266.362091] gitaly[891]: time="2026-08-17T07:22:23.427Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:23.426" grpc.time_ms=0.277 pid=891 span.kind=server system=grpc2374gitlab # [ 266.369619] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.288Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"42861120b39e49f56006e894","created_at":"2026-08-17T07:22:22.994Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:22.996Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-42861120b39e49f56006e894: done: 0.020164 sec","job_status":"done","queue_duration_s":0.271477,"scheduling_latency_s":0.271491,"redis_calls":7,"redis_duration_s":0.001046,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020164,"completed_at":"2026-08-17T07:22:23.288Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002984,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 266.422167] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.289Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"2bd42692f87bf432c7a99c12","created_at":"2026-08-17T07:22:22.999Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.000Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2bd42692f87bf432c7a99c12: start","job_status":"start","queue_duration_s":0.288704,"scheduling_latency_s":0.288719}2376gitlab # [ 266.422798] gitaly[891]: time="2026-08-17T07:22:23.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-17T07:22:23.452" grpc.time_ms=0.556 pid=891 span.kind=server system=grpc2377gitlab # [ 266.458045] gitaly[891]: time="2026-08-17T07:22:23.462Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A diskcache=544ec7ab-30d3-4ba4-942e-53120a12ab0e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:53.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:23.385" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2378gitlab # [ 266.458698] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.305Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"2bd42692f87bf432c7a99c12","created_at":"2026-08-17T07:22:22.999Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.000Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2bd42692f87bf432c7a99c12: done: 0.016402 sec","job_status":"done","queue_duration_s":0.288704,"scheduling_latency_s":0.288719,"redis_calls":7,"redis_duration_s":0.001215,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016402,"completed_at":"2026-08-17T07:22:23.305Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 266.499563] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d614227c2a8e334d584dfc34","created_at":"2026-08-17T07:22:23.001Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.003Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d614227c2a8e334d584dfc34: start","job_status":"start","queue_duration_s":0.303021,"scheduling_latency_s":0.303036}2380gitlab # [ 266.500218] gitaly[891]: time="2026-08-17T07:22:23.462Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7270 command.oublock=0 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-17T07:22:53.384" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-17T07:22:23.385" grpc.time_ms=76.977 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2381gitlab # [ 266.500809] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.315Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d614227c2a8e334d584dfc34","created_at":"2026-08-17T07:22:23.001Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.003Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d614227c2a8e334d584dfc34: done: 0.008613 sec","job_status":"done","queue_duration_s":0.303021,"scheduling_latency_s":0.303036,"redis_calls":7,"redis_duration_s":0.000935,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008613,"completed_at":"2026-08-17T07:22:23.314Z","load_balancing_strategy":"primary","db_duration_s":0.000261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 266.555974] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.315Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f66339dbad5aeb347d938620","created_at":"2026-08-17T07:22:23.003Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.004Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f66339dbad5aeb347d938620: start","job_status":"start","queue_duration_s":0.311113,"scheduling_latency_s":0.311128}2383gitlab # [ 266.556686] gitaly[891]: time="2026-08-17T07:22:23.497Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-17T07:22:53.496" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:23.496" grpc.time_ms=0.765 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2384gitlab # [ 266.557487] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f66339dbad5aeb347d938620","created_at":"2026-08-17T07:22:23.003Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.004Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f66339dbad5aeb347d938620: done: 0.018553 sec","job_status":"done","queue_duration_s":0.311113,"scheduling_latency_s":0.311128,"redis_calls":7,"redis_duration_s":0.001016,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018553,"completed_at":"2026-08-17T07:22:23.334Z","load_balancing_strategy":"primary","db_duration_s":0.006605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2385gitlab # [ 266.605986] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"1f59afd8eacf044cb520965c","created_at":"2026-08-17T07:22:23.046Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.047Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1f59afd8eacf044cb520965c: start","job_status":"start","queue_duration_s":0.288067,"scheduling_latency_s":0.288081}2386gitlab # [ 266.606598] gitaly[891]: time="2026-08-17T07:22:23.523Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K6FMXDBQ5CGP5K53H23A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:53.522" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:23.523" grpc.time_ms=0.514 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 266.607170] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.529Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"1f59afd8eacf044cb520965c","created_at":"2026-08-17T07:22:23.046Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.047Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-1f59afd8eacf044cb520965c: rescheduled"}2388gitlab # [ 266.615491] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.535Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"1f59afd8eacf044cb520965c","created_at":"2026-08-17T07:22:23.046Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-c34c2924fc1f47f3","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.047Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1f59afd8eacf044cb520965c: done: 0.200602 sec","job_status":"done","queue_duration_s":0.288067,"scheduling_latency_s":0.288081,"gitaly_calls":3,"gitaly_duration_s":0.08464,"redis_calls":68,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009146999999999999,"redis_read_bytes":149,"redis_write_bytes":18168,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000592,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000973,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":22,"redis_queues_duration_s":0.001966,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003243,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000204,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000391,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085376,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.174975311,"duration_s":0.200602,"completed_at":"2026-08-17T07:22:23.535Z","load_balancing_strategy":"primary","db_duration_s":0.027124,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2389gitlab # [ 266.679072] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.537Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ea87e134f199a5b93ce149bf","created_at":"2026-08-17T07:22:23.379Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.381Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ea87e134f199a5b93ce149bf: start","job_status":"start","queue_duration_s":0.156041,"scheduling_latency_s":0.15606}2390gitlab # [ 266.679700] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ea87e134f199a5b93ce149bf","created_at":"2026-08-17T07:22:23.379Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.381Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ea87e134f199a5b93ce149bf: done: 0.030413 sec","job_status":"done","queue_duration_s":0.156041,"scheduling_latency_s":0.15606,"redis_calls":7,"redis_duration_s":0.00116,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030413,"completed_at":"2026-08-17T07:22:23.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004912,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2391gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses2392gitlab # [ 266.720924] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.572Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea373c762b546f0e34e16d76","created_at":"2026-08-17T07:22:23.466Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.468Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea373c762b546f0e34e16d76: start","job_status":"start","queue_duration_s":0.103217,"scheduling_latency_s":0.103242}2393gitlab # [ 266.721511] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.590Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea373c762b546f0e34e16d76","created_at":"2026-08-17T07:22:23.466Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.468Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea373c762b546f0e34e16d76: done: 0.018253 sec","job_status":"done","queue_duration_s":0.103217,"scheduling_latency_s":0.103242,"redis_calls":7,"redis_duration_s":0.001026,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018253,"completed_at":"2026-08-17T07:22:23.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 266.757629] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dd3ce1e56b338c619e70ca45","created_at":"2026-08-17T07:22:23.473Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.476Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dd3ce1e56b338c619e70ca45: start","job_status":"start","queue_duration_s":0.115316,"scheduling_latency_s":0.115329}2395gitlab # [ 266.762866] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dd3ce1e56b338c619e70ca45","created_at":"2026-08-17T07:22:23.473Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.476Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dd3ce1e56b338c619e70ca45: done: 0.016961 sec","job_status":"done","queue_duration_s":0.115316,"scheduling_latency_s":0.115329,"redis_calls":7,"redis_duration_s":0.0011719999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016961,"completed_at":"2026-08-17T07:22:23.608Z","load_balancing_strategy":"primary","db_duration_s":0.002741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab # [ 266.806227] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.613Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"15c3275313533200d5835eb8","created_at":"2026-08-17T07:22:23.480Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.481Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-15c3275313533200d5835eb8: start","job_status":"start","queue_duration_s":0.131242,"scheduling_latency_s":0.131259}2397gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fdfcc97151300453f4ebee748e14afb9e6dc3ca3/statuses, in 0.14 seconds)2398(finished: subtest: eval and build post commit statuses, in 2.40 seconds)2399(finished: run the VM test script, in 317.32 seconds)2400gitlab # [ 266.808078] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"15c3275313533200d5835eb8","created_at":"2026-08-17T07:22:23.480Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.481Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-15c3275313533200d5835eb8: done: 0.023069 sec","job_status":"done","queue_duration_s":0.131242,"scheduling_latency_s":0.131259,"redis_calls":10,"redis_duration_s":0.004511,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001532,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023069,"completed_at":"2026-08-17T07:22:23.636Z","load_balancing_strategy":"primary","db_duration_s":0.003019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 266.862032] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.637Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3eb61fcc876a7c83a64bc206","created_at":"2026-08-17T07:22:23.482Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.483Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3eb61fcc876a7c83a64bc206: start","job_status":"start","queue_duration_s":0.15398,"scheduling_latency_s":0.153996}2402gitlab # [ 266.862756] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-17T07:22:23.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3eb61fcc876a7c83a64bc206","created_at":"2026-08-17T07:22:23.482Z","trace_propagation_headers":{"sentry-trace":"20495055f50648478890efb8519715b1-0ba6e089ec274bbd","baggage":"sentry-trace_id=20495055f50648478890efb8519715b1,sentry-release=Unknown"},"correlation_id":"01M079K6FMXDBQ5CGP5K53H23A","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-17T07:22:23.483Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3eb61fcc876a7c83a64bc206: done: 0.015461 sec","job_status":"done","queue_duration_s":0.15398,"scheduling_latency_s":0.153996,"redis_calls":7,"redis_duration_s":0.0009369999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015461,"completed_at":"2026-08-17T07:22:23.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2403test script finished in 317.39s2404cleanup2405kill QemuMachine (pid 46)2406gitlab # [ 266.935336] gitaly[891]: time="2026-08-17T07:22:23.925Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M079K7RGSHH0DQPJDHEFK8E8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-17T07:22:53.324" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-17T07:22:23.924" grpc.time_ms=0.534 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2407gitlab # [ 266qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2408gitlab # .2409(finished: cleanup, in 1.82 seconds)2410additionally exposed symbols:2411 gitlab,2412 vlan1,2413 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2414[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-17T07:21:22.023Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2415[]2416[]2417[]2418[]2419[]2420[]2421[]2422[]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'fdfcc97151300453f4ebee748e14afb9e6dc3ca3', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-17T07:22:20.909442Z', 'started_at': None, 'finished_at': None}]2472[]2473[{'id': 5, 'sha': 'fdfcc97151300453f4ebee748e14afb9e6dc3ca3', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-17T07:22:22.076Z', 'started_at': None, 'finished_at': '2026-08-17T07:22:22.742Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2474[{'id': 5, 'sha': 'fdfcc97151300453f4ebee748e14afb9e6dc3ca3', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-17T07:22:22.076Z', 'started_at': None, 'finished_at': '2026-08-17T07:22:22.742Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'fdfcc97151300453f4ebee748e14afb9e6dc3ca3', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-17T07:22:22.944Z', 'started_at': None, 'finished_at': '2026-08-17T07:22:23.130Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]