this derivation will be built: /nix/store/07wcg5g6dyfm7xrm6sdswbp3cj4mjw11-vm-test-run-nix-grpc-farm-k3s.drv building '/nix/store/07wcg5g6dyfm7xrm6sdswbp3cj4mjw11-vm-test-run-nix-grpc-farm-k3s.drv' vm-test-run-nix-grpc-farm-k3s> tribuchet: building on jamie vm-test-run-nix-grpc-farm-k3s> machine # [ 265.448807] garage[836]: 2026-10-12T10:02:31.826976Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.450875] garage[836]: 2026-10-12T10:02:31.827599Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 265.452956] garage[836]: 2026-10-12T10:02:31.831793Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.455236] garage[836]: 2026-10-12T10:02:31.832407Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 265.674613] niks3-server[1190]: 2026/10/12 10:02:32 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 265.682960] garage[836]: 2026-10-12T10:02:32.061773Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45b43e21f0b3646af07e6cd8d917aa8397c6ba1f0c078f37f5e65091e6f38c2b vm-test-run-nix-grpc-farm-k3s> machine # [ 265.689889] garage[836]: 2026-10-12T10:02:32.068582Z INFO garage_api_common::generic_server: 10.42.0.6:33766 PUT /farm/log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0d763bb7acf898fc310e92b967b64becb352edacb90b57aca60f09f5d5bb4c3a vm-test-run-nix-grpc-farm-k3s> machine # [ 265.691066] garage[836]: 2026-10-12T10:02:32.069634Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=28f392613f7930f2328b4847a6c13f7e6ffc5dca9b6dccce2a0186465576a095 vm-test-run-nix-grpc-farm-k3s> machine # [ 265.702271] niks3-server[1190]: 2026/10/12 10:02:32 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 265.704152] niks3-server[1190]: 2026/10/12 10:02:32 INFO Signed narinfos id=10 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 265.705242] garage[836]: 2026-10-12T10:02:32.082546Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 265.706775] garage[836]: 2026-10-12T10:02:32.083235Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 265.708172] garage[836]: 2026-10-12T10:02:32.084294Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 265.709477] garage[836]: 2026-10-12T10:02:32.086240Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83232b724c7d41f2e2e5377ee6b864f951912b6e2a5d88b1000e61fb44e7b0f4 vm-test-run-nix-grpc-farm-k3s> machine # [ 265.711756] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 265.712565] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 265.713613] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 265.714390] niks3-server[1190]: 2026/10/12 10:02:32 INFO Received complete push request method=POST path=/api/pushes/10/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 265.715193] garage[836]: 2026-10-12T10:02:32.092002Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.716728] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.735367] garage[836]: 2026-10-12T10:02:32.114239Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.736611] garage[836]: 2026-10-12T10:02:32.114687Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 265.742296] garage[836]: 2026-10-12T10:02:32.121196Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.743305] garage[836]: 2026-10-12T10:02:32.121595Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 265.752427] garage[836]: 2026-10-12T10:02:32.131349Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.755377] garage[836]: 2026-10-12T10:02:32.131889Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 265.814790] niks3-server[1190]: 2026/10/12 10:02:32 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 265.823433] garage[836]: 2026-10-12T10:02:32.202353Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1fd07311bcb671a02b1ddb71d61e3683cdf13b1c37f41f73e89c79e2c60a0884 vm-test-run-nix-grpc-farm-k3s> machine # [ 265.824189] garage[836]: 2026-10-12T10:02:32.203145Z INFO garage_api_common::generic_server: 10.42.0.6:33766 PUT /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3abef197eda28ca2219539d980e79a0936d8731ca6021e2934f9e560a163144e vm-test-run-nix-grpc-farm-k3s> machine # [ 265.826037] garage[836]: 2026-10-12T10:02:32.204964Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 265.827678] niks3-server[1190]: 2026/10/12 10:02:32 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 265.828598] niks3-server[1190]: 2026/10/12 10:02:32 INFO Signed narinfos id=11 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 265.829581] garage[836]: 2026-10-12T10:02:32.208519Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 265.830317] garage[836]: 2026-10-12T10:02:32.209243Z INFO garage_api_common::generic_server: 10.42.0.6:33766 PUT /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100232Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c5f1eecee547c956c45e5ea74db792a970c28137e2a010899c357568bfda5d9f vm-test-run-nix-grpc-farm-k3s> machine # [ 265.831487] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 265.833381] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 265.850759] niks3-server[1190]: 2026/10/12 10:02:32 INFO Received complete push request method=POST path=/api/pushes/11/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 265.853347] garage[836]: 2026-10-12T10:02:32.232208Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 265.856751] niks3-server[1190]: 2026/10/12 10:02:32 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 290.168419] garage[836]: 2026-10-12T10:02:56.546469Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 290.170662] garage[836]: 2026-10-12T10:02:56.547006Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 290.181381] garage[836]: 2026-10-12T10:02:56.560257Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 290.183373] garage[836]: 2026-10-12T10:02:56.560807Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 290.364531] niks3-server[1190]: 2026/10/12 10:02:56 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 290.374856] garage[836]: 2026-10-12T10:02:56.753419Z INFO garage_api_common::generic_server: 10.42.0.6:33766 PUT /farm/nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100256Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=df0e01fba64eabd5895eae272ab7407f3bd7e60265ae40482f1006145d73a644 vm-test-run-nix-grpc-farm-k3s> machine # [ 290.388574] garage[836]: 2026-10-12T10:02:56.767471Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100256Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=50f8a5c6287b250674ffcf9bf8d928558ba0d4066a59b19619bd8617f89d27de vm-test-run-nix-grpc-farm-k3s> machine # [ 290.392078] garage[836]: 2026-10-12T10:02:56.770959Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 290.396279] niks3-server[1190]: 2026/10/12 10:02:56 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 290.413505] garage[836]: 2026-10-12T10:02:56.767471Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100256Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2ca253d603d459445ec9fd1866f2c59e92d9551261cf983a3ea63389f6609d84 vm-test-run-nix-grpc-farm-k3s> machine # [ 290.424176] garage[836]: 2026-10-12T10:02:56.793473Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 290.429268] garage[836]: 2026-10-12T10:02:56.800546Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100256Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d7cfbeff2f39f6d01b66ec927bf652e3147e1e8eafad8b6500a0e2a36232b3ab vm-test-run-nix-grpc-farm-k3s> machine # [ 290.437641] garage[836]: 2026-10-12T10:02:56.802349Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 290.440881] niks3-server[1190]: 2026/10/12 10:02:56 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 290.441957] niks3-server[1190]: 2026/10/12 10:02:56 INFO Signed narinfos id=12 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 290.442791] niks3-server[1190]: 2026/10/12 10:02:56 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 290.443687] niks3-server[1190]: 2026/10/12 10:02:56 INFO Received complete push request method=POST path=/api/pushes/12/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 290.444559] niks3-server[1190]: 2026/10/12 10:02:56 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 290.445311] niks3-server[1190]: 2026/10/12 10:02:56 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 290.445988] garage[836]: 2026-10-12T10:02:56.804890Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --argstr tag t2 2>&1, in 76.37 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: build through the balancer lands in the cache, in 214.50 seconds) vm-test-run-nix-grpc-farm-k3s> subtest: a Job with the client image builds through the farm with its service account vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt, in 0.20 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --from-file=flake.nix=/nix/store/lhkgq72c5snz9l7av0mm0hzkgrwb0fhf-flake.nix vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --from-file=flake.nix=/nix/store/lhkgq72c5snz9l7av0mm0hzkgrwb0fhf-flake.nix, in 0.14 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl apply -f /nix/store/rr20qdb93q378rhwzwlicsxsgm1d6s8s-ci-job.json vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl apply -f /nix/store/rr20qdb93q378rhwzwlicsxsgm1d6s8s-ci-job.json, in 0.16 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' vm-test-run-nix-grpc-farm-k3s> machine # [ 292.389495] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice. vm-test-run-nix-grpc-farm-k3s> machine # [ 292.466944] k3s[838]: I1012 10:02:58.845318 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-nix-grpc-farm\") pod \"ci-pj292\" (UID: \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\") " pod="ci/ci-pj292" vm-test-run-nix-grpc-farm-k3s> machine # [ 292.468263] k3s[838]: I1012 10:02:58.845417 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wl5d\" (UniqueName: \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-kube-api-access-4wl5d\") pod \"ci-pj292\" (UID: \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\") " pod="ci/ci-pj292" vm-test-run-nix-grpc-farm-k3s> machine # [ 292.469586] k3s[838]: I1012 10:02:58.845708 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/9f039ce7-b30c-4971-b8e0-325d10b76bcc-job\") pod \"ci-pj292\" (UID: \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\") " pod="ci/ci-pj292" vm-test-run-nix-grpc-farm-k3s> machine # [ 292.891195] cni0: port 1(vethae7b03b4) entered blocking state vm-test-run-nix-grpc-farm-k3s> machine # [ 292.894028] cni0: port 1(vethae7b03b4) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 292.896313] vethae7b03b4: entered allmulticast mode vm-test-run-nix-grpc-farm-k3s> machine # [ 292.898347] vethae7b03b4: entered promiscuous mode vm-test-run-nix-grpc-farm-k3s> machine # [ 292.914422] cni0: port 1(vethae7b03b4) entered blocking state vm-test-run-nix-grpc-farm-k3s> machine # [ 292.915648] cni0: port 1(vethae7b03b4) entered forwarding state vm-test-run-nix-grpc-farm-k3s> machine # [ 292.809671] (udev-worker)[7653]: Network interface NamePolicy= disabled on kernel command line. vm-test-run-nix-grpc-farm-k3s> machine # [ 292.836362] dhcpcd[658]: vethae7b03b4: IAID eb:46:d6:86 vm-test-run-nix-grpc-farm-k3s> machine # [ 292.837035] dhcpcd[658]: vethae7b03b4: adding address fe80::4c78:ebff:fe46:d686 vm-test-run-nix-grpc-farm-k3s> machine # [ 292.855293] systemd[1]: Started libcontainer container 5d0fc4a12008ead25a89a4ab376ea0a509a3b9e3a845fb43f5685b5857cfe1fe. vm-test-run-nix-grpc-farm-k3s> machine # [ 294.412486] dhcpcd[658]: vethae7b03b4: soliciting a DHCP lease vm-test-run-nix-grpc-farm-k3s> machine # [ 294.989136] systemd[1]: Started libcontainer container a4eb513a4484d744bf7ba9585dac0bf996e57884b5c22850d86a7e6e68557d3e. vm-test-run-nix-grpc-farm-k3s> machine # [ 294.992921] dhcpcd[658]: vethae7b03b4: soliciting an IPv6 router vm-test-run-nix-grpc-farm-k3s> machine # [ 295.080624] k3s[838]: I1012 10:03:01.458815 838 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-pj292" podStartSLOduration=3.458793892 podStartE2EDuration="3.458793892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-12 10:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-12 10:03:01.457633409 +0000 UTC m=+277.688913505" watchObservedRunningTime="2026-10-12 10:03:01.458793892 +0000 UTC m=+277.690074267" vm-test-run-nix-grpc-farm-k3s> machine # [ 296.326408] garage[836]: 2026-10-12T10:03:02.705048Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 296.327476] garage[836]: 2026-10-12T10:03:02.706356Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 296.329633] garage[836]: 2026-10-12T10:03:02.706474Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 296.330996] garage[836]: 2026-10-12T10:03:02.706620Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 296.359749] garage[836]: 2026-10-12T10:03:02.738649Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 296.361504] garage[836]: 2026-10-12T10:03:02.738870Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 296.363088] garage[836]: 2026-10-12T10:03:02.740755Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 296.364555] garage[836]: 2026-10-12T10:03:02.740924Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 296.367414] garage[836]: 2026-10-12T10:03:02.746148Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 296.367988] garage[836]: 2026-10-12T10:03:02.746320Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 296.460551] niks3-server[1190]: 2026/10/12 10:03:02 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 296.469450] garage[836]: 2026-10-12T10:03:02.848253Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100302Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a9ad78d15a745ca4d378eb1552b91393f7aa584ac243e8f53de2aee724028621 vm-test-run-nix-grpc-farm-k3s> machine # [ 296.482190] garage[836]: 2026-10-12T10:03:02.848637Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100302Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6346779edacabbbf58529ebc4567d225e3fd05f391348030bea38c67d232c9ef vm-test-run-nix-grpc-farm-k3s> machine # [ 296.484256] garage[836]: 2026-10-12T10:03:02.850794Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 296.485500] garage[836]: 2026-10-12T10:03:02.858338Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 296.486256] garage[836]: 2026-10-12T10:03:02.859117Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100302Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4d988384bc8a09292b7afd28fe53dbd3e86b250158ecbfbac3d34aa734921b5f vm-test-run-nix-grpc-farm-k3s> machine # [ 296.487561] niks3-server[1190]: 2026/10/12 10:03:02 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 296.488675] niks3-server[1190]: 2026/10/12 10:03:02 INFO Signed narinfos id=13 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 296.490251] niks3-server[1190]: 2026/10/12 10:03:02 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 296.491459] niks3-server[1190]: 2026/10/12 10:03:02 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 296.526399] niks3-server[1190]: 2026/10/12 10:03:02 INFO Received complete push request method=POST path=/api/pushes/13/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 296.527706] garage[836]: 2026-10-12T10:03:02.905596Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 296.528798] niks3-server[1190]: 2026/10/12 10:03:02 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 299.413545] dhcpcd[658]: vethae7b03b4: probing for an IPv4LL address vm-test-run-nix-grpc-farm-k3s> machine # [ 303.499526] dhcpcd[658]: vethae7b03b4: using IPv4LL address 169.254.162.109 vm-test-run-nix-grpc-farm-k3s> machine # [ 303.501322] dhcpcd[658]: vethae7b03b4: adding route to 169.254.0.0/16 vm-test-run-nix-grpc-farm-k3s> machine # [ 306.998471] dhcpcd[658]: vethae7b03b4: no IPv6 Routers available vm-test-run-nix-grpc-farm-k3s> machine # [ 310.907148] postgres[725]: [725] LOG: checkpoint starting: time vm-test-run-nix-grpc-farm-k3s> machine # [ 321.343308] garage[836]: 2026-10-12T10:03:27.721453Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.349513] garage[836]: 2026-10-12T10:03:27.722121Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 321.354107] garage[836]: 2026-10-12T10:03:27.730737Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.359911] garage[836]: 2026-10-12T10:03:27.731300Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 321.645605] niks3-server[1190]: 2026/10/12 10:03:28 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 321.653914] garage[836]: 2026-10-12T10:03:28.032458Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=748aad080cf4defbc7cae4fb1302e9cd592b7973c0a387a5bdded24b9be10e30 vm-test-run-nix-grpc-farm-k3s> machine # [ 321.668697] garage[836]: 2026-10-12T10:03:28.047519Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3d305e01677dd0f61c51283c12005bdda93682226d2351eae24dbde0c60e27dc vm-test-run-nix-grpc-farm-k3s> machine # [ 321.682517] garage[836]: 2026-10-12T10:03:28.047654Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/gpvd12kzis7szd8w51klc50y5fsyav70.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6bf5962fef9a71c34f0c5406e5552ce564ec8465c9c4c92048afd4f3b84fc0f2 vm-test-run-nix-grpc-farm-k3s> machine # [ 321.683185] garage[836]: 2026-10-12T10:03:28.049009Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 321.684697] garage[836]: 2026-10-12T10:03:28.051575Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 321.685872] garage[836]: 2026-10-12T10:03:28.053621Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 321.687089] garage[836]: 2026-10-12T10:03:28.054284Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aae0042073746a3254e0a730f59ab73261017f2639d388fca9fe534d8487662d vm-test-run-nix-grpc-farm-k3s> machine # [ 321.688596] garage[836]: 2026-10-12T10:03:28.057112Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/gpvd12kzis7szd8w51klc50y5fsyav70.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.689775] niks3-server[1190]: 2026/10/12 10:03:28 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 321.690910] niks3-server[1190]: 2026/10/12 10:03:28 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 321.692095] niks3-server[1190]: 2026/10/12 10:03:28 INFO Signed narinfos id=14 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 321.693102] niks3-server[1190]: 2026/10/12 10:03:28 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 321.693643] niks3-server[1190]: 2026/10/12 10:03:28 INFO Received complete push request method=POST path=/api/pushes/14/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 321.695031] niks3-server[1190]: 2026/10/12 10:03:28 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 321.695377] niks3-server[1190]: 2026/10/12 10:03:28 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.712271] garage[836]: 2026-10-12T10:03:28.090883Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.713400] garage[836]: 2026-10-12T10:03:28.091177Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 321.715511] garage[836]: 2026-10-12T10:03:28.094486Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.718142] garage[836]: 2026-10-12T10:03:28.095485Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 321.725414] garage[836]: 2026-10-12T10:03:28.104096Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.726160] garage[836]: 2026-10-12T10:03:28.104302Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 321.776672] niks3-server[1190]: 2026/10/12 10:03:28 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 321.782900] garage[836]: 2026-10-12T10:03:28.161803Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c079e3d0e3d561f06ca0b7d6f00483fa930e00f9bffbadc9d5a4134a6700cd34 vm-test-run-nix-grpc-farm-k3s> machine # [ 321.788442] garage[836]: 2026-10-12T10:03:28.162205Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3a3d8f6c4c4b728245cd314f5bacce20ee5ac0a6b9154594d6b1f0f2af8ca5 vm-test-run-nix-grpc-farm-k3s> machine # [ 321.789087] niks3-server[1190]: 2026/10/12 10:03:28 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 321.789642] niks3-server[1190]: 2026/10/12 10:03:28 INFO Signed narinfos id=15 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 321.790183] garage[836]: 2026-10-12T10:03:28.169060Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100328Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c65f92cd8efe6241f41873ff85a03a6e169e2ed5ea5db3d4c97825b7310cb1af vm-test-run-nix-grpc-farm-k3s> machine # [ 321.790701] garage[836]: 2026-10-12T10:03:28.169059Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 321.792664] garage[836]: 2026-10-12T10:03:28.171305Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 321.793679] niks3-server[1190]: 2026/10/12 10:03:28 INFO Received complete push request method=POST path=/api/pushes/15/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 321.794259] niks3-server[1190]: 2026/10/12 10:03:28 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 321.797613] niks3-server[1190]: 2026/10/12 10:03:28 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.028545] garage[836]: 2026-10-12T10:03:52.406648Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.031341] garage[836]: 2026-10-12T10:03:52.407296Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 346.042407] garage[836]: 2026-10-12T10:03:52.421236Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.044609] garage[836]: 2026-10-12T10:03:52.421812Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 346.309435] niks3-server[1190]: 2026/10/12 10:03:52 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 346.322148] garage[836]: 2026-10-12T10:03:52.699844Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=208bcd1d5c2495c592b4328e1e3376f0115db01553582abe21ff2cb741cd7f22 vm-test-run-nix-grpc-farm-k3s> machine # [ 346.323527] garage[836]: 2026-10-12T10:03:52.700811Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=834943f81f3384f4400ecbc12a8ccc877ab9c9bb48e09a2abee2e8455fa33ea6 vm-test-run-nix-grpc-farm-k3s> machine # [ 346.324250] garage[836]: 2026-10-12T10:03:52.700941Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=70e9fbfe4ec150346441b8ecf699909041822b9fd9ee12a7527dcabd8f820c2f vm-test-run-nix-grpc-farm-k3s> machine # [ 346.360472] niks3-server[1190]: 2026/10/12 10:03:52 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 346.362161] garage[836]: 2026-10-12T10:03:52.739806Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 346.363947] garage[836]: 2026-10-12T10:03:52.740212Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 346.365409] garage[836]: 2026-10-12T10:03:52.742211Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 346.366517] garage[836]: 2026-10-12T10:03:52.743887Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4b9d4890ae4cd293dd43a04fed73abee8f0bc3d86a76836c184b19d725cfd8cb vm-test-run-nix-grpc-farm-k3s> machine # [ 346.367953] niks3-server[1190]: 2026/10/12 10:03:52 INFO Signed narinfos id=16 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 346.368863] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 346.369706] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 346.370907] niks3-server[1190]: 2026/10/12 10:03:52 INFO Received complete push request method=POST path=/api/pushes/16/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 346.372223] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 346.373240] garage[836]: 2026-10-12T10:03:52.747254Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.374298] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.400591] garage[836]: 2026-10-12T10:03:52.779536Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.401631] garage[836]: 2026-10-12T10:03:52.779763Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 346.402752] garage[836]: 2026-10-12T10:03:52.781402Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.403829] garage[836]: 2026-10-12T10:03:52.781665Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 346.406734] garage[836]: 2026-10-12T10:03:52.785480Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.408023] garage[836]: 2026-10-12T10:03:52.785653Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 346.453152] niks3-server[1190]: 2026/10/12 10:03:52 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 346.459751] garage[836]: 2026-10-12T10:03:52.838707Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d5162dbc26417af3985482bfb554ac40d3536e1930a113dbcea30b19a31642a3 vm-test-run-nix-grpc-farm-k3s> machine # [ 346.461084] garage[836]: 2026-10-12T10:03:52.838790Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dda7d9c0d7000f1065e07474341570eaba6ddbf58491d74d76d862cd86426cde vm-test-run-nix-grpc-farm-k3s> machine # [ 346.462573] niks3-server[1190]: 2026/10/12 10:03:52 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 346.463512] niks3-server[1190]: 2026/10/12 10:03:52 INFO Signed narinfos id=17 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 346.464058] garage[836]: 2026-10-12T10:03:52.841835Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 346.464623] garage[836]: 2026-10-12T10:03:52.842567Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 346.465283] garage[836]: 2026-10-12T10:03:52.842825Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100352Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=083bd9f7bb9c32c97acac4cf9c5c23479a28c101b76c9ae0014aec9f0d1150f4 vm-test-run-nix-grpc-farm-k3s> machine # [ 346.465775] niks3-server[1190]: 2026/10/12 10:03:52 INFO Received complete push request method=POST path=/api/pushes/17/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 346.467433] garage[836]: 2026-10-12T10:03:52.846038Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 346.468560] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 346.469710] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 346.470994] niks3-server[1190]: 2026/10/12 10:03:52 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 370.915893] garage[836]: 2026-10-12T10:04:17.293967Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 370.918608] garage[836]: 2026-10-12T10:04:17.294580Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 370.929577] garage[836]: 2026-10-12T10:04:17.308466Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 370.936724] garage[836]: 2026-10-12T10:04:17.315582Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 371.183483] niks3-server[1190]: 2026/10/12 10:04:17 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 371.191456] garage[836]: 2026-10-12T10:04:17.570309Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100417Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b5e649cbf459775a2523b682957e425db597371c77909c9f1cf337bc82fa6fed vm-test-run-nix-grpc-farm-k3s> machine # [ 371.193865] garage[836]: 2026-10-12T10:04:17.572575Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100417Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=13fa6088cb651d7a5a124579373a46efc8fd78e3b9ba3eea04b5edb0b5bd8a25 vm-test-run-nix-grpc-farm-k3s> machine # [ 371.195285] garage[836]: 2026-10-12T10:04:17.572664Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100417Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c5f5eba246972ce585d4fd547cc14e6235482edcab8827824d74d1ab6bfe7497 vm-test-run-nix-grpc-farm-k3s> machine # [ 371.199487] garage[836]: 2026-10-12T10:04:17.578138Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 371.201941] niks3-server[1190]: 2026/10/12 10:04:17 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 371.203705] garage[836]: 2026-10-12T10:04:17.581162Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 371.205900] niks3-server[1190]: 2026/10/12 10:04:17 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 371.247692] niks3-server[1190]: 2026/10/12 10:04:17 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 371.249338] niks3-server[1190]: 2026/10/12 10:04:17 INFO Signed narinfos id=18 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 371.252361] niks3-server[1190]: 2026/10/12 10:04:17 INFO Received complete push request method=POST path=/api/pushes/18/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 371.253521] garage[836]: 2026-10-12T10:04:17.628734Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100417Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9b6baf24b2e38f5fc2c7d4dda5110860418fe19e8d0bc3f0902198f686112ca vm-test-run-nix-grpc-farm-k3s> machine # [ 371.254373] garage[836]: 2026-10-12T10:04:17.629298Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 371.263090] niks3-server[1190]: 2026/10/12 10:04:17 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 372.851090] garage[836]: 2026-10-12T10:04:19.229177Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info vm-test-run-nix-grpc-farm-k3s> machine # [ 372.853352] garage[836]: 2026-10-12T10:04:19.230301Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info vm-test-run-nix-grpc-farm-k3s> machine # [ 372.864505] garage[836]: 2026-10-12T10:04:19.243369Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/2lbawlnbs2fgyvz7jsy103fsyj61iwv6.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 372.866476] garage[836]: 2026-10-12T10:04:19.243786Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 372.969494] garage[836]: 2026-10-12T10:04:19.347438Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 372.970779] garage[836]: 2026-10-12T10:04:19.347732Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 374.071877] garage[836]: 2026-10-12T10:04:20.450079Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 374.073575] garage[836]: 2026-10-12T10:04:20.450607Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 374.086359] garage[836]: 2026-10-12T10:04:20.465223Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 374.087902] garage[836]: 2026-10-12T10:04:20.465952Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 374.094936] garage[836]: 2026-10-12T10:04:20.473285Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 374.096544] garage[836]: 2026-10-12T10:04:20.473687Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 374.152516] niks3-server[1190]: 2026/10/12 10:04:20 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 374.157624] garage[836]: 2026-10-12T10:04:20.536556Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100420Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7a82d40af4df5700962e246883a361cadc6cde688d0b0abf692230947a4d9237 vm-test-run-nix-grpc-farm-k3s> machine # [ 374.163502] garage[836]: 2026-10-12T10:04:20.537735Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100420Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=95d2a48cb5b397c77ff225d5b30b62f5c0c8f865c0bf9c99d0a0254ef649ff28 vm-test-run-nix-grpc-farm-k3s> machine # [ 374.164105] niks3-server[1190]: 2026/10/12 10:04:20 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 374.164961] garage[836]: 2026-10-12T10:04:20.543375Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 374.166095] garage[836]: 2026-10-12T10:04:20.544743Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 374.167257] niks3-server[1190]: 2026/10/12 10:04:20 INFO Signed narinfos id=19 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 374.168420] niks3-server[1190]: 2026/10/12 10:04:20 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 374.169602] garage[836]: 2026-10-12T10:04:20.545402Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100420Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6234b48a982bfe684fe65e85a4c07a6b64a7a8c3e5de53a3a37447def63f3ea8 vm-test-run-nix-grpc-farm-k3s> machine # [ 374.170425] niks3-server[1190]: 2026/10/12 10:04:20 INFO Received complete push request method=POST path=/api/pushes/19/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 374.171166] niks3-server[1190]: 2026/10/12 10:04:20 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 374.171698] garage[836]: 2026-10-12T10:04:20.548722Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 374.174122] niks3-server[1190]: 2026/10/12 10:04:20 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 399.012900] garage[836]: 2026-10-12T10:04:45.391155Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 399.015611] garage[836]: 2026-10-12T10:04:45.391700Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 399.018074] garage[836]: 2026-10-12T10:04:45.396529Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 399.020182] garage[836]: 2026-10-12T10:04:45.397172Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 399.292402] niks3-server[1190]: 2026/10/12 10:04:45 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 399.298650] garage[836]: 2026-10-12T10:04:45.677478Z INFO garage_api_common::generic_server: 10.42.0.6:49384 PUT /farm/nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100445Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=abe6329f265ca5d48196f23455d5da3e9490abf513bc18a930992ea1802c5496 vm-test-run-nix-grpc-farm-k3s> machine # [ 399.311594] garage[836]: 2026-10-12T10:04:45.678419Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100445Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=75506e1f402ad0822626f6680ce57ec3e6f5f7256eec98a561e9fc19c7a38d6e vm-test-run-nix-grpc-farm-k3s> machine # [ 399.323876] garage[836]: 2026-10-12T10:04:45.680746Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100445Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8236c70a495a20922effb418e6fa3dc3113305ef6938b698be9e25af8398cc99 vm-test-run-nix-grpc-farm-k3s> machine # [ 399.336155] garage[836]: 2026-10-12T10:04:45.682573Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 399.341803] garage[836]: 2026-10-12T10:04:45.685695Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 399.347320] niks3-server[1190]: 2026/10/12 10:04:45 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 399.350925] niks3-server[1190]: 2026/10/12 10:04:45 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 399.353900] niks3-server[1190]: 2026/10/12 10:04:45 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 399.356491] niks3-server[1190]: 2026/10/12 10:04:45 INFO Signed narinfos id=20 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 399.357592] niks3-server[1190]: 2026/10/12 10:04:45 INFO Received complete push request method=POST path=/api/pushes/20/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 399.359123] niks3-server[1190]: 2026/10/12 10:04:45 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 399.360680] niks3-server[1190]: 2026/10/12 10:04:45 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 399.362320] garage[836]: 2026-10-12T10:04:45.691725Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 399.364872] garage[836]: 2026-10-12T10:04:45.692548Z INFO garage_api_common::generic_server: 10.42.0.6:33782 PUT /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100445Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3945df1817773fdc6662274e9be1095094b358889accf733af14d9127e7f3413 vm-test-run-nix-grpc-farm-k3s> machine # [ 399.369884] garage[836]: 2026-10-12T10:04:45.695416Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 400.500220] systemd[1]: cri-containerd-a4eb513a4484d744bf7ba9585dac0bf996e57884b5c22850d86a7e6e68557d3e.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 400.503080] systemd[1]: cri-containerd-a4eb513a4484d744bf7ba9585dac0bf996e57884b5c22850d86a7e6e68557d3e.scope: Consumed 1.195s CPU time over 1min 45.512s wall clock time, 157.4M memory peak, 88.2M read from disk, 412K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine # [ 400.558650] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a4eb513a4484d744bf7ba9585dac0bf996e57884b5c22850d86a7e6e68557d3e-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.429136] systemd[1]: cri-containerd-5d0fc4a12008ead25a89a4ab376ea0a509a3b9e3a845fb43f5685b5857cfe1fe.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.471203] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5d0fc4a12008ead25a89a4ab376ea0a509a3b9e3a845fb43f5685b5857cfe1fe-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.502394] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-5d0fc4a12008ead25a89a4ab376ea0a509a3b9e3a845fb43f5685b5857cfe1fe-shm.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.685585] cni0: port 1(vethae7b03b4) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 402.538615] dhcpcd[658]: vethae7b03b4: carrier lost vm-test-run-nix-grpc-farm-k3s> machine # [ 402.688837] vethae7b03b4 (unregistering): left allmulticast mode vm-test-run-nix-grpc-farm-k3s> machine # [ 402.689953] vethae7b03b4 (unregistering): left promiscuous mode vm-test-run-nix-grpc-farm-k3s> machine # [ 402.691123] cni0: port 1(vethae7b03b4) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 402.561385] systemd[1]: run-netns-cni\x2de10f41f1\x2dc6dd\x2d494b\x2d8b2a\x2da4890976ab3a.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.567176] dhcpcd[658]: vethae7b03b4: deleting address fe80::4c78:ebff:fe46:d686 vm-test-run-nix-grpc-farm-k3s> machine # [ 402.570260] dhcpcd[658]: vethae7b03b4: deleting route to 169.254.0.0/16 vm-test-run-nix-grpc-farm-k3s> machine # [ 402.625267] dhcpcd[658]: vethae7b03b4: removing interface vm-test-run-nix-grpc-farm-k3s> machine # [ 402.744407] k3s[838]: I1012 10:04:49.122829 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-kube-api-access-4wl5d\" (UniqueName: \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-kube-api-access-4wl5d\") pod \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\" (UID: \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 402.752980] k3s[838]: I1012 10:04:49.122891 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-nix-grpc-farm\") pod \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\" (UID: \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 402.760736] k3s[838]: I1012 10:04:49.122934 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f039ce7-b30c-4971-b8e0-325d10b76bcc-job\" (UniqueName: \"kubernetes.io/configmap/9f039ce7-b30c-4971-b8e0-325d10b76bcc-job\") pod \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\" (UID: \"9f039ce7-b30c-4971-b8e0-325d10b76bcc\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 402.764892] k3s[838]: I1012 10:04:49.123415 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f039ce7-b30c-4971-b8e0-325d10b76bcc-job" pod "9f039ce7-b30c-4971-b8e0-325d10b76bcc" (UID: "9f039ce7-b30c-4971-b8e0-325d10b76bcc"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 402.768924] k3s[838]: I1012 10:04:49.132443 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-kube-api-access-4wl5d" pod "9f039ce7-b30c-4971-b8e0-325d10b76bcc" (UID: "9f039ce7-b30c-4971-b8e0-325d10b76bcc"). InnerVolumeSpecName "kube-api-access-4wl5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 402.774075] k3s[838]: I1012 10:04:49.140427 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-nix-grpc-farm" pod "9f039ce7-b30c-4971-b8e0-325d10b76bcc" (UID: "9f039ce7-b30c-4971-b8e0-325d10b76bcc"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 402.778261] systemd[1]: var-lib-kubelet-pods-9f039ce7\x2db30c\x2d4971\x2db8e0\x2d325d10b76bcc-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.780335] systemd[1]: var-lib-kubelet-pods-9f039ce7\x2db30c\x2d4971\x2db8e0\x2d325d10b76bcc-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d4wl5d.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.844688] k3s[838]: I1012 10:04:49.223443 838 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wl5d\" (UniqueName: \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-kube-api-access-4wl5d\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 402.852588] k3s[838]: I1012 10:04:49.223483 838 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/9f039ce7-b30c-4971-b8e0-325d10b76bcc-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 402.853998] k3s[838]: I1012 10:04:49.223498 838 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/9f039ce7-b30c-4971-b8e0-325d10b76bcc-job\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 402.948875] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice. vm-test-run-nix-grpc-farm-k3s> machine # [ 402.950821] systemd[1]: kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice: Consumed 1.224s CPU time over 1min 50.559s wall clock time, 157.7M memory peak, 88.2M read from disk, 612K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine # [ 403.415745] k3s[838]: I1012 10:04:49.793459 838 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d0fc4a12008ead25a89a4ab376ea0a509a3b9e3a845fb43f5685b5857cfe1fe" vm-test-run-nix-grpc-farm-k3s> machine # [ 403.417474] k3s[838]: E1012 10:04:49.793630 838 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice/memory.max: no such file or directory" podName="ci-pj292" vm-test-run-nix-grpc-farm-k3s> machine # [ 403.419401] k3s[838]: E1012 10:04:49.793668 838 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f039ce7_b30c_4971_b8e0_325d10b76bcc.slice/cpu.max: no such file or directory" podName="ci-pj292" vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 111.63 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.15 seconds) vm-test-run-nix-grpc-farm-k3s> machine # don't know how to build these paths: vm-test-run-nix-grpc-farm-k3s> machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... vm-test-run-nix-grpc-farm-k3s> machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... vm-test-run-nix-grpc-farm-k3s> machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... vm-test-run-nix-grpc-farm-k3s> machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-fvmgz: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv vm-test-run-nix-grpc-farm-k3s> machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... vm-test-run-nix-grpc-farm-k3s> machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... vm-test-run-nix-grpc-farm-k3s> machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... vm-test-run-nix-grpc-farm-k3s> machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-fvmgz: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... vm-test-run-nix-grpc-farm-k3s> machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... vm-test-run-nix-grpc-farm-k3s> machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... vm-test-run-nix-grpc-farm-k3s> machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-fvmgz: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpm0ehx_e4/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status vm-test-run-nix-grpc-farm-k3s> machine # INFO:nix_fast_build.workers:builds: 0 vm-test-run-nix-grpc-farm-k3s> machine # warning: Git tree '/tmp' is dirty vm-test-run-nix-grpc-farm-k3s> machine # warning: Git tree '/tmp' is dirty vm-test-run-nix-grpc-farm-k3s> machine # ▶ x86_64-linux.t started vm-test-run-nix-grpc-farm-k3s> machine # INFO:nix_fast_build.workers:builds: 2 vm-test-run-nix-grpc-farm-k3s> machine # ✔ x86_64-linux.t (27s) vm-test-run-nix-grpc-farm-k3s> machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv vm-test-run-nix-grpc-farm-k3s> machine # warning: Git tree '/tmp' is dirty vm-test-run-nix-grpc-farm-k3s> machine: must succeed: nix eval --raw -f /nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --argstr tag ci outPath vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: nix eval --raw -f /nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --argstr tag ci outPath, in 0.13 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null vm-test-run-nix-grpc-farm-k3s> machine # [ 404.869657] garage[836]: 2026-10-12T10:04:51.247878Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 404.876080] garage[836]: 2026-10-12T10:04:51.254913Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) GET /farm/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: a Job with the client image builds through the farm with its service account, in 113.40 seconds) vm-test-run-nix-grpc-farm-k3s> subtest: a renewed balancer certificate is served without a rollout vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/lb-renewed.crt --key=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - vm-test-run-nix-grpc-farm-k3s> machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/lb-renewed.crt --key=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.26 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.51 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-675f9c895f-gzqlz -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example vm-test-run-nix-grpc-farm-k3s> machine # [ 405.907253] k3s[838]: E1012 10:04:52.285809 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36052: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 407.186614] k3s[838]: E1012 10:04:53.565006 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36056: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 408.393732] k3s[838]: E1012 10:04:54.772090 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36058: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 409.667304] k3s[838]: E1012 10:04:56.044401 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36066: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-675f9c895f-gzqlz -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 4.01 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --argstr tag t-renewed 2>&1 vm-test-run-nix-grpc-farm-k3s> machine # [ 409.833483] garage[836]: 2026-10-12T10:04:56.211736Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 409.836128] garage[836]: 2026-10-12T10:04:56.211802Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 409.838819] garage[836]: 2026-10-12T10:04:56.212073Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 409.840786] garage[836]: 2026-10-12T10:04:56.212125Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 409.851141] garage[836]: 2026-10-12T10:04:56.230082Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 409.853959] garage[836]: 2026-10-12T10:04:56.230373Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 409.854594] garage[836]: 2026-10-12T10:04:56.232201Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 409.855074] garage[836]: 2026-10-12T10:04:56.232717Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 409.859105] garage[836]: 2026-10-12T10:04:56.238057Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 409.859877] garage[836]: 2026-10-12T10:04:56.238253Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 409.908672] niks3-server[1190]: 2026/10/12 10:04:56 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 409.912618] garage[836]: 2026-10-12T10:04:56.290896Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100456Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=09bb38d21a881340af0f42ab8da769edb7950a66a663e83bf24fcd1f21cb45e9 vm-test-run-nix-grpc-farm-k3s> machine # [ 409.913199] garage[836]: 2026-10-12T10:04:56.291334Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100456Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4a1964d51abf3a83b788e4e6b334267b3769176d41b4c614f2977451b2cf04ab vm-test-run-nix-grpc-farm-k3s> machine # [ 409.924295] niks3-server[1190]: 2026/10/12 10:04:56 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 409.925151] niks3-server[1190]: 2026/10/12 10:04:56 INFO Signed narinfos id=21 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 409.926676] garage[836]: 2026-10-12T10:04:56.303769Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 409.927648] garage[836]: 2026-10-12T10:04:56.304252Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 409.929341] garage[836]: 2026-10-12T10:04:56.305513Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100456Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=709a953fa1ac17395973946ecd45b723d7a67bc70f77360addce2dab4a44c407 vm-test-run-nix-grpc-farm-k3s> machine # [ 409.930139] niks3-server[1190]: 2026/10/12 10:04:56 INFO Received complete push request method=POST path=/api/pushes/21/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 409.930798] niks3-server[1190]: 2026/10/12 10:04:56 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 409.931527] niks3-server[1190]: 2026/10/12 10:04:56 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 409.932129] garage[836]: 2026-10-12T10:04:56.310032Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 409.933530] niks3-server[1190]: 2026/10/12 10:04:56 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 415.281863] postgres[725]: [725] LOG: checkpoint complete: wrote 1039 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.294 s, sync=0.042 s, total=104.376 s; sync files=364, longest=0.004 s, average=0.001 s; distance=5021 kB, estimate=5021 kB; lsn=0/1C7CA38, redo lsn=0/1C4D830 vm-test-run-nix-grpc-farm-k3s> machine # [ 434.287411] garage[836]: 2026-10-12T10:05:20.665607Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.289555] garage[836]: 2026-10-12T10:05:20.666231Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 434.300538] garage[836]: 2026-10-12T10:05:20.679412Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.306725] garage[836]: 2026-10-12T10:05:20.679878Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 434.433717] niks3-server[1190]: 2026/10/12 10:05:20 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 434.438305] garage[836]: 2026-10-12T10:05:20.816562Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe96d4dd902a1189da9b32ea19759d54c6eaa67c437a4bd8b4fc727e4a2bf27e vm-test-run-nix-grpc-farm-k3s> machine # [ 434.441231] garage[836]: 2026-10-12T10:05:20.816642Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3252175379b0e5c02e25e0797f17fce7dfa95b589d06535ca87d6d9de8dc829f vm-test-run-nix-grpc-farm-k3s> machine # [ 434.443499] garage[836]: 2026-10-12T10:05:20.817148Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b600fbee63840b7f17a5aae1424657fcce6b5a5556e665ce7c042e1fdd3f357a vm-test-run-nix-grpc-farm-k3s> machine # [ 434.445114] garage[836]: 2026-10-12T10:05:20.819117Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 434.446356] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 434.481757] niks3-server[1190]: 2026/10/12 10:05:20 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 434.484710] niks3-server[1190]: 2026/10/12 10:05:20 INFO Signed narinfos id=22 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 434.486945] garage[836]: 2026-10-12T10:05:20.860806Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 434.491962] garage[836]: 2026-10-12T10:05:20.862097Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 434.494718] garage[836]: 2026-10-12T10:05:20.862377Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6378d63228d22096dad82d40b8a16c0e46e9e3829e376bb2b9a391db4d8cf615 vm-test-run-nix-grpc-farm-k3s> machine # [ 434.499684] garage[836]: 2026-10-12T10:05:20.864891Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.502272] niks3-server[1190]: 2026/10/12 10:05:20 INFO Received complete push request method=POST path=/api/pushes/22/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 434.503758] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 434.505388] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 434.507111] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.508852] garage[836]: 2026-10-12T10:05:20.879395Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.511743] garage[836]: 2026-10-12T10:05:20.879614Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 434.513681] garage[836]: 2026-10-12T10:05:20.880949Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.516366] garage[836]: 2026-10-12T10:05:20.881184Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 434.517045] garage[836]: 2026-10-12T10:05:20.884760Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.517678] garage[836]: 2026-10-12T10:05:20.884948Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 434.555032] niks3-server[1190]: 2026/10/12 10:05:20 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 434.560426] garage[836]: 2026-10-12T10:05:20.939360Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d408601aab104ebcd2c38e9f01533cf95833cafbe682e6bdd65f223d5a604648 vm-test-run-nix-grpc-farm-k3s> machine # [ 434.566453] garage[836]: 2026-10-12T10:05:20.939800Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c89e1dc9a3877626a16aad2a8f8deb615701b542e365f083060a40689f10dbaa vm-test-run-nix-grpc-farm-k3s> machine # [ 434.567143] garage[836]: 2026-10-12T10:05:20.941208Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 434.567820] garage[836]: 2026-10-12T10:05:20.943082Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 434.568662] garage[836]: 2026-10-12T10:05:20.943662Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100520Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b845597bda6361e70490bd094e6b221e1608751c810005f43838a4e0607de907 vm-test-run-nix-grpc-farm-k3s> machine # [ 434.569701] niks3-server[1190]: 2026/10/12 10:05:20 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 434.571463] niks3-server[1190]: 2026/10/12 10:05:20 INFO Signed narinfos id=23 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 434.572212] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 434.572965] niks3-server[1190]: 2026/10/12 10:05:20 INFO Received complete push request method=POST path=/api/pushes/23/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 434.573769] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 434.574682] niks3-server[1190]: 2026/10/12 10:05:20 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 434.575561] garage[836]: 2026-10-12T10:05:20.947392Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.167748] garage[836]: 2026-10-12T10:05:45.546288Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.168617] garage[836]: 2026-10-12T10:05:45.546585Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 459.173885] garage[836]: 2026-10-12T10:05:45.552822Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.174516] garage[836]: 2026-10-12T10:05:45.553054Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 459.258826] niks3-server[1190]: 2026/10/12 10:05:45 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 459.264312] garage[836]: 2026-10-12T10:05:45.643239Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=de4ba7be96c90a44735bc88e44aee5e06811470ec3659a320baa01116621e6d7 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.266996] garage[836]: 2026-10-12T10:05:45.644467Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d121545b78d4a48e3aa6f523993f228aa7f7511f73a98dbf4a7ea6df890130e1 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.275470] garage[836]: 2026-10-12T10:05:45.654422Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bade2d40e03320ccaddd73a4c79230dc088058fb6c1699fb820745a17ee031 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.281489] garage[836]: 2026-10-12T10:05:45.660203Z INFO garage_api_common::generic_server: 192.168.1.1:49234 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 459.282117] garage[836]: 2026-10-12T10:05:45.660244Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 459.284454] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 459.288853] niks3-server[1190]: 2026/10/12 10:05:45 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 459.289639] niks3-server[1190]: 2026/10/12 10:05:45 INFO Signed narinfos id=24 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.290223] garage[836]: 2026-10-12T10:05:45.669159Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 459.290832] garage[836]: 2026-10-12T10:05:45.669509Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae03503f4481c3482b85fa8369dff1aa9a6d9d3b84d583f095f1042f1f4a33c1 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.291723] niks3-server[1190]: 2026/10/12 10:05:45 INFO Received complete push request method=POST path=/api/pushes/24/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 459.301238] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 459.303650] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 459.305851] garage[836]: 2026-10-12T10:05:45.680690Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.309076] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.314996] garage[836]: 2026-10-12T10:05:45.693950Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.315825] garage[836]: 2026-10-12T10:05:45.694189Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 459.321268] garage[836]: 2026-10-12T10:05:45.700218Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.321993] garage[836]: 2026-10-12T10:05:45.700418Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 459.329865] garage[836]: 2026-10-12T10:05:45.708782Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.333299] garage[836]: 2026-10-12T10:05:45.709174Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 459.373583] niks3-server[1190]: 2026/10/12 10:05:45 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 459.377917] garage[836]: 2026-10-12T10:05:45.756834Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3e295075dae0a490c788e9c5e364c1b005e22e1f3824a540773e4255e7ab92c4 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.378658] garage[836]: 2026-10-12T10:05:45.757304Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3d43aeccd429fb00e8edaa68ba54bd0b23ea161d4e0d1a08ea4a32a1f65d0575 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.380338] niks3-server[1190]: 2026/10/12 10:05:45 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 459.381981] garage[836]: 2026-10-12T10:05:45.759274Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 459.382861] garage[836]: 2026-10-12T10:05:45.760077Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 459.383865] garage[836]: 2026-10-12T10:05:45.760569Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100545Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4b43c3ca9be2e67697d5299f951c69f259b5bbbba2731342aa055934765a14f1 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.384648] niks3-server[1190]: 2026/10/12 10:05:45 INFO Signed narinfos id=25 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 459.385216] niks3-server[1190]: 2026/10/12 10:05:45 INFO Received complete push request method=POST path=/api/pushes/25/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 459.385861] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 459.387227] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 459.387910] garage[836]: 2026-10-12T10:05:45.762568Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 459.388426] niks3-server[1190]: 2026/10/12 10:05:45 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 483.551041] garage[836]: 2026-10-12T10:06:09.929638Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 483.551800] garage[836]: 2026-10-12T10:06:09.929928Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 483.562549] garage[836]: 2026-10-12T10:06:09.941512Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 483.563684] garage[836]: 2026-10-12T10:06:09.941690Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 483.869862] niks3-server[1190]: 2026/10/12 10:06:10 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 483.877988] garage[836]: 2026-10-12T10:06:10.255712Z INFO garage_api_common::generic_server: 10.42.0.9:38552 PUT /farm/nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100610Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f320be3c3a46bae30b68ca07aecb7f3810993b13f143bbfb474bd4bf05c5f07f vm-test-run-nix-grpc-farm-k3s> machine # [ 483.879572] garage[836]: 2026-10-12T10:06:10.256547Z INFO garage_api_common::generic_server: 10.42.0.9:42672 PUT /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100610Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=06c4876e39aa3ebcfe29d57b83b25526c6d369b1160cf559cb8fa03c26cb3263 vm-test-run-nix-grpc-farm-k3s> machine # [ 483.884701] garage[836]: 2026-10-12T10:06:10.256847Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100610Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f2ad7b4f300d1fd018a489c3a82f9d09a8671a50b4e00dbb2234a6a98341889d vm-test-run-nix-grpc-farm-k3s> machine # [ 483.886992] garage[836]: 2026-10-12T10:06:10.258954Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 483.888494] garage[836]: 2026-10-12T10:06:10.260845Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 483.890447] niks3-server[1190]: 2026/10/12 10:06:10 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 483.891539] niks3-server[1190]: 2026/10/12 10:06:10 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 483.928874] niks3-server[1190]: 2026/10/12 10:06:10 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 483.929551] garage[836]: 2026-10-12T10:06:10.308190Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 483.931145] niks3-server[1190]: 2026/10/12 10:06:10 INFO Signed narinfos id=26 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 483.931955] niks3-server[1190]: 2026/10/12 10:06:10 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 483.932657] garage[836]: 2026-10-12T10:06:10.311536Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100610Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9dd15653bc674c837dea5d7ac057e9ed1e93fd789b7343218433da20f7fc4a41 vm-test-run-nix-grpc-farm-k3s> machine # [ 483.933883] niks3-server[1190]: 2026/10/12 10:06:10 INFO Received complete push request method=POST path=/api/pushes/26/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 483.934650] garage[836]: 2026-10-12T10:06:10.313584Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 483.936648] niks3-server[1190]: 2026/10/12 10:06:10 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/slmy5blibr1xsfgc3m4589bwni8f6nzn-job.nix --argstr tag t-renewed 2>&1, in 74.26 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: a renewed balancer certificate is served without a rollout, in 79.09 seconds) vm-test-run-nix-grpc-farm-k3s> subtest: metrics carry build_info vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -o jsonpath='{.items[0].status.podIP}{.status.podIP}' vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl"' vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl"', in 0.02 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: metrics carry build_info, in 0.16 seconds) vm-test-run-nix-grpc-farm-k3s> subtest: harmonia-gc frees space and the worker stays Ready vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' vm-test-run-nix-grpc-farm-k3s> machine # [ 484.283064] k3s[838]: E1012 10:06:10.661314 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55042: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.15 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' vm-test-run-nix-grpc-farm-k3s> machine # [ 484.502060] k3s[838]: E1012 10:06:10.880938 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55052: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.23 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'fallocate -l 11436773376 /nix/fill' vm-test-run-nix-grpc-farm-k3s> machine # [ 484.715818] k3s[838]: E1012 10:06:11.094738 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55054: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'fallocate -l 11436773376 /nix/fill', in 0.20 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc --since=30s | grep -q 'store paths deleted' vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc --since=30s | grep -q 'store paths deleted', in 8.47 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'rm /nix/fill' vm-test-run-nix-grpc-farm-k3s> machine # [ 493.340442] k3s[838]: E1012 10:06:19.719062 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43162: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'rm /nix/fill', in 0.16 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.11 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'command -v nix-daemon && command -v niks3' vm-test-run-nix-grpc-farm-k3s> machine # [ 493.628143] k3s[838]: E1012 10:06:20.006861 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43168: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 9.49 seconds) vm-test-run-nix-grpc-farm-k3s> subtest: losing the balancer mid-build: the client reconnects and the build succeeds vm-test-run-nix-grpc-farm-k3s> machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag lb1 vm-test-run-nix-grpc-farm-k3s> machine # [ 493.647890] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag lb1. vm-test-run-nix-grpc-farm-k3s> machine # Running as unit: vialb.service; invocation ID: 84f72672be0140eb8ec10bcf685faee2 vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag lb1, in 0.02 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" vm-test-run-nix-grpc-farm-k3s> machine # [ 493.756936] nix[13715]: don't know how to build these paths: vm-test-run-nix-grpc-farm-k3s> machine # [ 493.759349] nix[13715]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 493.767118] garage[836]: 2026-10-12T10:06:20.145770Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 493.772998] garage[836]: 2026-10-12T10:06:20.151950Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 493.779383] garage[836]: 2026-10-12T10:06:20.158329Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 493.785495] garage[836]: 2026-10-12T10:06:20.164434Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 493.794246] garage[836]: 2026-10-12T10:06:20.172919Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 493.794845] garage[836]: 2026-10-12T10:06:20.173414Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 493.796809] nix[13715]: copying 1 paths to '127.0.0.1:30051'... vm-test-run-nix-grpc-farm-k3s> machine # [ 493.798291] nix[13715]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... vm-test-run-nix-grpc-farm-k3s> machine # [ 493.846792] niks3-server[1190]: 2026/10/12 10:06:20 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 493.852825] garage[836]: 2026-10-12T10:06:20.231730Z INFO garage_api_common::generic_server: 10.42.0.6:46704 PUT /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100620Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9d65856b9e0a24bd443116fc0b2ea40abd9a16662a30c0dd9ed308d0eb800180 vm-test-run-nix-grpc-farm-k3s> machine # [ 493.866473] garage[836]: 2026-10-12T10:06:20.245313Z INFO garage_api_common::generic_server: 10.42.0.6:46704 PUT /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100620Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edf39c30a20aea4ae2ea7740593d5f4367de1beb276accce2689734621cbee23 vm-test-run-nix-grpc-farm-k3s> machine # [ 493.877749] garage[836]: 2026-10-12T10:06:20.256099Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 493.879224] niks3-server[1190]: 2026/10/12 10:06:20 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 493.881140] niks3-server[1190]: 2026/10/12 10:06:20 INFO Signed narinfos id=27 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 493.882194] niks3-server[1190]: 2026/10/12 10:06:20 INFO Received complete push request method=POST path=/api/pushes/27/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 493.883194] garage[836]: 2026-10-12T10:06:20.258766Z INFO garage_api_common::generic_server: 10.42.0.6:46704 PUT /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100620Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=32a53d447e8b41aa1da52283e23c05540a489c5523cc94b50b6d656bfdf045c7 vm-test-run-nix-grpc-farm-k3s> machine # [ 493.884866] garage[836]: 2026-10-12T10:06:20.260865Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 493.886313] niks3-server[1190]: 2026/10/12 10:06:20 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 493.887252] niks3-server[1190]: 2026/10/12 10:06:20 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 493.894189] nix[13715]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... vm-test-run-nix-grpc-farm-k3s> machine # [ 493.894929] nix[13715]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.04 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.29 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: ! systemctl is-active vialb vm-test-run-nix-grpc-farm-k3s> machine # [ 495.009653] nix[13715]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again vm-test-run-nix-grpc-farm-k3s> machine # [ 495.011180] nix[13715]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting vm-test-run-nix-grpc-farm-k3s> machine # [ 495.027751] systemd[1]: cri-containerd-cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.029997] systemd[1]: cri-containerd-cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e.scope: Consumed 3.140s CPU time over 7min 20.738s wall clock time, 60.1M memory peak, 38.5M read from disk, 581.4K incoming IP traffic, 709.7K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.052983] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.084665] systemd[1]: cri-containerd-da588150b9e063abdcce2be0a5fb389ca36861b5fc9475b7c29a255210eec61e.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.110825] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-da588150b9e063abdcce2be0a5fb389ca36861b5fc9475b7c29a255210eec61e-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.135823] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod45826622_df24_4edc_9099_0c702cf5f7a8.slice. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.146190] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-da588150b9e063abdcce2be0a5fb389ca36861b5fc9475b7c29a255210eec61e-shm.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.321546] cni0: port 4(veth3ff748c7) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 495.175547] dhcpcd[658]: veth3ff748c7: carrier lost vm-test-run-nix-grpc-farm-k3s> machine # [ 495.324242] veth3ff748c7 (unregistering): left allmulticast mode vm-test-run-nix-grpc-farm-k3s> machine # [ 495.325388] veth3ff748c7 (unregistering): left promiscuous mode vm-test-run-nix-grpc-farm-k3s> machine # [ 495.326533] cni0: port 4(veth3ff748c7) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 495.197433] systemd[1]: run-netns-cni\x2de4af09c5\x2d3353\x2d2b4f\x2d0b39\x2d3badb2bbd62c.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.198974] dhcpcd[658]: veth3ff748c7: deleting address fe80::187f:85ff:fe91:782b vm-test-run-nix-grpc-farm-k3s> machine # [ 495.202206] dhcpcd[658]: veth3ff748c7: deleting route to 169.254.0.0/16 vm-test-run-nix-grpc-farm-k3s> machine # [ 495.239091] k3s[838]: I1012 10:06:21.617736 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/45826622-df24-4edc-9099-0c702cf5f7a8-tls-lb\") pod \"nix-grpc-farm-lb-675f9c895f-z79v4\" (UID: \"45826622-df24-4edc-9099-0c702cf5f7a8\") " pod="farm/nix-grpc-farm-lb-675f9c895f-z79v4" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.240095] k3s[838]: I1012 10:06:21.618652 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45826622-df24-4edc-9099-0c702cf5f7a8-config\") pod \"nix-grpc-farm-lb-675f9c895f-z79v4\" (UID: \"45826622-df24-4edc-9099-0c702cf5f7a8\") " pod="farm/nix-grpc-farm-lb-675f9c895f-z79v4" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.240766] k3s[838]: I1012 10:06:21.618692 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45826622-df24-4edc-9099-0c702cf5f7a8-tmp\") pod \"nix-grpc-farm-lb-675f9c895f-z79v4\" (UID: \"45826622-df24-4edc-9099-0c702cf5f7a8\") " pod="farm/nix-grpc-farm-lb-675f9c895f-z79v4" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.241548] k3s[838]: I1012 10:06:21.618717 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/45826622-df24-4edc-9099-0c702cf5f7a8-tls-ca\") pod \"nix-grpc-farm-lb-675f9c895f-z79v4\" (UID: \"45826622-df24-4edc-9099-0c702cf5f7a8\") " pod="farm/nix-grpc-farm-lb-675f9c895f-z79v4" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.272308] dhcpcd[658]: veth3ff748c7: removing interface vm-test-run-nix-grpc-farm-k3s> machine # [ 495.340147] k3s[838]: I1012 10:06:21.719076 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tmp\") pod \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\" (UID: \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 495.340741] k3s[838]: I1012 10:06:21.719134 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-ca\" (UniqueName: \"kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-ca\") pod \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\" (UID: \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 495.341203] k3s[838]: I1012 10:06:21.719162 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-lb\" (UniqueName: \"kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-lb\") pod \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\" (UID: \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 495.341634] k3s[838]: I1012 10:06:21.719194 838 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be2a2726-ccf6-4aa6-a409-973cc2b3db09-config\" (UniqueName: \"kubernetes.io/configmap/be2a2726-ccf6-4aa6-a409-973cc2b3db09-config\") pod \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\" (UID: \"be2a2726-ccf6-4aa6-a409-973cc2b3db09\") " vm-test-run-nix-grpc-farm-k3s> machine # [ 495.357868] k3s[838]: I1012 10:06:21.736811 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-ca" pod "be2a2726-ccf6-4aa6-a409-973cc2b3db09" (UID: "be2a2726-ccf6-4aa6-a409-973cc2b3db09"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.358493] k3s[838]: I1012 10:06:21.736847 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tmp" pod "be2a2726-ccf6-4aa6-a409-973cc2b3db09" (UID: "be2a2726-ccf6-4aa6-a409-973cc2b3db09"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.366165] k3s[838]: I1012 10:06:21.745097 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-lb" pod "be2a2726-ccf6-4aa6-a409-973cc2b3db09" (UID: "be2a2726-ccf6-4aa6-a409-973cc2b3db09"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.373865] k3s[838]: I1012 10:06:21.752767 838 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2a2726-ccf6-4aa6-a409-973cc2b3db09-config" pod "be2a2726-ccf6-4aa6-a409-973cc2b3db09" (UID: "be2a2726-ccf6-4aa6-a409-973cc2b3db09"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.441476] k3s[838]: I1012 10:06:21.820414 838 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tmp\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.442145] k3s[838]: I1012 10:06:21.820440 838 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-ca\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.442568] k3s[838]: I1012 10:06:21.820453 838 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/be2a2726-ccf6-4aa6-a409-973cc2b3db09-tls-lb\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.443059] k3s[838]: I1012 10:06:21.820467 838 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be2a2726-ccf6-4aa6-a409-973cc2b3db09-config\") on node \"machine\" DevicePath \"\"" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.469703] (udev-worker)[13908]: Network interface NamePolicy= disabled on kernel command li[ 495.617430] cni0: port 1(vetha5bc1f23) entered blocking state vm-test-run-nix-grpc-farm-k3s> machine # ne. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.618842] cni0: port 1(vetha5bc1f23) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 495.620184] vetha5bc1f23: entered allmulticast mode vm-test-run-nix-grpc-farm-k3s> machine # [ 495.620978] vetha5bc1f23: entered promiscuous mode vm-test-run-nix-grpc-farm-k3s> machine # [ 495.630178] cni0: port 1(vetha5bc1f23) entered blocking state vm-test-run-nix-grpc-farm-k3s> machine # [ 495.632188] cni0: port 1(vetha5bc1f23) entered forwarding state vm-test-run-nix-grpc-farm-k3s> machine # [ 495.499621] dhcpcd[658]: vetha5bc1f23: IAID 43:df:31:87 vm-test-run-nix-grpc-farm-k3s> machine # [ 495.500494] dhcpcd[658]: vetha5bc1f23: adding address fe80::f0b8:43ff:fedf:3187 vm-test-run-nix-grpc-farm-k3s> machine # [ 495.558333] systemd[1]: Started libcontainer container fbd5834fd424dc056f550abfcfa260c142a7447d9eeb1644f000818de971d817. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.588720] dhcpcd[658]: vetha5bc1f23: soliciting a DHCP lease vm-test-run-nix-grpc-farm-k3s> machine # [ 495.670356] systemd[1]: Started libcontainer container 76f55c4defc98d0fe4dbac4ca8ece8f109d0941b9cf0127b1eaaea8a57591fef. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.728726] k3s[838]: I1012 10:06:22.107645 838 scope.go:122] "RemoveContainer" containerID="cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.737464] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podbe2a2726_ccf6_4aa6_a409_973cc2b3db09.slice. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.738626] systemd[1]: kubepods-besteffort-podbe2a2726_ccf6_4aa6_a409_973cc2b3db09.slice: Consumed 3.172s CPU time over 7min 23.468s wall clock time, 60.3M memory peak, 38.5M read from disk, 581.4K incoming IP traffic, 709.7K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine # [ 495.746194] k3s[838]: I1012 10:06:22.125136 838 scope.go:122] "RemoveContainer" containerID="cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.749809] k3s[838]: E1012 10:06:22.128706 838 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e\": not found" containerID="cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.750727] k3s[838]: I1012 10:06:22.128744 838 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e"} err="failed to get container status \"cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e\": rpc error: code = NotFound desc = an error occurred when try to find container \"cf88958393cd6fafb6fdd962b67aa5436948a0ea62dfd6e7a83fa2ba9705f46e\": not found" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.759628] k3s[838]: I1012 10:06:22.138546 838 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-675f9c895f-z79v4" podStartSLOduration=1.138522996 podStartE2EDuration="1.138522996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-12 10:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-12 10:06:22.122863464 +0000 UTC m=+478.354143560" watchObservedRunningTime="2026-10-12 10:06:22.138522996 +0000 UTC m=+478.369803092" vm-test-run-nix-grpc-farm-k3s> machine # [ 495.762894] k3s[838]: I1012 10:06:22.141837 838 endpointslice_controller.go:358] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date" vm-test-run-nix-grpc-farm-k3s> machine # [ 496.060913] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volume\x2dsubpaths-config-envoy-3.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.061637] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.062199] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.062684] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.063144] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.063618] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.064102] systemd[1]: var-lib-kubelet-pods-be2a2726\x2dccf6\x2d4aa6\x2da409\x2d973cc2b3db09-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 496.942982] k3s[838]: I1012 10:06:23.321190 838 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be2a2726-ccf6-4aa6-a409-973cc2b3db09" path="/var/lib/kubelet/pods/be2a2726-ccf6-4aa6-a409-973cc2b3db09/volumes" vm-test-run-nix-grpc-farm-k3s> machine # [ 497.511939] nix[13715]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting vm-test-run-nix-grpc-farm-k3s> machine # [ 497.849481] dhcpcd[658]: vetha5bc1f23: soliciting an IPv6 router vm-test-run-nix-grpc-farm-k3s> machine # [ 498.530534] garage[836]: 2026-10-12T10:06:24.908744Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 498.537113] garage[836]: 2026-10-12T10:06:24.915992Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) GET /farm/d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 498.545506] garage[836]: 2026-10-12T10:06:24.924409Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 498.552759] garage[836]: 2026-10-12T10:06:24.925512Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) GET /farm/nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 498.559901] nix[13715]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... vm-test-run-nix-grpc-farm-k3s> machine # [ 498.563172] nix[13715]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-fvmgz: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 500.591262] dhcpcd[658]: vetha5bc1f23: probing for an IPv4LL address vm-test-run-nix-grpc-farm-k3s> machine # [ 505.565819] dhcpcd[658]: vetha5bc1f23: using IPv4LL address 169.254.136.98 vm-test-run-nix-grpc-farm-k3s> machine # [ 505.568538] dhcpcd[658]: vetha5bc1f23: adding route to 169.254.0.0/16 vm-test-run-nix-grpc-farm-k3s> machine # [ 509.852079] dhcpcd[658]: vetha5bc1f23: no IPv6 Routers available vm-test-run-nix-grpc-farm-k3s> machine # [ 522.994730] garage[836]: 2026-10-12T10:06:49.372960Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 522.996463] garage[836]: 2026-10-12T10:06:49.373543Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 522.998988] garage[836]: 2026-10-12T10:06:49.377894Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 523.001242] garage[836]: 2026-10-12T10:06:49.378348Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 543.299110] niks3-server[1190]: 2026/10/12 10:07:09 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 543.310277] garage[836]: 2026-10-12T10:07:09.688492Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7bbd9e90dee486726486cc13b1eeb8dbd6217c3fa10fc7dd73028da53f138daa vm-test-run-nix-grpc-farm-k3s> machine # [ 543.315217] garage[836]: 2026-10-12T10:07:09.693359Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=46715987d3c77b84011ee9cc16ed302d4e9d68882fad067a8d324f08380d310f vm-test-run-nix-grpc-farm-k3s> machine # [ 543.317771] garage[836]: 2026-10-12T10:07:09.695728Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 543.322322] niks3-server[1190]: 2026/10/12 10:07:09 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 543.341674] niks3-server[1190]: 2026/10/12 10:07:09 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 543.343209] niks3-server[1190]: 2026/10/12 10:07:09 INFO Signed narinfos id=28 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 543.344878] garage[836]: 2026-10-12T10:07:09.720693Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 543.345523] garage[836]: 2026-10-12T10:07:09.722966Z INFO garage_api_common::generic_server: 10.42.0.9:46900 PUT /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=144348433020a6d972d1abc0efabe3e6d8b84474192d4ab7e596e91c88c8603a vm-test-run-nix-grpc-farm-k3s> machine # [ 543.347207] niks3-server[1190]: 2026/10/12 10:07:09 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 543.348236] niks3-server[1190]: 2026/10/12 10:07:09 INFO Received complete push request method=POST path=/api/pushes/28/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 543.349122] garage[836]: 2026-10-12T10:07:09.726820Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 543.358124] niks3-server[1190]: 2026/10/12 10:07:09 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 543.400813] systemd[1]: vialb.service: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 543.402379] systemd[1]: vialb.service: Consumed 184ms CPU time over 49.753s wall clock time, 39.9M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.80 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.27 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.46 seconds) vm-test-run-nix-grpc-farm-k3s> subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes vm-test-run-nix-grpc-farm-k3s> machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag s1 vm-test-run-nix-grpc-farm-k3s> machine # [ 544.125927] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag s1. vm-test-run-nix-grpc-farm-k3s> machine # Running as unit: slow.service; invocation ID: b658b1b1f59b457b8d1754c5a44406d0 vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/ycrz3hdwgsjgfs805qh70s9pzh6mmvik-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag s1, in 0.04 seconds) vm-test-run-nix-grpc-farm-k3s> machine # [ 544.260267] nix[15253]: don't know how to build these paths: vm-test-run-nix-grpc-farm-k3s> machine # [ 544.260972] nix[15253]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 544.275832] garage[836]: 2026-10-12T10:07:10.654705Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 544.276740] garage[836]: 2026-10-12T10:07:10.655157Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 544.278171] garage[836]: 2026-10-12T10:07:10.657107Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 544.278858] garage[836]: 2026-10-12T10:07:10.657430Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 544.285150] garage[836]: 2026-10-12T10:07:10.664092Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 544.285655] garage[836]: 2026-10-12T10:07:10.664339Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 544.287133] nix[15253]: copying 1 paths to '127.0.0.1:30051'... vm-test-run-nix-grpc-farm-k3s> machine # [ 544.288056] nix[15253]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... vm-test-run-nix-grpc-farm-k3s> machine # [ 544.320931] k3s[838]: E1012 10:07:10.699511 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39838: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 544.334195] niks3-server[1190]: 2026/10/12 10:07:10 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 544.339984] garage[836]: 2026-10-12T10:07:10.717959Z INFO garage_api_common::generic_server: 10.42.0.6:46704 PUT /farm/nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100710Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c764f6dc3b0566c618f2d8318465443cfeb798536034e7acdd854de11321566 vm-test-run-nix-grpc-farm-k3s> machine # [ 544.340571] garage[836]: 2026-10-12T10:07:10.718543Z INFO garage_api_common::generic_server: 10.42.0.6:38672 PUT /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100710Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=69cdde32e7b7de6f4a8d6fa0c92ea81b241f98473330782f0e207826879e6108 vm-test-run-nix-grpc-farm-k3s> machine # [ 544.343419] garage[836]: 2026-10-12T10:07:10.722351Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 544.344112] niks3-server[1190]: 2026/10/12 10:07:10 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 544.345126] niks3-server[1190]: 2026/10/12 10:07:10 INFO Signed narinfos id=29 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 544.346325] garage[836]: 2026-10-12T10:07:10.725271Z INFO garage_api_common::generic_server: 10.42.0.6:38672 PUT /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100710Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e1e3f03ab2e7659327ce19be68ea751248798f19d0013385fba5d004eb1f8e1f vm-test-run-nix-grpc-farm-k3s> machine # [ 544.347121] niks3-server[1190]: 2026/10/12 10:07:10 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst vm-test-run-nix-grpc-farm-k3s> machine # [ 544.348371] niks3-server[1190]: 2026/10/12 10:07:10 INFO Received complete push request method=POST path=/api/pushes/29/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 544.350040] garage[836]: 2026-10-12T10:07:10.728971Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 544.353081] niks3-server[1190]: 2026/10/12 10:07:10 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 544.375027] nix[15253]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... vm-test-run-nix-grpc-farm-k3s> machine # [ 544.375811] nix[15253]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 544.529374] k3s[838]: E1012 10:07:10.908152 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39848: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 545.840373] k3s[838]: E1012 10:07:12.218931 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39854: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 546.072896] k3s[838]: E1012 10:07:12.451754 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39868: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 547.369076] k3s[838]: E1012 10:07:13.747489 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39872: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 547.587576] k3s[838]: E1012 10:07:13.966442 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39886: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 548.884089] k3s[838]: E1012 10:07:15.261817 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39896: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 549.116212] k3s[838]: E1012 10:07:15.494166 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39898: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 550.384271] k3s[838]: E1012 10:07:16.762740 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39902: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 550.605110] k3s[838]: E1012 10:07:16.983597 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39904: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 551.900521] k3s[838]: E1012 10:07:18.278145 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39916: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 552.118331] k3s[838]: E1012 10:07:18.497200 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39920: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 553.321586] k3s[838]: E1012 10:07:19.699857 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33210: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 553.516163] k3s[838]: E1012 10:07:19.895010 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33224: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 554.849660] k3s[838]: E1012 10:07:21.227917 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33228: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 555.067648] k3s[838]: E1012 10:07:21.446474 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33242: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 556.346460] k3s[838]: E1012 10:07:22.724870 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33244: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 556.567465] k3s[838]: E1012 10:07:22.945903 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33252: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 557.805429] k3s[838]: E1012 10:07:24.183937 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33266: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 558.033425] k3s[838]: E1012 10:07:24.412295 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33272: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 559.340638] k3s[838]: E1012 10:07:25.718825 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33276: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 559.557073] k3s[838]: E1012 10:07:25.935883 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33280: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 560.846157] k3s[838]: E1012 10:07:27.224198 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33286: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 561.111151] k3s[838]: E1012 10:07:27.489567 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33292: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 562.388856] k3s[838]: E1012 10:07:28.766482 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33308: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 562.644381] k3s[838]: E1012 10:07:29.023166 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33318: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 563.928560] k3s[838]: E1012 10:07:30.306682 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51410: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 564.146407] k3s[838]: E1012 10:07:30.525241 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51414: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 565.434485] k3s[838]: E1012 10:07:31.812891 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51430: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 565.669512] k3s[838]: E1012 10:07:32.048341 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51446: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 566.977764] k3s[838]: E1012 10:07:33.356293 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51458: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 567.183920] k3s[838]: E1012 10:07:33.562760 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51472: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 568.437934] k3s[838]: E1012 10:07:34.816412 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51474: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 568.646126] k3s[838]: E1012 10:07:35.024958 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51480: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # command terminated with exit code 1 vm-test-run-nix-grpc-farm-k3s> machine # [ 569.331613] garage[836]: 2026-10-12T10:07:35.709648Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 569.338079] garage[836]: 2026-10-12T10:07:35.710088Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 569.342702] garage[836]: 2026-10-12T10:07:35.713886Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 569.348765] garage[836]: 2026-10-12T10:07:35.714084Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found vm-test-run-nix-grpc-farm-k3s> machine # [ 569.932850] k3s[838]: E1012 10:07:36.311360 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51496: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.152754] k3s[838]: E1012 10:07:36.530923 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51508: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl --wait=false vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-46lwl --wait=false, in 0.17 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: sleep 5.0 vm-test-run-nix-grpc-farm-k3s> machine # [ 570.391914] k3s[838]: E1012 10:07:36.770766 838 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c\" failed with read version: 837 is not as new as written version: 857 for group resource replicasets.apps" logger="UnhandledError" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.401637] systemd[1]: cri-containerd-12e4dc9e1d496e372d78c26fcf130a4ae07d6b5b1a8dfb30a1ee2904bc60e2c2.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 570.403591] systemd[1]: cri-containerd-12e4dc9e1d496e372d78c26fcf130a4ae07d6b5b1a8dfb30a1ee2904bc60e2c2.scope: Consumed 525ms CPU time over 8min 28.650s wall clock time, 13.9M memory peak, 5.4M read from disk. vm-test-run-nix-grpc-farm-k3s> machine # [ 570.426434] systemd[1]: Created slice libcontainer container kubepods-besteffort-podac5505f0_7f9b_42bd_88a0_4a3974199a77.slice. vm-test-run-nix-grpc-farm-k3s> machine # [ 570.456800] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-12e4dc9e1d496e372d78c26fcf130a4ae07d6b5b1a8dfb30a1ee2904bc60e2c2-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 570.567143] k3s[838]: I1012 10:07:36.945969 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ac5505f0-7f9b-42bd-88a0-4a3974199a77-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.574284] k3s[838]: I1012 10:07:36.946063 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/ac5505f0-7f9b-42bd-88a0-4a3974199a77-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.579095] k3s[838]: I1012 10:07:36.946104 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ac5505f0-7f9b-42bd-88a0-4a3974199a77-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.583925] k3s[838]: I1012 10:07:36.946137 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ac5505f0-7f9b-42bd-88a0-4a3974199a77-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.588960] k3s[838]: I1012 10:07:36.946165 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ac5505f0-7f9b-42bd-88a0-4a3974199a77-build\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.593784] k3s[838]: I1012 10:07:36.946196 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac5505f0-7f9b-42bd-88a0-4a3974199a77-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.598490] k3s[838]: I1012 10:07:36.946241 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ch7q\" (UniqueName: \"kubernetes.io/projected/ac5505f0-7f9b-42bd-88a0-4a3974199a77-kube-api-access-6ch7q\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.603618] k3s[838]: I1012 10:07:36.946275 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ac5505f0-7f9b-42bd-88a0-4a3974199a77-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 570.608395] k3s[838]: I1012 10:07:36.946413 838 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ac5505f0-7f9b-42bd-88a0-4a3974199a77-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6\" (UID: \"ac5505f0-7f9b-42bd-88a0-4a3974199a77\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" vm-test-run-nix-grpc-farm-k3s> machine # [ 571.117404] cni0: port 4(veth27e7240f) entered blocking state vm-test-run-nix-grpc-farm-k3s> machine # [ 571.119782] cni0: port 4(veth27e7240f) entered disabled state vm-test-run-nix-grpc-farm-k3s> machine # [ 571.122268] veth27e7240f: entered allmulticast mode vm-test-run-nix-grpc-farm-k3s> machine # [ 571.124405] veth27e7240f: entered promiscuous mode vm-test-run-nix-grpc-farm-k3s> machine # [ 571.141835] cni0: port 4(veth27e7240f) entered blocking state vm-test-run-nix-grpc-farm-k3s> machine # [ 571.144103] cni0: port 4(veth27e7240f) entered forwarding state vm-test-run-nix-grpc-farm-k3s> machine # [ 571.031454] (udev-worker)[17097]: Network interface NamePolicy= disabled on kernel command line. vm-test-run-nix-grpc-farm-k3s> machine # [ 571.066715] dhcpcd[658]: veth27e7240f: IAID 27:cd:b7:3a vm-test-run-nix-grpc-farm-k3s> machine # [ 571.067682] dhcpcd[658]: veth27e7240f: adding address fe80::7097:27ff:fecd:b73a vm-test-run-nix-grpc-farm-k3s> machine # [ 571.111326] systemd[1]: Started libcontainer container fe9f75cbd85cc759386bfbfa00060435b31b236f6be3fa7ad69e5d754af79b5e. vm-test-run-nix-grpc-farm-k3s> machine # [ 571.153992] dhcpcd[658]: veth27e7240f: soliciting a DHCP lease vm-test-run-nix-grpc-farm-k3s> machine # [ 571.326558] systemd[1]: Started libcontainer container 9e5a8f7155d461712c113fb1b933fc459f4037db77fa0061b1cf9509781e877f. vm-test-run-nix-grpc-farm-k3s> machine # [ 572.643380] dhcpcd[658]: veth27e7240f: soliciting an IPv6 router vm-test-run-nix-grpc-farm-k3s> machine # [ 573.064197] k3s[838]: E1012 10:07:39.441269 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 573.069360] k3s[838]: E1012 10:07:39.441498 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 573.074331] k3s[838]: E1012 10:07:39.441614 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 573.929614] systemd[1]: cri-containerd-9e5a8f7155d461712c113fb1b933fc459f4037db77fa0061b1cf9509781e877f.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 573.931588] systemd[1]: cri-containerd-9e5a8f7155d461712c113fb1b933fc459f4037db77fa0061b1cf9509781e877f.scope: Consumed 1.148s CPU time over 2.600s wall clock time, 489.3M memory peak, 202.3M read from disk, 231.4M written to disk. vm-test-run-nix-grpc-farm-k3s> machine # [ 573.996347] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9e5a8f7155d461712c113fb1b933fc459f4037db77fa0061b1cf9509781e877f-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 575.354367] systemd[1]: tmp-ovl\x2didmapped1290341672.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) vm-test-run-nix-grpc-farm-k3s> machine # [ 575.383474] systemd[1]: Started libcontainer container 17d276376e3c69934e1e68aa7864c7a5d7b32af69cea6e362396fb30716494f8. vm-test-run-nix-grpc-farm-k3s> machine # [ 575.630818] k3s[838]: E1012 10:07:42.009153 838 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34424: use of closed network connection" vm-test-run-nix-grpc-farm-k3s> machine: waiting for success: ! systemctl is-active slow vm-test-run-nix-grpc-farm-k3s> machine # [ 575.662392] systemd[1]: Started libcontainer container 50a06e4396423e7d08d86ecd510a45ab3f536014e11b0f279aea17b9754e25d7. vm-test-run-nix-grpc-farm-k3s> machine # [ 575.871096] systemd[1]: Started libcontainer container 0c3901d1f8a26c0f6bcdaaeb581f731383e43500e042e044724fd837084472d0. vm-test-run-nix-grpc-farm-k3s> machine # [ 575.951128] k3s[838]: I1012 10:07:42.329754 838 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-6cbbfc67c-sbxc6" podStartSLOduration=3.752924539 podStartE2EDuration="6.329707621s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.576783082s" isStatefulPod=false podCreationTimestamp="2026-10-12 10:07:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-12 10:07:42.327275189 +0000 UTC m=+558.558555843" watchObservedRunningTime="2026-10-12 10:07:42.329707621 +0000 UTC m=+558.560987717" vm-test-run-nix-grpc-farm-k3s> machine # [ 576.104463] systemd[1]: tmp-ovl\x2didmapped1845395846.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 576.155197] dhcpcd[658]: veth27e7240f: probing for an IPv4LL address vm-test-run-nix-grpc-farm-k3s> machine # [ 578.063388] k3s[838]: E1012 10:07:44.440926 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 578.072402] k3s[838]: E1012 10:07:44.441211 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 578.080695] k3s[838]: E1012 10:07:44.441338 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 581.551207] dhcpcd[658]: veth27e7240f: using IPv4LL address 169.254.114.93 vm-test-run-nix-grpc-farm-k3s> machine # [ 581.553889] dhcpcd[658]: veth27e7240f: adding route to 169.254.0.0/16 vm-test-run-nix-grpc-farm-k3s> machine # [ 583.063755] k3s[838]: E1012 10:07:49.441659 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 583.072702] k3s[838]: E1012 10:07:49.451464 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 583.074526] k3s[838]: E1012 10:07:49.451622 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 584.647267] dhcpcd[658]: veth27e7240f: no IPv6 Routers available vm-test-run-nix-grpc-farm-k3s> machine # [ 588.063414] k3s[838]: E1012 10:07:54.440927 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 588.068333] k3s[838]: E1012 10:07:54.441232 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 588.070205] k3s[838]: E1012 10:07:54.441357 838 remote_runtime.go:636] "ExecSync cmd from runtime service failed" err="rpc error: code = Canceled desc = context canceled" containerID="80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064" cmd=["nix","store","info","--store","daemon"] vm-test-run-nix-grpc-farm-k3s> machine # [ 589.504303] niks3-server[1190]: 2026/10/12 10:07:55 INFO Received push request method=POST path=/api/pushes vm-test-run-nix-grpc-farm-k3s> machine # [ 589.509469] garage[836]: 2026-10-12T10:07:55.887711Z INFO garage_api_common::generic_server: 10.42.0.6:38672 PUT /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aa75ef317d1ac65524b19f42be5ef0074a57f8e378cd08eef7386b54aae7a7a6 vm-test-run-nix-grpc-farm-k3s> machine # [ 589.511669] garage[836]: 2026-10-12T10:07:55.888827Z INFO garage_api_common::generic_server: 10.42.0.6:46704 PUT /farm/log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a56fcd96172c6449e8fd99e555b0395f7ee40a2fa0dfc14d29affa259f4a5e5b vm-test-run-nix-grpc-farm-k3s> machine # [ 589.536480] niks3-server[1190]: 2026/10/12 10:07:55 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign vm-test-run-nix-grpc-farm-k3s> machine # [ 589.538091] garage[836]: 2026-10-12T10:07:55.915373Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 589.542457] garage[836]: 2026-10-12T10:07:55.919268Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 589.544249] garage[836]: 2026-10-12T10:07:55.920249Z INFO garage_api_common::generic_server: 10.42.0.6:46704 PUT /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261012%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261012T100755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34916095ebb3063693dc58a8c6c0e7ab1f345a37ba8075309332847578c8fcb5 vm-test-run-nix-grpc-farm-k3s> machine # [ 589.546059] niks3-server[1190]: 2026/10/12 10:07:55 INFO Signed narinfos id=30 count=1 vm-test-run-nix-grpc-farm-k3s> machine # [ 589.546332] niks3-server[1190]: 2026/10/12 10:07:55 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls vm-test-run-nix-grpc-farm-k3s> machine # [ 589.547898] niks3-server[1190]: 2026/10/12 10:07:55 INFO Received complete push request method=POST path=/api/pushes/30/complete vm-test-run-nix-grpc-farm-k3s> machine # [ 589.548899] niks3-server[1190]: 2026/10/12 10:07:55 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv vm-test-run-nix-grpc-farm-k3s> machine # [ 589.550236] niks3-server[1190]: 2026/10/12 10:07:55 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 589.551923] garage[836]: 2026-10-12T10:07:55.925158Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 589.593575] systemd[1]: slow.service: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 589.594920] systemd[1]: slow.service: Consumed 197ms CPU time over 45.467s wall clock time, 35.6M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.8K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine # [ 590.242800] systemd[1]: cri-containerd-80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 590.248645] systemd[1]: cri-containerd-80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064.scope: Consumed 7.848s CPU time over 8min 48.724s wall clock time, 88.7M memory peak, 44.4M read from disk, 8K written to disk, 254.6K incoming IP traffic, 346.3K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine: (finished: waiting for success: ! systemctl is-active slow, in 14.65 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } vm-test-run-nix-grpc-farm-k3s> machine # [ 590.324543] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-80469782844fa90c09b3de98a01de7c4be8ed80ff112b72fbc34104295581064-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' vm-test-run-nix-grpc-farm-k3s> machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: nix eval --raw -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag s1 outPath vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: nix eval --raw -f /nix/store/8ga4sxf7wgfsvzwa355a42p2jy73ysys-slow.nix --argstr tag s1 outPath, in 0.14 seconds) vm-test-run-nix-grpc-farm-k3s> machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null vm-test-run-nix-grpc-farm-k3s> machine # [ 590.519360] garage[836]: 2026-10-12T10:07:56.897861Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) HEAD /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo vm-test-run-nix-grpc-farm-k3s> machine # [ 590.520518] garage[836]: 2026-10-12T10:07:56.899478Z INFO garage_api_common::generic_server: 192.168.1.1:41726 (key GK0123456789abcdef01234567) GET /farm/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo vm-test-run-nix-grpc-farm-k3s> machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.05 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.44 seconds) vm-test-run-nix-grpc-farm-k3s> (finished: run the VM test script, in 591.55 seconds) vm-test-run-nix-grpc-farm-k3s> machine # [ 590.600524] systemd[1]: cri-containerd-8889dace9633522744e5c0d8c17f19d9372a0222ff3101e758bc0ba6fcbec992.scope: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> machine # [ 590.602449] systemd[1]: cri-containerd-8889dace9633522744e5c0d8c17f19d9372a0222ff3101e758bc0ba6fcbec992.scope: Consumed 22.968s CPU time over 8min 49.332s wall clock time, 47.4M memory peak, 29.3M read from disk, 1.2M written to disk, 49.7K incoming IP traffic, 34.3K outgoing IP traffic. vm-test-run-nix-grpc-farm-k3s> machine # [ 590.649616] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8889dace9633522744e5c0d8c17f19d9372a0222ff3101e758bc0ba6fcbec992-rootfs.mount: Deactivated successfully. vm-test-run-nix-grpc-farm-k3s> test script finished in 591.84s vm-test-run-nix-grpc-farm-k3s> cleanup vm-test-run-nix-grpc-farm-k3s> kill QemuMachine (pid 45) vm-test-run-nix-grpc-farm-k3s> machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/lb41b0anx1f98y9y5s9mdv97gjgsq740-python3-3.14.7/bin/python3.14) vm-test-run-nix-grpc-farm-k3s> machine # [2026-10-12T10:07:58Z INFO virtiofsd] Client disconnected, shutting down vm-test-run-nix-grpc-farm-k3s> machine # [2026-10-12T10:07:58Z INFO virtiofsd] Client disconnected, shutting down vm-test-run-nix-grpc-farm-k3s> machine # [2026-10-12T10:07:58Z INFO virtiofsd] Client disconnected, shutting down vm-test-run-nix-grpc-farm-k3s> (finished: cleanup, in 1.09 seconds) vm-test-run-nix-grpc-farm-k3s> additionally exposed symbols: vm-test-run-nix-grpc-farm-k3s> machine, vm-test-run-nix-grpc-farm-k3s> vlan1, vm-test-run-nix-grpc-farm-k3s> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh post-build step Upload coverage to codecov: ok Skipping codecov: project=Mic92/nix-grpc-store attr=checks.x86_64-linux.k3s