1these 2 derivations will be built:2 /nix/store/bsfnjrhidwc9k419pjcvbx4axmji1kfv-niks3-tests-1.16.2.drv3 /nix/store/ksrwy09dli52jxblrjv2nvfiwqhjc690-niks3-go-unit-tests.drv4building '/nix/store/bsfnjrhidwc9k419pjcvbx4axmji1kfv-niks3-tests-1.16.2.drv'5niks3-tests-1.16.2> tribuchet: building on eliza6niks3-tests-1.16.2> Running phase: unpackPhase7niks3-tests-1.16.2> unpacking source archive /nix/store/c5i2fmjw8mq6zbnha5ap9yb6vb7nk229-source8niks3-tests-1.16.2> source root is source9niks3-tests-1.16.2> Running phase: patchPhase10niks3-tests-1.16.2> Running phase: updateAutotoolsGnuConfigScriptsPhase11niks3-tests-1.16.2> Running phase: configurePhase12niks3-tests-1.16.2> Running phase: buildPhase13niks3-tests-1.16.2> buildPhase completed in 1 minutes 49 seconds14niks3-tests-1.16.2> Running phase: installPhase15niks3-tests-1.16.2> Running phase: fixupPhase16niks3-tests-1.16.2> shrinking RPATHs of ELF executables and libraries in /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.217niks3-tests-1.16.2> shrinking /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin/niks3-openbao-signer.test18niks3-tests-1.16.2> shrinking /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin/niks3-hook.test19niks3-tests-1.16.2> shrinking /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin/niks3-server-oidc.test20niks3-tests-1.16.2> shrinking /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin/niks3-client.test21niks3-tests-1.16.2> shrinking /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin/niks3-server.test22niks3-tests-1.16.2> shrinking /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin/niks3-server-signing.test23niks3-tests-1.16.2> patchelf: cannot find section '.dynamic'. The input file is most likely statically linked: No such file or directory24niks3-tests-1.16.2> checking for references to /build/ in /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2...25niks3-tests-1.16.2> patchelf: cannot find section '.dynamic'. The input file is most likely statically linked: No such file or directory26niks3-tests-1.16.2> patching script interpreter paths in /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.227niks3-tests-1.16.2> stripping (with command strip and flags -S -p) in /nix/store/ccqr95q3n0pi8vkm5i3rgp66rnsqhh1h-niks3-tests-1.16.2/bin28building '/nix/store/ksrwy09dli52jxblrjv2nvfiwqhjc690-niks3-go-unit-tests.drv'29niks3-go-unit-tests> tribuchet: building on eliza30niks3-go-unit-tests> Running client tests...31niks3-go-unit-tests> === RUN TestPushPathsRefusesUntrustedClosure32niks3-go-unit-tests> --- PASS: TestPushPathsRefusesUntrustedClosure (0.03s)33niks3-go-unit-tests> === RUN TestDoServerRequestAttachesToken34niks3-go-unit-tests> === PAUSE TestDoServerRequestAttachesToken35niks3-go-unit-tests> === RUN TestUploadBuildLog_FileBodyReplayedOnRetry36niks3-go-unit-tests> === PAUSE TestUploadBuildLog_FileBodyReplayedOnRetry37niks3-go-unit-tests> === RUN TestRegisterUploadedObjectReusesConnections38niks3-go-unit-tests> === PAUSE TestRegisterUploadedObjectReusesConnections39niks3-go-unit-tests> === RUN TestRunGarbageCollection_FinishedOnAnotherReplica40niks3-go-unit-tests> === PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica41niks3-go-unit-tests> === RUN TestRunGarbageCollection_NotFoundAfterLocalRun42niks3-go-unit-tests> === PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun43niks3-go-unit-tests> === RUN TestCaseHackSuffix44niks3-go-unit-tests> === PAUSE TestCaseHackSuffix45niks3-go-unit-tests> === RUN TestFilterOversizedClosures46niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures47niks3-go-unit-tests> === RUN TestUploadMultipart_PartsInParallel48niks3-go-unit-tests> === PAUSE TestUploadMultipart_PartsInParallel49niks3-go-unit-tests> === RUN TestUploadMultipart_ReturnsAfterDroppedBody50niks3-go-unit-tests> === PAUSE TestUploadMultipart_ReturnsAfterDroppedBody51niks3-go-unit-tests> === RUN TestPartSizeForNAR52niks3-go-unit-tests> === PAUSE TestPartSizeForNAR53niks3-go-unit-tests> === RUN TestDumpPathCaseHackMatchesNix54niks3-go-unit-tests> --- PASS: TestDumpPathCaseHackMatchesNix (2.79s)55niks3-go-unit-tests> === RUN TestDumpPathCaseHackCollision56niks3-go-unit-tests> --- PASS: TestDumpPathCaseHackCollision (0.00s)57niks3-go-unit-tests> === RUN TestDumpPathMatchesNix58niks3-go-unit-tests> === PAUSE TestDumpPathMatchesNix59niks3-go-unit-tests> === RUN TestDumpPathSingleFile60niks3-go-unit-tests> === PAUSE TestDumpPathSingleFile61niks3-go-unit-tests> === RUN TestDumpPathWriterError62niks3-go-unit-tests> === PAUSE TestDumpPathWriterError63niks3-go-unit-tests> === RUN TestEncodeNixBase3264niks3-go-unit-tests> === PAUSE TestEncodeNixBase3265niks3-go-unit-tests> === RUN TestEncodeNixBase32WithRealHash66niks3-go-unit-tests> === PAUSE TestEncodeNixBase32WithRealHash67niks3-go-unit-tests> === RUN TestConvertHashToNix3268niks3-go-unit-tests> === PAUSE TestConvertHashToNix3269niks3-go-unit-tests> === RUN TestGetStorePathHash70niks3-go-unit-tests> === PAUSE TestGetStorePathHash71niks3-go-unit-tests> === RUN TestPathInfoHashCompatibility72niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility73niks3-go-unit-tests> === RUN TestParsePathInfoJSON74niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON75niks3-go-unit-tests> === RUN TestParsePathInfoJSONMultiplePaths76niks3-go-unit-tests> === PAUSE TestParsePathInfoJSONMultiplePaths77niks3-go-unit-tests> === RUN TestPathInfoCACompatibility78niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility79niks3-go-unit-tests> === RUN TestRateLimiterFeedback80niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback81niks3-go-unit-tests> === RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess82niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess83niks3-go-unit-tests> === RUN TestRegisterUploadedObject_BoundedAgainstSilentServer84niks3-go-unit-tests> === PAUSE TestRegisterUploadedObject_BoundedAgainstSilentServer85niks3-go-unit-tests> === RUN TestRegisterUploadedObject_OutlivesPush86niks3-go-unit-tests> === PAUSE TestRegisterUploadedObject_OutlivesPush87niks3-go-unit-tests> === RUN TestResolveStorePath88niks3-go-unit-tests> === PAUSE TestResolveStorePath89niks3-go-unit-tests> === RUN TestDoWithRetry_BodyReplayedViaGetBody90niks3-go-unit-tests> === PAUSE TestDoWithRetry_BodyReplayedViaGetBody91niks3-go-unit-tests> === RUN TestRetryTimeoutOutlastsMaxRetries92niks3-go-unit-tests> === PAUSE TestRetryTimeoutOutlastsMaxRetries93niks3-go-unit-tests> === RUN TestDoWithRetry_FinalResponseBodyReadable94niks3-go-unit-tests> === PAUSE TestDoWithRetry_FinalResponseBodyReadable95niks3-go-unit-tests> === RUN TestShellSplit96niks3-go-unit-tests> === PAUSE TestShellSplit97niks3-go-unit-tests> === RUN TestShellSplitErrors98niks3-go-unit-tests> === PAUSE TestShellSplitErrors99niks3-go-unit-tests> === RUN TestStreamPushReportsEveryPath100niks3-go-unit-tests> === PAUSE TestStreamPushReportsEveryPath101niks3-go-unit-tests> === RUN TestStreamPushBatchesUnderLoad102niks3-go-unit-tests> === PAUSE TestStreamPushBatchesUnderLoad103niks3-go-unit-tests> === RUN TestStreamPushIsolatesFailures104niks3-go-unit-tests> === PAUSE TestStreamPushIsolatesFailures105niks3-go-unit-tests> === RUN TestStreamPushGivesUpOnDeadServer106niks3-go-unit-tests> === PAUSE TestStreamPushGivesUpOnDeadServer107niks3-go-unit-tests> === RUN TestStreamPushRequestLine108niks3-go-unit-tests> === PAUSE TestStreamPushRequestLine109niks3-go-unit-tests> === RUN TestStreamPushReportsSignatures110niks3-go-unit-tests> === PAUSE TestStreamPushReportsSignatures111niks3-go-unit-tests> === RUN TestStreamPushReportsSkippedPaths112niks3-go-unit-tests> === PAUSE TestStreamPushReportsSkippedPaths113niks3-go-unit-tests> === RUN TestClientSignaturesByStorePath114niks3-go-unit-tests> === PAUSE TestClientSignaturesByStorePath115niks3-go-unit-tests> === RUN TestStreamPushStopsWhenCanceled116niks3-go-unit-tests> === PAUSE TestStreamPushStopsWhenCanceled117niks3-go-unit-tests> === RUN TestSetClientTLS118niks3-go-unit-tests> === PAUSE TestSetClientTLS119niks3-go-unit-tests> === RUN TestSetClientTLSDoesNotMutateDefaultTransport120niks3-go-unit-tests> === PAUSE TestSetClientTLSDoesNotMutateDefaultTransport121niks3-go-unit-tests> === RUN TestSetClientTLSErrors122niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors123niks3-go-unit-tests> === RUN TestStaticToken124niks3-go-unit-tests> === PAUSE TestStaticToken125niks3-go-unit-tests> === RUN TestFileTokenReadsAndCaches126niks3-go-unit-tests> === PAUSE TestFileTokenReadsAndCaches127niks3-go-unit-tests> === RUN TestFileTokenMissing128niks3-go-unit-tests> === PAUSE TestFileTokenMissing129niks3-go-unit-tests> === RUN TestFileTokenEmpty130niks3-go-unit-tests> === PAUSE TestFileTokenEmpty131niks3-go-unit-tests> === RUN TestScriptTokenNoExpiryRerunsEveryCall132niks3-go-unit-tests> === PAUSE TestScriptTokenNoExpiryRerunsEveryCall133niks3-go-unit-tests> === RUN TestScriptTokenCachesUntilRefresh134niks3-go-unit-tests> === PAUSE TestScriptTokenCachesUntilRefresh135niks3-go-unit-tests> === RUN TestScriptTokenEmptyToken136niks3-go-unit-tests> === PAUSE TestScriptTokenEmptyToken137niks3-go-unit-tests> === RUN TestScriptTokenBadJSON138niks3-go-unit-tests> === PAUSE TestScriptTokenBadJSON139niks3-go-unit-tests> === RUN TestScriptTokenScriptFails140niks3-go-unit-tests> === PAUSE TestScriptTokenScriptFails141niks3-go-unit-tests> === RUN TestScriptTokenEmptyCommand142niks3-go-unit-tests> === PAUSE TestScriptTokenEmptyCommand143niks3-go-unit-tests> === RUN TestUntrustedPaths144niks3-go-unit-tests> === PAUSE TestUntrustedPaths145niks3-go-unit-tests> === RUN TestUntrustedPathsContentAddressed146niks3-go-unit-tests> === PAUSE TestUntrustedPathsContentAddressed147niks3-go-unit-tests> === RUN TestParsePathInfoUltimate148niks3-go-unit-tests> === PAUSE TestParsePathInfoUltimate149niks3-go-unit-tests> === CONT TestDoServerRequestAttachesToken150niks3-go-unit-tests> === CONT TestDoWithRetry_FinalResponseBodyReadable151niks3-go-unit-tests> === CONT TestEncodeNixBase32WithRealHash152niks3-go-unit-tests> === CONT TestSetClientTLSErrors153niks3-go-unit-tests> --- PASS: TestEncodeNixBase32WithRealHash (0.00s)154niks3-go-unit-tests> === CONT TestRetryTimeoutOutlastsMaxRetries155niks3-go-unit-tests> === CONT TestStreamPushRequestLine156niks3-go-unit-tests> === CONT TestSetClientTLSDoesNotMutateDefaultTransport157niks3-go-unit-tests> === CONT TestDoWithRetry_BodyReplayedViaGetBody158niks3-go-unit-tests> === CONT TestStreamPushGivesUpOnDeadServer159niks3-go-unit-tests> === CONT TestStreamPushIsolatesFailures160niks3-go-unit-tests> === CONT TestStreamPushBatchesUnderLoad161niks3-go-unit-tests> === CONT TestParsePathInfoUltimate162niks3-go-unit-tests> === CONT TestResolveStorePath163niks3-go-unit-tests> === CONT TestStreamPushReportsSkippedPaths164niks3-go-unit-tests> === CONT TestRegisterUploadedObject_OutlivesPush165niks3-go-unit-tests> === CONT TestPathInfoCACompatibility166niks3-go-unit-tests> === CONT TestRegisterUploadedObject_BoundedAgainstSilentServer167niks3-go-unit-tests> === CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess168niks3-go-unit-tests> === CONT TestRateLimiterFeedback169niks3-go-unit-tests> === CONT TestDumpPathWriterError170niks3-go-unit-tests> === CONT TestFilterOversizedClosures171niks3-go-unit-tests> === CONT TestDumpPathSingleFile172niks3-go-unit-tests> === CONT TestDumpPathMatchesNix173niks3-go-unit-tests> === CONT TestParsePathInfoJSONMultiplePaths174niks3-go-unit-tests> === RUN TestStreamPushBatchesUnderLoad/oneAtATime=false175niks3-go-unit-tests> === RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths176niks3-go-unit-tests> --- PASS: TestResolveStorePath (0.00s)177niks3-go-unit-tests> --- PASS: TestParsePathInfoUltimate (0.00s)178niks3-go-unit-tests> === CONT TestEncodeNixBase32179niks3-go-unit-tests> === PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=false180niks3-go-unit-tests> === RUN TestStreamPushBatchesUnderLoad/oneAtATime=true181niks3-go-unit-tests> === RUN TestFilterOversizedClosures/no_limit_keeps_everything182niks3-go-unit-tests> === PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths183niks3-go-unit-tests> === RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths184niks3-go-unit-tests> === PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths185niks3-go-unit-tests> === RUN TestPathInfoCACompatibility/null_ca_field186niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/null_ca_field187niks3-go-unit-tests> === RUN TestPathInfoCACompatibility/old_string_format_-_text188niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/old_string_format_-_text189niks3-go-unit-tests> === RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive190niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive191niks3-go-unit-tests> === RUN TestPathInfoCACompatibility/new_structured_format_-_text192niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/new_structured_format_-_text193niks3-go-unit-tests> === RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method194niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method195niks3-go-unit-tests> === CONT TestUploadMultipart_PartsInParallel196niks3-go-unit-tests> === CONT TestStreamPushStopsWhenCanceled197niks3-go-unit-tests> === CONT TestPartSizeForNAR198niks3-go-unit-tests> 2026/11/10 21:13:26 ERROR Upload failed error="bad path" count=3199niks3-go-unit-tests> === RUN TestEncodeNixBase32/test_string_hash200niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Rate limiter enabled after throttle name=server-test rate=5201niks3-go-unit-tests> === CONT TestUploadMultipart_ReturnsAfterDroppedBody202niks3-go-unit-tests> --- PASS: TestStreamPushIsolatesFailures (0.01s)203niks3-go-unit-tests> === CONT TestSetClientTLS204niks3-go-unit-tests> --- PASS: TestStreamPushReportsSkippedPaths (0.01s)205niks3-go-unit-tests> === RUN TestRateLimiterFeedback/429_enables_limiter206niks3-go-unit-tests> 2026/11/10 21:13:26 ERROR Upload failed error="connection refused" count=20207niks3-go-unit-tests> 2026/11/10 21:13:26 ERROR Server seems unavailable, giving up on batch untried=17208niks3-go-unit-tests> 2026/11/10 21:13:26 ERROR Upload failed error=boom count=1209niks3-go-unit-tests> === CONT TestShellSplit210niks3-go-unit-tests> --- PASS: TestStreamPushStopsWhenCanceled (0.04s)211niks3-go-unit-tests> === CONT TestStreamPushReportsEveryPath212niks3-go-unit-tests> === CONT TestShellSplitErrors213niks3-go-unit-tests> === CONT TestScriptTokenEmptyToken214niks3-go-unit-tests> --- PASS: TestStreamPushGivesUpOnDeadServer (0.04s)215niks3-go-unit-tests> --- PASS: TestShellSplitErrors (0.00s)216niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/429_enables_limiter217niks3-go-unit-tests> === CONT TestUntrustedPathsContentAddressed218niks3-go-unit-tests> === PAUSE TestEncodeNixBase32/test_string_hash219niks3-go-unit-tests> === RUN TestRateLimiterFeedback/503_enables_limiter220niks3-go-unit-tests> === PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=true221niks3-go-unit-tests> === RUN TestPartSizeForNAR/zero_stays_at_minimum222niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/zero_stays_at_minimum223niks3-go-unit-tests> === RUN TestPartSizeForNAR/small_stays_at_minimum224niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/small_stays_at_minimum225niks3-go-unit-tests> === RUN TestPartSizeForNAR/80_GiB_fits_at_minimum226niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum227niks3-go-unit-tests> === RUN TestPartSizeForNAR/115_GiB_needs_larger_parts228niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts229niks3-go-unit-tests> === RUN TestPartSizeForNAR/1_TiB230niks3-go-unit-tests> === CONT TestScriptTokenEmptyCommand231niks3-go-unit-tests> === CONT TestScriptTokenScriptFails232niks3-go-unit-tests> === CONT TestScriptTokenBadJSON233niks3-go-unit-tests> === CONT TestClientSignaturesByStorePath234niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Rate limiter enabled after throttle name=server-test rate=5235niks3-go-unit-tests> === CONT TestGetStorePathHash236niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:36721237niks3-go-unit-tests> === RUN TestGetStorePathHash/valid_store_path238niks3-go-unit-tests> === PAUSE TestGetStorePathHash/valid_store_path239niks3-go-unit-tests> === RUN TestGetStorePathHash/basename_without_hyphen_should_error240niks3-go-unit-tests> === PAUSE TestGetStorePathHash/basename_without_hyphen_should_error241niks3-go-unit-tests> === RUN TestGetStorePathHash/hash_with_invalid_characters_should_error242niks3-go-unit-tests> === PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error243niks3-go-unit-tests> === RUN TestGetStorePathHash/hash_with_wrong_length_should_error244niks3-go-unit-tests> === PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error245niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/1_TiB246niks3-go-unit-tests> === RUN TestPartSizeForNAR/5_TiB_S3_max_object247niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/5_TiB_S3_max_object248niks3-go-unit-tests> === RUN TestPartSizeForNAR/capped_at_5_GiB249niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/capped_at_5_GiB250niks3-go-unit-tests> === CONT TestPathInfoHashCompatibility251niks3-go-unit-tests> === RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)252niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)253niks3-go-unit-tests> === RUN TestPathInfoHashCompatibility/old_string_format_with_colon254niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon255niks3-go-unit-tests> === CONT TestStreamPushReportsSignatures256niks3-go-unit-tests> === CONT TestParsePathInfoJSON257niks3-go-unit-tests> === RUN TestParsePathInfoJSON/Nix_format258niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/Nix_format259niks3-go-unit-tests> === RUN TestParsePathInfoJSON/Lix_format260niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/Lix_format261niks3-go-unit-tests> === RUN TestParsePathInfoJSON/empty_input262niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/empty_input263niks3-go-unit-tests> === RUN TestParsePathInfoJSON/whitespace_only264niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/whitespace_only265niks3-go-unit-tests> === RUN TestParsePathInfoJSON/invalid_JSON266niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/invalid_JSON267niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures/no_limit_keeps_everything268niks3-go-unit-tests> === RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped269niks3-go-unit-tests> === CONT TestUntrustedPaths270niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Rate limiter enabled after throttle name=server-test rate=5271niks3-go-unit-tests> === RUN TestSetClientTLSErrors/missing_cert_file272niks3-go-unit-tests> 2026/11/10 21:13:26 ERROR Upload failed error=boom count=1273niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/missing_cert_file274niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Rate limiter backed off name=server-test rate=5275niks3-go-unit-tests> === RUN TestSetClientTLSErrors/missing_key_file276niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/missing_key_file277niks3-go-unit-tests> === RUN TestSetClientTLSErrors/missing_ca_file278niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/missing_ca_file279niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:36721280niks3-go-unit-tests> === RUN TestSetClientTLSErrors/invalid_ca_file281niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:37527282niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:42327283niks3-go-unit-tests> === CONT TestRunGarbageCollection_FinishedOnAnotherReplica284niks3-go-unit-tests> --- PASS: TestStreamPushReportsEveryPath (0.00s)285niks3-go-unit-tests> === RUN TestEncodeNixBase32/empty_input286niks3-go-unit-tests> === PAUSE TestEncodeNixBase32/empty_input287niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/503_enables_limiter288niks3-go-unit-tests> === RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI289niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI290niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped291niks3-go-unit-tests> === CONT TestCaseHackSuffix292niks3-go-unit-tests> === RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512293niks3-go-unit-tests> === RUN TestFilterOversizedClosures/all_closures_skipped294niks3-go-unit-tests> === CONT TestRunGarbageCollection_NotFoundAfterLocalRun295niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/invalid_ca_file296niks3-go-unit-tests> === CONT TestConvertHashToNix32297niks3-go-unit-tests> === RUN TestConvertHashToNix32/SRI_format_to_Nix32298niks3-go-unit-tests> === PAUSE TestConvertHashToNix32/SRI_format_to_Nix32299niks3-go-unit-tests> === RUN TestConvertHashToNix32/already_Nix32_format300niks3-go-unit-tests> === CONT TestScriptTokenNoExpiryRerunsEveryCall301niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures/all_closures_skipped302niks3-go-unit-tests> === PAUSE TestConvertHashToNix32/already_Nix32_format303niks3-go-unit-tests> === RUN TestConvertHashToNix32/invalid_format304niks3-go-unit-tests> === PAUSE TestConvertHashToNix32/invalid_format305niks3-go-unit-tests> === CONT TestFileTokenEmpty306niks3-go-unit-tests> === CONT TestFileTokenMissing307niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:37527308niks3-go-unit-tests> === CONT TestFileTokenReadsAndCaches309niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Rate limiter backed off name=server-test rate=5310niks3-go-unit-tests> === CONT TestStaticToken311niks3-go-unit-tests> === CONT TestUploadBuildLog_FileBodyReplayedOnRetry312niks3-go-unit-tests> === RUN TestSetClientTLS/rejects_connection_without_client_cert313niks3-go-unit-tests> 2026/11/10 21:13:26 INFO Garbage collection started314niks3-go-unit-tests> === PAUSE TestSetClientTLS/rejects_connection_without_client_cert315niks3-go-unit-tests> === RUN TestSetClientTLS/succeeds_with_client_cert_and_CA316niks3-go-unit-tests> === CONT TestRegisterUploadedObjectReusesConnections317niks3-go-unit-tests> === CONT TestScriptTokenCachesUntilRefresh318niks3-go-unit-tests> === CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths319niks3-go-unit-tests> === CONT TestPathInfoCACompatibility/null_ca_field320niks3-go-unit-tests> === CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method321niks3-go-unit-tests> === CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths322niks3-go-unit-tests> === RUN TestRateLimiterFeedback/200_does_not_enable_limiter323niks3-go-unit-tests> === CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive324niks3-go-unit-tests> === CONT TestPathInfoCACompatibility/new_structured_format_-_text325niks3-go-unit-tests> === CONT TestPathInfoCACompatibility/old_string_format_-_text326niks3-go-unit-tests> === CONT TestStreamPushBatchesUnderLoad/oneAtATime=false327niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter328niks3-go-unit-tests> === RUN TestRateLimiterFeedback/400_does_not_enable_limiter329niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter330niks3-go-unit-tests> === PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA331niks3-go-unit-tests> === RUN TestSetClientTLS/preserves_debug_logging_transport332niks3-go-unit-tests> === PAUSE TestSetClientTLS/preserves_debug_logging_transport333niks3-go-unit-tests> 2026/11/10 21:13:26 INFO Garbage collection started334niks3-go-unit-tests> === CONT TestGetStorePathHash/valid_store_path335niks3-go-unit-tests> === CONT TestGetStorePathHash/hash_with_wrong_length_should_error336niks3-go-unit-tests> === CONT TestGetStorePathHash/basename_without_hyphen_should_error337niks3-go-unit-tests> === CONT TestPartSizeForNAR/zero_stays_at_minimum338niks3-go-unit-tests> === CONT TestPartSizeForNAR/1_TiB339niks3-go-unit-tests> === CONT TestPartSizeForNAR/capped_at_5_GiB340niks3-go-unit-tests> === CONT TestPartSizeForNAR/5_TiB_S3_max_object341niks3-go-unit-tests> === CONT TestPartSizeForNAR/small_stays_at_minimum342niks3-go-unit-tests> === CONT TestPartSizeForNAR/115_GiB_needs_larger_parts343niks3-go-unit-tests> === RUN TestUntrustedPaths/server_without_policy_accepts_anything344niks3-go-unit-tests> === CONT TestStreamPushBatchesUnderLoad/oneAtATime=true345niks3-go-unit-tests> === CONT TestGetStorePathHash/hash_with_invalid_characters_should_error346niks3-go-unit-tests> === CONT TestParsePathInfoJSON/Nix_format347niks3-go-unit-tests> === CONT TestParsePathInfoJSON/whitespace_only348niks3-go-unit-tests> 2026/11/10 21:13:26 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:37527349niks3-go-unit-tests> === CONT TestParsePathInfoJSON/invalid_JSON350niks3-go-unit-tests> === CONT TestParsePathInfoJSON/Lix_format351niks3-go-unit-tests> === CONT TestParsePathInfoJSON/empty_input352niks3-go-unit-tests> === CONT TestEncodeNixBase32/test_string_hash353niks3-go-unit-tests> --- PASS: TestShellSplit (0.00s)354niks3-go-unit-tests> --- PASS: TestScriptTokenEmptyCommand (0.00s)355niks3-go-unit-tests> --- PASS: TestRegisterUploadedObject_OutlivesPush (0.00s)356niks3-go-unit-tests> --- PASS: TestDoServerRequestAttachesToken (0.76s)357niks3-go-unit-tests> === CONT TestPartSizeForNAR/80_GiB_fits_at_minimum358niks3-go-unit-tests> === CONT TestSetClientTLSErrors/missing_cert_file359niks3-go-unit-tests> === PAUSE TestUntrustedPaths/server_without_policy_accepts_anything360niks3-go-unit-tests> --- PASS: TestScriptTokenScriptFails (0.00s)361niks3-go-unit-tests> --- PASS: TestClientSignaturesByStorePath (0.00s)362niks3-go-unit-tests> --- PASS: TestUntrustedPathsContentAddressed (0.00s)363niks3-go-unit-tests> --- PASS: TestUploadMultipart_ReturnsAfterDroppedBody (0.04s)364niks3-go-unit-tests> --- PASS: TestStreamPushReportsSignatures (0.00s)365niks3-go-unit-tests> --- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.04s)366niks3-go-unit-tests> --- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.05s)367niks3-go-unit-tests> --- PASS: TestDoWithRetry_FinalResponseBodyReadable (0.76s)368niks3-go-unit-tests> --- PASS: TestStaticToken (0.00s)369niks3-go-unit-tests> --- PASS: TestFileTokenMissing (0.00s)370niks3-go-unit-tests> --- PASS: TestFileTokenEmpty (0.00s)371niks3-go-unit-tests> --- PASS: TestFileTokenReadsAndCaches (0.00s)372niks3-go-unit-tests> === CONT TestFilterOversizedClosures/no_limit_keeps_everything373niks3-go-unit-tests> === RUN TestUntrustedPaths/built_locally374niks3-go-unit-tests> === CONT TestEncodeNixBase32/empty_input375niks3-go-unit-tests> === CONT TestSetClientTLSErrors/missing_key_file376niks3-go-unit-tests> === PAUSE TestUntrustedPaths/built_locally377niks3-go-unit-tests> === RUN TestUntrustedPaths/signed_by_the_server_key378niks3-go-unit-tests> === PAUSE TestUntrustedPaths/signed_by_the_server_key379niks3-go-unit-tests> --- PASS: TestEncodeNixBase32 (0.04s)380niks3-go-unit-tests> --- PASS: TestEncodeNixBase32/test_string_hash (0.94s)381niks3-go-unit-tests> --- PASS: TestEncodeNixBase32/empty_input (0.00s)382niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility (0.00s)383niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)384niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)385niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)386niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)387niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)388niks3-go-unit-tests> --- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)389niks3-go-unit-tests> --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)390niks3-go-unit-tests> --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)391niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:35607/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:35607/api/uploads/complete392niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"393niks3-go-unit-tests> === CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped394niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:35607/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:35607/api/uploads/complete395niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"396niks3-go-unit-tests> === CONT TestSetClientTLSErrors/invalid_ca_file397niks3-go-unit-tests> --- PASS: TestScriptTokenEmptyToken (0.94s)398niks3-go-unit-tests> === CONT TestConvertHashToNix32/invalid_format399niks3-go-unit-tests> === CONT TestConvertHashToNix32/already_Nix32_format400niks3-go-unit-tests> === CONT TestRateLimiterFeedback/429_enables_limiter401niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000402niks3-go-unit-tests> === CONT TestSetClientTLSErrors/missing_ca_file403niks3-go-unit-tests> 2026/11/10 21:13:27 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0404niks3-go-unit-tests> --- PASS: TestScriptTokenBadJSON (0.94s)405niks3-go-unit-tests> === CONT TestRateLimiterFeedback/503_enables_limiter406niks3-go-unit-tests> === CONT TestFilterOversizedClosures/all_closures_skipped407niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50408niks3-go-unit-tests> === CONT TestConvertHashToNix32/SRI_format_to_Nix32409niks3-go-unit-tests> --- PASS: TestConvertHashToNix32 (0.00s)410niks3-go-unit-tests> --- PASS: TestConvertHashToNix32/invalid_format (0.00s)411niks3-go-unit-tests> --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)412niks3-go-unit-tests> --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)413niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:37527414niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:35607/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:35607/api/uploads/complete415niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"416niks3-go-unit-tests> --- PASS: TestFilterOversizedClosures (0.04s)417niks3-go-unit-tests> --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.93s)418niks3-go-unit-tests> --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)419niks3-go-unit-tests> --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)420niks3-go-unit-tests> --- PASS: TestPartSizeForNAR (0.00s)421niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)422niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/1_TiB (0.00s)423niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)424niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)425niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)426niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)427niks3-go-unit-tests> --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)428niks3-go-unit-tests> === CONT TestSetClientTLS/preserves_debug_logging_transport429niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512430niks3-go-unit-tests> === CONT TestRateLimiterFeedback/400_does_not_enable_limiter431niks3-go-unit-tests> --- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.94s)432niks3-go-unit-tests> --- PASS: TestRegisterUploadedObject_BoundedAgainstSilentServer (0.98s)433niks3-go-unit-tests> === CONT TestRateLimiterFeedback/200_does_not_enable_limiter434niks3-go-unit-tests> === CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)435niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:37527436niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Rate limiter enabled after throttle name=server-test rate=5437niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:42665438niks3-go-unit-tests> --- PASS: TestGetStorePathHash (0.00s)439niks3-go-unit-tests> --- PASS: TestGetStorePathHash/valid_store_path (0.00s)440niks3-go-unit-tests> --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)441niks3-go-unit-tests> --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)442niks3-go-unit-tests> --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)443niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Rate limiter enabled after throttle name=s3-test rate=5444niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON (0.00s)445niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)446niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)447niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)448niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)449niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON/empty_input (0.00s)450niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:42109451niks3-go-unit-tests> --- PASS: TestStreamPushBatchesUnderLoad (0.04s)452niks3-go-unit-tests> --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=true (0.00s)453niks3-go-unit-tests> --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=false (0.00s)454niks3-go-unit-tests> === CONT TestSetClientTLS/rejects_connection_without_client_cert455niks3-go-unit-tests> === RUN TestUntrustedPaths/signed_by_an_upstream_key456niks3-go-unit-tests> === PAUSE TestUntrustedPaths/signed_by_an_upstream_key457niks3-go-unit-tests> === RUN TestUntrustedPaths/unsigned_substitute458niks3-go-unit-tests> === PAUSE TestUntrustedPaths/unsigned_substitute459niks3-go-unit-tests> === RUN TestUntrustedPaths/signed_only_by_another_key460niks3-go-unit-tests> === PAUSE TestUntrustedPaths/signed_only_by_another_key461niks3-go-unit-tests> === RUN TestUntrustedPaths/another_key's_signature_under_the_server_key_name462niks3-go-unit-tests> === PAUSE TestUntrustedPaths/another_key's_signature_under_the_server_key_name463niks3-go-unit-tests> === RUN TestUntrustedPaths/server_signature_over_different_contents464niks3-go-unit-tests> === PAUSE TestUntrustedPaths/server_signature_over_different_contents465niks3-go-unit-tests> === CONT TestUntrustedPaths/server_without_policy_accepts_anything466niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Rate limiter backed off name=server-test rate=5467niks3-go-unit-tests> === CONT TestSetClientTLS/succeeds_with_client_cert_and_CA468niks3-go-unit-tests> === CONT TestUntrustedPaths/signed_only_by_another_key469niks3-go-unit-tests> === CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512470niks3-go-unit-tests> === CONT TestUntrustedPaths/unsigned_substitute471niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Garbage collection finished on another replica. Its statistics are not available here472niks3-go-unit-tests> === CONT TestUntrustedPaths/signed_by_an_upstream_key473niks3-go-unit-tests> === CONT TestUntrustedPaths/built_locally474niks3-go-unit-tests> --- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.94s)475niks3-go-unit-tests> === CONT TestUntrustedPaths/signed_by_the_server_key476niks3-go-unit-tests> --- PASS: TestSetClientTLSErrors (0.76s)477niks3-go-unit-tests> --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)478niks3-go-unit-tests> --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)479niks3-go-unit-tests> --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)480niks3-go-unit-tests> --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)481niks3-go-unit-tests> === CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI482niks3-go-unit-tests> === CONT TestPathInfoHashCompatibility/old_string_format_with_colon483niks3-go-unit-tests> === CONT TestUntrustedPaths/server_signature_over_different_contents484niks3-go-unit-tests> === CONT TestUntrustedPaths/another_key's_signature_under_the_server_key_name485niks3-go-unit-tests> --- PASS: TestPathInfoHashCompatibility (0.94s)486niks3-go-unit-tests> --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)487niks3-go-unit-tests> --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)488niks3-go-unit-tests> --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)489niks3-go-unit-tests> --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)490niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:37527491niks3-go-unit-tests> --- PASS: TestUploadBuildLog_FileBodyReplayedOnRetry (0.95s)492niks3-go-unit-tests> --- PASS: TestUntrustedPaths (0.94s)493niks3-go-unit-tests> --- PASS: TestUntrustedPaths/server_without_policy_accepts_anything (0.00s)494niks3-go-unit-tests> --- PASS: TestUntrustedPaths/signed_only_by_another_key (0.01s)495niks3-go-unit-tests> --- PASS: TestUntrustedPaths/server_signature_over_different_contents (0.00s)496niks3-go-unit-tests> --- PASS: TestUntrustedPaths/unsigned_substitute (0.01s)497niks3-go-unit-tests> --- PASS: TestUntrustedPaths/built_locally (0.01s)498niks3-go-unit-tests> --- PASS: TestUntrustedPaths/signed_by_an_upstream_key (0.01s)499niks3-go-unit-tests> --- PASS: TestUntrustedPaths/another_key's_signature_under_the_server_key_name (0.00s)500niks3-go-unit-tests> --- PASS: TestUntrustedPaths/signed_by_the_server_key (0.01s)501niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Rate limiter enabled after throttle name=server-test rate=5502niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:38287503niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Rate limiter backed off name=server-test rate=5504niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:37527505niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback (0.04s)506niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)507niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)508niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)509niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.02s)510niks3-go-unit-tests> --- PASS: TestScriptTokenCachesUntilRefresh (0.96s)511niks3-go-unit-tests> --- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.96s)512niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:37527513niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:37527514niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)515niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:37527516niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:37527517niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:37527518niks3-go-unit-tests> --- PASS: TestDumpPathSingleFile (0.97s)519niks3-go-unit-tests> --- PASS: TestCaseHackSuffix (0.97s)520niks3-go-unit-tests> --- PASS: TestStreamPushRequestLine (1.73s)521niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:37527522niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:37527523niks3-go-unit-tests> 2026/11/10 21:13:27 http: TLS handshake error from 127.0.0.1:50684: remote error: tls: bad certificate524niks3-go-unit-tests> --- PASS: TestSetClientTLS (0.00s)525niks3-go-unit-tests> --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.02s)526niks3-go-unit-tests> --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.02s)527niks3-go-unit-tests> --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.03s)528niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:37527529niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:37527530niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:37527531niks3-go-unit-tests> --- PASS: TestRegisterUploadedObjectReusesConnections (0.97s)532niks3-go-unit-tests> --- PASS: TestDumpPathWriterError (0.98s)533niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:37527534niks3-go-unit-tests> 2026/11/10 21:13:27 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:37527535niks3-go-unit-tests> --- PASS: TestRetryTimeoutOutlastsMaxRetries (1.74s)536niks3-go-unit-tests> --- PASS: TestUploadMultipart_PartsInParallel (1.61s)537niks3-go-unit-tests> --- PASS: TestDumpPathMatchesNix (3.79s)538niks3-go-unit-tests> PASS539niks3-go-unit-tests> Running server tests...540niks3-go-unit-tests> The files belonging to this database system will be owned by user "nixbld".541niks3-go-unit-tests> This user must also own the server process.542niks3-go-unit-tests> 543niks3-go-unit-tests> The database cluster will be initialized with locale "C".544niks3-go-unit-tests> The default database encoding has accordingly been set to "SQL_ASCII".545niks3-go-unit-tests> The default text search configuration will be set to "english".546niks3-go-unit-tests> 547niks3-go-unit-tests> Data page checksums are enabled.548niks3-go-unit-tests> 549niks3-go-unit-tests> creating directory /build/postgres4102727693/data ... ok550niks3-go-unit-tests> creating subdirectories ... ok551niks3-go-unit-tests> selecting dynamic shared memory implementation ... posix552niks3-go-unit-tests> selecting default "max_connections" ... 100553niks3-go-unit-tests> selecting default "shared_buffers" ... 128MB554niks3-go-unit-tests> selecting default time zone ... UTC555niks3-go-unit-tests> creating configuration files ... ok556niks3-go-unit-tests> running bootstrap script ... ok557niks3-go-unit-tests> performing post-bootstrap initialization ... ok558niks3-go-unit-tests> syncing data to disk ... ok559niks3-go-unit-tests> 560niks3-go-unit-tests> initdb: warning: enabling "trust" authentication for local connections561niks3-go-unit-tests> initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.562niks3-go-unit-tests> 563niks3-go-unit-tests> Success. You can now start the database server using:564niks3-go-unit-tests> 565niks3-go-unit-tests> pg_ctl -D /build/postgres4102727693/data -l logfile start566niks3-go-unit-tests> 567niks3-go-unit-tests> /build/postgres4102727693:5432 - no response568niks3-go-unit-tests> /build/postgres4102727693:5432 - no response569niks3-go-unit-tests> /build/postgres4102727693:5432 - no response570niks3-go-unit-tests> /build/postgres4102727693:5432 - no response571niks3-go-unit-tests> /build/postgres4102727693:5432 - no response572niks3-go-unit-tests> 2026-11-10 21:13:43.632 UTC [136] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit573niks3-go-unit-tests> 2026-11-10 21:13:43.633 UTC [136] LOG: listening on Unix socket "/build/postgres4102727693/.s.PGSQL.5432"574niks3-go-unit-tests> 2026-11-10 21:13:43.641 UTC [147] LOG: database system was shut down at 2026-11-10 21:13:42 UTC575niks3-go-unit-tests> 2026-11-10 21:13:43.647 UTC [136] LOG: database system is ready to accept connections576niks3-go-unit-tests> /build/postgres4102727693:5432 - accepting connections577niks3-go-unit-tests> {"timestamp":"2026-11-10T21:13:59.069212479Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a98d27bb-6fe3-453f-a53e-7af81007f0ef","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":17,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(201)"}578niks3-go-unit-tests> {"timestamp":"2026-11-10T21:13:59.184637393Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f19affe3-1b82-41ce-88ef-ef84174b5062","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(205)"}579niks3-go-unit-tests> {"timestamp":"2026-11-10T21:13:59.286888183Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9289ed0a-c2fe-4c0a-bc5c-cfc67e162efd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(198)"}580niks3-go-unit-tests> === RUN TestAbortSucceeded581niks3-go-unit-tests> === PAUSE TestAbortSucceeded582niks3-go-unit-tests> === RUN TestService_AuthMiddleware583niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware584niks3-go-unit-tests> === RUN TestService_AuthMiddleware_MTLSProxyHeader585niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_MTLSProxyHeader586niks3-go-unit-tests> === RUN TestService_AuthMiddleware_MTLSBoundSubjects587niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_MTLSBoundSubjects588niks3-go-unit-tests> === RUN TestService_ReadAuthMiddleware589niks3-go-unit-tests> === PAUSE TestService_ReadAuthMiddleware590niks3-go-unit-tests> === RUN TestService_AuthMiddleware_OIDC591niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_OIDC592niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC593niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC594niks3-go-unit-tests> === RUN TestService_ReadScope_PublicByDefault595niks3-go-unit-tests> === PAUSE TestService_ReadScope_PublicByDefault596niks3-go-unit-tests> === RUN TestCacheConfigHandler597niks3-go-unit-tests> === PAUSE TestCacheConfigHandler598niks3-go-unit-tests> === RUN TestCacheStatsHandler599niks3-go-unit-tests> === PAUSE TestCacheStatsHandler600niks3-go-unit-tests> === RUN TestClientCADerivations601niks3-go-unit-tests> === PAUSE TestClientCADerivations602niks3-go-unit-tests> === RUN TestClientErrorHandling603niks3-go-unit-tests> === PAUSE TestClientErrorHandling604niks3-go-unit-tests> === RUN TestClientIntegration605niks3-go-unit-tests> === PAUSE TestClientIntegration606niks3-go-unit-tests> === RUN TestClientMultipleUploads607niks3-go-unit-tests> === PAUSE TestClientMultipleUploads608niks3-go-unit-tests> === RUN TestClientWithDependencies609niks3-go-unit-tests> === PAUSE TestClientWithDependencies610niks3-go-unit-tests> === RUN TestClientSharedPathCommittedMidPush611niks3-go-unit-tests> === PAUSE TestClientSharedPathCommittedMidPush612niks3-go-unit-tests> === RUN TestPinProtectsFromGC613niks3-go-unit-tests> === PAUSE TestPinProtectsFromGC614niks3-go-unit-tests> === RUN TestClientPushesUseOnePush615niks3-go-unit-tests> === PAUSE TestClientPushesUseOnePush616niks3-go-unit-tests> === RUN TestClientFallsBackToClosures617niks3-go-unit-tests> === PAUSE TestClientFallsBackToClosures618niks3-go-unit-tests> === RUN TestDeleteClosuresRacingPins619niks3-go-unit-tests> === PAUSE TestDeleteClosuresRacingPins620niks3-go-unit-tests> === RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock621niks3-go-unit-tests> === PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock622niks3-go-unit-tests> === RUN TestResolveDBConnectionString623niks3-go-unit-tests> === PAUSE TestResolveDBConnectionString624niks3-go-unit-tests> === RUN TestConnectWaitsForAPeerMigration625niks3-go-unit-tests> === PAUSE TestConnectWaitsForAPeerMigration626niks3-go-unit-tests> === RUN TestLeadElectsOneAndHandsOver627niks3-go-unit-tests> === PAUSE TestLeadElectsOneAndHandsOver628niks3-go-unit-tests> === RUN TestLeadIncumbentWinsAfterRestart629niks3-go-unit-tests> 2026/11/10 21:14:00 INFO lead: acquired remote=192.0.2.1:1234630niks3-go-unit-tests> 2026/11/10 21:14:00 INFO lead: released remote=192.0.2.1:1234631niks3-go-unit-tests> 2026/11/10 21:14:00 INFO lead: acquired remote=192.0.2.1:1234632niks3-go-unit-tests> 2026/11/10 21:14:02 INFO lead: released remote=192.0.2.1:1234633niks3-go-unit-tests> --- PASS: TestLeadIncumbentWinsAfterRestart (2.66s)634niks3-go-unit-tests> === RUN TestLeadIncumbentAnnouncesAtOnce635niks3-go-unit-tests> === PAUSE TestLeadIncumbentAnnouncesAtOnce636niks3-go-unit-tests> === RUN TestLeadEndsOnShutdown637niks3-go-unit-tests> === PAUSE TestLeadEndsOnShutdown638niks3-go-unit-tests> === RUN TestLeadEndsWhenItsConnectionHangs639niks3-go-unit-tests> 2026/11/10 21:14:03 INFO lead: acquired remote=192.0.2.1:1234640niks3-go-unit-tests> 2026-11-10 21:14:04.716 UTC [396] FATAL: terminating connection due to administrator command641niks3-go-unit-tests> 2026/11/10 21:14:04 INFO lead: acquired remote=192.0.2.1:1234642niks3-go-unit-tests> 2026/11/10 21:14:05 WARN lead: lock connection lost error="timeout: context deadline exceeded"643niks3-go-unit-tests> 2026/11/10 21:14:05 INFO lead: released remote=192.0.2.1:1234644niks3-go-unit-tests> 2026/11/10 21:14:06 INFO lead: released remote=192.0.2.1:1234645niks3-go-unit-tests> --- PASS: TestLeadEndsWhenItsConnectionHangs (4.24s)646niks3-go-unit-tests> === RUN TestGCAdvisoryLockBlocksConcurrentRun647niks3-go-unit-tests> === PAUSE TestGCAdvisoryLockBlocksConcurrentRun648niks3-go-unit-tests> === RUN TestGCBugBareHashReferences649niks3-go-unit-tests> === PAUSE TestGCBugBareHashReferences650niks3-go-unit-tests> === RUN TestGCMetrics651niks3-go-unit-tests> === PAUSE TestGCMetrics652niks3-go-unit-tests> === RUN TestPushDedupSurvivesConcurrentGC653niks3-go-unit-tests> === PAUSE TestPushDedupSurvivesConcurrentGC654niks3-go-unit-tests> === RUN TestDeduplicatedObjectsRecordedAsPending655niks3-go-unit-tests> === PAUSE TestDeduplicatedObjectsRecordedAsPending656niks3-go-unit-tests> === RUN TestGCSweepSkipsPendingObjects657niks3-go-unit-tests> === PAUSE TestGCSweepSkipsPendingObjects658niks3-go-unit-tests> === RUN TestTombstonedObjectOfferedWithoutWaiting659niks3-go-unit-tests> === PAUSE TestTombstonedObjectOfferedWithoutWaiting660niks3-go-unit-tests> === RUN TestGCSweepDeliversEachKeyOnce661niks3-go-unit-tests> === PAUSE TestGCSweepDeliversEachKeyOnce662niks3-go-unit-tests> === RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection663niks3-go-unit-tests> === PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection664niks3-go-unit-tests> === RUN TestForceGCDuringPushOffersSweptObject665niks3-go-unit-tests> === PAUSE TestForceGCDuringPushOffersSweptObject666niks3-go-unit-tests> === RUN TestFailedS3DeleteKeepsTombstone667niks3-go-unit-tests> === PAUSE TestFailedS3DeleteKeepsTombstone668niks3-go-unit-tests> === RUN TestSweepSkipsRowsLockedByPush669niks3-go-unit-tests> === PAUSE TestSweepSkipsRowsLockedByPush670niks3-go-unit-tests> === RUN TestRegisterCompletedObjectNeedsPendingRow671niks3-go-unit-tests> === PAUSE TestRegisterCompletedObjectNeedsPendingRow672niks3-go-unit-tests> === RUN TestGetExistingObjectsLocksRows673niks3-go-unit-tests> === PAUSE TestGetExistingObjectsLocksRows674niks3-go-unit-tests> === RUN TestSweepRechecksPendingAfterLocking675niks3-go-unit-tests> === PAUSE TestSweepRechecksPendingAfterLocking676niks3-go-unit-tests> === RUN TestPushWaitsForSweepHoldingRow677niks3-go-unit-tests> === PAUSE TestPushWaitsForSweepHoldingRow678niks3-go-unit-tests> === RUN TestCommitRacingPendingCleanupKeepsObjects679niks3-go-unit-tests> === PAUSE TestCommitRacingPendingCleanupKeepsObjects680niks3-go-unit-tests> === RUN TestGCEndsOnShutdown681niks3-go-unit-tests> === PAUSE TestGCEndsOnShutdown682niks3-go-unit-tests> === RUN TestGCTaskStore_StartNew683niks3-go-unit-tests> === PAUSE TestGCTaskStore_StartNew684niks3-go-unit-tests> === RUN TestGCTaskStore_DeduplicateSameParams685niks3-go-unit-tests> === PAUSE TestGCTaskStore_DeduplicateSameParams686niks3-go-unit-tests> === RUN TestGCTaskStore_ConflictDifferentParams687niks3-go-unit-tests> === PAUSE TestGCTaskStore_ConflictDifferentParams688niks3-go-unit-tests> === RUN TestGCTaskStore_GetEmpty689niks3-go-unit-tests> === PAUSE TestGCTaskStore_GetEmpty690niks3-go-unit-tests> === RUN TestGCTaskStore_GetReturnsLatest691niks3-go-unit-tests> === PAUSE TestGCTaskStore_GetReturnsLatest692niks3-go-unit-tests> === RUN TestGCTaskStore_CompletedAllowsNewTask693niks3-go-unit-tests> === PAUSE TestGCTaskStore_CompletedAllowsNewTask694niks3-go-unit-tests> === RUN TestGCTaskStore_PhaseUpdates695niks3-go-unit-tests> === PAUSE TestGCTaskStore_PhaseUpdates696niks3-go-unit-tests> === RUN TestGCTaskStore_Fail697niks3-go-unit-tests> === PAUSE TestGCTaskStore_Fail698niks3-go-unit-tests> === RUN TestGracefulShutdownDrainsInflight699niks3-go-unit-tests> === PAUSE TestGracefulShutdownDrainsInflight700niks3-go-unit-tests> === RUN TestService_healthCheckHandler701niks3-go-unit-tests> === PAUSE TestService_healthCheckHandler702niks3-go-unit-tests> === RUN TestService_readinessHandler703niks3-go-unit-tests> === PAUSE TestService_readinessHandler704niks3-go-unit-tests> === RUN TestGenerateLandingPage705niks3-go-unit-tests> === PAUSE TestGenerateLandingPage706niks3-go-unit-tests> === RUN TestEnsureAbortUploadsRule707niks3-go-unit-tests> === PAUSE TestEnsureAbortUploadsRule708niks3-go-unit-tests> === RUN TestCacheConfigHandlerMaxNarSize709niks3-go-unit-tests> === PAUSE TestCacheConfigHandlerMaxNarSize710niks3-go-unit-tests> === RUN TestCreatePendingClosureRejectsOversizedNAR711niks3-go-unit-tests> === PAUSE TestCreatePendingClosureRejectsOversizedNAR712niks3-go-unit-tests> === RUN TestNARDeduplicationMetadataUploadBug713niks3-go-unit-tests> === PAUSE TestNARDeduplicationMetadataUploadBug714niks3-go-unit-tests> === RUN TestMetricsInventory715niks3-go-unit-tests> === PAUSE TestMetricsInventory716niks3-go-unit-tests> === RUN TestMetricsCommit717niks3-go-unit-tests> === PAUSE TestMetricsCommit718niks3-go-unit-tests> === RUN TestService_NativeMTLS719niks3-go-unit-tests> === PAUSE TestService_NativeMTLS720niks3-go-unit-tests> === RUN TestServerTLSConfig721niks3-go-unit-tests> === PAUSE TestServerTLSConfig722niks3-go-unit-tests> === RUN TestMultipartCleanup723niks3-go-unit-tests> === PAUSE TestMultipartCleanup724niks3-go-unit-tests> === RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded725niks3-go-unit-tests> === PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded726niks3-go-unit-tests> === RUN TestPendingCleanupUsesOneCutoff727niks3-go-unit-tests> === PAUSE TestPendingCleanupUsesOneCutoff728niks3-go-unit-tests> === RUN TestObjectStatsTrigger729niks3-go-unit-tests> === PAUSE TestObjectStatsTrigger730niks3-go-unit-tests> === RUN TestObjectStatsUpdatedOncePerCommit731niks3-go-unit-tests> === PAUSE TestObjectStatsUpdatedOncePerCommit732niks3-go-unit-tests> === RUN TestOrphanedObjectsGC733niks3-go-unit-tests> === PAUSE TestOrphanedObjectsGC734niks3-go-unit-tests> === RUN TestOrphanedObjectsGCStressTest735niks3-go-unit-tests> === PAUSE TestOrphanedObjectsGCStressTest736niks3-go-unit-tests> === RUN TestCreatePin_ReservedPins737niks3-go-unit-tests> === PAUSE TestCreatePin_ReservedPins738niks3-go-unit-tests> === RUN TestPresentReportsOnlyClosureRoots739niks3-go-unit-tests> === PAUSE TestPresentReportsOnlyClosureRoots740niks3-go-unit-tests> === RUN TestPresentRefreshesOnlyStaleClosures741niks3-go-unit-tests> === PAUSE TestPresentRefreshesOnlyStaleClosures742niks3-go-unit-tests> === RUN TestPresentNotReportedWhileGCDeletesClosure743niks3-go-unit-tests> === PAUSE TestPresentNotReportedWhileGCDeletesClosure744niks3-go-unit-tests> === RUN TestParseSingleRange745niks3-go-unit-tests> === PAUSE TestParseSingleRange746niks3-go-unit-tests> === RUN TestProxyHeadersOnlyTrustedOnSocket747niks3-go-unit-tests> 2026/11/10 21:14:07 INFO Starting HTTP server address=127.0.0.1:43631748niks3-go-unit-tests> 2026/11/10 21:14:07 INFO Starting HTTP server address=proxy.sock749niks3-go-unit-tests> 2026/11/10 21:14:07 WARN mTLS auth: subject not in bound subjects subject="CN=someone"750niks3-go-unit-tests> 2026/11/10 21:14:07 INFO Shutdown signal received, draining in-flight requests timeout=10s751niks3-go-unit-tests> --- PASS: TestProxyHeadersOnlyTrustedOnSocket (1.18s)752niks3-go-unit-tests> === RUN TestIsValidCachePath753niks3-go-unit-tests> === PAUSE TestIsValidCachePath754niks3-go-unit-tests> === RUN TestReadProxyNarinfo755niks3-go-unit-tests> === PAUSE TestReadProxyNarinfo756niks3-go-unit-tests> === RUN TestReadProxyNarinfoAlreadyDecompressed757niks3-go-unit-tests> === PAUSE TestReadProxyNarinfoAlreadyDecompressed758niks3-go-unit-tests> === RUN TestReadProxyContentNegotiation759niks3-go-unit-tests> === PAUSE TestReadProxyContentNegotiation760niks3-go-unit-tests> === RUN TestReadProxyNarStreaming761niks3-go-unit-tests> === PAUSE TestReadProxyNarStreaming762niks3-go-unit-tests> === RUN TestReadProxy404763niks3-go-unit-tests> === PAUSE TestReadProxy404764niks3-go-unit-tests> === RUN TestReadProxyInvalidPath765niks3-go-unit-tests> === PAUSE TestReadProxyInvalidPath766niks3-go-unit-tests> === RUN TestReadProxyHead767niks3-go-unit-tests> === PAUSE TestReadProxyHead768niks3-go-unit-tests> === RUN TestReadProxyOutlastsServerWriteTimeout769niks3-go-unit-tests> === PAUSE TestReadProxyOutlastsServerWriteTimeout770niks3-go-unit-tests> === RUN TestReadProxyConditionalGet771niks3-go-unit-tests> === PAUSE TestReadProxyConditionalGet772niks3-go-unit-tests> === RUN TestReadProxyRootRedirectsToIndexHTML773niks3-go-unit-tests> === PAUSE TestReadProxyRootRedirectsToIndexHTML774niks3-go-unit-tests> === RUN TestReadProxyDisabled775niks3-go-unit-tests> === PAUSE TestReadProxyDisabled776niks3-go-unit-tests> === RUN TestReadRedirectNar777niks3-go-unit-tests> === PAUSE TestReadRedirectNar778niks3-go-unit-tests> === RUN TestReadRedirectKeepsNarinfoProxied779niks3-go-unit-tests> === PAUSE TestReadRedirectKeepsNarinfoProxied780niks3-go-unit-tests> === RUN TestReadProxyRangeRequest781niks3-go-unit-tests> === PAUSE TestReadProxyRangeRequest782niks3-go-unit-tests> === RUN TestReadRedirectUsesPublicS3URL783niks3-go-unit-tests> === PAUSE TestReadRedirectUsesPublicS3URL784niks3-go-unit-tests> === RUN TestPush_OverlappingRootsStoreOneRowPerKey785niks3-go-unit-tests> === PAUSE TestPush_OverlappingRootsStoreOneRowPerKey786niks3-go-unit-tests> === RUN TestPush_CompleteCommitsEveryRoot787niks3-go-unit-tests> === PAUSE TestPush_CompleteCommitsEveryRoot788niks3-go-unit-tests> === RUN TestPush_RepeatedRootCommitsOnce789niks3-go-unit-tests> === PAUSE TestPush_RepeatedRootCommitsOnce790niks3-go-unit-tests> === RUN TestPush_CompleteWaitsForCleanupOfThePush791niks3-go-unit-tests> === PAUSE TestPush_CompleteWaitsForCleanupOfThePush792niks3-go-unit-tests> === RUN TestPush_RootsAreLockedInByteOrder793niks3-go-unit-tests> === PAUSE TestPush_RootsAreLockedInByteOrder794niks3-go-unit-tests> === RUN TestPush_SkippedKeySurvivesGCBeforeCommit795niks3-go-unit-tests> === PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit796niks3-go-unit-tests> === RUN TestPush_RejectsBadRequests797niks3-go-unit-tests> === PAUSE TestPush_RejectsBadRequests798niks3-go-unit-tests> === RUN TestPush_SignsNarinfosOfItsPendingObjects799niks3-go-unit-tests> === PAUSE TestPush_SignsNarinfosOfItsPendingObjects800niks3-go-unit-tests> === RUN TestSharedNarBothUploadsComplete801niks3-go-unit-tests> === PAUSE TestSharedNarBothUploadsComplete802niks3-go-unit-tests> === RUN TestCompleteMultipartUpload_ErrorButObjectExists803niks3-go-unit-tests> === PAUSE TestCompleteMultipartUpload_ErrorButObjectExists804niks3-go-unit-tests> === RUN TestCompletedNarNotReofferedAcrossClosures805niks3-go-unit-tests> === PAUSE TestCompletedNarNotReofferedAcrossClosures806niks3-go-unit-tests> === RUN TestPresignedUploadRegisteredBeforeCommit807niks3-go-unit-tests> === PAUSE TestPresignedUploadRegisteredBeforeCommit808niks3-go-unit-tests> === RUN TestService_Rustfstest809niks3-go-unit-tests> === PAUSE TestService_Rustfstest810niks3-go-unit-tests> === RUN TestParseSize811niks3-go-unit-tests> === PAUSE TestParseSize812niks3-go-unit-tests> === RUN TestSkippedUploadsHandler813niks3-go-unit-tests> === PAUSE TestSkippedUploadsHandler814niks3-go-unit-tests> === RUN TestSystemdListenerNotActivated815niks3-go-unit-tests> --- PASS: TestSystemdListenerNotActivated (0.00s)816niks3-go-unit-tests> === RUN TestWatchdogBeatsWhenHealthy817niks3-go-unit-tests> --- PASS: TestWatchdogBeatsWhenHealthy (0.02s)818niks3-go-unit-tests> === RUN TestWatchdogSkipsWhenUnhealthy819niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"820niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"821niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"822niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"823niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"824niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"825niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"826niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"827niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"828niks3-go-unit-tests> 2026/11/10 21:14:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"829niks3-go-unit-tests> --- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)830niks3-go-unit-tests> === RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle831niks3-go-unit-tests> === PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle832niks3-go-unit-tests> === RUN TestProxyWriteTimeout833niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout834niks3-go-unit-tests> === RUN TestPendingClosureWriteTimeout835niks3-go-unit-tests> === PAUSE TestPendingClosureWriteTimeout836niks3-go-unit-tests> === RUN TestIsValidUploadKey837niks3-go-unit-tests> === PAUSE TestIsValidUploadKey838niks3-go-unit-tests> === RUN TestUploadHandlersRejectInvalidKeys839niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys840niks3-go-unit-tests> === RUN TestUploadHandlersRejectOversizedBody841niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody842niks3-go-unit-tests> === RUN TestService_cleanupPendingClosuresHandler843niks3-go-unit-tests> === PAUSE TestService_cleanupPendingClosuresHandler844niks3-go-unit-tests> === RUN TestService_createPendingClosureHandler845niks3-go-unit-tests> === PAUSE TestService_createPendingClosureHandler846niks3-go-unit-tests> === RUN TestService_verifyS3Integrity847niks3-go-unit-tests> === PAUSE TestService_verifyS3Integrity848niks3-go-unit-tests> === RUN TestService_verifyS3ReuploadsStaleNarinfo849niks3-go-unit-tests> === PAUSE TestService_verifyS3ReuploadsStaleNarinfo850niks3-go-unit-tests> === RUN TestCompleteMultipartUnregistered851niks3-go-unit-tests> === PAUSE TestCompleteMultipartUnregistered852niks3-go-unit-tests> === RUN TestCreatePendingClosure_SmallNARUsesSimplePUT853niks3-go-unit-tests> === PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT854niks3-go-unit-tests> === CONT TestPendingClosureWriteTimeout855niks3-go-unit-tests> === CONT TestAbortSucceeded856niks3-go-unit-tests> === CONT TestProxyWriteTimeout857niks3-go-unit-tests> === RUN TestProxyWriteTimeout/narinfo858niks3-go-unit-tests> === CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle859niks3-go-unit-tests> === CONT TestSkippedUploadsHandler860niks3-go-unit-tests> === CONT TestParseSize861niks3-go-unit-tests> === CONT TestService_Rustfstest862niks3-go-unit-tests> === CONT TestPresignedUploadRegisteredBeforeCommit863niks3-go-unit-tests> === CONT TestService_createPendingClosureHandler864niks3-go-unit-tests> === CONT TestCompletedNarNotReofferedAcrossClosures865niks3-go-unit-tests> === CONT TestCompleteMultipartUpload_ErrorButObjectExists866niks3-go-unit-tests> === CONT TestCreatePendingClosure_SmallNARUsesSimplePUT867niks3-go-unit-tests> === CONT TestSharedNarBothUploadsComplete868niks3-go-unit-tests> === CONT TestCompleteMultipartUnregistered869niks3-go-unit-tests> === CONT TestPush_SignsNarinfosOfItsPendingObjects870niks3-go-unit-tests> === CONT TestService_verifyS3ReuploadsStaleNarinfo871niks3-go-unit-tests> === CONT TestPush_RejectsBadRequests872niks3-go-unit-tests> === CONT TestGCTaskStore_GetReturnsLatest873niks3-go-unit-tests> === CONT TestUploadHandlersRejectInvalidKeys874niks3-go-unit-tests> === RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info875niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info876niks3-go-unit-tests> === RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal877niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal878niks3-go-unit-tests> === RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key879niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key880niks3-go-unit-tests> === RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key881niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key882niks3-go-unit-tests> === CONT TestPush_SkippedKeySurvivesGCBeforeCommit883niks3-go-unit-tests> 2026/11/10 21:14:07 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000884niks3-go-unit-tests> === RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed885niks3-go-unit-tests> === PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed886niks3-go-unit-tests> === RUN TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed887niks3-go-unit-tests> === PAUSE TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed888niks3-go-unit-tests> === RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost889niks3-go-unit-tests> === PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost890niks3-go-unit-tests> === RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed891niks3-go-unit-tests> === PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed892niks3-go-unit-tests> === RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed893niks3-go-unit-tests> === PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed894niks3-go-unit-tests> === CONT TestPush_RepeatedRootCommitsOnce895niks3-go-unit-tests> === CONT TestLeadElectsOneAndHandsOver896niks3-go-unit-tests> === CONT TestGCTaskStore_DeduplicateSameParams897niks3-go-unit-tests> === CONT TestService_verifyS3Integrity898niks3-go-unit-tests> === CONT TestUploadHandlersRejectOversizedBody899niks3-go-unit-tests> === CONT TestPush_RootsAreLockedInByteOrder900niks3-go-unit-tests> === CONT TestService_cleanupPendingClosuresHandler901niks3-go-unit-tests> === CONT TestGCTaskStore_GetEmpty902niks3-go-unit-tests> === RUN TestPendingClosureWriteTimeout/empty903niks3-go-unit-tests> --- PASS: TestAbortSucceeded (0.00s)904niks3-go-unit-tests> === CONT TestGCTaskStore_ConflictDifferentParams905niks3-go-unit-tests> --- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)906niks3-go-unit-tests> === CONT TestConnectWaitsForAPeerMigration907niks3-go-unit-tests> --- PASS: TestParseSize (0.00s)908niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/narinfo909niks3-go-unit-tests> === CONT TestPush_CompleteCommitsEveryRoot910niks3-go-unit-tests> --- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)911niks3-go-unit-tests> --- PASS: TestSkippedUploadsHandler (0.01s)912niks3-go-unit-tests> --- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)913niks3-go-unit-tests> === CONT TestPush_CompleteWaitsForCleanupOfThePush914niks3-go-unit-tests> === PAUSE TestPendingClosureWriteTimeout/empty915niks3-go-unit-tests> === RUN TestPendingClosureWriteTimeout/400_objects916niks3-go-unit-tests> === PAUSE TestPendingClosureWriteTimeout/400_objects917niks3-go-unit-tests> === RUN TestPendingClosureWriteTimeout/670k_objects918niks3-go-unit-tests> === PAUSE TestPendingClosureWriteTimeout/670k_objects919niks3-go-unit-tests> === RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline920niks3-go-unit-tests> === PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline921niks3-go-unit-tests> === CONT TestGCTaskStore_StartNew922niks3-go-unit-tests> === CONT TestResolveDBConnectionString923niks3-go-unit-tests> === RUN TestProxyWriteTimeout/1_GiB_nar924niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/1_GiB_nar925niks3-go-unit-tests> === RUN TestProxyWriteTimeout/10_GiB_nar926niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/10_GiB_nar927niks3-go-unit-tests> === RUN TestProxyWriteTimeout/unknown_size928niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/unknown_size929niks3-go-unit-tests> --- PASS: TestGCTaskStore_GetEmpty (0.00s)930niks3-go-unit-tests> --- PASS: TestGCTaskStore_StartNew (0.00s)931niks3-go-unit-tests> === CONT TestGCEndsOnShutdown932niks3-go-unit-tests> === RUN TestGCEndsOnShutdown/before_the_run933niks3-go-unit-tests> === PAUSE TestGCEndsOnShutdown/before_the_run934niks3-go-unit-tests> === RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete935niks3-go-unit-tests> === PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete936niks3-go-unit-tests> === RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark937niks3-go-unit-tests> === RUN TestResolveDBConnectionString/flag_wins938niks3-go-unit-tests> === CONT TestPush_OverlappingRootsStoreOneRowPerKey939niks3-go-unit-tests> === PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark940niks3-go-unit-tests> === CONT TestReadRedirectUsesPublicS3URL941niks3-go-unit-tests> === PAUSE TestResolveDBConnectionString/flag_wins942niks3-go-unit-tests> === RUN TestResolveDBConnectionString/file_when_flag_empty943niks3-go-unit-tests> === PAUSE TestResolveDBConnectionString/file_when_flag_empty944niks3-go-unit-tests> === RUN TestResolveDBConnectionString/missing_file_is_an_error945niks3-go-unit-tests> === PAUSE TestResolveDBConnectionString/missing_file_is_an_error946niks3-go-unit-tests> === RUN TestResolveDBConnectionString/PGHOST_allows_empty947niks3-go-unit-tests> === PAUSE TestResolveDBConnectionString/PGHOST_allows_empty948niks3-go-unit-tests> === RUN TestResolveDBConnectionString/nothing_configured949niks3-go-unit-tests> === PAUSE TestResolveDBConnectionString/nothing_configured950niks3-go-unit-tests> === CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock951niks3-go-unit-tests> === RUN TestUploadHandlersRejectOversizedBody/create_pending_closure952niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure953niks3-go-unit-tests> === RUN TestUploadHandlersRejectOversizedBody/complete_multipart954niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart955niks3-go-unit-tests> === RUN TestUploadHandlersRejectOversizedBody/request_more_parts956niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts957niks3-go-unit-tests> === CONT TestCommitRacingPendingCleanupKeepsObjects958niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures959niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received complete multipart upload request method=POST path=/api/multipart/complete960niks3-go-unit-tests> 2026/11/10 21:14:10 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst961niks3-go-unit-tests> --- PASS: TestCompleteMultipartUnregistered (2.10s)962niks3-go-unit-tests> === CONT TestReadProxyRangeRequest963niks3-go-unit-tests> --- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (2.14s)964niks3-go-unit-tests> === CONT TestDeleteClosuresRacingPins965niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures966niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures967niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures968niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures969niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures970niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures971niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures972niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst973niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures974niks3-go-unit-tests> --- PASS: TestPresignedUploadRegisteredBeforeCommit (3.14s)975niks3-go-unit-tests> === CONT TestPushWaitsForSweepHoldingRow976niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received uploads request method=POST path=/api/pending_closures977niks3-go-unit-tests> === RUN TestPush_RejectsBadRequests/root_not_in_objects978niks3-go-unit-tests> === PAUSE TestPush_RejectsBadRequests/root_not_in_objects979niks3-go-unit-tests> === RUN TestPush_RejectsBadRequests/no_roots980niks3-go-unit-tests> === PAUSE TestPush_RejectsBadRequests/no_roots981niks3-go-unit-tests> === RUN TestPush_RejectsBadRequests/no_objects982niks3-go-unit-tests> === PAUSE TestPush_RejectsBadRequests/no_objects983niks3-go-unit-tests> === RUN TestPush_RejectsBadRequests/bad_root984niks3-go-unit-tests> === PAUSE TestPush_RejectsBadRequests/bad_root985niks3-go-unit-tests> === CONT TestClientFallsBackToClosures986niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received push request method=POST path=/api/pushes987niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign988niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Signed narinfos id=1 count=1989niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign990niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign991niks3-go-unit-tests> 2026/11/10 21:14:10 ERROR Failed to sign narinfos signer="index 1" error="signing key cannot be nil"992niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign993niks3-go-unit-tests> 2026/11/10 21:14:10 ERROR Failed to sign narinfos signer=niks3-test-1 error="signer failed"994niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign995niks3-go-unit-tests> 2026/11/10 21:14:10 ERROR Signer returned unexpected signature count signer=niks3-test-1 got=0 want=1996niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign997niks3-go-unit-tests> 2026/11/10 21:14:10 ERROR Signer returned unexpected object key signer=niks3-test-1 object_key=unexpected.narinfo998niks3-go-unit-tests> --- PASS: TestPush_SignsNarinfosOfItsPendingObjects (3.23s)999niks3-go-unit-tests> === CONT TestSweepRechecksPendingAfterLocking1000niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received push request method=POST path=/api/pushes1001niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received complete push request method=POST path=/api/pushes/1/complete1002niks3-go-unit-tests> 2026/11/10 21:14:10 INFO Received push request method=POST path=/api/pushes1003niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete push request method=POST path=/api/pushes/1/complete1004niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1005niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1006niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1007niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LmMxNDViNDdiLWM4NjctNDc1NC05MTg4LWE3NGVhYTEzMzFmNHgxNzk0MzQ1MjUwODIwNDE5Njgy parts=101008niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete1009niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjgxNWU2MjQ3LWYzMGQtNGYxOC1hYTFkLTYyZWZmMGM4Njc1ZHgxNzk0MzQ1MjUwNzc1ODM0Mjgw parts=121010niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed upload id=1 objects=2 duration=24.870875ms1011niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000001012niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received uploads request method=POST path=/api/pending_closures1013niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjhhYWYzYjc2LWE5OWQtNDY2Yi05MTEwLTdiNTQ0NWRkMzk4N3gxNzk0MzQ1MjUwODQ5Mjc0MDM2 parts=101014niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete1015niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Starting cleanup of old closures method=DELETE path=/api/closures1016niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1017niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed upload id=1 objects=2 duration=6.184398ms1018niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Aborted multipart uploads count=0 kept=01019niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjNjODU0ZTM1LTI4NGItNDkwZS04MDQyLWNhMDhjYmVlNjFhMngxNzk0MzQ1MjUwODgzNzQ1MzQy parts=121020niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received uploads request method=POST path=/api/pending_closures1021niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received uploads request method=POST path=/api/pending_closures1022niks3-go-unit-tests> === CONT TestClientPushesUseOnePush1023niks3-go-unit-tests> --- PASS: TestCompletedNarNotReofferedAcrossClosures (3.80s)1024niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received uploads request method=POST path=/api/pending_closures1025niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo1026niks3-go-unit-tests> 2026/11/10 21:14:11 WARN Found objects in DB but missing from S3, will re-upload count=11027niks3-go-unit-tests> --- PASS: TestService_verifyS3Integrity (2.91s)1028niks3-go-unit-tests> === CONT TestGetExistingObjectsLocksRows1029niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed push id=1 objects=4 duration=666.103216ms1030niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received push request method=POST path=/api/pushes1031niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed push id=1 objects=4 duration=640.954777ms1032niks3-go-unit-tests> --- PASS: TestPush_RepeatedRootCommitsOnce (3.94s)1033niks3-go-unit-tests> === CONT TestPinProtectsFromGC1034niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01035niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Vacuumed table table=pending_closures1036niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Vacuumed table table=pending_objects1037niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Vacuumed table table=multipart_uploads1038niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Vacuumed table table=closures1039niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Vacuumed table table=objects1040niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Aborted multipart uploads count=0 kept=01041niks3-go-unit-tests> 2026/11/10 21:14:11 WARN Force mode enabled - objects will be deleted immediately without grace period1042niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000001043niks3-go-unit-tests> --- PASS: TestService_createPendingClosureHandler (4.05s)1044niks3-go-unit-tests> === CONT TestRegisterCompletedObjectNeedsPendingRow1045niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Aborted multipart uploads count=0 kept=01046niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received uploads request method=POST path=/api/pending_closures1047niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1048niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received push request method=POST path=/api/pushes1049niks3-go-unit-tests> --- PASS: TestReadRedirectUsesPublicS3URL (1.56s)1050niks3-go-unit-tests> === CONT TestReadRedirectKeepsNarinfoProxied1051niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjVlODc0Yzc3LWM4NjAtNDNiMC04MzI2LTUyYzU5MTk2NzEzZngxNzk0MzQ1MjUwNzg4NjQwMjgx parts=121052niks3-go-unit-tests> --- PASS: TestSharedNarBothUploadsComplete (4.23s)1053niks3-go-unit-tests> === CONT TestClientSharedPathCommittedMidPush1054niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received complete push request method=POST path=/api/pushes/1/complete1055niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received cleanup request method=DELETE path=/api/pending_closures1056niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Aborted multipart uploads count=0 kept=01057niks3-go-unit-tests> 2026/11/10 21:14:11 INFO Received uploads request method=POST path=/api/pending_closures1058niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received cleanup request method=DELETE path=/api/pending_closures1059niks3-go-unit-tests> 2026/11/10 21:14:12 INFO lead: acquired remote=192.0.2.1:12341060niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Aborted multipart uploads count=1 kept=01061niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete1062niks3-go-unit-tests> 2026-11-10 21:14:12.024 UTC [473] ERROR: Closure does not exist: id=11063niks3-go-unit-tests> 2026-11-10 21:14:12.024 UTC [473] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 13 at RAISE1064niks3-go-unit-tests> 2026-11-10 21:14:12.024 UTC [473] STATEMENT: -- name: CommitPendingClosure :one1065niks3-go-unit-tests> SELECT commit_pending_closure($1::bigint)::bigint1066niks3-go-unit-tests> 1067niks3-go-unit-tests> --- PASS: TestService_cleanupPendingClosuresHandler (3.40s)1068niks3-go-unit-tests> === CONT TestSweepSkipsRowsLockedByPush1069niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received uploads request method=POST path=/api/pending_closures1070niks3-go-unit-tests> 2026/11/10 21:14:12 WARN Force mode enabled - objects will be deleted immediately without grace period1071niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01072niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=01073niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_closures1074niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_objects1075niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=multipart_uploads1076niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=closures1077niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_closures1078niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=objects1079niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_objects1080niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=multipart_uploads1081niks3-go-unit-tests> --- PASS: TestSweepRechecksPendingAfterLocking (1.18s)1082niks3-go-unit-tests> === CONT TestObjectStatsUpdatedOncePerCommit1083niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=closures1084niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received push request method=POST path=/api/pushes1085niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=objects1086niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received complete push request method=POST path=/api/pushes/2/complete1087niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Completed push id=2 objects=4 duration=3.715435ms1088niks3-go-unit-tests> --- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (4.42s)1089niks3-go-unit-tests> === CONT TestClientWithDependencies1090niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1091niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Completed push id=1 objects=6 duration=184.799272ms1092niks3-go-unit-tests> --- PASS: TestPush_CompleteCommitsEveryRoot (3.53s)1093niks3-go-unit-tests> === CONT TestFailedS3DeleteKeepsTombstone1094niks3-go-unit-tests> --- PASS: TestGetExistingObjectsLocksRows (0.65s)1095niks3-go-unit-tests> === CONT TestClientMultipleUploads1096niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received uploads request method=POST path=/api/pending_closures1097niks3-go-unit-tests> --- PASS: TestReadProxyRangeRequest (1.54s)1098niks3-go-unit-tests> === CONT TestObjectStatsTrigger1099niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1100niks3-go-unit-tests> 2026/11/10 21:14:12 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjU5NWM0OGJlLWI5OTUtNGY3NC1iNGVmLTcyN2U3YjUxYjM2OXgxNzk0MzQ1MjUyMjQ4MjcxODQw1101niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Aborted multipart uploads count=0 kept=01102niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjU5NWM0OGJlLWI5OTUtNGY3NC1iNGVmLTcyN2U3YjUxYjM2OXgxNzk0MzQ1MjUyMjQ4MjcxODQw parts=11103niks3-go-unit-tests> --- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (3.69s)1104niks3-go-unit-tests> === CONT TestClientIntegration1105niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received push request method=POST path=/api/pushes1106niks3-go-unit-tests> --- PASS: TestService_Rustfstest (4.63s)1107niks3-go-unit-tests> === CONT TestPendingCleanupUsesOneCutoff1108niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received push request method=POST path=/api/pushes1109niks3-go-unit-tests> --- PASS: TestPushWaitsForSweepHoldingRow (1.55s)1110niks3-go-unit-tests> === CONT TestClientErrorHandling1111niks3-go-unit-tests> === RUN TestClientErrorHandling/InvalidStorePath1112niks3-go-unit-tests> === PAUSE TestClientErrorHandling/InvalidStorePath1113niks3-go-unit-tests> === RUN TestClientErrorHandling/InvalidAuthToken1114niks3-go-unit-tests> === PAUSE TestClientErrorHandling/InvalidAuthToken1115niks3-go-unit-tests> === RUN TestClientErrorHandling/ServerNotAvailable1116niks3-go-unit-tests> === PAUSE TestClientErrorHandling/ServerNotAvailable1117niks3-go-unit-tests> === CONT TestForceGCDuringPushOffersSweptObject1118niks3-go-unit-tests> === RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows1119niks3-go-unit-tests> === PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows1120niks3-go-unit-tests> === RUN TestForceGCDuringPushOffersSweptObject/after_presence_check1121niks3-go-unit-tests> === PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check1122niks3-go-unit-tests> === CONT TestClientCADerivations1123niks3-go-unit-tests> --- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (2.04s)1124niks3-go-unit-tests> === CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection1125niks3-go-unit-tests> 2026/11/10 21:14:12 WARN Force mode enabled - objects will be deleted immediately without grace period1126niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01127niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_closures1128niks3-go-unit-tests> 2026-11-10 21:14:12.458 UTC [570] ERROR: Push does not exist: id=11129niks3-go-unit-tests> 2026-11-10 21:14:12.458 UTC [570] CONTEXT: PL/pgSQL function commit_push(bigint) line 11 at RAISE1130niks3-go-unit-tests> 2026-11-10 21:14:12.458 UTC [570] STATEMENT: SELECT commit_push($1)1131niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_objects1132niks3-go-unit-tests> --- PASS: TestPush_CompleteWaitsForCleanupOfThePush (3.83s)1133niks3-go-unit-tests> === CONT TestOrphanedObjectsGC1134niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=multipart_uploads1135niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=closures1136niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=objects1137niks3-go-unit-tests> --- PASS: TestReadRedirectKeepsNarinfoProxied (0.53s)1138niks3-go-unit-tests> === CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded1139niks3-go-unit-tests> --- PASS: TestRegisterCompletedObjectNeedsPendingRow (0.77s)1140niks3-go-unit-tests> === CONT TestReadRedirectNar1141niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Aborted multipart uploads count=0 kept=01142niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Received uploads request method=POST path=/api/pending_closures1143niks3-go-unit-tests> --- PASS: TestObjectStatsTrigger (0.39s)1144niks3-go-unit-tests> === CONT TestReadProxyDisabled1145niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Aborted multipart uploads count=0 kept=01146niks3-go-unit-tests> 2026/11/10 21:14:12 WARN Force mode enabled - objects will be deleted immediately without grace period1147niks3-go-unit-tests> 2026-11-10 21:14:12.832 UTC [610] ERROR: could not obtain lock on row in relation "closures"1148niks3-go-unit-tests> 2026-11-10 21:14:12.832 UTC [610] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1149niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] ERROR: could not obtain lock on row in relation "closures"1150niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1151niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] ERROR: could not obtain lock on row in relation "closures"1152niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1153niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] ERROR: could not obtain lock on row in relation "closures"1154niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1155niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] ERROR: could not obtain lock on row in relation "closures"1156niks3-go-unit-tests> 2026-11-10 21:14:12.834 UTC [610] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1157niks3-go-unit-tests> 2026/11/10 21:14:12 WARN Force mode enabled - objects will be deleted immediately without grace period1158niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01159niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_closures1160niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_objects1161niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=multipart_uploads1162niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=closures1163niks3-go-unit-tests> --- PASS: TestCommitRacingPendingCleanupKeepsObjects (2.33s)1164niks3-go-unit-tests> === CONT TestReadProxyRootRedirectsToIndexHTML1165niks3-go-unit-tests> --- PASS: TestPush_RootsAreLockedInByteOrder (4.22s)1166niks3-go-unit-tests> === CONT TestMultipartCleanup1167niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=objects1168niks3-go-unit-tests> --- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (2.46s)1169niks3-go-unit-tests> === CONT TestReadProxyConditionalGet1170niks3-go-unit-tests> === NAME TestClientMultipleUploads1171niks3-go-unit-tests> client_integration_test.go:405: Created store path 0: /build/TestClientMultipleUploads4104156099/001/store/yczd5wx57gw00h6qz1z7ran44lhcd3qc-test-file-0.txt1172niks3-go-unit-tests> === NAME TestClientIntegration1173niks3-go-unit-tests> client_integration_test.go:291: Created store path: /build/TestClientIntegration1423301553/002/store/kwnma4lp0w7gb5l93zi18fphd86jsj5k-test-file.txt1174niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Aborted multipart uploads count=0 kept=01175niks3-go-unit-tests> 2026/11/10 21:14:12 WARN Force mode enabled - objects will be deleted immediately without grace period1176niks3-go-unit-tests> 2026/11/10 21:14:12 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."1177niks3-go-unit-tests> 2026/11/10 21:14:12 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1178niks3-go-unit-tests> --- PASS: TestFailedS3DeleteKeepsTombstone (0.70s)1179niks3-go-unit-tests> === CONT TestServerTLSConfig1180niks3-go-unit-tests> === RUN TestServerTLSConfig/no_client_CA1181niks3-go-unit-tests> === PAUSE TestServerTLSConfig/no_client_CA1182niks3-go-unit-tests> === RUN TestServerTLSConfig/missing_CA_file1183niks3-go-unit-tests> === PAUSE TestServerTLSConfig/missing_CA_file1184niks3-go-unit-tests> === RUN TestServerTLSConfig/not_a_PEM_file1185niks3-go-unit-tests> === PAUSE TestServerTLSConfig/not_a_PEM_file1186niks3-go-unit-tests> === CONT TestGCSweepDeliversEachKeyOnce1187niks3-go-unit-tests> --- PASS: TestReadProxyDisabled (0.27s)1188niks3-go-unit-tests> === CONT TestService_NativeMTLS1189niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=01190niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_closures1191niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=pending_objects1192niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=multipart_uploads1193niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=closures1194niks3-go-unit-tests> 2026/11/10 21:14:12 INFO Vacuumed table table=objects1195niks3-go-unit-tests> --- PASS: TestSweepSkipsRowsLockedByPush (0.92s)1196niks3-go-unit-tests> === CONT TestTombstonedObjectOfferedWithoutWaiting1197niks3-go-unit-tests> === NAME TestClientMultipleUploads1198niks3-go-unit-tests> client_integration_test.go:405: Created store path 1: /build/TestClientMultipleUploads4104156099/001/store/h68gqb1m8gyh2vylzpbbkl8sc1rsn1pk-test-file-1.txt1199niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1200niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1201niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1202niks3-go-unit-tests> === CONT TestReadProxyOutlastsServerWriteTimeout1203niks3-go-unit-tests> --- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (0.59s)1204niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1205niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received cleanup request method=DELETE path=/api/pending_closures1206niks3-go-unit-tests> --- PASS: TestReadRedirectNar (0.58s)1207niks3-go-unit-tests> === CONT TestMetricsCommit1208niks3-go-unit-tests> --- PASS: TestObjectStatsUpdatedOncePerCommit (1.09s)1209niks3-go-unit-tests> === CONT TestGCSweepSkipsPendingObjects1210niks3-go-unit-tests> --- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (0.82s)1211niks3-go-unit-tests> === CONT TestReadProxyHead1212niks3-go-unit-tests> 2026/11/10 21:14:13 INFO lead: released remote=192.0.2.1:12341213niks3-go-unit-tests> 2026/11/10 21:14:13 INFO lead: acquired remote=192.0.2.1:12341214niks3-go-unit-tests> === NAME TestClientMultipleUploads1215niks3-go-unit-tests> client_integration_test.go:405: Created store path 2: /build/TestClientMultipleUploads4104156099/001/store/5iq7ixjgc8376wjsy6gdklv2xn73jmf1-test-file-2.txt1216niks3-go-unit-tests> === NAME TestPinProtectsFromGC1217niks3-go-unit-tests> client_integration_test.go:778: Pinned store path: /build/TestPinProtectsFromGC3511848235/001/store/v60j8wm3mvz895f22xsh2pvhcp5hiq2a-pinned-file.txt1218niks3-go-unit-tests> client_integration_test.go:779: Unpinned store path: /build/TestPinProtectsFromGC3511848235/001/store/v0qf5z1kz20m03xcb5bx706pznd65jwv-unpinned-file.txt1219niks3-go-unit-tests> --- PASS: TestReadProxyRootRedirectsToIndexHTML (0.84s)1220niks3-go-unit-tests> === CONT TestMetricsInventory1221niks3-go-unit-tests> === NAME TestOrphanedObjectsGC1222niks3-go-unit-tests> orphaned_objects_gc_test.go:287: GC Test Summary:1223niks3-go-unit-tests> orphaned_objects_gc_test.go:288: - Kept: 2 objects from closure A1224niks3-go-unit-tests> orphaned_objects_gc_test.go:289: - Deleted: 2 objects from closure B1225niks3-go-unit-tests> orphaned_objects_gc_test.go:290: - Deleted: 6 orphaned chain objects (X1->X2->X3)1226niks3-go-unit-tests> orphaned_objects_gc_test.go:291: - Deleted: 2 orphaned single objects (Y)1227niks3-go-unit-tests> orphaned_objects_gc_test.go:292: - Total deleted: 10 objects1228niks3-go-unit-tests> --- PASS: TestOrphanedObjectsGC (1.25s)1229niks3-go-unit-tests> === CONT TestDeduplicatedObjectsRecordedAsPending1230niks3-go-unit-tests> --- PASS: TestReadProxyConditionalGet (0.87s)1231niks3-go-unit-tests> === CONT TestReadProxyInvalidPath1232niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1233niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Aborted multipart uploads count=0 kept=01234niks3-go-unit-tests> 2026/11/10 21:14:13 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1235niks3-go-unit-tests> 2026/11/10 21:14:13 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1236niks3-go-unit-tests> --- PASS: TestService_NativeMTLS (0.86s)1237niks3-go-unit-tests> === CONT TestNARDeduplicationMetadataUploadBug1238niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Aborted multipart uploads count=0 kept=01239niks3-go-unit-tests> --- PASS: TestReadProxyHead (0.57s)1240niks3-go-unit-tests> === CONT TestPushDedupSurvivesConcurrentGC1241niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1242niks3-go-unit-tests> --- PASS: TestTombstonedObjectOfferedWithoutWaiting (0.92s)1243niks3-go-unit-tests> === CONT TestReadProxy4041244niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received push request method=POST path=/api/pushes1245niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received uploads request method=POST path=/api/pending_closures1246niks3-go-unit-tests> 2026/11/10 21:14:13 INFO Received complete push request method=POST path=/api/pushes/1/complete1247niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Received cleanup request method=DELETE path=/api/pending_closures1248niks3-go-unit-tests> 2026/11/10 21:14:14 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket61/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""1249niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Aborted multipart uploads count=0 kept=11250niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Received cleanup request method=DELETE path=/api/pending_closures1251niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Aborted multipart uploads count=1 kept=01252niks3-go-unit-tests> --- PASS: TestMultipartCleanup (1.20s)1253niks3-go-unit-tests> === CONT TestCreatePendingClosureRejectsOversizedNAR1254niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Received uploads request method=POST path=/api/pending_closures1255niks3-go-unit-tests> --- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)1256niks3-go-unit-tests> === CONT TestGCMetrics1257niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Aborted multipart uploads count=0 kept=01258niks3-go-unit-tests> 2026/11/10 21:14:14 WARN Force mode enabled - objects will be deleted immediately without grace period1259niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01260niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=pending_closures1261niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=pending_objects1262niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=multipart_uploads1263niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=closures1264niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=objects1265niks3-go-unit-tests> --- PASS: TestGCMetrics (0.22s)1266niks3-go-unit-tests> === CONT TestReadProxyNarStreaming1267niks3-go-unit-tests> 2026/11/10 21:14:14 INFO lead: released remote=192.0.2.1:12341268niks3-go-unit-tests> --- PASS: TestLeadElectsOneAndHandsOver (6.65s)1269niks3-go-unit-tests> === CONT TestCacheConfigHandlerMaxNarSize1270niks3-go-unit-tests> --- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1271niks3-go-unit-tests> === CONT TestCacheStatsHandler1272niks3-go-unit-tests> --- PASS: TestReadProxyNarStreaming (0.21s)1273niks3-go-unit-tests> === CONT TestGCBugBareHashReferences1274niks3-go-unit-tests> 2026/11/10 21:14:14 WARN Force mode enabled - objects will be deleted immediately without grace period1275niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Completed push id=1 objects=4 duration=826.164614ms1276niks3-go-unit-tests> 2026/11/10 21:14:14 WARN Force mode enabled - objects will be deleted immediately without grace period1277niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01278niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete1279niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=pending_closures1280niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Completed upload id=2 objects=2 duration=3.651254ms1281niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=pending_objects1282niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=multipart_uploads1283niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=closures1284niks3-go-unit-tests> --- PASS: TestMetricsCommit (1.62s)1285niks3-go-unit-tests> === CONT TestEnsureAbortUploadsRule1286niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=objects1287niks3-go-unit-tests> --- PASS: TestGCSweepSkipsPendingObjects (1.54s)1288niks3-go-unit-tests> === CONT TestReadProxyContentNegotiation1289niks3-go-unit-tests> === NAME TestClientCADerivations1290niks3-go-unit-tests> client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations471745732/001/store/pd34f18nsxa3q8wni6xdipdvrncfvpl0-ca-test1291niks3-go-unit-tests> === NAME TestClientWithDependencies1292niks3-go-unit-tests> client_integration_test.go:660: Built derivation: /build/TestClientWithDependencies3420743950/001/store/zv17lk0v4036r24p0y0z11qcp2lxdns7-test-script1293niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Received uploads request method=POST path=/api/pending_closures1294niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=01295niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=pending_closures1296niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=pending_objects1297niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=multipart_uploads1298niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=closures1299niks3-go-unit-tests> --- PASS: TestDeduplicatedObjectsRecordedAsPending (1.13s)1300niks3-go-unit-tests> === CONT TestGenerateLandingPage1301niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Vacuumed table table=objects1302niks3-go-unit-tests> --- PASS: TestGCSweepDeliversEachKeyOnce (1.97s)1303niks3-go-unit-tests> === CONT TestCacheConfigHandler1304niks3-go-unit-tests> === RUN TestCacheConfigHandler/full_config,_no_issuer1305niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/full_config,_no_issuer1306niks3-go-unit-tests> === RUN TestCacheConfigHandler/no_cache_url_configured1307niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/no_cache_url_configured1308niks3-go-unit-tests> === RUN TestCacheConfigHandler/no_signing_keys1309niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/no_signing_keys1310niks3-go-unit-tests> === RUN TestCacheConfigHandler/upstream_keys_advertised1311niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/upstream_keys_advertised1312niks3-go-unit-tests> === RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1313niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1314niks3-go-unit-tests> === CONT TestReadProxyNarinfoAlreadyDecompressed1315niks3-go-unit-tests> --- PASS: TestGenerateLandingPage (0.01s)1316niks3-go-unit-tests> === CONT TestLeadEndsOnShutdown1317niks3-go-unit-tests> --- PASS: TestMetricsInventory (1.17s)1318niks3-go-unit-tests> === CONT TestGCAdvisoryLockBlocksConcurrentRun1319niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Received uploads request method=POST path=/api/pending_closures1320niks3-go-unit-tests> --- PASS: TestReadProxyInvalidPath (1.23s)1321niks3-go-unit-tests> === CONT TestService_healthCheckHandler1322niks3-go-unit-tests> 2026/11/10 21:14:14 WARN Rate limiter enabled after throttle name=s3-test rate=51323niks3-go-unit-tests> 2026/11/10 21:14:14 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."1324niks3-go-unit-tests> === NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1325niks3-go-unit-tests> throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=101326niks3-go-unit-tests> throttle_test.go:215: Rate limiter: enabled=true, rate=5.001327niks3-go-unit-tests> --- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (7.24s)1328niks3-go-unit-tests> === CONT TestLeadIncumbentAnnouncesAtOnce1329niks3-go-unit-tests> 2026/11/10 21:14:14 INFO Aborted multipart uploads count=0 kept=01330niks3-go-unit-tests> --- PASS: TestReadProxy404 (1.27s)1331niks3-go-unit-tests> === CONT TestService_ReadScope_PublicByDefault1332niks3-go-unit-tests> --- PASS: TestGCBugBareHashReferences (0.98s)1333niks3-go-unit-tests> === CONT TestReadProxyNarinfo1334niks3-go-unit-tests> === NAME TestNARDeduplicationMetadataUploadBug1335niks3-go-unit-tests> metadata_upload_test.go:48: First store path: /build/TestNARDeduplicationMetadataUploadBug1429258835/001/store/jr0ywwl48snjxi5zfswwdb2nxvp2ciwh-file1.txt1336niks3-go-unit-tests> === NAME TestClientWithDependencies1337niks3-go-unit-tests> client_integration_test.go:662: Found 1 dependencies (including self)1338niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01339niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=pending_closures1340niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=pending_objects1341niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=multipart_uploads1342niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=closures1343niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=objects1344niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Aborted multipart uploads count=0 kept=01345niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Force mode enabled - objects will be deleted immediately without grace period1346niks3-go-unit-tests> --- PASS: TestService_ReadScope_PublicByDefault (0.39s)1347niks3-go-unit-tests> === CONT TestGracefulShutdownDrainsInflight1348niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=01349niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Starting HTTP server address=127.0.0.1:385131350niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Shutdown signal received, draining in-flight requests timeout=10s1351niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=pending_closures1352niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=pending_objects1353niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=multipart_uploads1354niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=closures1355niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Vacuumed table table=objects1356niks3-go-unit-tests> --- PASS: TestPushDedupSurvivesConcurrentGC (1.73s)1357niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC1358niks3-go-unit-tests> --- PASS: TestService_healthCheckHandler (0.61s)1359niks3-go-unit-tests> === CONT TestService_readinessHandler1360niks3-go-unit-tests> 2026/11/10 21:14:15 INFO lead: acquired remote=192.0.2.1:12341361niks3-go-unit-tests> 2026/11/10 21:14:15 INFO lead: released remote=192.0.2.1:12341362niks3-go-unit-tests> --- PASS: TestLeadIncumbentAnnouncesAtOnce (0.62s)1363niks3-go-unit-tests> === CONT TestPresentRefreshesOnlyStaleClosures1364niks3-go-unit-tests> --- PASS: TestConnectWaitsForAPeerMigration (6.96s)1365niks3-go-unit-tests> === CONT TestGCTaskStore_CompletedAllowsNewTask1366niks3-go-unit-tests> --- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1367niks3-go-unit-tests> === CONT TestPresentReportsOnlyClosureRoots1368niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received push request method=POST path=/api/pushes1369niks3-go-unit-tests> 2026/11/10 21:14:15 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:34309/oidc1370niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received push request method=POST path=/api/pushes1371niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)1372niks3-go-unit-tests> --- PASS: TestGracefulShutdownDrainsInflight (0.07s)1373niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Uploading jr0ywwl48snjxi5zfswwdb2nxvp2ciwh-file1.txt (160B)1374niks3-go-unit-tests> === CONT TestIsValidCachePath1375niks3-go-unit-tests> === RUN TestIsValidCachePath/narinfo1376niks3-go-unit-tests> === PAUSE TestIsValidCachePath/narinfo1377niks3-go-unit-tests> === RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1378niks3-go-unit-tests> === PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1379niks3-go-unit-tests> === RUN TestIsValidCachePath/nar_zst1380niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_zst1381niks3-go-unit-tests> === RUN TestIsValidCachePath/nar_xz1382niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_xz1383niks3-go-unit-tests> === RUN TestIsValidCachePath/nar_bz21384niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_bz21385niks3-go-unit-tests> === RUN TestIsValidCachePath/nar_uncompressed1386niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_uncompressed1387niks3-go-unit-tests> === RUN TestIsValidCachePath/ls1388niks3-go-unit-tests> === PAUSE TestIsValidCachePath/ls1389niks3-go-unit-tests> === RUN TestIsValidCachePath/log1390niks3-go-unit-tests> === PAUSE TestIsValidCachePath/log1391niks3-go-unit-tests> === RUN TestIsValidCachePath/realisation1392niks3-go-unit-tests> === PAUSE TestIsValidCachePath/realisation1393niks3-go-unit-tests> === RUN TestIsValidCachePath/nix-cache-info1394niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nix-cache-info1395niks3-go-unit-tests> === RUN TestIsValidCachePath/index.html1396niks3-go-unit-tests> === PAUSE TestIsValidCachePath/index.html1397niks3-go-unit-tests> === RUN TestIsValidCachePath/traversal_parent1398niks3-go-unit-tests> === PAUSE TestIsValidCachePath/traversal_parent1399niks3-go-unit-tests> === RUN TestIsValidCachePath/traversal_in_middle1400niks3-go-unit-tests> === PAUSE TestIsValidCachePath/traversal_in_middle1401niks3-go-unit-tests> === RUN TestIsValidCachePath/invalid_char_e1402niks3-go-unit-tests> === PAUSE TestIsValidCachePath/invalid_char_e1403niks3-go-unit-tests> === RUN TestIsValidCachePath/invalid_char_u1404niks3-go-unit-tests> === PAUSE TestIsValidCachePath/invalid_char_u1405niks3-go-unit-tests> === RUN TestIsValidCachePath/random_path1406niks3-go-unit-tests> === PAUSE TestIsValidCachePath/random_path1407niks3-go-unit-tests> === RUN TestIsValidCachePath/empty1408niks3-go-unit-tests> === PAUSE TestIsValidCachePath/empty1409niks3-go-unit-tests> === RUN TestIsValidCachePath/leading_slash1410niks3-go-unit-tests> === PAUSE TestIsValidCachePath/leading_slash1411niks3-go-unit-tests> === RUN TestIsValidCachePath/wrong_extension1412niks3-go-unit-tests> === PAUSE TestIsValidCachePath/wrong_extension1413niks3-go-unit-tests> === RUN TestIsValidCachePath/short_hash1414niks3-go-unit-tests> === PAUSE TestIsValidCachePath/short_hash1415niks3-go-unit-tests> === CONT TestService_AuthMiddleware_OIDC1416niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)1417niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Uploading zv17lk0v4036r24p0y0z11qcp2lxdns7-test-script (136B)1418niks3-go-unit-tests> 2026/11/10 21:14:15 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:39463/oidc1419niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=jr0ywwl48snjxi5zfswwdb2nxvp2ciwh.ls error="server returned 404: 404 page not found\n"1420niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=zv17lk0v4036r24p0y0z11qcp2lxdns7.ls error="server returned 404: 404 page not found\n"1421niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"1422niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=log/s81x3dgb2j1lfz70mc21dw1yd3qr54w3-test-script.drv error="server returned 404: 404 page not found\n"1423niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1424niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"1425niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1426niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Signed narinfos id=1 count=11427niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Signed narinfos id=1 count=11428niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Uploading 1 narinfos1429niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Uploading 1 narinfos1430niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received complete push request method=POST path=/api/pushes/1/complete1431niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=zv17lk0v4036r24p0y0z11qcp2lxdns7.narinfo error="server returned 404: 404 page not found\n"1432niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received complete push request method=POST path=/api/pushes/1/complete1433niks3-go-unit-tests> 2026/11/10 21:14:15 WARN Failed to register uploaded object key=jr0ywwl48snjxi5zfswwdb2nxvp2ciwh.narinfo error="server returned 404: 404 page not found\n"1434niks3-go-unit-tests> --- PASS: TestReadProxyNarinfoAlreadyDecompressed (0.91s)1435niks3-go-unit-tests> === CONT TestCreatePin_ReservedPins1436niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Completed push id=1 objects=3 duration=7.739293ms1437niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Upload complete. (219ms)1438niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Completed push id=1 objects=4 duration=9.291728ms1439niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Upload complete. (207ms)1440niks3-go-unit-tests> === NAME TestNARDeduplicationMetadataUploadBug1441niks3-go-unit-tests> metadata_upload_test.go:54: Retrieved narinfo from S3:1442niks3-go-unit-tests> StorePath: /build/TestNARDeduplicationMetadataUploadBug1429258835/001/store/jr0ywwl48snjxi5zfswwdb2nxvp2ciwh-file1.txt1443niks3-go-unit-tests> URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1444niks3-go-unit-tests> Compression: zstd1445niks3-go-unit-tests> NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1446niks3-go-unit-tests> NarSize: 1601447niks3-go-unit-tests> References: 1448niks3-go-unit-tests> CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1449niks3-go-unit-tests> === NAME TestClientWithDependencies1450niks3-go-unit-tests> client_integration_test.go:664: Skipping nix copy test - isolated store (/build/TestClientWithDependencies3420743950/001/store) requires matching store prefix1451niks3-go-unit-tests> === NAME TestNARDeduplicationMetadataUploadBug1452niks3-go-unit-tests> metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1453niks3-go-unit-tests> metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1454niks3-go-unit-tests> {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}1455niks3-go-unit-tests> --- PASS: TestClientWithDependencies (3.62s)1456niks3-go-unit-tests> === CONT TestIsValidUploadKey1457niks3-go-unit-tests> === RUN TestIsValidUploadKey/narinfo1458niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/narinfo1459niks3-go-unit-tests> === RUN TestIsValidUploadKey/nar_zst1460niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_zst1461niks3-go-unit-tests> === RUN TestIsValidUploadKey/nar_xz1462niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_xz1463niks3-go-unit-tests> === RUN TestIsValidUploadKey/nar_plain1464niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_plain1465niks3-go-unit-tests> === RUN TestIsValidUploadKey/listing1466niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/listing1467niks3-go-unit-tests> === RUN TestIsValidUploadKey/build_log1468niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log1469niks3-go-unit-tests> === RUN TestIsValidUploadKey/build_log_home-manager_file1470niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_home-manager_file1471niks3-go-unit-tests> === RUN TestIsValidUploadKey/build_log_plus_in_name1472niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_plus_in_name1473niks3-go-unit-tests> === RUN TestIsValidUploadKey/build_log_question_mark1474niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_question_mark1475niks3-go-unit-tests> === RUN TestIsValidUploadKey/build_log_equals1476niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_equals1477niks3-go-unit-tests> === RUN TestIsValidUploadKey/realisation1478niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/realisation1479niks3-go-unit-tests> === RUN TestIsValidUploadKey/realisation_plus_in_output1480niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/realisation_plus_in_output1481niks3-go-unit-tests> === RUN TestIsValidUploadKey/nix-cache-info1482niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nix-cache-info1483niks3-go-unit-tests> === RUN TestIsValidUploadKey/index.html1484niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/index.html1485niks3-go-unit-tests> === RUN TestIsValidUploadKey/narinfo_key,_nar_type1486niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/narinfo_key,_nar_type1487niks3-go-unit-tests> === RUN TestIsValidUploadKey/nar_key,_narinfo_type1488niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_key,_narinfo_type1489niks3-go-unit-tests> === RUN TestIsValidUploadKey/listing_key,_narinfo_type1490niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/listing_key,_narinfo_type1491niks3-go-unit-tests> === RUN TestIsValidUploadKey/traversal1492niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/traversal1493niks3-go-unit-tests> === RUN TestIsValidUploadKey/traversal_nar1494niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/traversal_nar1495niks3-go-unit-tests> === RUN TestIsValidUploadKey/absolute1496niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/absolute1497niks3-go-unit-tests> === RUN TestIsValidUploadKey/empty_key1498niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/empty_key1499niks3-go-unit-tests> === RUN TestIsValidUploadKey/unknown_type1500niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/unknown_type1501niks3-go-unit-tests> === CONT TestParseSingleRange1502niks3-go-unit-tests> === RUN TestParseSingleRange/none1503niks3-go-unit-tests> === PAUSE TestParseSingleRange/none1504niks3-go-unit-tests> === RUN TestParseSingleRange/unknown_unit1505niks3-go-unit-tests> === PAUSE TestParseSingleRange/unknown_unit1506niks3-go-unit-tests> === RUN TestParseSingleRange/multi-range_ignored1507niks3-go-unit-tests> === PAUSE TestParseSingleRange/multi-range_ignored1508niks3-go-unit-tests> === RUN TestParseSingleRange/malformed_no_dash1509niks3-go-unit-tests> === PAUSE TestParseSingleRange/malformed_no_dash1510niks3-go-unit-tests> === RUN TestParseSingleRange/malformed_both_empty1511niks3-go-unit-tests> === PAUSE TestParseSingleRange/malformed_both_empty1512niks3-go-unit-tests> === RUN TestParseSingleRange/malformed_end_before_start1513niks3-go-unit-tests> === PAUSE TestParseSingleRange/malformed_end_before_start1514niks3-go-unit-tests> === RUN TestParseSingleRange/closed1515niks3-go-unit-tests> === PAUSE TestParseSingleRange/closed1516niks3-go-unit-tests> === RUN TestParseSingleRange/open-ended1517niks3-go-unit-tests> === PAUSE TestParseSingleRange/open-ended1518niks3-go-unit-tests> === RUN TestParseSingleRange/end_clamped_to_size1519niks3-go-unit-tests> === PAUSE TestParseSingleRange/end_clamped_to_size1520niks3-go-unit-tests> === RUN TestParseSingleRange/suffix1521niks3-go-unit-tests> === PAUSE TestParseSingleRange/suffix1522niks3-go-unit-tests> === RUN TestParseSingleRange/suffix_exceeds_size1523niks3-go-unit-tests> === PAUSE TestParseSingleRange/suffix_exceeds_size1524niks3-go-unit-tests> === RUN TestParseSingleRange/single_byte1525niks3-go-unit-tests> === PAUSE TestParseSingleRange/single_byte1526niks3-go-unit-tests> === RUN TestParseSingleRange/start_past_EOF1527niks3-go-unit-tests> === PAUSE TestParseSingleRange/start_past_EOF1528niks3-go-unit-tests> === RUN TestParseSingleRange/start_far_past_EOF1529niks3-go-unit-tests> === PAUSE TestParseSingleRange/start_far_past_EOF1530niks3-go-unit-tests> === CONT TestOrphanedObjectsGCStressTest1531niks3-go-unit-tests> 2026/11/10 21:14:15 WARN readiness check failed error="closed pool"1532niks3-go-unit-tests> --- PASS: TestService_readinessHandler (0.23s)1533niks3-go-unit-tests> === CONT TestService_ReadAuthMiddleware1534niks3-go-unit-tests> === NAME TestNARDeduplicationMetadataUploadBug1535niks3-go-unit-tests> metadata_upload_test.go:64: Second store path (same content): /build/TestNARDeduplicationMetadataUploadBug1429258835/001/store/0bi165n7ihkbs6la2iwhvmvg1cc233aa-file2.txt1536niks3-go-unit-tests> --- PASS: TestPresentReportsOnlyClosureRoots (0.25s)1537niks3-go-unit-tests> === CONT TestPresentNotReportedWhileGCDeletesClosure1538niks3-go-unit-tests> === RUN TestPresentNotReportedWhileGCDeletesClosure/stale1539niks3-go-unit-tests> === PAUSE TestPresentNotReportedWhileGCDeletesClosure/stale1540niks3-go-unit-tests> === RUN TestPresentNotReportedWhileGCDeletesClosure/fresh1541niks3-go-unit-tests> === PAUSE TestPresentNotReportedWhileGCDeletesClosure/fresh1542niks3-go-unit-tests> === CONT TestGCTaskStore_Fail1543niks3-go-unit-tests> --- PASS: TestGCTaskStore_Fail (0.00s)1544niks3-go-unit-tests> === CONT TestService_AuthMiddleware_MTLSProxyHeader1545niks3-go-unit-tests> --- PASS: TestPresentRefreshesOnlyStaleClosures (0.27s)1546niks3-go-unit-tests> === CONT TestService_AuthMiddleware1547niks3-go-unit-tests> 2026/11/10 21:14:15 ERROR Failed to decode narinfo key=3hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216 error=<nil>1548niks3-go-unit-tests> --- PASS: TestReadProxyNarinfo (0.41s)1549niks3-go-unit-tests> === CONT TestService_AuthMiddleware_MTLSBoundSubjects1550niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/builder_may_write1551niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/builder_may_write1552niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/builder_may_not_admin1553niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1554niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/ops_may_admin1555niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/ops_may_admin1556niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/ops_may_not_write1557niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/ops_may_not_write1558niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/reader_may_not_write1559niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/reader_may_not_write1560niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/static_token_may_admin1561niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/static_token_may_admin1562niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/static_token_may_write1563niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/static_token_may_write1564niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/reader_may_read1565niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/reader_may_read1566niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/writer_implies_read1567niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/writer_implies_read1568niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/anonymous_may_not_read1569niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1570niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1571niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1572niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1573niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1574niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1575niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1576niks3-go-unit-tests> === RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1577niks3-go-unit-tests> === PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1578niks3-go-unit-tests> === CONT TestGCTaskStore_PhaseUpdates1579niks3-go-unit-tests> --- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1580niks3-go-unit-tests> === CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1581niks3-go-unit-tests> 2026/11/10 21:14:15 INFO Received uploads request method=POST path=/1582niks3-go-unit-tests> === CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed1583niks3-go-unit-tests> === RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1584niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1585niks3-go-unit-tests> === RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1586niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1587niks3-go-unit-tests> === RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1588niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1589niks3-go-unit-tests> === RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1590niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1591niks3-go-unit-tests> === CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed1592niks3-go-unit-tests> 2026/11/10 21:14:16 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:42909/oidc1593niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1594niks3-go-unit-tests> === NAME TestClientCADerivations1595niks3-go-unit-tests> client_ca_test.go:139: Found 1 dependencies (including self)1596niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/api/pending_closures1597niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1598niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/api/pending_closures1599niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)1600niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading kwnma4lp0w7gb5l93zi18fphd86jsj5k-test-file.txt (152B)1601niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)1602niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading wbvgw5k8nqsqn9nppgzk23llr9zcr87p-b (216B)1603niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading ikjwgz3zc644z1925vd4rvaq3m11a5vx-shared-dep (136B)1604niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)1605niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 2c6z14byz6vywchifa26r659vqhj1npf-top (224B)1606niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 2yx7yhhifdgx3sl2dn738rfki6scgsfq-shared-dep (136B)1607niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=kwnma4lp0w7gb5l93zi18fphd86jsj5k.ls error="server returned 404: 404 page not found\n"1608niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=s7nc4zb0am6azqv8i33hfpaja2cd7903.ls error="server returned 404: 404 page not found\n"1609niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1610niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"1611niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=1 count=11612niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=wbvgw5k8nqsqn9nppgzk23llr9zcr87p.ls error="server returned 404: 404 page not found\n"1613niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 1 narinfos1614niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=2yx7yhhifdgx3sl2dn738rfki6scgsfq.ls error="server returned 404: 404 page not found\n"1615niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=ikjwgz3zc644z1925vd4rvaq3m11a5vx.ls error="server returned 404: 404 page not found\n"1616niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"1617niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=2c6z14byz6vywchifa26r659vqhj1npf.ls error="server returned 404: 404 page not found\n"1618niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"1619niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1620niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign1621niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/1k30nd92i4bs88b8fv40cfwh9qyjijr6cmmllbvx82wm61digmkf.nar.zst error="server returned 404: 404 page not found\n"1622niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=1 count=21623niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=1 count=21624niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 2 narinfos1625niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign1626niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=2 count=21627niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 4 narinfos1628niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/0gv58wz755gpjrfr7whs8qcizsirffcjdbipj1fsvxzcvs59nzd7.nar.zst error="server returned 404: 404 page not found\n"1629niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=kwnma4lp0w7gb5l93zi18fphd86jsj5k.narinfo error="server returned 404: 404 page not found\n"1630niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete push request method=POST path=/api/pushes/1/complete1631niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=2yx7yhhifdgx3sl2dn738rfki6scgsfq.narinfo error="server returned 404: 404 page not found\n"1632niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete push request method=POST path=/api/pushes/1/complete1633niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=wbvgw5k8nqsqn9nppgzk23llr9zcr87p.narinfo error="server returned 404: 404 page not found\n"1634niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=2c6z14byz6vywchifa26r659vqhj1npf.narinfo error="server returned 404: 404 page not found\n"1635niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=s7nc4zb0am6azqv8i33hfpaja2cd7903.narinfo error="server returned 404: 404 page not found\n"1636niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=ikjwgz3zc644z1925vd4rvaq3m11a5vx.narinfo error="server returned 404: 404 page not found\n"1637niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete1638niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=ikjwgz3zc644z1925vd4rvaq3m11a5vx.narinfo error="server returned 404: 404 page not found\n"1639niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed push id=1 objects=3 duration=13.088584ms1640niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Upload complete. (2.693s)1641niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed push id=1 objects=6 duration=11.688891ms1642niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Upload complete. (2.699s)1643niks3-go-unit-tests> === NAME TestClientSharedPathCommittedMidPush1644niks3-go-unit-tests> client_integration_test.go:727: Retrieved narinfo from S3:1645niks3-go-unit-tests> StorePath: /build/TestClientSharedPathCommittedMidPush780637304/001/store/2yx7yhhifdgx3sl2dn738rfki6scgsfq-shared-dep1646niks3-go-unit-tests> URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1647niks3-go-unit-tests> Compression: zstd1648niks3-go-unit-tests> NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821649niks3-go-unit-tests> NarSize: 1361650niks3-go-unit-tests> References: 1651niks3-go-unit-tests> CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1652niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed upload id=1 objects=6 duration=8.991385ms1653niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete1654niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed upload id=2 objects=6 duration=1.228831ms1655niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Upload complete. (2.704s)1656niks3-go-unit-tests> === NAME TestClientFallsBackToClosures1657niks3-go-unit-tests> client_pushes_test.go:112: Retrieved narinfo from S3:1658niks3-go-unit-tests> StorePath: /build/TestClientFallsBackToClosures2372097738/001/store/ikjwgz3zc644z1925vd4rvaq3m11a5vx-shared-dep1659niks3-go-unit-tests> URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1660niks3-go-unit-tests> Compression: zstd1661niks3-go-unit-tests> NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821662niks3-go-unit-tests> NarSize: 1361663niks3-go-unit-tests> References: 1664niks3-go-unit-tests> CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1665niks3-go-unit-tests> === NAME TestClientSharedPathCommittedMidPush1666niks3-go-unit-tests> client_integration_test.go:727: Retrieved narinfo from S3:1667niks3-go-unit-tests> StorePath: /build/TestClientSharedPathCommittedMidPush780637304/001/store/2c6z14byz6vywchifa26r659vqhj1npf-top1668niks3-go-unit-tests> URL: nar/0gv58wz755gpjrfr7whs8qcizsirffcjdbipj1fsvxzcvs59nzd7.nar.zst1669niks3-go-unit-tests> Compression: zstd1670niks3-go-unit-tests> NarHash: sha256:0gv58wz755gpjrfr7whs8qcizsirffcjdbipj1fsvxzcvs59nzd71671niks3-go-unit-tests> NarSize: 2241672niks3-go-unit-tests> References: /build/TestClientSharedPathCommittedMidPush780637304/001/store/2yx7yhhifdgx3sl2dn738rfki6scgsfq-shared-dep1673niks3-go-unit-tests> CA: text:sha256:1hymkq6wmi6gmz0h9hdy489ar4mlppk0ny3qgj1002f92npw05mp1674niks3-go-unit-tests> === NAME TestClientFallsBackToClosures1675niks3-go-unit-tests> client_pushes_test.go:112: Retrieved narinfo from S3:1676niks3-go-unit-tests> StorePath: /build/TestClientFallsBackToClosures2372097738/001/store/s7nc4zb0am6azqv8i33hfpaja2cd7903-a1677niks3-go-unit-tests> URL: nar/1k30nd92i4bs88b8fv40cfwh9qyjijr6cmmllbvx82wm61digmkf.nar.zst1678niks3-go-unit-tests> Compression: zstd1679niks3-go-unit-tests> NarHash: sha256:1k30nd92i4bs88b8fv40cfwh9qyjijr6cmmllbvx82wm61digmkf1680niks3-go-unit-tests> NarSize: 2161681niks3-go-unit-tests> References: /build/TestClientFallsBackToClosures2372097738/001/store/ikjwgz3zc644z1925vd4rvaq3m11a5vx-shared-dep1682niks3-go-unit-tests> CA: text:sha256:0pnlp5p6cl73g689swcy5r16zy0lnv38x2kx30jjhx6kkw4h57b11683niks3-go-unit-tests> --- PASS: TestClientSharedPathCommittedMidPush (4.34s)1684niks3-go-unit-tests> === CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed1685niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_MTLSProxyHeader (0.47s)1686niks3-go-unit-tests> === CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1687niks3-go-unit-tests> === NAME TestClientFallsBackToClosures1688niks3-go-unit-tests> client_pushes_test.go:112: Retrieved narinfo from S3:1689niks3-go-unit-tests> StorePath: /build/TestClientFallsBackToClosures2372097738/001/store/wbvgw5k8nqsqn9nppgzk23llr9zcr87p-b1690niks3-go-unit-tests> URL: nar/1k30nd92i4bs88b8fv40cfwh9qyjijr6cmmllbvx82wm61digmkf.nar.zst1691niks3-go-unit-tests> Compression: zstd1692niks3-go-unit-tests> NarHash: sha256:1k30nd92i4bs88b8fv40cfwh9qyjijr6cmmllbvx82wm61digmkf1693niks3-go-unit-tests> NarSize: 2161694niks3-go-unit-tests> References: /build/TestClientFallsBackToClosures2372097738/001/store/ikjwgz3zc644z1925vd4rvaq3m11a5vx-shared-dep1695niks3-go-unit-tests> CA: text:sha256:0pnlp5p6cl73g689swcy5r16zy0lnv38x2kx30jjhx6kkw4h57b11696niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete multipart upload request method=POST path=/1697niks3-go-unit-tests> === CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1698niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received request for more parts method=POST path=/1699niks3-go-unit-tests> === CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost1700niks3-go-unit-tests> --- PASS: TestClientFallsBackToClosures (5.42s)1701niks3-go-unit-tests> === CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal1702niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/1703niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)1704niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)1705niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1706niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1707niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1708niks3-go-unit-tests> === CONT TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed1709niks3-go-unit-tests> --- PASS: TestService_ReadAuthMiddleware (0.54s)1710niks3-go-unit-tests> === CONT TestPendingClosureWriteTimeout/empty1711niks3-go-unit-tests> === CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1712niks3-go-unit-tests> 2026/11/10 21:14:16 INFO lead: acquired remote=192.0.2.1:12341713niks3-go-unit-tests> 2026/11/10 21:14:16 ERROR failed to check GC advisory lock error="query pg_locks: failed to connect to `user=nixbld database=niks3`: /nonexistent/.s.PGSQL.5432 (/nonexistent): dial error: dial unix /nonexistent/.s.PGSQL.5432: connect: no such file or directory"1714niks3-go-unit-tests> --- PASS: TestGCAdvisoryLockBlocksConcurrentRun (1.58s)1715niks3-go-unit-tests> === CONT TestPendingClosureWriteTimeout/670k_objects1716niks3-go-unit-tests> === CONT TestPendingClosureWriteTimeout/400_objects1717niks3-go-unit-tests> === CONT TestProxyWriteTimeout/narinfo1718niks3-go-unit-tests> === CONT TestProxyWriteTimeout/10_GiB_nar1719niks3-go-unit-tests> === CONT TestProxyWriteTimeout/1_GiB_nar1720niks3-go-unit-tests> === CONT TestProxyWriteTimeout/unknown_size1721niks3-go-unit-tests> --- PASS: TestProxyWriteTimeout (2.66s)1722niks3-go-unit-tests> --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1723niks3-go-unit-tests> --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1724niks3-go-unit-tests> --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)1725niks3-go-unit-tests> --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1726niks3-go-unit-tests> === CONT TestGCEndsOnShutdown/before_the_run1727niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Installed lifecycle rule aborting incomplete NAR uploads bucket=bucket87 days=21728niks3-go-unit-tests> --- PASS: TestEnsureAbortUploadsRule (1.72s)1729niks3-go-unit-tests> === CONT TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark1730niks3-go-unit-tests> --- PASS: TestReadProxyContentNegotiation (1.72s)1731niks3-go-unit-tests> === CONT TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1732niks3-go-unit-tests> --- PASS: TestCacheStatsHandler (2.10s)1733niks3-go-unit-tests> === CONT TestResolveDBConnectionString/flag_wins1734niks3-go-unit-tests> === CONT TestResolveDBConnectionString/missing_file_is_an_error1735niks3-go-unit-tests> === CONT TestResolveDBConnectionString/file_when_flag_empty1736niks3-go-unit-tests> === CONT TestResolveDBConnectionString/PGHOST_allows_empty1737niks3-go-unit-tests> === CONT TestResolveDBConnectionString/nothing_configured1738niks3-go-unit-tests> === CONT TestUploadHandlersRejectOversizedBody/create_pending_closure1739niks3-go-unit-tests> --- PASS: TestResolveDBConnectionString (0.00s)1740niks3-go-unit-tests> --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1741niks3-go-unit-tests> --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1742niks3-go-unit-tests> --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)1743niks3-go-unit-tests> --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1744niks3-go-unit-tests> --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1745niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/1746niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/api/pending_closures1747niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Aborted multipart uploads count=0 kept=01748niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Force mode enabled - objects will be deleted immediately without grace period1749niks3-go-unit-tests> 2026/11/10 21:14:16 ERROR failed to remove object object=nar/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.nar.zst error="Post \"http://localhost:39267/bucket90/?delete=\": context canceled"1750niks3-go-unit-tests> === CONT TestUploadHandlersRejectOversizedBody/request_more_parts1751niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received request for more parts method=POST path=/1752niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1753niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1754niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1755niks3-go-unit-tests> 2026/11/10 21:14:16 INFO All 1 paths already cached1756niks3-go-unit-tests> === NAME TestClientIntegration1757niks3-go-unit-tests> client_integration_test.go:317: Retrieved narinfo from S3:1758niks3-go-unit-tests> StorePath: /build/TestClientIntegration1423301553/002/store/kwnma4lp0w7gb5l93zi18fphd86jsj5k-test-file.txt1759niks3-go-unit-tests> URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1760niks3-go-unit-tests> Compression: zstd1761niks3-go-unit-tests> NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11762niks3-go-unit-tests> NarSize: 1521763niks3-go-unit-tests> References: 1764niks3-go-unit-tests> CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11765niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)1766niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading v60j8wm3mvz895f22xsh2pvhcp5hiq2a-pinned-file.txt (128B)1767niks3-go-unit-tests> client_integration_test.go:318: Retrieved .ls file from S3 (compressed size: 77 bytes)1768niks3-go-unit-tests> client_integration_test.go:318: Decompressed .ls content (64 bytes):1769niks3-go-unit-tests> {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}1770niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)1771niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 5iq7ixjgc8376wjsy6gdklv2xn73jmf1-test-file-2.txt (160B)1772niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading h68gqb1m8gyh2vylzpbbkl8sc1rsn1pk-test-file-1.txt (160B)1773niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading yczd5wx57gw00h6qz1z7ran44lhcd3qc-test-file-0.txt (160B)1774niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)1775niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading jrfja2wrmvlxsjdf03ncwfc4wlqncxrf-b (216B)1776niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading sxjsnkic8dfmx780x5i58i0rad1idbg8-shared-dep (136B)1777niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=yczd5wx57gw00h6qz1z7ran44lhcd3qc.ls error="server returned 404: 404 page not found\n"1778niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"1779niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=5iq7ixjgc8376wjsy6gdklv2xn73jmf1.ls error="server returned 404: 404 page not found\n"1780niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"1781niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1782niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"1783niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"1784niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=v60j8wm3mvz895f22xsh2pvhcp5hiq2a.ls error="server returned 404: 404 page not found\n"1785niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=1 count=11786niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 1 narinfos1787niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1788niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=h68gqb1m8gyh2vylzpbbkl8sc1rsn1pk.ls error="server returned 404: 404 page not found\n"1789niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=1 count=31790niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 3 narinfos1791niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=i1v8vlz6sml5qjjpwpf3fa39b8jvzslq.ls error="server returned 404: 404 page not found\n"1792niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete push request method=POST path=/api/pushes/1/complete1793niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=sxjsnkic8dfmx780x5i58i0rad1idbg8.ls error="server returned 404: 404 page not found\n"1794niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=v60j8wm3mvz895f22xsh2pvhcp5hiq2a.narinfo error="server returned 404: 404 page not found\n"1795niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/1xyimx5gazmhy82s167gyh9c5j29511c69zjhzqj57p7x39v5fr4.nar.zst error="server returned 404: 404 page not found\n"1796niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1797niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=jrfja2wrmvlxsjdf03ncwfc4wlqncxrf.ls error="server returned 404: 404 page not found\n"1798niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"1799niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Signed narinfos id=1 count=31800niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Uploading 3 narinfos1801niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=5iq7ixjgc8376wjsy6gdklv2xn73jmf1.narinfo error="server returned 404: 404 page not found\n"1802niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=yczd5wx57gw00h6qz1z7ran44lhcd3qc.narinfo error="server returned 404: 404 page not found\n"1803niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=h68gqb1m8gyh2vylzpbbkl8sc1rsn1pk.narinfo error="server returned 404: 404 page not found\n"1804niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete push request method=POST path=/api/pushes/1/complete1805niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete push request method=POST path=/api/pushes/1/complete1806niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=i1v8vlz6sml5qjjpwpf3fa39b8jvzslq.narinfo error="server returned 404: 404 page not found\n"1807niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed push id=1 objects=3 duration=9.655092ms1808niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=jrfja2wrmvlxsjdf03ncwfc4wlqncxrf.narinfo error="server returned 404: 404 page not found\n"1809niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Upload complete. (615ms)1810niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Failed to register uploaded object key=sxjsnkic8dfmx780x5i58i0rad1idbg8.narinfo error="server returned 404: 404 page not found\n"1811niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed push id=1 objects=9 duration=10.787822ms1812niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Upload complete. (624ms)1813niks3-go-unit-tests> === NAME TestClientMultipleUploads1814niks3-go-unit-tests> client_integration_test.go:416: Uploaded 3 paths in 3.247757693s1815niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Completed push id=1 objects=8 duration=11.55849ms1816niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Upload complete. (631ms)1817niks3-go-unit-tests> === NAME TestClientPushesUseOnePush1818niks3-go-unit-tests> client_pushes_test.go:97: Retrieved narinfo from S3:1819niks3-go-unit-tests> StorePath: /build/TestClientPushesUseOnePush1413449938/001/store/sxjsnkic8dfmx780x5i58i0rad1idbg8-shared-dep1820niks3-go-unit-tests> URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1821niks3-go-unit-tests> Compression: zstd1822niks3-go-unit-tests> NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821823niks3-go-unit-tests> NarSize: 1361824niks3-go-unit-tests> References: 1825niks3-go-unit-tests> CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1826niks3-go-unit-tests> client_pushes_test.go:97: Retrieved narinfo from S3:1827niks3-go-unit-tests> StorePath: /build/TestClientPushesUseOnePush1413449938/001/store/i1v8vlz6sml5qjjpwpf3fa39b8jvzslq-a1828niks3-go-unit-tests> URL: nar/1xyimx5gazmhy82s167gyh9c5j29511c69zjhzqj57p7x39v5fr4.nar.zst1829niks3-go-unit-tests> Compression: zstd1830niks3-go-unit-tests> NarHash: sha256:1xyimx5gazmhy82s167gyh9c5j29511c69zjhzqj57p7x39v5fr41831niks3-go-unit-tests> NarSize: 2161832niks3-go-unit-tests> References: /build/TestClientPushesUseOnePush1413449938/001/store/sxjsnkic8dfmx780x5i58i0rad1idbg8-shared-dep1833niks3-go-unit-tests> CA: text:sha256:0fhgj0g8chw9v8q6yy05h3clp8gnp05ckid51ap169chhs74mdvs1834niks3-go-unit-tests> --- PASS: TestClientMultipleUploads (4.67s)1835niks3-go-unit-tests> === CONT TestUploadHandlersRejectOversizedBody/complete_multipart1836niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received complete multipart upload request method=POST path=/1837niks3-go-unit-tests> === NAME TestClientPushesUseOnePush1838niks3-go-unit-tests> client_pushes_test.go:97: Retrieved narinfo from S3:1839niks3-go-unit-tests> StorePath: /build/TestClientPushesUseOnePush1413449938/001/store/jrfja2wrmvlxsjdf03ncwfc4wlqncxrf-b1840niks3-go-unit-tests> URL: nar/1xyimx5gazmhy82s167gyh9c5j29511c69zjhzqj57p7x39v5fr4.nar.zst1841niks3-go-unit-tests> Compression: zstd1842niks3-go-unit-tests> NarHash: sha256:1xyimx5gazmhy82s167gyh9c5j29511c69zjhzqj57p7x39v5fr41843niks3-go-unit-tests> NarSize: 2161844niks3-go-unit-tests> References: /build/TestClientPushesUseOnePush1413449938/001/store/sxjsnkic8dfmx780x5i58i0rad1idbg8-shared-dep1845niks3-go-unit-tests> CA: text:sha256:0fhgj0g8chw9v8q6yy05h3clp8gnp05ckid51ap169chhs74mdvs1846niks3-go-unit-tests> === CONT TestPush_RejectsBadRequests/root_not_in_objects1847niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1848niks3-go-unit-tests> === CONT TestPush_RejectsBadRequests/no_objects1849niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1850niks3-go-unit-tests> === CONT TestPush_RejectsBadRequests/bad_root1851niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1852niks3-go-unit-tests> --- PASS: TestClientPushesUseOnePush (5.33s)1853niks3-go-unit-tests> === CONT TestPush_RejectsBadRequests/no_roots1854niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received push request method=POST path=/api/pushes1855niks3-go-unit-tests> === CONT TestClientErrorHandling/InvalidStorePath1856niks3-go-unit-tests> === CONT TestClientErrorHandling/ServerNotAvailable1857niks3-go-unit-tests> --- PASS: TestPush_RejectsBadRequests (3.17s)1858niks3-go-unit-tests> --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.00s)1859niks3-go-unit-tests> --- PASS: TestPush_RejectsBadRequests/no_objects (0.00s)1860niks3-go-unit-tests> --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)1861niks3-go-unit-tests> --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)1862niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1863niks3-go-unit-tests> 2026/11/10 21:14:16 WARN Refused reserved pin name=worker-x86_64-linux1864niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1865niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received create pin request method=POST path=/api/pins/my-app1866niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1867niks3-go-unit-tests> --- PASS: TestCreatePin_ReservedPins (1.12s)1868niks3-go-unit-tests> === CONT TestClientErrorHandling/InvalidAuthToken1869niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/api/pending_closures1870niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/api/pending_closures1871niks3-go-unit-tests> === CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows1872niks3-go-unit-tests> 2026/11/10 21:14:16 INFO Received uploads request method=POST path=/api/pending_closures1873niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures1874niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Aborted multipart uploads count=0 kept=01875niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1876niks3-go-unit-tests> 2026/11/10 21:14:17 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"1877niks3-go-unit-tests> 2026/11/10 21:14:17 WARN mTLS auth: bound subjects configured but subject DN unavailable1878niks3-go-unit-tests> 2026/11/10 21:14:17 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1879niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (1.17s)1880niks3-go-unit-tests> === CONT TestForceGCDuringPushOffersSweptObject/after_presence_check1881niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Force mode enabled - objects will be deleted immediately without grace period1882niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000200000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjE2ODM4NTlmLTcwMmYtNDg1My1iNTliLTA2N2EwOTk5NWI2N3gxNzk0MzQ1MjU2NTI3MjQzOTUy parts=101883niks3-go-unit-tests> === CONT TestServerTLSConfig/no_client_CA1884niks3-go-unit-tests> === CONT TestServerTLSConfig/not_a_PEM_file1885niks3-go-unit-tests> === CONT TestServerTLSConfig/missing_CA_file1886niks3-go-unit-tests> --- PASS: TestServerTLSConfig (0.00s)1887niks3-go-unit-tests> --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1888niks3-go-unit-tests> --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)1889niks3-go-unit-tests> --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1890niks3-go-unit-tests> === CONT TestCacheConfigHandler/full_config,_no_issuer1891niks3-go-unit-tests> === CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1892niks3-go-unit-tests> === CONT TestCacheConfigHandler/upstream_keys_advertised1893niks3-go-unit-tests> === CONT TestCacheConfigHandler/no_signing_keys1894niks3-go-unit-tests> === CONT TestCacheConfigHandler/no_cache_url_configured1895niks3-go-unit-tests> --- PASS: TestCacheConfigHandler (0.00s)1896niks3-go-unit-tests> --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1897niks3-go-unit-tests> --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1898niks3-go-unit-tests> --- PASS: TestCacheConfigHandler/upstream_keys_advertised (0.00s)1899niks3-go-unit-tests> --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1900niks3-go-unit-tests> --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1901niks3-go-unit-tests> === CONT TestIsValidCachePath/narinfo1902niks3-go-unit-tests> === CONT TestIsValidCachePath/invalid_char_u1903niks3-go-unit-tests> === CONT TestIsValidCachePath/invalid_char_e1904niks3-go-unit-tests> === CONT TestIsValidCachePath/traversal_in_middle1905niks3-go-unit-tests> === CONT TestIsValidCachePath/traversal_parent1906niks3-go-unit-tests> === CONT TestIsValidCachePath/index.html1907niks3-go-unit-tests> === CONT TestIsValidCachePath/random_path1908niks3-go-unit-tests> === CONT TestIsValidCachePath/nix-cache-info1909niks3-go-unit-tests> === CONT TestIsValidCachePath/realisation1910niks3-go-unit-tests> === CONT TestIsValidCachePath/log1911niks3-go-unit-tests> === CONT TestIsValidCachePath/ls1912niks3-go-unit-tests> === CONT TestIsValidCachePath/nar_uncompressed1913niks3-go-unit-tests> === CONT TestIsValidCachePath/nar_bz21914niks3-go-unit-tests> === CONT TestIsValidCachePath/nar_xz1915niks3-go-unit-tests> === CONT TestIsValidCachePath/nar_zst1916niks3-go-unit-tests> === CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1917niks3-go-unit-tests> === CONT TestIsValidCachePath/leading_slash1918niks3-go-unit-tests> === CONT TestIsValidCachePath/wrong_extension1919niks3-go-unit-tests> === CONT TestIsValidCachePath/empty1920niks3-go-unit-tests> === CONT TestIsValidCachePath/short_hash1921niks3-go-unit-tests> --- PASS: TestIsValidCachePath (0.00s)1922niks3-go-unit-tests> --- PASS: TestIsValidCachePath/narinfo (0.00s)1923niks3-go-unit-tests> --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1924niks3-go-unit-tests> --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1925niks3-go-unit-tests> --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1926niks3-go-unit-tests> --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1927niks3-go-unit-tests> --- PASS: TestIsValidCachePath/index.html (0.00s)1928niks3-go-unit-tests> --- PASS: TestIsValidCachePath/random_path (0.00s)1929niks3-go-unit-tests> --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1930niks3-go-unit-tests> --- PASS: TestIsValidCachePath/realisation (0.00s)1931niks3-go-unit-tests> --- PASS: TestIsValidCachePath/log (0.00s)1932niks3-go-unit-tests> --- PASS: TestIsValidCachePath/ls (0.00s)1933niks3-go-unit-tests> --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1934niks3-go-unit-tests> --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1935niks3-go-unit-tests> --- PASS: TestIsValidCachePath/nar_xz (0.00s)1936niks3-go-unit-tests> --- PASS: TestIsValidCachePath/nar_zst (0.00s)1937niks3-go-unit-tests> --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1938niks3-go-unit-tests> --- PASS: TestIsValidCachePath/leading_slash (0.00s)1939niks3-go-unit-tests> --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1940niks3-go-unit-tests> --- PASS: TestIsValidCachePath/empty (0.00s)1941niks3-go-unit-tests> --- PASS: TestIsValidCachePath/short_hash (0.00s)1942niks3-go-unit-tests> === CONT TestIsValidUploadKey/narinfo1943niks3-go-unit-tests> === CONT TestIsValidUploadKey/realisation_plus_in_output1944niks3-go-unit-tests> === CONT TestIsValidUploadKey/unknown_type1945niks3-go-unit-tests> === CONT TestIsValidUploadKey/empty_key1946niks3-go-unit-tests> === CONT TestIsValidUploadKey/absolute1947niks3-go-unit-tests> === CONT TestIsValidUploadKey/traversal_nar1948niks3-go-unit-tests> === CONT TestIsValidUploadKey/traversal1949niks3-go-unit-tests> === CONT TestIsValidUploadKey/listing_key,_narinfo_type1950niks3-go-unit-tests> === CONT TestIsValidUploadKey/nar_key,_narinfo_type1951niks3-go-unit-tests> === CONT TestIsValidUploadKey/narinfo_key,_nar_type1952niks3-go-unit-tests> === CONT TestIsValidUploadKey/index.html1953niks3-go-unit-tests> === CONT TestIsValidUploadKey/nix-cache-info1954niks3-go-unit-tests> === CONT TestIsValidUploadKey/build_log_home-manager_file1955niks3-go-unit-tests> === CONT TestIsValidUploadKey/realisation1956niks3-go-unit-tests> === CONT TestIsValidUploadKey/build_log_equals1957niks3-go-unit-tests> === CONT TestIsValidUploadKey/build_log_plus_in_name1958niks3-go-unit-tests> === CONT TestIsValidUploadKey/nar_plain1959niks3-go-unit-tests> === CONT TestIsValidUploadKey/build_log1960niks3-go-unit-tests> === CONT TestIsValidUploadKey/listing1961niks3-go-unit-tests> === CONT TestIsValidUploadKey/nar_xz1962niks3-go-unit-tests> === CONT TestIsValidUploadKey/build_log_question_mark1963niks3-go-unit-tests> === CONT TestIsValidUploadKey/nar_zst1964niks3-go-unit-tests> --- PASS: TestIsValidUploadKey (0.00s)1965niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/narinfo (0.00s)1966niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1967niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1968niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/empty_key (0.00s)1969niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/absolute (0.00s)1970niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1971niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/traversal (0.00s)1972niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1973niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1974niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1975niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/index.html (0.00s)1976niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1977niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1978niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/realisation (0.00s)1979niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1980niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1981niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1982niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/build_log (0.00s)1983niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/listing (0.00s)1984niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1985niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1986niks3-go-unit-tests> --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1987niks3-go-unit-tests> === CONT TestParseSingleRange/none1988niks3-go-unit-tests> === CONT TestParseSingleRange/start_far_past_EOF1989niks3-go-unit-tests> === CONT TestParseSingleRange/start_past_EOF1990niks3-go-unit-tests> === CONT TestParseSingleRange/single_byte1991niks3-go-unit-tests> === CONT TestParseSingleRange/suffix_exceeds_size1992niks3-go-unit-tests> === CONT TestParseSingleRange/suffix1993niks3-go-unit-tests> === CONT TestParseSingleRange/end_clamped_to_size1994niks3-go-unit-tests> === CONT TestParseSingleRange/open-ended1995niks3-go-unit-tests> === CONT TestParseSingleRange/closed1996niks3-go-unit-tests> === CONT TestParseSingleRange/malformed_end_before_start1997niks3-go-unit-tests> === CONT TestParseSingleRange/malformed_both_empty1998niks3-go-unit-tests> === CONT TestParseSingleRange/malformed_no_dash1999niks3-go-unit-tests> === CONT TestParseSingleRange/multi-range_ignored2000niks3-go-unit-tests> === CONT TestParseSingleRange/unknown_unit2001niks3-go-unit-tests> --- PASS: TestParseSingleRange (0.00s)2002niks3-go-unit-tests> --- PASS: TestParseSingleRange/none (0.00s)2003niks3-go-unit-tests> --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)2004niks3-go-unit-tests> --- PASS: TestParseSingleRange/start_past_EOF (0.00s)2005niks3-go-unit-tests> --- PASS: TestParseSingleRange/single_byte (0.00s)2006niks3-go-unit-tests> --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)2007niks3-go-unit-tests> --- PASS: TestParseSingleRange/suffix (0.00s)2008niks3-go-unit-tests> --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)2009niks3-go-unit-tests> --- PASS: TestParseSingleRange/open-ended (0.00s)2010niks3-go-unit-tests> --- PASS: TestParseSingleRange/closed (0.00s)2011niks3-go-unit-tests> --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)2012niks3-go-unit-tests> --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)2013niks3-go-unit-tests> --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)2014niks3-go-unit-tests> --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)2015niks3-go-unit-tests> --- PASS: TestParseSingleRange/unknown_unit (0.00s)2016niks3-go-unit-tests> === CONT TestPresentNotReportedWhileGCDeletesClosure/stale2017niks3-go-unit-tests> === CONT TestPresentNotReportedWhileGCDeletesClosure/fresh2018niks3-go-unit-tests> --- PASS: TestGCEndsOnShutdown (0.00s)2019niks3-go-unit-tests> --- PASS: TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete (0.28s)2020niks3-go-unit-tests> --- PASS: TestGCEndsOnShutdown/before_the_run (0.66s)2021niks3-go-unit-tests> --- PASS: TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark (0.63s)2022niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete2023niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2024niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed upload id=1 objects=3 duration=5.112968ms2025niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2026niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/builder_may_write2027niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/reader_may_read2028niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/empty_netrc_password_may_not_read2029niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read2030niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Authentication failed token_preview=wrong token_length=5 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]2031niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/static_token_may_admin_with_netrc2032niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/reader_may_read_with_netrc2033niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/anonymous_may_not_read2034niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/writer_implies_read2035niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/reader_may_not_write2036niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/static_token_may_write2037niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/static_token_may_admin2038niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/ops_may_admin2039niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/builder_may_not_admin2040niks3-go-unit-tests> === CONT TestService_RequireScope_OIDC/ops_may_not_write2041niks3-go-unit-tests> === CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token2042niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC (0.35s)2043niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)2044niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)2045niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/empty_netrc_password_may_not_read (0.00s)2046niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read (0.00s)2047niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/static_token_may_admin_with_netrc (0.00s)2048niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/reader_may_read_with_netrc (0.00s)2049niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)2050niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)2051niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)2052niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)2053niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)2054niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)2055niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)2056niks3-go-unit-tests> --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)2057niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"2058niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware (1.29s)2059niks3-go-unit-tests> === CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected2060niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]2061niks3-go-unit-tests> === CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2062niks3-go-unit-tests> === CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected2063niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Authentication failed token_preview=eyJhbGciOi...Xnf-Eq9T5g token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]2064niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_OIDC (0.30s)2065niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)2066niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)2067niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.01s)2068niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)2069niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2070niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Aborted multipart uploads count=0 kept=02071niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete multipart upload request method=POST path=/api/multipart/complete2072niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete multipart upload request method=POST path=/api/multipart/complete2073niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000300000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjMzZWM2YjgyLWQxMTktNDgwNS1iODg5LWVjN2FkODQzNTVjOXgxNzk0MzQ1MjU2ODg2ODY3OTgx parts=102074niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete2075niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000500000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LmI2MmMxMWIzLTIwZDEtNGM0Ny05NmI3LWFhNzM3YWU4ZmVmY3gxNzk0MzQ1MjU2OTUwMjU3NTAy parts=102076niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed upload id=1 objects=3 duration=3.283871ms2077niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2078niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete2079niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed upload id=1 objects=3 duration=6.014137ms2080niks3-go-unit-tests> 2026/11/10 21:14:17 INFO lead: released remote=192.0.2.1:12342081niks3-go-unit-tests> --- PASS: TestLeadEndsOnShutdown (2.58s)2082niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2083niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete multipart upload request method=POST path=/api/multipart/complete2084niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete multipart upload request method=POST path=/api/multipart/complete2085niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000400000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjI0MmY0MWEwLTEzZWQtNDE2MC1hZDAwLTcwYmE1MDlmY2Y3NngxNzk0MzQ1MjU3MTE5NTEzNTY3 parts=102086niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete2087niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed upload id=1 objects=3 duration=3.621194ms2088niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2089niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete multipart upload request method=POST path=/api/multipart/complete2090niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f100300000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LmFiNTE5ZDA5LTY1YzQtNDFlZC04ZGFkLWVmNjExMTVmY2RlNngxNzk0MzQ1MjU3Mzk3NTE4Mzgz parts=102091niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete2092niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed upload id=2 objects=3 duration=1.550255ms2093niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received uploads request method=POST path=/api/pending_closures2094niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Force mode enabled - objects will be deleted immediately without grace period2095niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Object in database but missing from S3 key=nar/dadb44fdadb44fdadb44fdadb44f000500000000000000000000.nar.zst2096niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Found objects in DB but missing from S3, will re-upload count=12097niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received push request method=POST path=/api/pushes2098niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2099niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Object in database but missing from S3 key=nar/dadb44fdadb44fdadb44fdadb44f000300000000000000000000.nar.zst2100niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Narinfo references a NAR missing from S3, will re-upload narinfo=dadb44fdadb44fdadb44fdadb44f0003.narinfo2101niks3-go-unit-tests> --- PASS: TestPendingClosureWriteTimeout (0.91s)2102niks3-go-unit-tests> --- PASS: TestPendingClosureWriteTimeout/empty (0.00s)2103niks3-go-unit-tests> --- PASS: TestPendingClosureWriteTimeout/670k_objects (0.00s)2104niks3-go-unit-tests> --- PASS: TestPendingClosureWriteTimeout/400_objects (0.00s)2105niks3-go-unit-tests> --- PASS: TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline (1.62s)2106niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000100000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5LjQ2Mjg5ZGZiLTFjYzMtNGZkYi1hN2QyLWVkNTgzZjk5MGNjOHgxNzk0MzQ1MjU3MDA4Njk1OTE2 parts=102107niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)2108niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete2109niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed upload id=1 objects=3 duration=6.597703ms2110niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Failed to register uploaded object key=0bi165n7ihkbs6la2iwhvmvg1cc233aa.ls error="server returned 404: 404 page not found\n"2111niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign2112niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Signed narinfos id=2 count=12113niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Uploading 1 narinfos2114niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Received complete push request method=POST path=/api/pushes/2/complete2115niks3-go-unit-tests> 2026/11/10 21:14:17 WARN Failed to register uploaded object key=0bi165n7ihkbs6la2iwhvmvg1cc233aa.narinfo error="server returned 404: 404 page not found\n"2116niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Completed push id=2 objects=3 duration=9.650711ms2117niks3-go-unit-tests> 2026/11/10 21:14:17 INFO Upload complete. (1.215s)2118niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=1 objects-deleted-after-grace-period=1 objects-failed-to-delete=02119niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Vacuumed table table=pending_closures2120niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Vacuumed table table=pending_objects2121niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Vacuumed table table=multipart_uploads2122niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Vacuumed table table=closures2123niks3-go-unit-tests> === NAME TestNARDeduplicationMetadataUploadBug2124niks3-go-unit-tests> metadata_upload_test.go:76: Retrieved narinfo from S3:2125niks3-go-unit-tests> StorePath: /build/TestNARDeduplicationMetadataUploadBug1429258835/001/store/0bi165n7ihkbs6la2iwhvmvg1cc233aa-file2.txt2126niks3-go-unit-tests> URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst2127niks3-go-unit-tests> Compression: zstd2128niks3-go-unit-tests> NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf2129niks3-go-unit-tests> NarSize: 1602130niks3-go-unit-tests> References: 2131niks3-go-unit-tests> CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf2132niks3-go-unit-tests> metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)2133niks3-go-unit-tests> metadata_upload_test.go:77: Decompressed .ls content (49 bytes):2134niks3-go-unit-tests> {"version":1,"root":{"type":"regular","size":44}}2135niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Vacuumed table table=objects2136niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Received uploads request method=POST path=/api/pending_closures2137niks3-go-unit-tests> --- PASS: TestNARDeduplicationMetadataUploadBug (4.23s)2138niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Object in database but missing from S3 key=nar/dadb44fdadb44fdadb44fdadb44f000100000000000000000000.nar.zst2139niks3-go-unit-tests> 2026/11/10 21:14:18 WARN Narinfo references a NAR missing from S3, will re-upload narinfo=dadb44fdadb44fdadb44fdadb44f0001.narinfo2140niks3-go-unit-tests> --- PASS: TestReadProxyOutlastsServerWriteTimeout (4.97s)2141niks3-go-unit-tests> 2026/11/10 21:14:18 WARN Request failed, retrying attempt=2 backoff=186.811419ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2142niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Received uploads request method=POST path=/api/pending_closures2143niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectOversizedBody (1.88s)2144niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.09s)2145niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.07s)2146niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (1.61s)2147niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Aborted multipart uploads count=0 kept=02148niks3-go-unit-tests> 2026/11/10 21:14:18 WARN Request failed, retrying attempt=3 backoff=399.205346ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2149niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Received complete multipart upload request method=POST path=/api/multipart/complete2150niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f100400000000000000000000.nar.zst upload_id=MDdjODY3OWEtM2RiMy00MTdlLWJmZGQtNTcwOTU2NGIyYzU5Ljk5ZWNmZDVkLTFmN2EtNDhjNC1hOWNiLTU0NWZlN2UwNmYxZXgxNzk0MzQ1MjU3NTc2OTMyNTA0 parts=102151niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete2152niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Completed upload id=2 objects=3 duration=973.549µs2153niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Received uploads request method=POST path=/api/pending_closures2154niks3-go-unit-tests> 2026/11/10 21:14:18 INFO Object in database but missing from S3 key=nar/dadb44fdadb44fdadb44fdadb44f000400000000000000000000.nar.zst2155niks3-go-unit-tests> 2026/11/10 21:14:18 WARN Narinfo references a NAR missing from S3, will re-upload narinfo=dadb44fdadb44fdadb44fdadb44f0004.narinfo2156niks3-go-unit-tests> --- PASS: TestService_verifyS3ReuploadsStaleNarinfo (0.00s)2157niks3-go-unit-tests> --- PASS: TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed (0.82s)2158niks3-go-unit-tests> --- PASS: TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed (1.65s)2159niks3-go-unit-tests> --- PASS: TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost (1.65s)2160niks3-go-unit-tests> --- PASS: TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed (2.13s)2161niks3-go-unit-tests> --- PASS: TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed (2.44s)2162niks3-go-unit-tests> === NAME TestOrphanedObjectsGCStressTest2163niks3-go-unit-tests> orphaned_objects_gc_test.go:422: Created 10 active closures, 5 to-delete closures, 20 orphaned chains2164niks3-go-unit-tests> --- PASS: TestPresentNotReportedWhileGCDeletesClosure (0.00s)2165niks3-go-unit-tests> --- PASS: TestPresentNotReportedWhileGCDeletesClosure/stale (1.44s)2166niks3-go-unit-tests> --- PASS: TestPresentNotReportedWhileGCDeletesClosure/fresh (1.47s)2167niks3-go-unit-tests> 2026/11/10 21:14:18 WARN Request failed, retrying attempt=4 backoff=782.533437ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2168niks3-go-unit-tests> 2026/11/10 21:14:19 INFO Aborted multipart uploads count=1 kept=02169niks3-go-unit-tests> 2026/11/10 21:14:19 INFO Received cleanup request method=DELETE path=/api/pending_closures2170niks3-go-unit-tests> 2026/11/10 21:14:19 INFO Aborted multipart uploads count=1 kept=02171niks3-go-unit-tests> --- PASS: TestPendingCleanupUsesOneCutoff (6.81s)2172niks3-go-unit-tests> 2026/11/10 21:14:19 WARN Request failed, retrying attempt=5 backoff=1.544583503s error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2173niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received push request method=POST path=/api/pushes2174niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received push request method=POST path=/api/pushes2175niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)2176niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading pd34f18nsxa3q8wni6xdipdvrncfvpl0-ca-test (144B)2177niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Object in database but missing from S3 key=kwnma4lp0w7gb5l93zi18fphd86jsj5k.ls2178niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Found objects in DB but missing from S3, will re-upload count=12179niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)2180niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received complete push request method=POST path=/api/pushes/2/complete2181niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=pd34f18nsxa3q8wni6xdipdvrncfvpl0.ls error="server returned 404: 404 page not found\n"2182niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"2183niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=kwnma4lp0w7gb5l93zi18fphd86jsj5k.ls error="server returned 404: 404 page not found\n"2184niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign2185niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=log/zvv37j4dy8nj4p7agxspf9bybfcykprd-ca-test.drv error="server returned 404: 404 page not found\n"2186niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Signed narinfos id=1 count=12187niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading 1 narinfos2188niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Completed push id=2 objects=3 duration=4.727664ms2189niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Upload complete. (2.37s)2190niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received complete push request method=POST path=/api/pushes/1/complete2191niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=pd34f18nsxa3q8wni6xdipdvrncfvpl0.narinfo error="server returned 404: 404 page not found\n"2192niks3-go-unit-tests> === NAME TestClientIntegration2193niks3-go-unit-tests> client_integration_test.go:335: Retrieved .ls file from S3 (compressed size: 62 bytes)2194niks3-go-unit-tests> client_integration_test.go:335: Decompressed .ls content (49 bytes):2195niks3-go-unit-tests> {"version":1,"root":{"type":"regular","size":39}}2196niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Completed push id=1 objects=4 duration=11.014005ms2197niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Upload complete. (3.555s)2198niks3-go-unit-tests> === NAME TestClientCADerivations2199niks3-go-unit-tests> client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations471745732/001/store/pd34f18nsxa3q8wni6xdipdvrncfvpl0-ca-test2200niks3-go-unit-tests> URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst2201niks3-go-unit-tests> Compression: zstd2202niks3-go-unit-tests> NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2203niks3-go-unit-tests> NarSize: 1442204niks3-go-unit-tests> References: 2205niks3-go-unit-tests> Deriver: /build/TestClientCADerivations471745732/001/store/zvv37j4dy8nj4p7agxspf9bybfcykprd-ca-test.drv2206niks3-go-unit-tests> CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2207niks3-go-unit-tests> client_ca_test.go:185: Checking for realisation files in S3...2208niks3-go-unit-tests> client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations2209niks3-go-unit-tests> client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache2210niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received push request method=POST path=/api/pushes2211niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)2212niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading v0qf5z1kz20m03xcb5bx706pznd65jwv-unpinned-file.txt (128B)2213niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=v0qf5z1kz20m03xcb5bx706pznd65jwv.ls error="server returned 404: 404 page not found\n"2214niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign2215niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Signed narinfos id=2 count=12216niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Uploading 1 narinfos2217niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"2218niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"2219niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Received complete push request method=POST path=/api/pushes/2/complete2220niks3-go-unit-tests> 2026/11/10 21:14:20 WARN Failed to register uploaded object key=v0qf5z1kz20m03xcb5bx706pznd65jwv.narinfo error="server returned 404: 404 page not found\n"2221niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Completed push id=2 objects=3 duration=2.212241ms2222niks3-go-unit-tests> 2026/11/10 21:14:20 INFO Upload complete. (3.012s)2223niks3-go-unit-tests> 2026/11/10 21:14:21 WARN Force mode enabled - objects will be deleted immediately without grace period2224niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=02225niks3-go-unit-tests> 2026/11/10 21:14:21 WARN Request failed, retrying attempt=1 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2226niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Vacuumed table table=pending_closures2227niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Vacuumed table table=pending_objects2228niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Vacuumed table table=multipart_uploads2229niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Vacuumed table table=closures2230niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Starting cleanup of old closures method=DELETE path=/api/closures2231niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Garbage collection started2232niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Vacuumed table table=objects2233niks3-go-unit-tests> --- PASS: TestForceGCDuringPushOffersSweptObject (0.00s)2234niks3-go-unit-tests> --- PASS: TestForceGCDuringPushOffersSweptObject/before_pending_rows (1.12s)2235niks3-go-unit-tests> --- PASS: TestForceGCDuringPushOffersSweptObject/after_presence_check (4.01s)2236niks3-go-unit-tests> 2026/11/10 21:14:21 INFO Aborted multipart uploads count=0 kept=02237niks3-go-unit-tests> 2026/11/10 21:14:21 WARN Request failed, retrying attempt=2 backoff=183.844533ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2238niks3-go-unit-tests> --- PASS: TestDeleteClosuresRacingPins (10.45s)2239niks3-go-unit-tests> 2026/11/10 21:14:21 WARN Request failed, retrying attempt=3 backoff=395.768915ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2240niks3-go-unit-tests> 2026/11/10 21:14:21 WARN Request failed, retrying attempt=4 backoff=740.657092ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2241niks3-go-unit-tests> 2026/11/10 21:14:22 WARN Request failed, retrying attempt=5 backoff=1.677508789s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config2242niks3-go-unit-tests> === NAME TestOrphanedObjectsGCStressTest2243niks3-go-unit-tests> orphaned_objects_gc_test.go:440: Marked 210 objects for deletion2244niks3-go-unit-tests> 2026/11/10 21:14:22 WARN Force mode enabled - objects will be deleted immediately without grace period2245niks3-go-unit-tests> 2026/11/10 21:14:22 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"2246niks3-go-unit-tests> 2026/11/10 21:14:22 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=02247niks3-go-unit-tests> 2026/11/10 21:14:22 INFO Vacuumed table table=pending_closures2248niks3-go-unit-tests> 2026/11/10 21:14:22 INFO Vacuumed table table=pending_objects2249niks3-go-unit-tests> 2026/11/10 21:14:22 INFO Vacuumed table table=multipart_uploads2250niks3-go-unit-tests> 2026/11/10 21:14:22 INFO Vacuumed table table=closures2251niks3-go-unit-tests> 2026/11/10 21:14:22 INFO Vacuumed table table=objects2252niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=02253niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Received create pin request method=POST path=/api/pins/myapp2254niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Created/updated pin name=myapp store_path=/build/TestPinProtectsFromGC3511848235/001/store/v60j8wm3mvz895f22xsh2pvhcp5hiq2a-pinned-file.txt narinfo_key=v60j8wm3mvz895f22xsh2pvhcp5hiq2a.narinfo2255niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Starting cleanup of old closures method=DELETE path=/api/closures2256niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Garbage collection started2257niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Aborted multipart uploads count=0 kept=02258niks3-go-unit-tests> orphaned_objects_gc_test.go:503: Stress test completed successfully:2259niks3-go-unit-tests> orphaned_objects_gc_test.go:504: - Active objects preserved: 202260niks3-go-unit-tests> orphaned_objects_gc_test.go:505: - Objects deleted: 2102261niks3-go-unit-tests> orphaned_objects_gc_test.go:506: - Total GC'd: 2102262niks3-go-unit-tests> --- PASS: TestOrphanedObjectsGCStressTest (7.40s)2263niks3-go-unit-tests> 2026/11/10 21:14:23 WARN Force mode enabled - objects will be deleted immediately without grace period2264niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=02265niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Vacuumed table table=pending_closures2266niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Vacuumed table table=pending_objects2267niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Vacuumed table table=multipart_uploads2268niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Vacuumed table table=closures2269niks3-go-unit-tests> 2026/11/10 21:14:23 INFO Vacuumed table table=objects2270niks3-go-unit-tests> --- PASS: TestClientErrorHandling (0.00s)2271niks3-go-unit-tests> --- PASS: TestClientErrorHandling/InvalidStorePath (1.09s)2272niks3-go-unit-tests> --- PASS: TestClientErrorHandling/InvalidAuthToken (5.60s)2273niks3-go-unit-tests> --- PASS: TestClientErrorHandling/ServerNotAvailable (7.28s)2274niks3-go-unit-tests> === NAME TestPinProtectsFromGC2275niks3-go-unit-tests> client_integration_test.go:887: Pin successfully protected closure from garbage collection2276niks3-go-unit-tests> --- PASS: TestPinProtectsFromGC (13.49s)2277niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Received push request method=POST path=/api/pushes2278niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)2279niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Received complete push request method=POST path=/api/pushes/3/complete2280niks3-go-unit-tests> 2026/11/10 21:14:25 WARN Failed to register uploaded object key=kwnma4lp0w7gb5l93zi18fphd86jsj5k.ls error="server returned 404: 404 page not found\n"2281niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Completed push id=3 objects=3 duration=4.575444ms2282niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Upload complete. (3.224s)2283niks3-go-unit-tests> === NAME TestClientIntegration2284niks3-go-unit-tests> client_integration_test.go:352: Retrieved .ls file from S3 (compressed size: 62 bytes)2285niks3-go-unit-tests> client_integration_test.go:352: Decompressed .ls content (49 bytes):2286niks3-go-unit-tests> {"version":1,"root":{"type":"regular","size":39}}2287niks3-go-unit-tests> client_integration_test.go:363: Testing garbage collection...2288niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Starting cleanup of old closures method=DELETE path=/api/closures2289niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Garbage collection started2290niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Aborted multipart uploads count=0 kept=02291niks3-go-unit-tests> 2026/11/10 21:14:25 WARN Force mode enabled - objects will be deleted immediately without grace period2292niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=02293niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Vacuumed table table=pending_closures2294niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Vacuumed table table=pending_objects2295niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Vacuumed table table=multipart_uploads2296niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Vacuumed table table=closures2297niks3-go-unit-tests> 2026/11/10 21:14:25 INFO Vacuumed table table=objects2298niks3-go-unit-tests> 2026/11/10 21:14:27 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=02299niks3-go-unit-tests> client_integration_test.go:370: Objects in database after GC:2300niks3-go-unit-tests> client_integration_test.go:370: Successfully deleted all objects with GC --force2301niks3-go-unit-tests> --- PASS: TestClientIntegration (15.58s)2302niks3-go-unit-tests> === NAME TestClientCADerivations2303niks3-go-unit-tests> client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features2304niks3-go-unit-tests> warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable2305niks3-go-unit-tests> error: binary cache 's3://bucket44?endpoint=http://localhost:39267®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations471745732/001/store'2306niks3-go-unit-tests> client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 12307niks3-go-unit-tests> --- PASS: TestClientCADerivations (25.40s)2308niks3-go-unit-tests> PASS2309niks3-go-unit-tests> {"timestamp":"2026-11-10T21:14:37.828659051Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:40344","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(199)"}2310niks3-go-unit-tests> 2026-11-10 21:14:38.183 UTC [136] LOG: received smart shutdown request2311niks3-go-unit-tests> 2026-11-10 21:14:38.191 UTC [136] LOG: background worker "logical replication launcher" (PID 150) exited with exit code 12312niks3-go-unit-tests> 2026-11-10 21:14:38.208 UTC [145] LOG: shutting down2313niks3-go-unit-tests> 2026-11-10 21:14:38.209 UTC [145] LOG: checkpoint starting: shutdown immediate