tribuchet: building on eliza Running client tests... === RUN TestDoServerRequestAttachesToken === PAUSE TestDoServerRequestAttachesToken === RUN TestUploadBuildLog_FileBodyReplayedOnRetry === PAUSE TestUploadBuildLog_FileBodyReplayedOnRetry === RUN TestRegisterUploadedObjectReusesConnections === PAUSE TestRegisterUploadedObjectReusesConnections === RUN TestRunGarbageCollection_FinishedOnAnotherReplica === PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica === RUN TestRunGarbageCollection_NotFoundAfterLocalRun === PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun === RUN TestCaseHackSuffix === PAUSE TestCaseHackSuffix === RUN TestFilterOversizedClosures === PAUSE TestFilterOversizedClosures === RUN TestUploadMultipart_PartsInParallel === PAUSE TestUploadMultipart_PartsInParallel === RUN TestUploadMultipart_FailedPartBufferNotReused === PAUSE TestUploadMultipart_FailedPartBufferNotReused === RUN TestPartSizeForNAR === PAUSE TestPartSizeForNAR === RUN TestUploadMultipart_SupersededByPeer === PAUSE TestUploadMultipart_SupersededByPeer === RUN TestDumpPathCaseHackMatchesNix --- PASS: TestDumpPathCaseHackMatchesNix (0.10s) === RUN TestDumpPathCaseHackCollision --- PASS: TestDumpPathCaseHackCollision (0.00s) === RUN TestSupersededNARStillUploadsListing === PAUSE TestSupersededNARStillUploadsListing === RUN TestDumpPathMatchesNix === PAUSE TestDumpPathMatchesNix === RUN TestDumpPathSingleFile === PAUSE TestDumpPathSingleFile === RUN TestDumpPathWriterError === PAUSE TestDumpPathWriterError === RUN TestEncodeNixBase32 === PAUSE TestEncodeNixBase32 === RUN TestEncodeNixBase32WithRealHash === PAUSE TestEncodeNixBase32WithRealHash === RUN TestConvertHashToNix32 === PAUSE TestConvertHashToNix32 === RUN TestGetStorePathHash === PAUSE TestGetStorePathHash === RUN TestPathInfoHashCompatibility === PAUSE TestPathInfoHashCompatibility === RUN TestParsePathInfoJSON === PAUSE TestParsePathInfoJSON === RUN TestParsePathInfoJSONMultiplePaths === PAUSE TestParsePathInfoJSONMultiplePaths === RUN TestPathInfoCACompatibility === PAUSE TestPathInfoCACompatibility === RUN TestRateLimiterFeedback === PAUSE TestRateLimiterFeedback === RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess === PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess === RUN TestRegisterUploadedObject_BoundedAgainstSilentServer === PAUSE TestRegisterUploadedObject_BoundedAgainstSilentServer === RUN TestResolveStorePath === PAUSE TestResolveStorePath === RUN TestDoWithRetry_BodyReplayedViaGetBody === PAUSE TestDoWithRetry_BodyReplayedViaGetBody === RUN TestRetryTimeoutOutlastsMaxRetries === PAUSE TestRetryTimeoutOutlastsMaxRetries === RUN TestDoWithRetry_FinalResponseBodyReadable === PAUSE TestDoWithRetry_FinalResponseBodyReadable === RUN TestShellSplit === PAUSE TestShellSplit === RUN TestShellSplitErrors === PAUSE TestShellSplitErrors === RUN TestStreamPushReportsEveryPath === PAUSE TestStreamPushReportsEveryPath === RUN TestStreamPushBatchesUnderLoad === PAUSE TestStreamPushBatchesUnderLoad === RUN TestStreamPushIsolatesFailures === PAUSE TestStreamPushIsolatesFailures === RUN TestStreamPushGivesUpOnDeadServer === PAUSE TestStreamPushGivesUpOnDeadServer === RUN TestStreamPushRequestLine === PAUSE TestStreamPushRequestLine === RUN TestStreamPushReportsSignatures === PAUSE TestStreamPushReportsSignatures === RUN TestStreamPushReportsSkippedPaths === PAUSE TestStreamPushReportsSkippedPaths === RUN TestClientSignaturesByStorePath === PAUSE TestClientSignaturesByStorePath === RUN TestStreamPushStopsWhenCanceled === PAUSE TestStreamPushStopsWhenCanceled === RUN TestSetClientTLS === PAUSE TestSetClientTLS === RUN TestSetClientTLSDoesNotMutateDefaultTransport === PAUSE TestSetClientTLSDoesNotMutateDefaultTransport === RUN TestSetClientTLSErrors === PAUSE TestSetClientTLSErrors === RUN TestStaticToken === PAUSE TestStaticToken === RUN TestFileTokenReadsAndCaches === PAUSE TestFileTokenReadsAndCaches === RUN TestFileTokenMissing === PAUSE TestFileTokenMissing === RUN TestFileTokenEmpty === PAUSE TestFileTokenEmpty === RUN TestScriptTokenNoExpiryRerunsEveryCall === PAUSE TestScriptTokenNoExpiryRerunsEveryCall === RUN TestScriptTokenCachesUntilRefresh === PAUSE TestScriptTokenCachesUntilRefresh === RUN TestScriptTokenEmptyToken === PAUSE TestScriptTokenEmptyToken === RUN TestScriptTokenBadJSON === PAUSE TestScriptTokenBadJSON === RUN TestScriptTokenScriptFails === PAUSE TestScriptTokenScriptFails === RUN TestScriptTokenEmptyCommand === PAUSE TestScriptTokenEmptyCommand === CONT TestDoServerRequestAttachesToken === CONT TestSetClientTLS === CONT TestStreamPushIsolatesFailures === CONT TestStreamPushStopsWhenCanceled --- PASS: TestStreamPushStopsWhenCanceled (0.00s) === CONT TestRateLimiterFeedback === RUN TestRateLimiterFeedback/429_enables_limiter === PAUSE TestRateLimiterFeedback/429_enables_limiter === RUN TestRateLimiterFeedback/503_enables_limiter === PAUSE TestRateLimiterFeedback/503_enables_limiter === RUN TestRateLimiterFeedback/200_does_not_enable_limiter === PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter === RUN TestRateLimiterFeedback/400_does_not_enable_limiter === PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter === CONT TestClientSignaturesByStorePath === CONT TestStreamPushReportsEveryPath --- PASS: TestClientSignaturesByStorePath (0.00s) === CONT TestStreamPushReportsSignatures === CONT TestPathInfoCACompatibility 2026/10/27 08:16:03 ERROR Upload failed error="bad path" count=3 === CONT TestStreamPushReportsSkippedPaths === CONT TestStreamPushGivesUpOnDeadServer === CONT TestUploadMultipart_PartsInParallel === CONT TestDumpPathSingleFile === CONT TestDumpPathMatchesNix === CONT TestSupersededNARStillUploadsListing 2026/10/27 08:16:03 ERROR Upload failed error=boom count=1 === RUN TestSupersededNARStillUploadsListing/small_NAR === CONT TestParsePathInfoJSONMultiplePaths === RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths === PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths === RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths === PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths === CONT TestDoWithRetry_FinalResponseBodyReadable 2026/10/27 08:16:03 ERROR Upload failed error="connection refused" count=20 2026/10/27 08:16:03 ERROR Server seems unavailable, giving up on batch untried=17 === CONT TestPathInfoHashCompatibility === CONT TestDumpPathWriterError === RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) === PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) === RUN TestPathInfoHashCompatibility/old_string_format_with_colon === PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon === RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI === PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI === RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512 === PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512 === CONT TestPartSizeForNAR === RUN TestPartSizeForNAR/zero_stays_at_minimum === PAUSE TestPartSizeForNAR/zero_stays_at_minimum === RUN TestPartSizeForNAR/small_stays_at_minimum === PAUSE TestPartSizeForNAR/small_stays_at_minimum === RUN TestPartSizeForNAR/80_GiB_fits_at_minimum === PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum === RUN TestPartSizeForNAR/115_GiB_needs_larger_parts === PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts === RUN TestPartSizeForNAR/1_TiB === PAUSE TestPartSizeForNAR/1_TiB === CONT TestGetStorePathHash === RUN TestGetStorePathHash/valid_store_path === PAUSE TestGetStorePathHash/valid_store_path === RUN TestGetStorePathHash/basename_without_hyphen_should_error === PAUSE TestGetStorePathHash/basename_without_hyphen_should_error === RUN TestGetStorePathHash/hash_with_invalid_characters_should_error === PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error === RUN TestGetStorePathHash/hash_with_wrong_length_should_error === PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error === CONT TestUploadMultipart_FailedPartBufferNotReused === CONT TestRegisterUploadedObject_BoundedAgainstSilentServer === CONT TestRegisterUploadedObjectReusesConnections === CONT TestDoWithRetry_BodyReplayedViaGetBody === CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess === CONT TestStreamPushBatchesUnderLoad === CONT TestRunGarbageCollection_FinishedOnAnotherReplica === RUN TestPathInfoCACompatibility/null_ca_field === CONT TestStreamPushRequestLine --- PASS: TestStreamPushReportsSkippedPaths (0.00s) --- PASS: TestStreamPushReportsEveryPath (0.00s) --- PASS: TestStreamPushReportsSignatures (0.00s) --- PASS: TestStreamPushIsolatesFailures (0.01s) --- PASS: TestStreamPushGivesUpOnDeadServer (0.00s) 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=server-test rate=5 === CONT TestShellSplitErrors --- PASS: TestShellSplitErrors (0.00s) === CONT TestUploadMultipart_SupersededByPeer 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:33139 === PAUSE TestSupersededNARStillUploadsListing/small_NAR === RUN TestSupersededNARStillUploadsListing/dump_cut_short === CONT TestShellSplit --- PASS: TestShellSplit (0.00s) === CONT TestFilterOversizedClosures === RUN TestFilterOversizedClosures/no_limit_keeps_everything === RUN TestPartSizeForNAR/5_TiB_S3_max_object === CONT TestResolveStorePath 2026/10/27 08:16:03 WARN Rate limiter backed off name=server-test rate=5 === CONT TestParsePathInfoJSON === RUN TestParsePathInfoJSON/Nix_format === PAUSE TestParsePathInfoJSON/Nix_format === RUN TestParsePathInfoJSON/Lix_format === RUN TestSetClientTLS/rejects_connection_without_client_cert === CONT TestConvertHashToNix32 === RUN TestConvertHashToNix32/SRI_format_to_Nix32 === PAUSE TestConvertHashToNix32/SRI_format_to_Nix32 === RUN TestConvertHashToNix32/already_Nix32_format === PAUSE TestConvertHashToNix32/already_Nix32_format === RUN TestConvertHashToNix32/invalid_format === PAUSE TestConvertHashToNix32/invalid_format === CONT TestEncodeNixBase32 === RUN TestEncodeNixBase32/test_string_hash === PAUSE TestEncodeNixBase32/test_string_hash === RUN TestEncodeNixBase32/empty_input === PAUSE TestEncodeNixBase32/empty_input === CONT TestRetryTimeoutOutlastsMaxRetries 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=server-test rate=5 === CONT TestEncodeNixBase32WithRealHash === PAUSE TestFilterOversizedClosures/no_limit_keeps_everything === PAUSE TestSupersededNARStillUploadsListing/dump_cut_short === RUN TestSupersededNARStillUploadsListing/listing_upload_fails 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:36213 === PAUSE TestSupersededNARStillUploadsListing/listing_upload_fails === RUN TestUploadMultipart_SupersededByPeer/exists === PAUSE TestUploadMultipart_SupersededByPeer/exists === RUN TestUploadMultipart_SupersededByPeer/missing === CONT TestScriptTokenEmptyToken === PAUSE TestParsePathInfoJSON/Lix_format === RUN TestParsePathInfoJSON/empty_input 2026/10/27 08:16:03 ERROR Upload failed error=boom count=1 === PAUSE TestSetClientTLS/rejects_connection_without_client_cert --- PASS: TestDumpPathSingleFile (0.15s) === CONT TestCaseHackSuffix 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:36213 === RUN TestSetClientTLS/succeeds_with_client_cert_and_CA === PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA === RUN TestSetClientTLS/preserves_debug_logging_transport --- PASS: TestDoWithRetry_FinalResponseBodyReadable (0.11s) === CONT TestScriptTokenNoExpiryRerunsEveryCall === PAUSE TestPathInfoCACompatibility/null_ca_field === RUN TestPathInfoCACompatibility/old_string_format_-_text === PAUSE TestPathInfoCACompatibility/old_string_format_-_text === RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive === PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive === RUN TestPathInfoCACompatibility/new_structured_format_-_text === PAUSE TestPathInfoCACompatibility/new_structured_format_-_text === RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method === PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method --- PASS: TestDoServerRequestAttachesToken (0.12s) === CONT TestScriptTokenBadJSON === CONT TestScriptTokenEmptyCommand --- PASS: TestScriptTokenEmptyCommand (0.00s) === CONT TestScriptTokenScriptFails 2026/10/27 08:16:03 INFO Garbage collection started --- PASS: TestResolveStorePath (0.00s) === RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped === PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped === RUN TestFilterOversizedClosures/all_closures_skipped === PAUSE TestFilterOversizedClosures/all_closures_skipped === PAUSE TestUploadMultipart_SupersededByPeer/missing === CONT TestScriptTokenCachesUntilRefresh === CONT TestFileTokenReadsAndCaches 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:36213 === CONT TestFileTokenMissing --- PASS: TestScriptTokenEmptyToken (0.00s) === CONT TestFileTokenEmpty --- PASS: TestFileTokenReadsAndCaches (0.00s) === CONT TestSetClientTLSErrors 2026/10/27 08:16:03 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0 === PAUSE TestParsePathInfoJSON/empty_input === RUN TestParsePathInfoJSON/whitespace_only === PAUSE TestParsePathInfoJSON/whitespace_only === RUN TestParsePathInfoJSON/invalid_JSON === PAUSE TestParsePathInfoJSON/invalid_JSON === PAUSE TestSetClientTLS/preserves_debug_logging_transport --- PASS: TestFileTokenMissing (0.00s) === CONT TestStaticToken --- PASS: TestStaticToken (0.00s) === CONT TestRunGarbageCollection_NotFoundAfterLocalRun === PAUSE TestPartSizeForNAR/5_TiB_S3_max_object === RUN TestPartSizeForNAR/capped_at_5_GiB === CONT TestSetClientTLSDoesNotMutateDefaultTransport --- PASS: TestFileTokenEmpty (0.00s) === CONT TestRateLimiterFeedback/429_enables_limiter 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:36213 --- PASS: TestScriptTokenScriptFails (0.00s) === CONT TestRateLimiterFeedback/200_does_not_enable_limiter --- PASS: TestScriptTokenBadJSON (0.00s) === CONT TestRateLimiterFeedback/400_does_not_enable_limiter === CONT TestUploadBuildLog_FileBodyReplayedOnRetry 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=server-test rate=5 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:46625 2026/10/27 08:16:03 WARN Garbage collection finished on another replica. Its statistics are not available here --- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.08s) === CONT TestRateLimiterFeedback/503_enables_limiter === CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths 2026/10/27 08:16:03 WARN Rate limiter backed off name=server-test rate=5 === CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) === CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512 === CONT TestGetStorePathHash/valid_store_path === CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:36213 === CONT TestPathInfoHashCompatibility/old_string_format_with_colon === CONT TestGetStorePathHash/hash_with_invalid_characters_should_error === CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths === CONT TestConvertHashToNix32/SRI_format_to_Nix32 === CONT TestConvertHashToNix32/invalid_format === CONT TestConvertHashToNix32/already_Nix32_format === CONT TestEncodeNixBase32/empty_input === CONT TestSupersededNARStillUploadsListing/small_NAR 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=server-test rate=5 === PAUSE TestPartSizeForNAR/capped_at_5_GiB 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:44129 --- PASS: TestPathInfoHashCompatibility (0.00s) --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s) --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s) --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s) --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s) --- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s) === CONT TestSupersededNARStillUploadsListing/dump_cut_short 2026/10/27 08:16:03 INFO Garbage collection started === RUN TestSetClientTLSErrors/missing_cert_file === PAUSE TestSetClientTLSErrors/missing_cert_file === RUN TestSetClientTLSErrors/missing_key_file === PAUSE TestSetClientTLSErrors/missing_key_file === RUN TestSetClientTLSErrors/missing_ca_file === PAUSE TestSetClientTLSErrors/missing_ca_file 2026/10/27 08:16:03 WARN Rate limiter backed off name=server-test rate=5 === RUN TestSetClientTLSErrors/invalid_ca_file 2026/10/27 08:16:03 INFO Uploading abc-hello (1.0GB) === PAUSE TestSetClientTLSErrors/invalid_ca_file --- PASS: TestRateLimiterFeedback (0.00s) --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s) --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s) --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s) --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s) === CONT TestSupersededNARStillUploadsListing/listing_upload_fails 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:36213 === CONT TestGetStorePathHash/basename_without_hyphen_should_error --- PASS: TestParsePathInfoJSONMultiplePaths (0.00s) --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s) --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s) --- PASS: TestConvertHashToNix32 (0.00s) --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s) --- PASS: TestConvertHashToNix32/invalid_format (0.00s) --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s) === CONT TestEncodeNixBase32/test_string_hash === CONT TestGetStorePathHash/hash_with_wrong_length_should_error 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=s3-test rate=5 === CONT TestPathInfoCACompatibility/null_ca_field === CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method === CONT TestPathInfoCACompatibility/new_structured_format_-_text === CONT TestPathInfoCACompatibility/old_string_format_-_text === CONT TestUploadMultipart_SupersededByPeer/exists 2026/10/27 08:16:03 INFO Uploading abc-hello (1.0GB) === CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:36213 === NAME TestStreamPushBatchesUnderLoad streampush_test.go:171: batches = [[/nix/store/first] [/nix/store/x] [/nix/store/y /nix/store/z]], want [first] then [x y z] --- PASS: TestPathInfoCACompatibility (0.15s) --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s) --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s) --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s) --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s) --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s) --- FAIL: TestStreamPushBatchesUnderLoad (0.41s) --- PASS: TestEncodeNixBase32 (0.01s) --- PASS: TestEncodeNixBase32/empty_input (0.00s) --- PASS: TestEncodeNixBase32/test_string_hash (0.32s) --- PASS: TestGetStorePathHash (0.00s) --- PASS: TestGetStorePathHash/valid_store_path (0.00s) --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s) --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s) --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s) === CONT TestUploadMultipart_SupersededByPeer/missing --- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.34s) === CONT TestSetClientTLS/rejects_connection_without_client_cert 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:40693 --- PASS: TestEncodeNixBase32WithRealHash (0.00s) === CONT TestFilterOversizedClosures/no_limit_keeps_everything 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=server-test rate=5 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:45021 === CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped 2026/10/27 08:16:03 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000 === CONT TestParsePathInfoJSON/whitespace_only === CONT TestParsePathInfoJSON/empty_input === CONT TestParsePathInfoJSON/Lix_format === CONT TestSetClientTLS/preserves_debug_logging_transport 2026/10/27 08:16:03 WARN Rate limiter backed off name=server-test rate=5 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:45021 === CONT TestPartSizeForNAR/zero_stays_at_minimum === CONT TestPartSizeForNAR/115_GiB_needs_larger_parts === CONT TestPartSizeForNAR/capped_at_5_GiB === CONT TestPartSizeForNAR/5_TiB_S3_max_object === CONT TestPartSizeForNAR/1_TiB === CONT TestPartSizeForNAR/small_stays_at_minimum === CONT TestPartSizeForNAR/80_GiB_fits_at_minimum === CONT TestSetClientTLSErrors/missing_key_file === CONT TestSetClientTLSErrors/invalid_ca_file === CONT TestSetClientTLSErrors/missing_ca_file 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:36213 === CONT TestSetClientTLS/succeeds_with_client_cert_and_CA === CONT TestSetClientTLSErrors/missing_cert_file === CONT TestParsePathInfoJSON/Nix_format --- PASS: TestCaseHackSuffix (0.34s) === CONT TestParsePathInfoJSON/invalid_JSON === CONT TestFilterOversizedClosures/all_closures_skipped 2026/10/27 08:16:03 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50 --- PASS: TestFilterOversizedClosures (0.15s) --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s) --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s) --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s) --- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.42s) --- PASS: TestUploadBuildLog_FileBodyReplayedOnRetry (0.34s) --- PASS: TestPartSizeForNAR (0.15s) --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s) --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s) --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s) --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s) --- PASS: TestPartSizeForNAR/1_TiB (0.00s) --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s) --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s) --- PASS: TestUploadMultipart_SupersededByPeer (0.00s) --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s) --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s) --- PASS: TestParsePathInfoJSON (0.15s) --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s) --- PASS: TestParsePathInfoJSON/empty_input (0.00s) --- PASS: TestParsePathInfoJSON/Lix_format (0.00s) --- PASS: TestParsePathInfoJSON/Nix_format (0.00s) --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s) --- PASS: TestSetClientTLSErrors (0.00s) --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s) --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s) --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s) --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s) 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:36213 --- PASS: TestScriptTokenCachesUntilRefresh (0.34s) 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:36213 --- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.34s) 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:36213 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:36213 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:36213 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:36213 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:36213 --- PASS: TestRegisterUploadedObjectReusesConnections (0.43s) 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:36213 2026/10/27 08:16:03 http: TLS handshake error from 127.0.0.1:43428: remote error: tls: bad certificate --- PASS: TestSetClientTLS (0.16s) --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s) --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s) --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.02s) 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:36213 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:36213 --- PASS: TestStreamPushRequestLine (0.36s) 2026/10/27 08:16:03 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:36213 --- PASS: TestRetryTimeoutOutlastsMaxRetries (0.44s) --- PASS: TestDumpPathWriterError (0.51s) 2026/10/27 08:16:03 WARN Rate limiter enabled after throttle name=s3-test rate=5 2026/10/27 08:16:03 INFO Uploading abc-hello (1.0GB) 2026/10/27 08:16:03 WARN Request failed, retrying attempt=1 backoff=100ms error="Put \"http://127.0.0.1:45535/part/2\": uploading part 1: server returned 404: no such upload\n" url=http://127.0.0.1:45535/part/2 2026/10/27 08:16:03 ERROR Failed to close zstd encoder error="io: read/write on closed pipe" --- PASS: TestDumpPathMatchesNix (0.67s) 2026/10/27 08:16:04 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:37105/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:37105/api/uploads/complete 2026/10/27 08:16:04 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:37105/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:37105/api/uploads/complete 2026/10/27 08:16:04 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded" 2026/10/27 08:16:04 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded" 2026/10/27 08:16:04 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:37105/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:37105/api/uploads/complete 2026/10/27 08:16:04 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded" --- PASS: TestRegisterUploadedObject_BoundedAgainstSilentServer (1.07s) --- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.01s) --- PASS: TestUploadMultipart_FailedPartBufferNotReused (1.08s) --- PASS: TestSupersededNARStillUploadsListing (0.15s) --- PASS: TestSupersededNARStillUploadsListing/listing_upload_fails (0.34s) --- PASS: TestSupersededNARStillUploadsListing/small_NAR (0.34s) --- PASS: TestSupersededNARStillUploadsListing/dump_cut_short (0.93s) --- PASS: TestUploadMultipart_PartsInParallel (1.10s) FAIL