niks3-go-unit-tests
checks.x86_64-linux.go-unit-tests
· build #358
· raw
1tribuchet: building on jamie2Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestRegisterUploadedObjectReusesConnections6=== PAUSE TestRegisterUploadedObjectReusesConnections7=== RUN TestRunGarbageCollection_FinishedOnAnotherReplica8=== PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica9=== RUN TestRunGarbageCollection_NotFoundAfterLocalRun10=== PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun11=== RUN TestCaseHackSuffix12=== PAUSE TestCaseHackSuffix13=== RUN TestFilterOversizedClosures14=== PAUSE TestFilterOversizedClosures15=== RUN TestUploadMultipart_PartsInParallel16=== PAUSE TestUploadMultipart_PartsInParallel17=== RUN TestPartSizeForNAR18=== PAUSE TestPartSizeForNAR19=== RUN TestUploadMultipart_SupersededByPeer20=== PAUSE TestUploadMultipart_SupersededByPeer21=== RUN TestDumpPathCaseHackMatchesNix22--- PASS: TestDumpPathCaseHackMatchesNix (0.05s)23=== RUN TestDumpPathCaseHackCollision24--- PASS: TestDumpPathCaseHackCollision (0.00s)25=== RUN TestDumpPathMatchesNix26=== PAUSE TestDumpPathMatchesNix27=== RUN TestDumpPathSingleFile28=== PAUSE TestDumpPathSingleFile29=== RUN TestDumpPathWriterError30=== PAUSE TestDumpPathWriterError31=== RUN TestEncodeNixBase3232=== PAUSE TestEncodeNixBase3233=== RUN TestEncodeNixBase32WithRealHash34=== PAUSE TestEncodeNixBase32WithRealHash35=== RUN TestConvertHashToNix3236=== PAUSE TestConvertHashToNix3237=== RUN TestGetStorePathHash38=== PAUSE TestGetStorePathHash39=== RUN TestPathInfoHashCompatibility40=== PAUSE TestPathInfoHashCompatibility41=== RUN TestParsePathInfoJSON42=== PAUSE TestParsePathInfoJSON43=== RUN TestParsePathInfoJSONMultiplePaths44=== PAUSE TestParsePathInfoJSONMultiplePaths45=== RUN TestPathInfoCACompatibility46=== PAUSE TestPathInfoCACompatibility47=== RUN TestRateLimiterFeedback48=== PAUSE TestRateLimiterFeedback49=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess50=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess51=== RUN TestResolveStorePath52=== PAUSE TestResolveStorePath53=== RUN TestDoWithRetry_BodyReplayedViaGetBody54=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody55=== RUN TestShellSplit56=== PAUSE TestShellSplit57=== RUN TestShellSplitErrors58=== PAUSE TestShellSplitErrors59=== RUN TestStreamPushReportsEveryPath60=== PAUSE TestStreamPushReportsEveryPath61=== RUN TestStreamPushBatchesUnderLoad62=== PAUSE TestStreamPushBatchesUnderLoad63=== RUN TestStreamPushIsolatesFailures64=== PAUSE TestStreamPushIsolatesFailures65=== RUN TestStreamPushGivesUpOnDeadServer66=== PAUSE TestStreamPushGivesUpOnDeadServer67=== RUN TestStreamPushRequestLine68=== PAUSE TestStreamPushRequestLine69=== RUN TestStreamPushReportsSignatures70=== PAUSE TestStreamPushReportsSignatures71=== RUN TestClientSignaturesByStorePath72=== PAUSE TestClientSignaturesByStorePath73=== RUN TestSetClientTLS74=== PAUSE TestSetClientTLS75=== RUN TestSetClientTLSDoesNotMutateDefaultTransport76=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport77=== RUN TestSetClientTLSErrors78=== PAUSE TestSetClientTLSErrors79=== RUN TestStaticToken80=== PAUSE TestStaticToken81=== RUN TestFileTokenReadsAndCaches82=== PAUSE TestFileTokenReadsAndCaches83=== RUN TestFileTokenMissing84=== PAUSE TestFileTokenMissing85=== RUN TestFileTokenEmpty86=== PAUSE TestFileTokenEmpty87=== RUN TestScriptTokenNoExpiryRerunsEveryCall88=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall89=== RUN TestScriptTokenCachesUntilRefresh90=== PAUSE TestScriptTokenCachesUntilRefresh91=== RUN TestScriptTokenEmptyToken92=== PAUSE TestScriptTokenEmptyToken93=== RUN TestScriptTokenBadJSON94=== PAUSE TestScriptTokenBadJSON95=== RUN TestScriptTokenScriptFails96=== PAUSE TestScriptTokenScriptFails97=== RUN TestScriptTokenEmptyCommand98=== PAUSE TestScriptTokenEmptyCommand99=== CONT TestDoServerRequestAttachesToken100=== CONT TestDoWithRetry_BodyReplayedViaGetBody101=== CONT TestEncodeNixBase32102=== RUN TestEncodeNixBase32/test_string_hash103=== CONT TestParsePathInfoJSONMultiplePaths104=== CONT TestParsePathInfoJSON105=== RUN TestParsePathInfoJSON/Nix_format106=== PAUSE TestParsePathInfoJSON/Nix_format107=== RUN TestParsePathInfoJSON/Lix_format108=== CONT TestResolveStorePath109=== PAUSE TestParsePathInfoJSON/Lix_format110=== CONT TestPathInfoHashCompatibility111=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)112=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess113=== CONT TestGetStorePathHash114=== RUN TestGetStorePathHash/valid_store_path115=== CONT TestRateLimiterFeedback116=== CONT TestConvertHashToNix32117=== RUN TestRateLimiterFeedback/429_enables_limiter118=== RUN TestConvertHashToNix32/SRI_format_to_Nix321192026/10/05 11:22:44 WARN Rate limiter enabled after throttle name=server-test rate=5120=== PAUSE TestRateLimiterFeedback/429_enables_limiter121=== RUN TestRateLimiterFeedback/503_enables_limiter122=== CONT TestUploadMultipart_PartsInParallel123=== PAUSE TestRateLimiterFeedback/503_enables_limiter124=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter125=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter126=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter127=== CONT TestDumpPathWriterError128=== CONT TestDumpPathSingleFile129=== CONT TestDumpPathMatchesNix130=== CONT TestUploadMultipart_SupersededByPeer131=== CONT TestFilterOversizedClosures132=== CONT TestPartSizeForNAR133=== CONT TestRunGarbageCollection_NotFoundAfterLocalRun134=== CONT TestSetClientTLSErrors135=== CONT TestStreamPushGivesUpOnDeadServer136=== CONT TestCaseHackSuffix137=== PAUSE TestEncodeNixBase32/test_string_hash138=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths139=== RUN TestParsePathInfoJSON/empty_input140=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)141=== PAUSE TestGetStorePathHash/valid_store_path142=== CONT TestPathInfoCACompatibility143=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32144=== RUN TestEncodeNixBase32/empty_input145--- PASS: TestResolveStorePath (0.00s)146=== PAUSE TestEncodeNixBase32/empty_input147=== CONT TestSetClientTLSDoesNotMutateDefaultTransport148=== CONT TestEncodeNixBase32WithRealHash149=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter150=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths151=== CONT TestSetClientTLS152--- PASS: TestEncodeNixBase32WithRealHash (0.00s)153=== RUN TestFilterOversizedClosures/no_limit_keeps_everything154=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything155=== RUN TestConvertHashToNix32/already_Nix32_format156=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon157=== RUN TestGetStorePathHash/basename_without_hyphen_should_error1582026/10/05 11:22:44 WARN Rate limiter enabled after throttle name=server-test rate=5159=== RUN TestPathInfoCACompatibility/null_ca_field1602026/10/05 11:22:44 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:36769161=== PAUSE TestPathInfoCACompatibility/null_ca_field162=== PAUSE TestParsePathInfoJSON/empty_input163=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped164=== RUN TestParsePathInfoJSON/whitespace_only1652026/10/05 11:22:44 ERROR Upload failed error="connection refused" count=20166=== RUN TestUploadMultipart_SupersededByPeer/exists1672026/10/05 11:22:44 ERROR Server seems unavailable, giving up on batch untried=17168=== PAUSE TestUploadMultipart_SupersededByPeer/exists169=== RUN TestUploadMultipart_SupersededByPeer/missing170=== PAUSE TestUploadMultipart_SupersededByPeer/missing171=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped172=== RUN TestFilterOversizedClosures/all_closures_skipped173=== PAUSE TestFilterOversizedClosures/all_closures_skipped1742026/10/05 11:22:44 WARN Rate limiter backed off name=server-test rate=5175=== CONT TestClientSignaturesByStorePath1762026/10/05 11:22:44 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:36769177=== CONT TestScriptTokenBadJSON178=== PAUSE TestConvertHashToNix32/already_Nix32_format179=== PAUSE TestParsePathInfoJSON/whitespace_only180=== RUN TestPathInfoCACompatibility/old_string_format_-_text181=== RUN TestPartSizeForNAR/zero_stays_at_minimum182=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum183=== CONT TestScriptTokenEmptyCommand184=== CONT TestScriptTokenEmptyToken185=== RUN TestSetClientTLS/rejects_connection_without_client_cert1862026/10/05 11:22:44 INFO Garbage collection started187=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert188=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths189=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths190=== CONT TestScriptTokenScriptFails191=== RUN TestSetClientTLSErrors/missing_cert_file192=== PAUSE TestSetClientTLSErrors/missing_cert_file193--- PASS: TestDoServerRequestAttachesToken (0.04s)194=== CONT TestStreamPushReportsSignatures195=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon196=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error197=== CONT TestRunGarbageCollection_FinishedOnAnotherReplica198=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error199=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error200=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error201=== CONT TestScriptTokenCachesUntilRefresh202=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error203=== RUN TestConvertHashToNix32/invalid_format204=== PAUSE TestConvertHashToNix32/invalid_format2052026/10/05 11:22:44 ERROR Upload failed error=boom count=1206=== CONT TestStreamPushRequestLine207=== CONT TestStreamPushReportsEveryPath208=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text209=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive210=== RUN TestParsePathInfoJSON/invalid_JSON211=== RUN TestPartSizeForNAR/small_stays_at_minimum212=== PAUSE TestPartSizeForNAR/small_stays_at_minimum213=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive2142026/10/05 11:22:44 ERROR Upload failed error=boom count=1215=== PAUSE TestParsePathInfoJSON/invalid_JSON216=== CONT TestFileTokenReadsAndCaches217=== CONT TestFileTokenEmpty218--- PASS: TestClientSignaturesByStorePath (0.00s)219=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI220=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI221=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha5122222026/10/05 11:22:44 INFO Garbage collection started223=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512224=== CONT TestScriptTokenNoExpiryRerunsEveryCall225=== CONT TestStreamPushBatchesUnderLoad226=== CONT TestFileTokenMissing227=== CONT TestShellSplitErrors228=== CONT TestShellSplit229=== CONT TestEncodeNixBase32/test_string_hash230=== CONT TestEncodeNixBase32/empty_input231=== CONT TestRateLimiterFeedback/429_enables_limiter232=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter233=== RUN TestSetClientTLSErrors/missing_key_file234=== PAUSE TestSetClientTLSErrors/missing_key_file235=== RUN TestSetClientTLSErrors/missing_ca_file236=== PAUSE TestSetClientTLSErrors/missing_ca_file237=== RUN TestSetClientTLSErrors/invalid_ca_file238=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum239=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter2402026/10/05 11:22:44 WARN Rate limiter enabled after throttle name=server-test rate=52412026/10/05 11:22:44 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:39505242=== RUN TestPathInfoCACompatibility/new_structured_format_-_text243=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA2442026/10/05 11:22:44 WARN Rate limiter backed off name=server-test rate=5245=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA246--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.05s)247=== CONT TestRegisterUploadedObjectReusesConnections248=== CONT TestStaticToken249=== PAUSE TestSetClientTLSErrors/invalid_ca_file250=== CONT TestUploadMultipart_SupersededByPeer/exists251=== CONT TestUploadMultipart_SupersededByPeer/missing252=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum253=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts254=== CONT TestFilterOversizedClosures/no_limit_keeps_everything2552026/10/05 11:22:44 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0256=== CONT TestFilterOversizedClosures/all_closures_skipped2572026/10/05 11:22:44 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50258=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths259=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths260=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts261=== CONT TestGetStorePathHash/valid_store_path262=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error263=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error264=== CONT TestConvertHashToNix32/invalid_format265=== RUN TestPartSizeForNAR/1_TiB266=== CONT TestConvertHashToNix32/already_Nix32_format267=== CONT TestParsePathInfoJSON/Nix_format268=== PAUSE TestPartSizeForNAR/1_TiB269=== RUN TestPartSizeForNAR/5_TiB_S3_max_object270=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object271=== RUN TestPartSizeForNAR/capped_at_5_GiB272=== PAUSE TestPartSizeForNAR/capped_at_5_GiB273=== CONT TestParsePathInfoJSON/invalid_JSON274=== CONT TestParsePathInfoJSON/Lix_format275=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)276=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512277=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI278=== CONT TestSetClientTLSErrors/missing_cert_file279=== CONT TestSetClientTLSErrors/missing_ca_file280=== CONT TestSetClientTLSErrors/invalid_ca_file281=== CONT TestSetClientTLSErrors/missing_key_file282=== CONT TestPartSizeForNAR/zero_stays_at_minimum283=== CONT TestPartSizeForNAR/capped_at_5_GiB284=== CONT TestPartSizeForNAR/5_TiB_S3_max_object285=== CONT TestPartSizeForNAR/1_TiB286=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts287=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum288=== CONT TestPartSizeForNAR/small_stays_at_minimum2892026/10/05 11:22:44 WARN Garbage collection finished on another replica. Its statistics are not available here290=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text291=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method292=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method293=== CONT TestPathInfoCACompatibility/null_ca_field294=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon295=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive296=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped2972026/10/05 11:22:44 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000298=== CONT TestConvertHashToNix32/SRI_format_to_Nix32299=== CONT TestGetStorePathHash/basename_without_hyphen_should_error300--- PASS: TestStreamPushGivesUpOnDeadServer (0.04s)301--- PASS: TestScriptTokenEmptyCommand (0.00s)302--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s)303--- PASS: TestStreamPushReportsSignatures (0.00s)304--- PASS: TestStreamPushReportsEveryPath (0.00s)305--- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.04s)306--- PASS: TestFileTokenEmpty (0.00s)307--- PASS: TestShellSplitErrors (0.00s)308--- PASS: TestShellSplit (0.00s)309=== CONT TestRateLimiterFeedback/503_enables_limiter310--- PASS: TestEncodeNixBase32 (0.00s)311 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)312 --- PASS: TestEncodeNixBase32/empty_input (0.00s)313=== CONT TestStreamPushIsolatesFailures314--- PASS: TestFileTokenReadsAndCaches (0.00s)315--- PASS: TestFileTokenMissing (0.00s)316--- PASS: TestStaticToken (0.00s)317=== CONT TestParsePathInfoJSON/whitespace_only318=== CONT TestParsePathInfoJSON/empty_input319=== RUN TestSetClientTLS/preserves_debug_logging_transport320=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method321=== CONT TestPathInfoCACompatibility/new_structured_format_-_text3222026/10/05 11:22:44 ERROR Upload failed error="bad path" count=3323=== PAUSE TestSetClientTLS/preserves_debug_logging_transport3242026/10/05 11:22:44 WARN Rate limiter enabled after throttle name=server-test rate=5325=== CONT TestPathInfoCACompatibility/old_string_format_-_text326--- PASS: TestScriptTokenScriptFails (0.00s)327=== CONT TestSetClientTLS/rejects_connection_without_client_cert328--- PASS: TestScriptTokenEmptyToken (0.00s)329=== CONT TestSetClientTLS/preserves_debug_logging_transport330=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA3312026/10/05 11:22:44 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:37267332--- PASS: TestParsePathInfoJSONMultiplePaths (0.05s)333 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)334 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)335--- PASS: TestScriptTokenBadJSON (0.00s)336--- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.00s)337--- PASS: TestStreamPushIsolatesFailures (0.00s)338--- PASS: TestParsePathInfoJSON (0.05s)339 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)340 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)341 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)342 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)343 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)3442026/10/05 11:22:44 WARN Rate limiter backed off name=server-test rate=5345--- PASS: TestUploadMultipart_SupersededByPeer (0.05s)346 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)347 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s)348--- PASS: TestRateLimiterFeedback (0.04s)349 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)350 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)351 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)352 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.01s)353--- PASS: TestSetClientTLSErrors (0.05s)354 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)355 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)356 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)357 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)358--- PASS: TestPartSizeForNAR (0.05s)359 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)360 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)361 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)362 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)363 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)364 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)365 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)366--- PASS: TestConvertHashToNix32 (0.05s)367 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)368 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)369 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)370--- PASS: TestGetStorePathHash (0.05s)371 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)372 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)373 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)374 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)375--- PASS: TestFilterOversizedClosures (0.05s)376 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)377 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)378 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)379--- PASS: TestPathInfoHashCompatibility (0.05s)380 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)381 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)382 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)383 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)384--- PASS: TestPathInfoCACompatibility (0.05s)385 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)386 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)387 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)388 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)389 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)390--- PASS: TestScriptTokenCachesUntilRefresh (0.02s)391--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.02s)3922026/10/05 11:22:44 http: TLS handshake error from 127.0.0.1:44368: remote error: tls: bad certificate393--- PASS: TestSetClientTLS (0.05s)394 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s)395 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.00s)396 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.02s)397--- PASS: TestStreamPushRequestLine (0.03s)398--- PASS: TestDumpPathSingleFile (0.07s)399--- PASS: TestCaseHackSuffix (0.03s)400--- PASS: TestRegisterUploadedObjectReusesConnections (0.03s)401--- PASS: TestDumpPathWriterError (0.04s)402--- PASS: TestDumpPathMatchesNix (0.12s)403--- PASS: TestStreamPushBatchesUnderLoad (0.10s)404--- PASS: TestUploadMultipart_PartsInParallel (0.66s)405--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)406PASS407Running server tests...408The files belonging to this database system will be owned by user "nixbld".409This user must also own the server process.410411The database cluster will be initialized with locale "C".412The default database encoding has accordingly been set to "SQL_ASCII".413The default text search configuration will be set to "english".414415Data page checksums are enabled.416417creating directory /build/postgres701361425/data ... ok418creating subdirectories ... ok419selecting dynamic shared memory implementation ... posix420selecting default "max_connections" ... 100421selecting default "shared_buffers" ... 128MB422selecting default time zone ... UTC423creating configuration files ... ok424running bootstrap script ... ok425performing post-bootstrap initialization ... ok426syncing data to disk ... ok427428initdb: warning: enabling "trust" authentication for local connections429initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.430431Success. You can now start the database server using:432433 pg_ctl -D /build/postgres701361425/data -l logfile start434435/build/postgres701361425:5432 - no response4362026-10-05 11:22:46.056 UTC [130] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit4372026-10-05 11:22:46.056 UTC [130] LOG: listening on Unix socket "/build/postgres701361425/.s.PGSQL.5432"4382026-10-05 11:22:46.061 UTC [137] LOG: database system was shut down at 2026-10-05 11:22:45 UTC4392026-10-05 11:22:46.078 UTC [130] LOG: database system is ready to accept connections440/build/postgres701361425:5432 - accepting connections441{"timestamp":"2026-10-05T11:22:46.367191823Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"bb1bb11b-41d7-4b41-96d7-10ce4e37dba3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(392)"}442=== RUN TestService_AuthMiddleware443=== PAUSE TestService_AuthMiddleware444=== RUN TestService_AuthMiddleware_MTLSProxyHeader445=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader446=== RUN TestService_AuthMiddleware_MTLSBoundSubjects447=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects448=== RUN TestService_ReadAuthMiddleware449=== PAUSE TestService_ReadAuthMiddleware450=== RUN TestService_AuthMiddleware_OIDC451=== PAUSE TestService_AuthMiddleware_OIDC452=== RUN TestService_RequireScope_OIDC453=== PAUSE TestService_RequireScope_OIDC454=== RUN TestService_ReadScope_PublicByDefault455=== PAUSE TestService_ReadScope_PublicByDefault456=== RUN TestCacheConfigHandler457=== PAUSE TestCacheConfigHandler458=== RUN TestCacheStatsHandler459=== PAUSE TestCacheStatsHandler460=== RUN TestClientCADerivations461=== PAUSE TestClientCADerivations462=== RUN TestClientErrorHandling463=== PAUSE TestClientErrorHandling464=== RUN TestClientIntegration465=== PAUSE TestClientIntegration466=== RUN TestClientMultipleUploads467=== PAUSE TestClientMultipleUploads468=== RUN TestClientWithDependencies469=== PAUSE TestClientWithDependencies470=== RUN TestClientSharedPathCommittedMidPush471=== PAUSE TestClientSharedPathCommittedMidPush472=== RUN TestPinProtectsFromGC473=== PAUSE TestPinProtectsFromGC474=== RUN TestClientPushesUseOnePush475=== PAUSE TestClientPushesUseOnePush476=== RUN TestClientFallsBackToClosures477=== PAUSE TestClientFallsBackToClosures478=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock479=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock480=== RUN TestResolveDBConnectionString481=== PAUSE TestResolveDBConnectionString482=== RUN TestConnectWaitsForAPeerMigration483=== PAUSE TestConnectWaitsForAPeerMigration484=== RUN TestLeadElectsOneAndHandsOver485=== PAUSE TestLeadElectsOneAndHandsOver486=== RUN TestLeadIncumbentWinsAfterRestart4872026/10/05 11:22:46 INFO lead: acquired remote=192.0.2.1:12344882026/10/05 11:22:47 INFO lead: released remote=192.0.2.1:12344892026/10/05 11:22:47 INFO lead: acquired remote=192.0.2.1:12344902026/10/05 11:22:48 INFO lead: released remote=192.0.2.1:1234491--- PASS: TestLeadIncumbentWinsAfterRestart (1.90s)492=== RUN TestLeadIncumbentAnnouncesAtOnce493=== PAUSE TestLeadIncumbentAnnouncesAtOnce494=== RUN TestLeadEndsOnShutdown495=== PAUSE TestLeadEndsOnShutdown496=== RUN TestLeadEndsWhenItsConnectionHangs4972026/10/05 11:22:48 INFO lead: acquired remote=192.0.2.1:12344982026-10-05 11:22:49.893 UTC [574] FATAL: terminating connection due to administrator command4992026/10/05 11:22:50 INFO lead: acquired remote=192.0.2.1:12345002026/10/05 11:22:51 WARN lead: lock connection lost error="timeout: context deadline exceeded"5012026/10/05 11:22:51 INFO lead: released remote=192.0.2.1:12345022026/10/05 11:22:51 INFO lead: released remote=192.0.2.1:1234503--- PASS: TestLeadEndsWhenItsConnectionHangs (2.92s)504=== RUN TestGCAdvisoryLockBlocksConcurrentRun505=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun506=== RUN TestGCBugBareHashReferences507=== PAUSE TestGCBugBareHashReferences508=== RUN TestGCMetrics509=== PAUSE TestGCMetrics510=== RUN TestPushDedupSurvivesConcurrentGC511=== PAUSE TestPushDedupSurvivesConcurrentGC512=== RUN TestDeduplicatedObjectsRecordedAsPending513=== PAUSE TestDeduplicatedObjectsRecordedAsPending514=== RUN TestGCSweepSkipsPendingObjects515=== PAUSE TestGCSweepSkipsPendingObjects516=== RUN TestTombstonedObjectOfferedWithoutWaiting517=== PAUSE TestTombstonedObjectOfferedWithoutWaiting518=== RUN TestGCSweepDeliversEachKeyOnce519=== PAUSE TestGCSweepDeliversEachKeyOnce520=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection521=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection522=== RUN TestForceGCDuringPushOffersSweptObject523=== PAUSE TestForceGCDuringPushOffersSweptObject524=== RUN TestFailedS3DeleteKeepsTombstone525=== PAUSE TestFailedS3DeleteKeepsTombstone526=== RUN TestSweepSkipsRowsLockedByPush527=== PAUSE TestSweepSkipsRowsLockedByPush528=== RUN TestRegisterCompletedObjectNeedsPendingRow529=== PAUSE TestRegisterCompletedObjectNeedsPendingRow530=== RUN TestGetExistingObjectsLocksRows531=== PAUSE TestGetExistingObjectsLocksRows532=== RUN TestSweepRechecksPendingAfterLocking533=== PAUSE TestSweepRechecksPendingAfterLocking534=== RUN TestPushWaitsForSweepHoldingRow535=== PAUSE TestPushWaitsForSweepHoldingRow536=== RUN TestCommitRacingPendingCleanupKeepsObjects537=== PAUSE TestCommitRacingPendingCleanupKeepsObjects538=== RUN TestGCEndsOnShutdown539=== PAUSE TestGCEndsOnShutdown540=== RUN TestGCTaskStore_StartNew541=== PAUSE TestGCTaskStore_StartNew542=== RUN TestGCTaskStore_DeduplicateSameParams543=== PAUSE TestGCTaskStore_DeduplicateSameParams544=== RUN TestGCTaskStore_ConflictDifferentParams545=== PAUSE TestGCTaskStore_ConflictDifferentParams546=== RUN TestGCTaskStore_GetEmpty547=== PAUSE TestGCTaskStore_GetEmpty548=== RUN TestGCTaskStore_GetReturnsLatest549=== PAUSE TestGCTaskStore_GetReturnsLatest550=== RUN TestGCTaskStore_CompletedAllowsNewTask551=== PAUSE TestGCTaskStore_CompletedAllowsNewTask552=== RUN TestGCTaskStore_PhaseUpdates553=== PAUSE TestGCTaskStore_PhaseUpdates554=== RUN TestGCTaskStore_Fail555=== PAUSE TestGCTaskStore_Fail556=== RUN TestGracefulShutdownDrainsInflight557=== PAUSE TestGracefulShutdownDrainsInflight558=== RUN TestService_healthCheckHandler559=== PAUSE TestService_healthCheckHandler560=== RUN TestService_readinessHandler561=== PAUSE TestService_readinessHandler562=== RUN TestGenerateLandingPage563=== PAUSE TestGenerateLandingPage564=== RUN TestCacheConfigHandlerMaxNarSize565=== PAUSE TestCacheConfigHandlerMaxNarSize566=== RUN TestCreatePendingClosureRejectsOversizedNAR567=== PAUSE TestCreatePendingClosureRejectsOversizedNAR568=== RUN TestNARDeduplicationMetadataUploadBug569=== PAUSE TestNARDeduplicationMetadataUploadBug570=== RUN TestMetricsInventory571=== PAUSE TestMetricsInventory572=== RUN TestService_NativeMTLS573=== PAUSE TestService_NativeMTLS574=== RUN TestServerTLSConfig575=== PAUSE TestServerTLSConfig576=== RUN TestMultipartCleanup577=== PAUSE TestMultipartCleanup578=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded579=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded580=== RUN TestPendingCleanupUsesOneCutoff581=== PAUSE TestPendingCleanupUsesOneCutoff582=== RUN TestObjectStatsTrigger583=== PAUSE TestObjectStatsTrigger584=== RUN TestOrphanedObjectsGC585=== PAUSE TestOrphanedObjectsGC586=== RUN TestOrphanedObjectsGCStressTest587=== PAUSE TestOrphanedObjectsGCStressTest588=== RUN TestCreatePin_ReservedPins589=== PAUSE TestCreatePin_ReservedPins590=== RUN TestPresentReportsOnlyClosureRoots591=== PAUSE TestPresentReportsOnlyClosureRoots592=== RUN TestPresentNotReportedWhileGCDeletesClosure593=== PAUSE TestPresentNotReportedWhileGCDeletesClosure594=== RUN TestParseSingleRange595=== PAUSE TestParseSingleRange596=== RUN TestProxyHeadersOnlyTrustedOnSocket597=== PAUSE TestProxyHeadersOnlyTrustedOnSocket598=== RUN TestIsValidCachePath599=== PAUSE TestIsValidCachePath600=== RUN TestReadProxyNarinfo601=== PAUSE TestReadProxyNarinfo602=== RUN TestReadProxyNarinfoAlreadyDecompressed603=== PAUSE TestReadProxyNarinfoAlreadyDecompressed604=== RUN TestReadProxyNarStreaming605=== PAUSE TestReadProxyNarStreaming606=== RUN TestReadProxy404607=== PAUSE TestReadProxy404608=== RUN TestReadProxyInvalidPath609=== PAUSE TestReadProxyInvalidPath610=== RUN TestReadProxyHead611=== PAUSE TestReadProxyHead612=== RUN TestReadProxyOutlastsServerWriteTimeout613=== PAUSE TestReadProxyOutlastsServerWriteTimeout614=== RUN TestReadProxyConditionalGet615=== PAUSE TestReadProxyConditionalGet616=== RUN TestReadProxyRootRedirectsToIndexHTML617=== PAUSE TestReadProxyRootRedirectsToIndexHTML618=== RUN TestReadProxyDisabled619=== PAUSE TestReadProxyDisabled620=== RUN TestReadRedirectNar621=== PAUSE TestReadRedirectNar622=== RUN TestReadRedirectKeepsNarinfoProxied623=== PAUSE TestReadRedirectKeepsNarinfoProxied624=== RUN TestReadProxyRangeRequest625=== PAUSE TestReadProxyRangeRequest626=== RUN TestReadRedirectUsesPublicS3URL627=== PAUSE TestReadRedirectUsesPublicS3URL628=== RUN TestPush_OverlappingRootsStoreOneRowPerKey629=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey630=== RUN TestPush_CompleteCommitsEveryRoot631=== PAUSE TestPush_CompleteCommitsEveryRoot632=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit633=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit634=== RUN TestPush_RejectsBadRequests635=== PAUSE TestPush_RejectsBadRequests636=== RUN TestPush_SignsNarinfosOfItsPendingObjects637=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects638=== RUN TestRedundantMultipartUpload639=== PAUSE TestRedundantMultipartUpload640=== RUN TestCompleteMultipartUpload_ErrorButObjectExists641=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists642=== RUN TestCompletedNarNotReofferedAcrossClosures643=== PAUSE TestCompletedNarNotReofferedAcrossClosures644=== RUN TestPresignedUploadRegisteredBeforeCommit645=== PAUSE TestPresignedUploadRegisteredBeforeCommit646=== RUN TestService_Rustfstest647=== PAUSE TestService_Rustfstest648=== RUN TestParseSize649=== PAUSE TestParseSize650=== RUN TestSkippedUploadsHandler651=== PAUSE TestSkippedUploadsHandler652=== RUN TestSystemdListenerNotActivated653--- PASS: TestSystemdListenerNotActivated (0.00s)654=== RUN TestWatchdogBeatsWhenHealthy655--- PASS: TestWatchdogBeatsWhenHealthy (0.02s)656=== RUN TestWatchdogSkipsWhenUnhealthy6572026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6582026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6592026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6602026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6612026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6622026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6632026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6642026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6652026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6662026/10/05 11:22:51 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"667--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)668=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle669=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle670=== RUN TestProxyWriteTimeout671=== PAUSE TestProxyWriteTimeout672=== RUN TestPendingClosureWriteTimeout673=== PAUSE TestPendingClosureWriteTimeout674=== RUN TestIsValidUploadKey675=== PAUSE TestIsValidUploadKey676=== RUN TestUploadHandlersRejectInvalidKeys677=== PAUSE TestUploadHandlersRejectInvalidKeys678=== RUN TestUploadHandlersRejectOversizedBody679=== PAUSE TestUploadHandlersRejectOversizedBody680=== RUN TestService_cleanupPendingClosuresHandler681=== PAUSE TestService_cleanupPendingClosuresHandler682=== RUN TestService_createPendingClosureHandler683=== PAUSE TestService_createPendingClosureHandler684=== RUN TestService_verifyS3Integrity685=== PAUSE TestService_verifyS3Integrity686=== RUN TestCompleteMultipartUnregistered687=== PAUSE TestCompleteMultipartUnregistered688=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT689=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT690=== CONT TestService_AuthMiddleware691=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT692=== CONT TestTombstonedObjectOfferedWithoutWaiting693=== CONT TestService_NativeMTLS694=== CONT TestMetricsInventory695=== CONT TestNARDeduplicationMetadataUploadBug696=== CONT TestCreatePendingClosureRejectsOversizedNAR697=== CONT TestCacheConfigHandlerMaxNarSize6982026/10/05 11:22:51 INFO Received uploads request method=POST path=/api/pending_closures699=== CONT TestGenerateLandingPage700=== CONT TestGCEndsOnShutdown701=== RUN TestGCEndsOnShutdown/before_the_run702=== CONT TestCommitRacingPendingCleanupKeepsObjects703=== CONT TestPushWaitsForSweepHoldingRow704=== CONT TestSweepRechecksPendingAfterLocking705=== CONT TestGCTaskStore_StartNew706=== CONT TestGetExistingObjectsLocksRows707=== CONT TestService_readinessHandler708=== CONT TestService_healthCheckHandler709=== CONT TestRegisterCompletedObjectNeedsPendingRow710=== CONT TestGracefulShutdownDrainsInflight711=== CONT TestSweepSkipsRowsLockedByPush712=== CONT TestGCTaskStore_Fail713=== CONT TestFailedS3DeleteKeepsTombstone714=== CONT TestGCTaskStore_PhaseUpdates715=== CONT TestServerTLSConfig716--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)717=== CONT TestForceGCDuringPushOffersSweptObject718=== CONT TestGCTaskStore_CompletedAllowsNewTask719=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection720=== CONT TestGCTaskStore_GetReturnsLatest721=== CONT TestGCSweepDeliversEachKeyOnce722--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)723--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)724--- PASS: TestGCTaskStore_StartNew (0.00s)725--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)726--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)727=== RUN TestServerTLSConfig/no_client_CA728=== PAUSE TestServerTLSConfig/no_client_CA729=== RUN TestServerTLSConfig/missing_CA_file730=== PAUSE TestServerTLSConfig/missing_CA_file731=== RUN TestServerTLSConfig/not_a_PEM_file732=== PAUSE TestServerTLSConfig/not_a_PEM_file733=== CONT TestGCTaskStore_GetEmpty734--- PASS: TestGCTaskStore_GetEmpty (0.00s)735=== CONT TestGCTaskStore_DeduplicateSameParams736--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)737=== CONT TestReadProxyRangeRequest738=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows739=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows740=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check741=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check742=== CONT TestService_verifyS3Integrity743--- PASS: TestGCTaskStore_Fail (0.00s)744--- PASS: TestGenerateLandingPage (0.00s)7452026/10/05 11:22:51 INFO Starting HTTP server address=127.0.0.1:41687746=== CONT TestReadProxyNarinfo747=== PAUSE TestGCEndsOnShutdown/before_the_run748=== RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete749=== PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete750=== RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark751=== PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark752=== CONT TestService_createPendingClosureHandler753=== CONT TestGCTaskStore_ConflictDifferentParams7542026/10/05 11:22:51 INFO Shutdown signal received, draining in-flight requests timeout=10s755--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)756=== CONT TestCompleteMultipartUnregistered757=== CONT TestService_cleanupPendingClosuresHandler758--- PASS: TestGracefulShutdownDrainsInflight (0.07s)759=== CONT TestUploadHandlersRejectOversizedBody760=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts761=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts762=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure763=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure764=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart765=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart766=== CONT TestReadRedirectKeepsNarinfoProxied7672026/10/05 11:22:52 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"768--- PASS: TestService_AuthMiddleware (0.57s)769=== CONT TestUploadHandlersRejectInvalidKeys770=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info771=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info772=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal773=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal774=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key775=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key776=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key777=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key778=== CONT TestIsValidUploadKey779=== RUN TestIsValidUploadKey/narinfo780=== PAUSE TestIsValidUploadKey/narinfo781=== RUN TestIsValidUploadKey/nar_zst782=== PAUSE TestIsValidUploadKey/nar_zst783=== RUN TestIsValidUploadKey/nar_xz784=== PAUSE TestIsValidUploadKey/nar_xz785=== RUN TestIsValidUploadKey/nar_plain786=== PAUSE TestIsValidUploadKey/nar_plain787=== RUN TestIsValidUploadKey/listing788=== PAUSE TestIsValidUploadKey/listing789=== RUN TestIsValidUploadKey/build_log790=== PAUSE TestIsValidUploadKey/build_log791=== RUN TestIsValidUploadKey/build_log_home-manager_file792=== PAUSE TestIsValidUploadKey/build_log_home-manager_file793=== RUN TestIsValidUploadKey/build_log_plus_in_name794=== PAUSE TestIsValidUploadKey/build_log_plus_in_name795=== RUN TestIsValidUploadKey/build_log_question_mark796=== PAUSE TestIsValidUploadKey/build_log_question_mark797=== RUN TestIsValidUploadKey/build_log_equals798=== PAUSE TestIsValidUploadKey/build_log_equals799=== RUN TestIsValidUploadKey/realisation800=== PAUSE TestIsValidUploadKey/realisation801=== RUN TestIsValidUploadKey/realisation_plus_in_output802=== PAUSE TestIsValidUploadKey/realisation_plus_in_output803=== RUN TestIsValidUploadKey/nix-cache-info804=== PAUSE TestIsValidUploadKey/nix-cache-info805=== RUN TestIsValidUploadKey/index.html806=== PAUSE TestIsValidUploadKey/index.html807=== RUN TestIsValidUploadKey/narinfo_key,_nar_type808=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type809=== RUN TestIsValidUploadKey/nar_key,_narinfo_type810=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type811=== RUN TestIsValidUploadKey/listing_key,_narinfo_type812=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type813=== RUN TestIsValidUploadKey/traversal814=== PAUSE TestIsValidUploadKey/traversal815=== RUN TestIsValidUploadKey/traversal_nar816=== PAUSE TestIsValidUploadKey/traversal_nar817=== RUN TestIsValidUploadKey/absolute818=== PAUSE TestIsValidUploadKey/absolute819=== RUN TestIsValidUploadKey/empty_key820=== PAUSE TestIsValidUploadKey/empty_key821=== RUN TestIsValidUploadKey/unknown_type822=== PAUSE TestIsValidUploadKey/unknown_type823=== CONT TestPendingClosureWriteTimeout824=== RUN TestPendingClosureWriteTimeout/empty825=== PAUSE TestPendingClosureWriteTimeout/empty826=== RUN TestPendingClosureWriteTimeout/400_objects827=== PAUSE TestPendingClosureWriteTimeout/400_objects828=== RUN TestPendingClosureWriteTimeout/670k_objects829=== PAUSE TestPendingClosureWriteTimeout/670k_objects830=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline831=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline832=== CONT TestProxyWriteTimeout833=== RUN TestProxyWriteTimeout/narinfo834=== PAUSE TestProxyWriteTimeout/narinfo835=== RUN TestProxyWriteTimeout/1_GiB_nar836=== PAUSE TestProxyWriteTimeout/1_GiB_nar837=== RUN TestProxyWriteTimeout/10_GiB_nar838=== PAUSE TestProxyWriteTimeout/10_GiB_nar839=== RUN TestProxyWriteTimeout/unknown_size840=== PAUSE TestProxyWriteTimeout/unknown_size841=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle842--- PASS: TestMetricsInventory (0.61s)843=== CONT TestReadRedirectNar8442026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures8452026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=08462026/10/05 11:22:52 WARN Force mode enabled - objects will be deleted immediately without grace period8472026/10/05 11:22:52 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=0848--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (0.67s)849=== CONT TestSkippedUploadsHandler8502026/10/05 11:22:52 INFO Client skipped oversized paths paths=3 nar_bytes=50000000008512026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures8522026/10/05 11:22:52 INFO Vacuumed table table=pending_closures8532026/10/05 11:22:52 INFO Vacuumed table table=pending_objects8542026/10/05 11:22:52 INFO Vacuumed table table=multipart_uploads8552026/10/05 11:22:52 INFO Vacuumed table table=closures8562026/10/05 11:22:52 INFO Vacuumed table table=objects857--- PASS: TestSkippedUploadsHandler (0.01s)858=== CONT TestParseSize859--- PASS: TestParseSize (0.00s)860=== CONT TestReadProxyDisabled861--- PASS: TestTombstonedObjectOfferedWithoutWaiting (0.68s)862=== CONT TestService_Rustfstest863--- PASS: TestCommitRacingPendingCleanupKeepsObjects (0.68s)864=== CONT TestReadProxyRootRedirectsToIndexHTML8652026/10/05 11:22:52 WARN readiness check failed error="closed pool"866--- PASS: TestService_readinessHandler (0.69s)867=== CONT TestPresignedUploadRegisteredBeforeCommit8682026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures8692026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=08702026/10/05 11:22:52 WARN Force mode enabled - objects will be deleted immediately without grace period8712026/10/05 11:22:52 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=08722026/10/05 11:22:52 INFO Vacuumed table table=pending_closures8732026/10/05 11:22:52 INFO Vacuumed table table=pending_objects8742026/10/05 11:22:52 INFO Vacuumed table table=multipart_uploads8752026/10/05 11:22:52 INFO Vacuumed table table=closures8762026/10/05 11:22:52 INFO Vacuumed table table=objects8772026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=08782026/10/05 11:22:52 WARN Force mode enabled - objects will be deleted immediately without grace period8792026/10/05 11:22:52 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=08802026/10/05 11:22:52 INFO Vacuumed table table=pending_closures8812026/10/05 11:22:52 INFO Vacuumed table table=pending_objects8822026/10/05 11:22:52 INFO Vacuumed table table=multipart_uploads8832026/10/05 11:22:52 INFO Vacuumed table table=closures8842026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=0885--- PASS: TestRegisterCompletedObjectNeedsPendingRow (0.79s)8862026/10/05 11:22:52 INFO Vacuumed table table=objects887=== CONT TestCompletedNarNotReofferedAcrossClosures8882026/10/05 11:22:52 WARN Force mode enabled - objects will be deleted immediately without grace period889--- PASS: TestSweepSkipsRowsLockedByPush (0.80s)890=== CONT TestReadProxyConditionalGet8912026/10/05 11:22:52 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=08922026/10/05 11:22:52 INFO Vacuumed table table=pending_closures8932026/10/05 11:22:52 INFO Vacuumed table table=pending_objects8942026/10/05 11:22:52 INFO Vacuumed table table=multipart_uploads8952026/10/05 11:22:52 INFO Vacuumed table table=closures8962026/10/05 11:22:52 INFO Received complete multipart upload request method=POST path=/api/multipart/complete8972026/10/05 11:22:52 INFO Vacuumed table table=objects898--- PASS: TestGCSweepDeliversEachKeyOnce (0.82s)899=== CONT TestCompleteMultipartUpload_ErrorButObjectExists9002026/10/05 11:22:52 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst901--- PASS: TestCompleteMultipartUnregistered (0.82s)902=== CONT TestReadProxyOutlastsServerWriteTimeout9032026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=09042026/10/05 11:22:52 WARN Force mode enabled - objects will be deleted immediately without grace period9052026/10/05 11:22:52 WARN mTLS auth: subject not in bound subjects subject="CN=reader"9062026/10/05 11:22:52 WARN mTLS auth: subject not in bound subjects subject="CN=reader"907--- PASS: TestService_NativeMTLS (0.85s)908=== CONT TestRedundantMultipartUpload9092026/10/05 11:22:52 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."9102026/10/05 11:22:52 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."911--- PASS: TestFailedS3DeleteKeepsTombstone (0.85s)912=== CONT TestReadProxyHead9132026/10/05 11:22:52 INFO Received cleanup request method=DELETE path=/api/pending_closures9142026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=09152026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9162026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9172026/10/05 11:22:52 INFO Received cleanup request method=DELETE path=/api/pending_closures9182026/10/05 11:22:52 INFO Aborted multipart uploads count=1 kept=09192026/10/05 11:22:52 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete9202026-10-05 11:22:52.441 UTC [659] ERROR: Closure does not exist: id=19212026-10-05 11:22:52.441 UTC [659] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 12 at RAISE9222026-10-05 11:22:52.441 UTC [659] STATEMENT: -- name: CommitPendingClosure :exec923 SELECT commit_pending_closure($1::bigint)924 925--- PASS: TestService_cleanupPendingClosuresHandler (0.91s)926=== CONT TestPush_SignsNarinfosOfItsPendingObjects927--- PASS: TestGetExistingObjectsLocksRows (0.94s)928=== CONT TestReadProxyInvalidPath9292026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9302026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9312026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures932--- PASS: TestReadProxyRangeRequest (0.99s)933=== CONT TestPush_RejectsBadRequests9342026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=09352026/10/05 11:22:52 WARN Force mode enabled - objects will be deleted immediately without grace period9362026/10/05 11:22:52 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=09372026/10/05 11:22:52 INFO Vacuumed table table=pending_closures9382026/10/05 11:22:52 INFO Vacuumed table table=pending_objects9392026/10/05 11:22:52 INFO Vacuumed table table=multipart_uploads9402026/10/05 11:22:52 INFO Vacuumed table table=closures9412026/10/05 11:22:52 INFO Vacuumed table table=objects942--- PASS: TestSweepRechecksPendingAfterLocking (1.06s)943=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit9442026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures945=== NAME TestNARDeduplicationMetadataUploadBug946 metadata_upload_test.go:48: First store path: /build/TestNARDeduplicationMetadataUploadBug1632670334/001/store/3kwvpfwrfxabnl0fvls25slrnr8d2n1p-file1.txt9472026/10/05 11:22:52 ERROR Failed to decompress narinfo error="decompressed size exceeds configured limit"9482026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures949--- PASS: TestService_healthCheckHandler (1.15s)950=== CONT TestReadProxy4049512026/10/05 11:22:52 INFO Received push request method=POST path=/api/pushes9522026/10/05 11:22:52 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)9532026/10/05 11:22:52 INFO Uploading 3kwvpfwrfxabnl0fvls25slrnr8d2n1p-file1.txt (160B)954--- PASS: TestReadRedirectKeepsNarinfoProxied (0.78s)955=== CONT TestPush_CompleteCommitsEveryRoot9562026/10/05 11:22:52 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"9572026/10/05 11:22:52 WARN Failed to register uploaded object key=3kwvpfwrfxabnl0fvls25slrnr8d2n1p.ls error="server returned 404: 404 page not found\n"9582026/10/05 11:22:52 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign9592026/10/05 11:22:52 INFO Signed narinfos id=1 count=19602026/10/05 11:22:52 INFO Uploading 1 narinfos9612026/10/05 11:22:52 INFO Received complete push request method=POST path=/api/pushes/1/complete9622026/10/05 11:22:52 WARN Failed to register uploaded object key=3kwvpfwrfxabnl0fvls25slrnr8d2n1p.narinfo error="server returned 404: 404 page not found\n"9632026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9642026/10/05 11:22:52 INFO Upload complete. (81ms)965=== NAME TestNARDeduplicationMetadataUploadBug966 metadata_upload_test.go:54: Retrieved narinfo from S3:967 StorePath: /build/TestNARDeduplicationMetadataUploadBug1632670334/001/store/3kwvpfwrfxabnl0fvls25slrnr8d2n1p-file1.txt968 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst969 Compression: zstd970 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf971 NarSize: 160972 References: 973 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf974 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)975 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):976 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}977--- PASS: TestReadRedirectNar (0.64s)978=== CONT TestReadProxyNarStreaming979=== NAME TestNARDeduplicationMetadataUploadBug980 metadata_upload_test.go:64: Second store path (same content): /build/TestNARDeduplicationMetadataUploadBug1632670334/001/store/bbm56bkwypkcxm55vk2rp4gm7cs7qdnb-file2.txt981--- PASS: TestReadProxyDisabled (0.59s)982=== CONT TestPush_OverlappingRootsStoreOneRowPerKey983--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (1.29s)984=== CONT TestReadProxyNarinfoAlreadyDecompressed985--- PASS: TestService_Rustfstest (0.62s)986=== CONT TestReadRedirectUsesPublicS3URL9872026/10/05 11:22:52 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9882026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9892026/10/05 11:22:52 INFO Received push request method=POST path=/api/pushes9902026/10/05 11:22:52 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)9912026/10/05 11:22:52 ERROR Refusing narinfo larger than the limit key=5hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216992--- PASS: TestReadProxyNarinfo (1.34s)993=== CONT TestCreatePin_ReservedPins9942026/10/05 11:22:52 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign9952026/10/05 11:22:52 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst9962026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures9972026/10/05 11:22:52 INFO Signed narinfos id=2 count=19982026/10/05 11:22:52 INFO Uploading 1 narinfos9992026/10/05 11:22:52 WARN Failed to register uploaded object key=bbm56bkwypkcxm55vk2rp4gm7cs7qdnb.ls error="server returned 404: 404 page not found\n"1000--- PASS: TestPresignedUploadRegisteredBeforeCommit (0.66s)1001=== CONT TestPinProtectsFromGC10022026/10/05 11:22:52 INFO Received complete push request method=POST path=/api/pushes/2/complete10032026/10/05 11:22:52 WARN Failed to register uploaded object key=bbm56bkwypkcxm55vk2rp4gm7cs7qdnb.narinfo error="server returned 404: 404 page not found\n"10042026/10/05 11:22:52 INFO Upload complete. (62ms)1005--- PASS: TestReadProxyRootRedirectsToIndexHTML (0.68s)1006=== CONT TestIsValidCachePath1007=== RUN TestIsValidCachePath/narinfo1008=== PAUSE TestIsValidCachePath/narinfo1009=== NAME TestNARDeduplicationMetadataUploadBug1010 metadata_upload_test.go:76: Retrieved narinfo from S3:1011 StorePath: /build/TestNARDeduplicationMetadataUploadBug1632670334/001/store/bbm56bkwypkcxm55vk2rp4gm7cs7qdnb-file2.txt1012 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1013 Compression: zstd1014 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1015 NarSize: 1601016 References: 1017 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1018=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1019=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1020=== RUN TestIsValidCachePath/nar_zst1021=== PAUSE TestIsValidCachePath/nar_zst1022=== RUN TestIsValidCachePath/nar_xz1023=== PAUSE TestIsValidCachePath/nar_xz1024=== RUN TestIsValidCachePath/nar_bz21025=== PAUSE TestIsValidCachePath/nar_bz21026=== RUN TestIsValidCachePath/nar_uncompressed1027=== PAUSE TestIsValidCachePath/nar_uncompressed1028=== RUN TestIsValidCachePath/ls1029=== PAUSE TestIsValidCachePath/ls1030=== RUN TestIsValidCachePath/log1031=== PAUSE TestIsValidCachePath/log1032=== RUN TestIsValidCachePath/realisation1033=== PAUSE TestIsValidCachePath/realisation1034=== RUN TestIsValidCachePath/nix-cache-info1035=== PAUSE TestIsValidCachePath/nix-cache-info1036=== RUN TestIsValidCachePath/index.html1037=== PAUSE TestIsValidCachePath/index.html1038=== RUN TestIsValidCachePath/traversal_parent1039=== PAUSE TestIsValidCachePath/traversal_parent1040=== RUN TestIsValidCachePath/traversal_in_middle1041=== PAUSE TestIsValidCachePath/traversal_in_middle1042=== RUN TestIsValidCachePath/invalid_char_e1043=== PAUSE TestIsValidCachePath/invalid_char_e1044=== RUN TestIsValidCachePath/invalid_char_u1045=== PAUSE TestIsValidCachePath/invalid_char_u1046=== RUN TestIsValidCachePath/random_path1047=== PAUSE TestIsValidCachePath/random_path1048=== RUN TestIsValidCachePath/empty1049=== PAUSE TestIsValidCachePath/empty1050=== RUN TestIsValidCachePath/leading_slash1051=== PAUSE TestIsValidCachePath/leading_slash1052=== RUN TestIsValidCachePath/wrong_extension1053=== PAUSE TestIsValidCachePath/wrong_extension1054=== RUN TestIsValidCachePath/short_hash1055=== PAUSE TestIsValidCachePath/short_hash1056=== CONT TestGCSweepSkipsPendingObjects1057=== NAME TestNARDeduplicationMetadataUploadBug1058 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1059 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1060 {"version":1,"root":{"type":"regular","size":44}}1061--- PASS: TestNARDeduplicationMetadataUploadBug (1.37s)1062=== CONT TestProxyHeadersOnlyTrustedOnSocket10632026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures10642026/10/05 11:22:52 INFO Received complete multipart upload request method=POST path=/api/multipart/complete10652026/10/05 11:22:52 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LmQzMDRiZTc0LTQwMDMtNGU5Ny05OTRiLWU0YzhkZGM5M2NjZngxNzkxMTk5MzcyNDQzMzI0NDUz parts=1010662026/10/05 11:22:52 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete10672026/10/05 11:22:52 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:34643/oidc1068--- PASS: TestReadProxyConditionalGet (0.62s)1069=== CONT TestParseSingleRange1070=== RUN TestParseSingleRange/none1071=== PAUSE TestParseSingleRange/none1072=== RUN TestParseSingleRange/unknown_unit1073=== PAUSE TestParseSingleRange/unknown_unit1074=== RUN TestParseSingleRange/multi-range_ignored1075=== PAUSE TestParseSingleRange/multi-range_ignored1076=== RUN TestParseSingleRange/malformed_no_dash1077=== PAUSE TestParseSingleRange/malformed_no_dash1078=== RUN TestParseSingleRange/malformed_both_empty1079=== PAUSE TestParseSingleRange/malformed_both_empty1080=== RUN TestParseSingleRange/malformed_end_before_start1081=== PAUSE TestParseSingleRange/malformed_end_before_start1082=== RUN TestParseSingleRange/closed1083=== PAUSE TestParseSingleRange/closed1084=== RUN TestParseSingleRange/open-ended1085=== PAUSE TestParseSingleRange/open-ended1086=== RUN TestParseSingleRange/end_clamped_to_size10872026/10/05 11:22:52 INFO Completed upload id=11088=== PAUSE TestParseSingleRange/end_clamped_to_size1089=== RUN TestParseSingleRange/suffix1090=== PAUSE TestParseSingleRange/suffix1091=== RUN TestParseSingleRange/suffix_exceeds_size1092=== PAUSE TestParseSingleRange/suffix_exceeds_size1093=== RUN TestParseSingleRange/single_byte1094=== PAUSE TestParseSingleRange/single_byte1095=== RUN TestParseSingleRange/start_past_EOF1096=== PAUSE TestParseSingleRange/start_past_EOF1097=== RUN TestParseSingleRange/start_far_past_EOF10982026/10/05 11:22:52 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1099=== PAUSE TestParseSingleRange/start_far_past_EOF1100=== CONT TestDeduplicatedObjectsRecordedAsPending11012026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures11022026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures11032026/10/05 11:22:52 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo11042026/10/05 11:22:52 WARN Found objects in DB but missing from S3, will re-upload count=11105--- PASS: TestService_verifyS3Integrity (1.43s)1106=== CONT TestPresentNotReportedWhileGCDeletesClosure11072026/10/05 11:22:52 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LjcxMGY0MGViLTc2MzMtNDI1Yy04YmJhLWI2YTJhN2YzNmNiNngxNzkxMTk5MzcyNDk4Njk4ODA4 parts=1011082026/10/05 11:22:52 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete11092026/10/05 11:22:52 INFO Completed upload id=111102026/10/05 11:22:52 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000011112026/10/05 11:22:52 INFO Received uploads request method=POST path=/api/pending_closures11122026/10/05 11:22:52 INFO Starting cleanup of old closures method=DELETE path=/api/closures11132026/10/05 11:22:52 INFO Aborted multipart uploads count=0 kept=011142026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures11152026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011162026/10/05 11:22:53 INFO Vacuumed table table=pending_closures11172026/10/05 11:22:53 INFO Vacuumed table table=pending_objects11182026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads11192026/10/05 11:22:53 INFO Vacuumed table table=closures11202026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures11212026/10/05 11:22:53 INFO Vacuumed table table=objects11222026/10/05 11:22:53 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000001123--- PASS: TestService_createPendingClosureHandler (1.50s)1124=== CONT TestPresentReportsOnlyClosureRoots11252026/10/05 11:22:53 INFO Received complete multipart upload request method=POST path=/api/multipart/complete11262026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures11272026/10/05 11:22:53 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LmU2ZmE5NGI5LTljYTgtNDhiOS1iMTJiLTE2OWIxOWNmZmZhMXgxNzkxMTk5MzczMDE2OTQ3NzUw11282026/10/05 11:22:53 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LmU2ZmE5NGI5LTljYTgtNDhiOS1iMTJiLTE2OWIxOWNmZmZhMXgxNzkxMTk5MzczMDE2OTQ3NzUw parts=11129--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (0.72s)1130=== CONT TestCacheStatsHandler1131--- PASS: TestReadProxyHead (0.72s)1132=== CONT TestPushDedupSurvivesConcurrentGC11332026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes11342026/10/05 11:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign11352026/10/05 11:22:53 INFO Signed narinfos id=1 count=11136--- PASS: TestReadProxyInvalidPath (0.67s)1137--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (0.71s)1138=== CONT TestClientSharedPathCommittedMidPush1139=== CONT TestClientWithDependencies1140--- PASS: TestPushWaitsForSweepHoldingRow (1.65s)1141=== CONT TestGCMetrics1142=== RUN TestPush_RejectsBadRequests/no_roots1143=== PAUSE TestPush_RejectsBadRequests/no_roots1144=== RUN TestPush_RejectsBadRequests/no_objects1145=== PAUSE TestPush_RejectsBadRequests/no_objects1146=== RUN TestPush_RejectsBadRequests/bad_root1147=== PAUSE TestPush_RejectsBadRequests/bad_root1148=== RUN TestPush_RejectsBadRequests/root_not_in_objects1149=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects1150=== CONT TestClientMultipleUploads11512026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes11522026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/1/complete11532026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes1154--- PASS: TestReadProxy404 (0.61s)1155=== CONT TestClientIntegration11562026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes11572026/10/05 11:22:53 INFO Aborted multipart uploads count=0 kept=011582026/10/05 11:22:53 WARN Force mode enabled - objects will be deleted immediately without grace period11592026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/1/complete11602026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=01161--- PASS: TestPush_CompleteCommitsEveryRoot (0.61s)1162=== CONT TestGCBugBareHashReferences11632026/10/05 11:22:53 INFO Vacuumed table table=pending_closures1164--- PASS: TestReadProxyNarStreaming (0.56s)1165=== CONT TestClientErrorHandling1166=== RUN TestClientErrorHandling/InvalidStorePath1167=== PAUSE TestClientErrorHandling/InvalidStorePath1168=== RUN TestClientErrorHandling/InvalidAuthToken1169=== PAUSE TestClientErrorHandling/InvalidAuthToken1170=== RUN TestClientErrorHandling/ServerNotAvailable1171=== PAUSE TestClientErrorHandling/ServerNotAvailable1172=== CONT TestGCAdvisoryLockBlocksConcurrentRun11732026/10/05 11:22:53 INFO Vacuumed table table=pending_objects11742026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads11752026/10/05 11:22:53 INFO Vacuumed table table=closures11762026/10/05 11:22:53 INFO Vacuumed table table=objects11772026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/2/complete11782026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes1179--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (0.77s)1180=== CONT TestClientCADerivations1181--- PASS: TestReadProxyNarinfoAlreadyDecompressed (0.58s)1182=== CONT TestService_AuthMiddleware_OIDC1183--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (0.60s)1184=== CONT TestLeadEndsOnShutdown1185--- PASS: TestReadRedirectUsesPublicS3URL (0.62s)1186=== CONT TestCacheConfigHandler1187=== RUN TestCacheConfigHandler/full_config,_no_issuer1188=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1189=== RUN TestCacheConfigHandler/no_cache_url_configured1190=== PAUSE TestCacheConfigHandler/no_cache_url_configured1191=== RUN TestCacheConfigHandler/no_signing_keys1192=== PAUSE TestCacheConfigHandler/no_signing_keys1193=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1194=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1195=== CONT TestLeadIncumbentAnnouncesAtOnce11962026/10/05 11:22:53 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:44567/oidc11972026/10/05 11:22:53 INFO Starting HTTP server address=127.0.0.1:4203511982026/10/05 11:22:53 INFO Starting HTTP server address=/build/TestProxyHeadersOnlyTrustedOnSocket3821987125/001/proxy.sock11992026/10/05 11:22:53 WARN mTLS auth: subject not in bound subjects subject="CN=someone"12002026/10/05 11:22:53 INFO Shutdown signal received, draining in-flight requests timeout=10s1201--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.60s)1202=== CONT TestService_ReadScope_PublicByDefault12032026/10/05 11:22:53 INFO Received complete multipart upload request method=POST path=/api/multipart/complete12042026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures12052026/10/05 11:22:53 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LmNlMzc0MDQ0LTQxNGUtNDliZi04MmI0LTIxODA5ZTBiOWVkYXgxNzkxMTk5MzcyOTIwMjkzOTYx parts=1212062026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures1207--- PASS: TestCompletedNarNotReofferedAcrossClosures (1.21s)1208=== CONT TestService_RequireScope_OIDC1209=== NAME TestPinProtectsFromGC1210 client_integration_test.go:731: Pinned store path: /build/TestPinProtectsFromGC3194704088/001/store/h9a6iccmxnq9a75jm6a444flnf2l27ak-pinned-file.txt1211 client_integration_test.go:732: Unpinned store path: /build/TestPinProtectsFromGC3194704088/001/store/xqvqcs3gxldq9qfp7s5533dchi5y5126-unpinned-file.txt12122026/10/05 11:22:53 INFO Aborted multipart uploads count=0 kept=012132026/10/05 11:22:53 WARN Force mode enabled - objects will be deleted immediately without grace period12142026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012152026/10/05 11:22:53 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux12162026/10/05 11:22:53 WARN Refused reserved pin name=worker-x86_64-linux12172026/10/05 11:22:53 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux12182026/10/05 11:22:53 INFO Received create pin request method=POST path=/api/pins/my-app12192026/10/05 11:22:53 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1220--- PASS: TestCreatePin_ReservedPins (0.69s)12212026/10/05 11:22:53 INFO Vacuumed table table=pending_closures1222=== CONT TestLeadElectsOneAndHandsOver12232026/10/05 11:22:53 INFO Vacuumed table table=pending_objects12242026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads12252026/10/05 11:22:53 INFO Vacuumed table table=closures12262026/10/05 11:22:53 INFO Vacuumed table table=objects1227--- PASS: TestGCSweepSkipsPendingObjects (0.69s)1228=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock12292026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures1230--- PASS: TestDeduplicatedObjectsRecordedAsPending (0.65s)1231=== CONT TestClientFallsBackToClosures12322026/10/05 11:22:53 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:35837/oidc12332026/10/05 11:22:53 INFO Received complete multipart upload request method=POST path=/api/multipart/complete12342026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes12352026/10/05 11:22:53 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12362026/10/05 11:22:53 INFO Uploading h9a6iccmxnq9a75jm6a444flnf2l27ak-pinned-file.txt (128B)12372026/10/05 11:22:53 WARN Failed to register uploaded object key=h9a6iccmxnq9a75jm6a444flnf2l27ak.ls error="server returned 404: 404 page not found\n"12382026/10/05 11:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12392026/10/05 11:22:53 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"12402026/10/05 11:22:53 INFO Signed narinfos id=1 count=112412026/10/05 11:22:53 INFO Uploading 1 narinfos12422026/10/05 11:22:53 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LmI5MzRhMmMyLTgxN2UtNGEyMC1iMzhmLWM0N2Q3NWI5NzlmOXgxNzkxMTk5MzczMDQ5MjA2NTkw parts=1212432026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures12442026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/1/complete1245--- PASS: TestPresentReportsOnlyClosureRoots (0.61s)12462026/10/05 11:22:53 WARN Failed to register uploaded object key=h9a6iccmxnq9a75jm6a444flnf2l27ak.narinfo error="server returned 404: 404 page not found\n"1247=== CONT TestConnectWaitsForAPeerMigration12482026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures12492026/10/05 11:22:53 INFO Upload complete. (80ms)1250--- PASS: TestCacheStatsHandler (0.62s)1251=== CONT TestClientPushesUseOnePush12522026/10/05 11:22:53 INFO Received uploads request method=POST path=/api/pending_closures12532026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes12542026/10/05 11:22:53 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12552026/10/05 11:22:53 INFO Uploading xqvqcs3gxldq9qfp7s5533dchi5y5126-unpinned-file.txt (128B)12562026/10/05 11:22:53 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"12572026/10/05 11:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign12582026/10/05 11:22:53 INFO Signed narinfos id=2 count=112592026/10/05 11:22:53 WARN Failed to register uploaded object key=xqvqcs3gxldq9qfp7s5533dchi5y5126.ls error="server returned 404: 404 page not found\n"12602026/10/05 11:22:53 INFO Uploading 1 narinfos12612026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/2/complete12622026/10/05 11:22:53 WARN Failed to register uploaded object key=xqvqcs3gxldq9qfp7s5533dchi5y5126.narinfo error="server returned 404: 404 page not found\n"12632026/10/05 11:22:53 INFO Upload complete. (63ms)12642026/10/05 11:22:53 INFO Aborted multipart uploads count=0 kept=012652026/10/05 11:22:53 INFO Starting cleanup of old closures method=DELETE path=/api/closures12662026/10/05 11:22:53 INFO Garbage collection started12672026/10/05 11:22:53 INFO Aborted multipart uploads count=0 kept=012682026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012692026/10/05 11:22:53 INFO Vacuumed table table=pending_closures12702026/10/05 11:22:53 WARN Force mode enabled - objects will be deleted immediately without grace period12712026/10/05 11:22:53 INFO Vacuumed table table=pending_objects12722026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads12732026/10/05 11:22:53 INFO Vacuumed table table=closures12742026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012752026/10/05 11:22:53 INFO Vacuumed table table=objects12762026/10/05 11:22:53 INFO Vacuumed table table=pending_closures12772026/10/05 11:22:53 INFO Vacuumed table table=pending_objects12782026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads12792026/10/05 11:22:53 INFO Vacuumed table table=closures12802026/10/05 11:22:53 INFO Vacuumed table table=objects12812026/10/05 11:22:53 INFO Aborted multipart uploads count=0 kept=012822026/10/05 11:22:53 INFO Aborted multipart uploads count=0 kept=012832026/10/05 11:22:53 WARN Force mode enabled - objects will be deleted immediately without grace period12842026/10/05 11:22:53 WARN Force mode enabled - objects will be deleted immediately without grace period12852026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012862026/10/05 11:22:53 INFO Vacuumed table table=pending_closures12872026/10/05 11:22:53 INFO Vacuumed table table=pending_objects12882026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads12892026/10/05 11:22:53 INFO Vacuumed table table=closures1290--- PASS: TestGCMetrics (0.65s)1291=== CONT TestResolveDBConnectionString1292=== RUN TestResolveDBConnectionString/flag_wins1293=== PAUSE TestResolveDBConnectionString/flag_wins1294=== RUN TestResolveDBConnectionString/file_when_flag_empty1295=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1296=== RUN TestResolveDBConnectionString/missing_file_is_an_error1297=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error12982026/10/05 11:22:53 INFO Vacuumed table table=objects1299=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1300=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1301=== RUN TestResolveDBConnectionString/nothing_configured1302=== PAUSE TestResolveDBConnectionString/nothing_configured1303=== CONT TestService_AuthMiddleware_MTLSBoundSubjects1304--- PASS: TestPushDedupSurvivesConcurrentGC (0.73s)1305=== CONT TestService_ReadAuthMiddleware13062026/10/05 11:22:53 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=013072026/10/05 11:22:53 INFO Vacuumed table table=pending_closures13082026/10/05 11:22:53 INFO Vacuumed table table=pending_objects13092026/10/05 11:22:53 INFO Vacuumed table table=multipart_uploads13102026/10/05 11:22:53 INFO Vacuumed table table=closures13112026/10/05 11:22:53 INFO Vacuumed table table=objects1312=== NAME TestClientWithDependencies1313 client_integration_test.go:613: Built derivation: /build/TestClientWithDependencies1008791187/001/store/pm175jsa91rsn7gvh3ak2yd918h9jcbr-test-script1314=== NAME TestClientMultipleUploads1315 client_integration_test.go:358: Created store path 0: /build/TestClientMultipleUploads1886066694/001/store/rksjfafbk38afaqimam0za3f4kvzhhs3-test-file-0.txt1316=== NAME TestClientWithDependencies1317 client_integration_test.go:615: Found 1 dependencies (including self)1318=== NAME TestClientIntegration1319 client_integration_test.go:286: Created store path: /build/TestClientIntegration3576644611/002/store/k1s4rvkhlcr2w0fxfhfqiipiwcg0bi08-test-file.txt13202026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes13212026/10/05 11:22:53 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)13222026/10/05 11:22:53 INFO Uploading k9cprhfgc79320hi6czl97kfvylr4w5h-top (224B)13232026/10/05 11:22:53 INFO Uploading 1468spq8gf7hg5mb624m1nqfb128agya-shared-dep (136B)1324=== NAME TestClientMultipleUploads1325 client_integration_test.go:358: Created store path 1: /build/TestClientMultipleUploads1886066694/001/store/1xn05apx4qlsiml6zx5lg1c78h8b8g45-test-file-1.txt13262026/10/05 11:22:53 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"13272026/10/05 11:22:53 WARN Failed to register uploaded object key=nar/1hrawzdy798jhz8vfnyc7yj4pqqy91cdkl8dnldmszzg1jxlqcw9.nar.zst error="server returned 404: 404 page not found\n"13282026/10/05 11:22:53 WARN Failed to register uploaded object key=1468spq8gf7hg5mb624m1nqfb128agya.ls error="server returned 404: 404 page not found\n"13292026/10/05 11:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13302026/10/05 11:22:53 WARN Failed to register uploaded object key=k9cprhfgc79320hi6czl97kfvylr4w5h.ls error="server returned 404: 404 page not found\n"13312026/10/05 11:22:53 INFO Signed narinfos id=1 count=213322026/10/05 11:22:53 INFO Uploading 2 narinfos13332026/10/05 11:22:53 ERROR failed to check GC advisory lock error="query pg_locks: failed to connect to `user=nixbld database=niks3`: /nonexistent/.s.PGSQL.5432 (/nonexistent): dial error: dial unix /nonexistent/.s.PGSQL.5432: connect: no such file or directory"1334--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.58s)1335=== CONT TestObjectStatsTrigger13362026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/1/complete13372026/10/05 11:22:53 WARN Failed to register uploaded object key=1468spq8gf7hg5mb624m1nqfb128agya.narinfo error="server returned 404: 404 page not found\n"13382026/10/05 11:22:53 WARN Failed to register uploaded object key=k9cprhfgc79320hi6czl97kfvylr4w5h.narinfo error="server returned 404: 404 page not found\n"13392026/10/05 11:22:53 INFO Upload complete. (71ms)1340=== NAME TestClientSharedPathCommittedMidPush1341 client_integration_test.go:680: Retrieved narinfo from S3:1342 StorePath: /build/TestClientSharedPathCommittedMidPush376147459/001/store/1468spq8gf7hg5mb624m1nqfb128agya-shared-dep1343 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1344 Compression: zstd1345 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821346 NarSize: 1361347 References: 1348 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1349 client_integration_test.go:680: Retrieved narinfo from S3:1350 StorePath: /build/TestClientSharedPathCommittedMidPush376147459/001/store/k9cprhfgc79320hi6czl97kfvylr4w5h-top1351 URL: nar/1hrawzdy798jhz8vfnyc7yj4pqqy91cdkl8dnldmszzg1jxlqcw9.nar.zst1352 Compression: zstd1353 NarHash: sha256:1hrawzdy798jhz8vfnyc7yj4pqqy91cdkl8dnldmszzg1jxlqcw91354 NarSize: 2241355 References: /build/TestClientSharedPathCommittedMidPush376147459/001/store/1468spq8gf7hg5mb624m1nqfb128agya-shared-dep1356 CA: text:sha256:0r0qqrgwzz5wbkx5pd8w6cwi8sqha1zhvn5xfy6w2qc1pn1j9sj71357--- PASS: TestClientSharedPathCommittedMidPush (0.79s)1358=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded1359=== NAME TestClientMultipleUploads1360 client_integration_test.go:358: Created store path 2: /build/TestClientMultipleUploads1886066694/001/store/is6hhfhjqcnwbyywcav3z7qg3a1j818j-test-file-2.txt13612026/10/05 11:22:53 INFO lead: acquired remote=192.0.2.1:123413622026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes13632026/10/05 11:22:53 INFO Received push request method=POST path=/api/pushes13642026/10/05 11:22:53 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13652026/10/05 11:22:53 INFO Uploading k1s4rvkhlcr2w0fxfhfqiipiwcg0bi08-test-file.txt (152B)13662026/10/05 11:22:53 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)13672026/10/05 11:22:53 INFO Uploading pm175jsa91rsn7gvh3ak2yd918h9jcbr-test-script (136B)13682026/10/05 11:22:53 WARN Failed to register uploaded object key=k1s4rvkhlcr2w0fxfhfqiipiwcg0bi08.ls error="server returned 404: 404 page not found\n"13692026/10/05 11:22:53 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"13702026/10/05 11:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13712026/10/05 11:22:53 INFO Signed narinfos id=1 count=113722026/10/05 11:22:53 INFO Uploading 1 narinfos13732026/10/05 11:22:53 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"13742026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/1/complete13752026/10/05 11:22:53 WARN Failed to register uploaded object key=k1s4rvkhlcr2w0fxfhfqiipiwcg0bi08.narinfo error="server returned 404: 404 page not found\n"13762026/10/05 11:22:53 WARN Failed to register uploaded object key=pm175jsa91rsn7gvh3ak2yd918h9jcbr.ls error="server returned 404: 404 page not found\n"13772026/10/05 11:22:53 INFO lead: acquired remote=192.0.2.1:123413782026/10/05 11:22:53 INFO lead: released remote=192.0.2.1:12341379--- PASS: TestLeadIncumbentAnnouncesAtOnce (0.54s)1380=== CONT TestOrphanedObjectsGCStressTest13812026/10/05 11:22:53 WARN Failed to register uploaded object key=log/cg161qbymsmbkliklgl1gzjib13v3g2y-test-script.drv error="server returned 404: 404 page not found\n"13822026/10/05 11:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign13832026/10/05 11:22:53 INFO Signed narinfos id=1 count=113842026/10/05 11:22:53 INFO Uploading 1 narinfos13852026/10/05 11:22:53 INFO Received complete push request method=POST path=/api/pushes/1/complete13862026/10/05 11:22:53 WARN Failed to register uploaded object key=pm175jsa91rsn7gvh3ak2yd918h9jcbr.narinfo error="server returned 404: 404 page not found\n"13872026/10/05 11:22:53 INFO Upload complete. (67ms)13882026/10/05 11:22:54 INFO Upload complete. (74ms)1389=== NAME TestClientWithDependencies1390 client_integration_test.go:617: Skipping nix copy test - isolated store (/build/TestClientWithDependencies1008791187/001/store) requires matching store prefix13912026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes1392--- PASS: TestClientWithDependencies (0.86s)1393=== CONT TestPendingCleanupUsesOneCutoff1394=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1395=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1396=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1397=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1398=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1399=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1400=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1401=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1402=== CONT TestOrphanedObjectsGC14032026/10/05 11:22:54 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)14042026/10/05 11:22:54 INFO Uploading rksjfafbk38afaqimam0za3f4kvzhhs3-test-file-0.txt (160B)14052026/10/05 11:22:54 INFO Uploading is6hhfhjqcnwbyywcav3z7qg3a1j818j-test-file-2.txt (160B)14062026/10/05 11:22:54 INFO Uploading 1xn05apx4qlsiml6zx5lg1c78h8b8g45-test-file-1.txt (160B)14072026/10/05 11:22:54 WARN Failed to register uploaded object key=is6hhfhjqcnwbyywcav3z7qg3a1j818j.ls error="server returned 404: 404 page not found\n"14082026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"1409=== NAME TestClientCADerivations14102026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"1411 client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations1909932343/001/store/h7q3wq5mfdk647xc3b99pbnar28am8la-ca-test14122026/10/05 11:22:54 WARN Failed to register uploaded object key=rksjfafbk38afaqimam0za3f4kvzhhs3.ls error="server returned 404: 404 page not found\n"14132026/10/05 11:22:54 WARN Failed to register uploaded object key=1xn05apx4qlsiml6zx5lg1c78h8b8g45.ls error="server returned 404: 404 page not found\n"14142026/10/05 11:22:54 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign14152026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"14162026/10/05 11:22:54 INFO Signed narinfos id=1 count=314172026/10/05 11:22:54 INFO Uploading 3 narinfos14182026/10/05 11:22:54 WARN Failed to register uploaded object key=rksjfafbk38afaqimam0za3f4kvzhhs3.narinfo error="server returned 404: 404 page not found\n"14192026/10/05 11:22:54 INFO Received complete push request method=POST path=/api/pushes/1/complete14202026/10/05 11:22:54 WARN Failed to register uploaded object key=is6hhfhjqcnwbyywcav3z7qg3a1j818j.narinfo error="server returned 404: 404 page not found\n"14212026/10/05 11:22:54 WARN Failed to register uploaded object key=1xn05apx4qlsiml6zx5lg1c78h8b8g45.narinfo error="server returned 404: 404 page not found\n"14222026/10/05 11:22:54 INFO All 1 paths already cached1423=== NAME TestClientIntegration1424 client_integration_test.go:312: Retrieved narinfo from S3:1425 StorePath: /build/TestClientIntegration3576644611/002/store/k1s4rvkhlcr2w0fxfhfqiipiwcg0bi08-test-file.txt1426 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1427 Compression: zstd1428 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11429 NarSize: 1521430 References: 1431 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11432 client_integration_test.go:313: Retrieved .ls file from S3 (compressed size: 77 bytes)14332026/10/05 11:22:54 INFO Upload complete. (65ms)1434 client_integration_test.go:313: Decompressed .ls content (64 bytes):1435 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}1436 client_integration_test.go:316: Testing garbage collection...1437=== NAME TestClientMultipleUploads1438 client_integration_test.go:369: Uploaded 3 paths in 96.303839ms1439--- PASS: TestService_ReadScope_PublicByDefault (0.55s)1440=== CONT TestService_AuthMiddleware_MTLSProxyHeader1441--- PASS: TestClientMultipleUploads (0.87s)1442=== CONT TestMultipartCleanup1443=== NAME TestClientCADerivations1444 client_ca_test.go:139: Found 1 dependencies (including self)14452026/10/05 11:22:54 INFO lead: acquired remote=192.0.2.1:123414462026/10/05 11:22:54 INFO Starting cleanup of old closures method=DELETE path=/api/closures14472026/10/05 11:22:54 INFO Garbage collection started14482026/10/05 11:22:54 INFO Aborted multipart uploads count=0 kept=014492026/10/05 11:22:54 WARN Force mode enabled - objects will be deleted immediately without grace period14502026/10/05 11:22:54 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=01451--- PASS: TestGCBugBareHashReferences (0.78s)1452=== CONT TestServerTLSConfig/no_client_CA1453=== CONT TestServerTLSConfig/not_a_PEM_file1454=== CONT TestServerTLSConfig/missing_CA_file1455--- PASS: TestServerTLSConfig (0.00s)1456 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1457 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)1458 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1459=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows14602026/10/05 11:22:54 INFO Vacuumed table table=pending_closures14612026/10/05 11:22:54 INFO Vacuumed table table=pending_objects14622026/10/05 11:22:54 INFO Vacuumed table table=multipart_uploads1463--- PASS: TestPresentNotReportedWhileGCDeletesClosure (1.16s)1464=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check14652026/10/05 11:22:54 INFO Vacuumed table table=closures14662026/10/05 11:22:54 INFO Vacuumed table table=objects1467=== RUN TestService_RequireScope_OIDC/builder_may_write1468=== PAUSE TestService_RequireScope_OIDC/builder_may_write1469=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1470=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1471=== RUN TestService_RequireScope_OIDC/ops_may_admin1472=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1473=== RUN TestService_RequireScope_OIDC/ops_may_not_write1474=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1475=== RUN TestService_RequireScope_OIDC/reader_may_not_write1476=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1477=== RUN TestService_RequireScope_OIDC/static_token_may_admin1478=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1479=== RUN TestService_RequireScope_OIDC/static_token_may_write1480=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1481=== RUN TestService_RequireScope_OIDC/reader_may_read1482=== PAUSE TestService_RequireScope_OIDC/reader_may_read1483=== RUN TestService_RequireScope_OIDC/writer_implies_read1484=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1485=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1486=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1487=== RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1488=== PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1489=== RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1490=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1491=== RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1492=== PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1493=== RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1494=== PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1495=== CONT TestGCEndsOnShutdown/before_the_run14962026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes14972026/10/05 11:22:54 INFO Received complete multipart upload request method=POST path=/api/multipart/complete14982026/10/05 11:22:54 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)14992026/10/05 11:22:54 INFO Uploading h7q3wq5mfdk647xc3b99pbnar28am8la-ca-test (144B)15002026/10/05 11:22:54 WARN Failed to register uploaded object key=h7q3wq5mfdk647xc3b99pbnar28am8la.ls error="server returned 404: 404 page not found\n"15012026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"15022026/10/05 11:22:54 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15032026/10/05 11:22:54 WARN Failed to register uploaded object key=log/pnv04k5rnmliqvxj0kfa3f0v6rf8jd9w-ca-test.drv error="server returned 404: 404 page not found\n"15042026/10/05 11:22:54 INFO Signed narinfos id=1 count=115052026/10/05 11:22:54 INFO Uploading 1 narinfos15062026/10/05 11:22:54 WARN Failed to abort redundant multipart upload, keeping its row object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LjcyMTU1MDhjLWE1MzMtNDdiYS1hNmI5LTRmZDZhNDg5NjkzY3gxNzkxMTk5MzczNjYxMDQ0MDAz error="Get \"http://127.0.0.1:1/bucket37/?location=\": dial tcp 127.0.0.1:1: connect: connection refused"15072026/10/05 11:22:54 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=MzlkZDY1ZGEtMzJmMS00NTUxLThhNTYtMzMyZWNiZTk2MWE5LjhkYzY3YTllLTBkNTQtNGZkOC04MDZjLTE1NjFhYTI3ODhlZHgxNzkxMTk5MzczNjUzMDU3MzE4 parts=1215082026/10/05 11:22:54 INFO Received complete push request method=POST path=/api/pushes/1/complete15092026/10/05 11:22:54 WARN Failed to register uploaded object key=h7q3wq5mfdk647xc3b99pbnar28am8la.narinfo error="server returned 404: 404 page not found\n"15102026/10/05 11:22:54 INFO Received cleanup request method=DELETE path=/api/pending_closures15112026/10/05 11:22:54 INFO Aborted multipart uploads count=1 kept=015122026/10/05 11:22:54 INFO Upload complete. (110ms)1513=== NAME TestClientCADerivations1514 client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations1909932343/001/store/h7q3wq5mfdk647xc3b99pbnar28am8la-ca-test1515 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1516 Compression: zstd1517 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1518 NarSize: 1441519 References: 1520 Deriver: /build/TestClientCADerivations1909932343/001/store/pnv04k5rnmliqvxj0kfa3f0v6rf8jd9w-ca-test.drv1521 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1522 client_ca_test.go:185: Checking for realisation files in S3...1523--- PASS: TestRedundantMultipartUpload (1.83s)1524=== NAME TestClientCADerivations1525 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations1526 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache1527=== CONT TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark15282026/10/05 11:22:54 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"15292026/10/05 11:22:54 WARN mTLS auth: bound subjects configured but subject DN unavailable15302026/10/05 11:22:54 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1531--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (0.39s)1532=== CONT TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete1533--- PASS: TestService_ReadAuthMiddleware (0.41s)1534=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts15352026/10/05 11:22:54 INFO Received request for more parts method=POST path=/1536=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart15372026/10/05 11:22:54 INFO Received complete multipart upload request method=POST path=/1538--- PASS: TestObjectStatsTrigger (0.37s)1539=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure15402026/10/05 11:22:54 INFO Received uploads request method=POST path=/15412026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures1542--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (0.36s)1543=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info15442026/10/05 11:22:54 INFO Received uploads request method=POST path=/1545=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key15462026/10/05 11:22:54 INFO Received complete multipart upload request method=POST path=/1547=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key15482026/10/05 11:22:54 INFO Received request for more parts method=POST path=/1549=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal15502026/10/05 11:22:54 INFO Received uploads request method=POST path=/1551--- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)1552 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)1553 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)1554 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)1555 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)1556=== CONT TestIsValidUploadKey/narinfo1557=== CONT TestIsValidUploadKey/realisation_plus_in_output1558=== CONT TestIsValidUploadKey/unknown_type1559=== CONT TestIsValidUploadKey/empty_key1560=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1561=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1562=== CONT TestIsValidUploadKey/index.html1563=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1564=== CONT TestIsValidUploadKey/nix-cache-info1565=== CONT TestIsValidUploadKey/absolute1566=== CONT TestIsValidUploadKey/traversal_nar1567=== CONT TestIsValidUploadKey/traversal1568=== CONT TestIsValidUploadKey/build_log_home-manager_file1569=== CONT TestIsValidUploadKey/realisation1570=== CONT TestIsValidUploadKey/build_log_equals1571=== CONT TestIsValidUploadKey/build_log_question_mark1572=== CONT TestIsValidUploadKey/build_log_plus_in_name1573=== CONT TestIsValidUploadKey/build_log1574=== CONT TestIsValidUploadKey/nar_plain1575=== CONT TestIsValidUploadKey/nar_xz1576=== CONT TestIsValidUploadKey/listing1577=== CONT TestIsValidUploadKey/nar_zst1578--- PASS: TestIsValidUploadKey (0.00s)1579 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1580 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1581 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1582 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1583 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1584 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1585 --- PASS: TestIsValidUploadKey/index.html (0.00s)1586 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1587 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1588 --- PASS: TestIsValidUploadKey/absolute (0.00s)1589 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1590 --- PASS: TestIsValidUploadKey/traversal (0.00s)1591 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1592 --- PASS: TestIsValidUploadKey/realisation (0.00s)1593 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1594 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1595 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1596 --- PASS: TestIsValidUploadKey/build_log (0.00s)1597 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1598 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1599 --- PASS: TestIsValidUploadKey/listing (0.00s)1600 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)1601=== CONT TestPendingClosureWriteTimeout/empty1602=== CONT TestPendingClosureWriteTimeout/670k_objects1603=== CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1604=== CONT TestPendingClosureWriteTimeout/400_objects1605=== CONT TestProxyWriteTimeout/narinfo1606=== CONT TestProxyWriteTimeout/10_GiB_nar1607=== CONT TestProxyWriteTimeout/unknown_size1608=== CONT TestProxyWriteTimeout/1_GiB_nar1609--- PASS: TestProxyWriteTimeout (0.00s)1610 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)1611 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)1612 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)1613 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)1614=== CONT TestIsValidCachePath/narinfo1615=== CONT TestIsValidCachePath/index.html1616=== CONT TestIsValidCachePath/nix-cache-info1617=== CONT TestIsValidCachePath/realisation1618=== CONT TestIsValidCachePath/log1619=== CONT TestIsValidCachePath/ls1620=== CONT TestIsValidCachePath/nar_uncompressed1621=== CONT TestIsValidCachePath/nar_bz21622=== CONT TestIsValidCachePath/nar_xz1623=== CONT TestIsValidCachePath/nar_zst1624=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1625=== CONT TestIsValidCachePath/traversal_parent1626=== CONT TestIsValidCachePath/empty1627=== CONT TestIsValidCachePath/leading_slash1628=== CONT TestIsValidCachePath/random_path1629=== CONT TestIsValidCachePath/short_hash1630=== CONT TestIsValidCachePath/invalid_char_u1631=== CONT TestIsValidCachePath/wrong_extension1632=== CONT TestIsValidCachePath/invalid_char_e1633=== CONT TestIsValidCachePath/traversal_in_middle1634--- PASS: TestIsValidCachePath (0.00s)1635 --- PASS: TestIsValidCachePath/narinfo (0.00s)1636 --- PASS: TestIsValidCachePath/index.html (0.00s)1637 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1638 --- PASS: TestIsValidCachePath/realisation (0.00s)1639 --- PASS: TestIsValidCachePath/log (0.00s)1640 --- PASS: TestIsValidCachePath/ls (0.00s)1641 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1642 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1643 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1644 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1645 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1646 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1647 --- PASS: TestIsValidCachePath/empty (0.00s)1648 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1649 --- PASS: TestIsValidCachePath/random_path (0.00s)1650 --- PASS: TestIsValidCachePath/short_hash (0.00s)1651 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1652 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1653 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1654 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1655=== CONT TestParseSingleRange/none1656=== CONT TestParseSingleRange/open-ended1657=== CONT TestParseSingleRange/start_far_past_EOF1658=== CONT TestParseSingleRange/start_past_EOF1659=== CONT TestParseSingleRange/single_byte1660=== CONT TestParseSingleRange/suffix_exceeds_size1661=== CONT TestParseSingleRange/suffix1662=== CONT TestParseSingleRange/end_clamped_to_size1663=== CONT TestParseSingleRange/malformed_both_empty1664=== CONT TestParseSingleRange/closed1665=== CONT TestParseSingleRange/malformed_end_before_start1666=== CONT TestParseSingleRange/multi-range_ignored1667=== CONT TestParseSingleRange/malformed_no_dash1668=== CONT TestParseSingleRange/unknown_unit1669--- PASS: TestParseSingleRange (0.00s)1670 --- PASS: TestParseSingleRange/none (0.00s)1671 --- PASS: TestParseSingleRange/open-ended (0.00s)1672 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1673 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1674 --- PASS: TestParseSingleRange/single_byte (0.00s)1675 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1676 --- PASS: TestParseSingleRange/suffix (0.00s)1677 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1678 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1679 --- PASS: TestParseSingleRange/closed (0.00s)1680 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1681 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1682 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1683 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1684=== CONT TestPush_RejectsBadRequests/no_roots16852026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes1686=== CONT TestPush_RejectsBadRequests/bad_root16872026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes1688=== CONT TestPush_RejectsBadRequests/root_not_in_objects16892026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes1690=== CONT TestPush_RejectsBadRequests/no_objects16912026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes1692=== CONT TestClientErrorHandling/InvalidStorePath1693--- PASS: TestPush_RejectsBadRequests (0.65s)1694 --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)1695 --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)1696 --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.00s)1697 --- PASS: TestPush_RejectsBadRequests/no_objects (0.00s)1698=== NAME TestClientCADerivations1699 client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features1700 warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable1701 error: binary cache 's3://bucket65?endpoint=http://localhost:34857®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations1909932343/001/store'1702 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 11703--- PASS: TestClientCADerivations (0.97s)1704=== CONT TestClientErrorHandling/ServerNotAvailable17052026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures17062026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures17072026/10/05 11:22:54 INFO Received cleanup request method=DELETE path=/api/pending_closures17082026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures17092026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures17102026/10/05 11:22:54 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)17112026/10/05 11:22:54 INFO Uploading k95fhqyq1z89yk7gc9dh1mm157y939n4-shared-dep (136B)17122026/10/05 11:22:54 INFO Uploading dhb8h8jw5jnky6divv9m1wj5fxnjizlf-a (216B)17132026/10/05 11:22:54 WARN Failed to register uploaded object key=k95fhqyq1z89yk7gc9dh1mm157y939n4.ls error="server returned 404: 404 page not found\n"17142026/10/05 11:22:54 WARN Failed to register uploaded object key=38n6s3qgx3p510s19hd47p85xdmyc8xa.ls error="server returned 404: 404 page not found\n"17152026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"17162026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/1jb0f7fv735bz1574isi3fqhyjyq2gifc0zhka0a0bmcj5hwbwh0.nar.zst error="server returned 404: 404 page not found\n"17172026/10/05 11:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign17182026/10/05 11:22:54 WARN Failed to register uploaded object key=dhb8h8jw5jnky6divv9m1wj5fxnjizlf.ls error="server returned 404: 404 page not found\n"17192026/10/05 11:22:54 INFO Signed narinfos id=1 count=217202026/10/05 11:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign17212026/10/05 11:22:54 INFO Signed narinfos id=2 count=217222026/10/05 11:22:54 INFO Uploading 4 narinfos17232026/10/05 11:22:54 WARN Failed to register uploaded object key=38n6s3qgx3p510s19hd47p85xdmyc8xa.narinfo error="server returned 404: 404 page not found\n"17242026/10/05 11:22:54 WARN Failed to register uploaded object key=dhb8h8jw5jnky6divv9m1wj5fxnjizlf.narinfo error="server returned 404: 404 page not found\n"17252026/10/05 11:22:54 WARN Failed to register uploaded object key=k95fhqyq1z89yk7gc9dh1mm157y939n4.narinfo error="server returned 404: 404 page not found\n"17262026/10/05 11:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete17272026/10/05 11:22:54 WARN Failed to register uploaded object key=k95fhqyq1z89yk7gc9dh1mm157y939n4.narinfo error="server returned 404: 404 page not found\n"1728--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (0.34s)1729=== CONT TestClientErrorHandling/InvalidAuthToken17302026/10/05 11:22:54 INFO Completed upload id=117312026/10/05 11:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete17322026/10/05 11:22:54 INFO Completed upload id=217332026/10/05 11:22:54 INFO Upload complete. (80ms)1734=== NAME TestClientFallsBackToClosures1735 client_pushes_test.go:112: Retrieved narinfo from S3:1736 StorePath: /build/TestClientFallsBackToClosures2401061317/001/store/k95fhqyq1z89yk7gc9dh1mm157y939n4-shared-dep1737 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1738 Compression: zstd1739 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821740 NarSize: 1361741 References: 1742 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1743 client_pushes_test.go:112: Retrieved narinfo from S3:1744 StorePath: /build/TestClientFallsBackToClosures2401061317/001/store/dhb8h8jw5jnky6divv9m1wj5fxnjizlf-a1745 URL: nar/1jb0f7fv735bz1574isi3fqhyjyq2gifc0zhka0a0bmcj5hwbwh0.nar.zst1746 Compression: zstd1747 NarHash: sha256:1jb0f7fv735bz1574isi3fqhyjyq2gifc0zhka0a0bmcj5hwbwh01748 NarSize: 2161749 References: /build/TestClientFallsBackToClosures2401061317/001/store/k95fhqyq1z89yk7gc9dh1mm157y939n4-shared-dep1750 CA: text:sha256:1hp4ahzb822i2in0kjniwjgagrdm9ykj7bmcnfbnrr4wkx8a5rv61751 client_pushes_test.go:112: Retrieved narinfo from S3:1752 StorePath: /build/TestClientFallsBackToClosures2401061317/001/store/38n6s3qgx3p510s19hd47p85xdmyc8xa-b1753 URL: nar/1jb0f7fv735bz1574isi3fqhyjyq2gifc0zhka0a0bmcj5hwbwh0.nar.zst1754 Compression: zstd1755 NarHash: sha256:1jb0f7fv735bz1574isi3fqhyjyq2gifc0zhka0a0bmcj5hwbwh01756 NarSize: 2161757 References: /build/TestClientFallsBackToClosures2401061317/001/store/k95fhqyq1z89yk7gc9dh1mm157y939n4-shared-dep1758 CA: text:sha256:1hp4ahzb822i2in0kjniwjgagrdm9ykj7bmcnfbnrr4wkx8a5rv617592026/10/05 11:22:54 INFO Received push request method=POST path=/api/pushes1760--- PASS: TestClientFallsBackToClosures (0.81s)1761=== CONT TestCacheConfigHandler/full_config,_no_issuer1762=== CONT TestCacheConfigHandler/no_signing_keys1763=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1764=== CONT TestCacheConfigHandler/no_cache_url_configured1765=== CONT TestResolveDBConnectionString/flag_wins1766=== CONT TestResolveDBConnectionString/PGHOST_allows_empty1767=== CONT TestResolveDBConnectionString/nothing_configured1768=== CONT TestResolveDBConnectionString/missing_file_is_an_error1769--- PASS: TestCacheConfigHandler (0.00s)1770 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1771 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1772 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1773 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)17742026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures1775=== CONT TestResolveDBConnectionString/file_when_flag_empty1776=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token1777--- PASS: TestResolveDBConnectionString (0.00s)1778 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1779 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1780 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1781 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1782 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)1783=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected17842026/10/05 11:22:54 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1785=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1786=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected17872026/10/05 11:22:54 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)17882026/10/05 11:22:54 INFO Uploading z3dgh8q2m3273sgrpvag47x9bqjx8gib-a (216B)17892026/10/05 11:22:54 INFO Uploading s8idqnp4yypad7mw8x9yy89k2gdb58gg-shared-dep (136B)17902026/10/05 11:22:54 WARN Authentication failed token_preview=eyJhbGciOi...wGIXFaRlLw token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]1791=== CONT TestService_RequireScope_OIDC/builder_may_write1792--- PASS: TestService_AuthMiddleware_OIDC (0.62s)1793 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.00s)1794 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)1795 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)1796 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)17972026/10/05 11:22:54 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1798=== CONT TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read17992026/10/05 11:22:54 WARN Authentication failed token_preview=wrong token_length=5 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1800=== CONT TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1801=== CONT TestService_RequireScope_OIDC/reader_may_read_with_netrc1802=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read1803=== CONT TestService_RequireScope_OIDC/writer_implies_read1804=== CONT TestService_RequireScope_OIDC/reader_may_read1805=== CONT TestService_RequireScope_OIDC/static_token_may_write1806=== CONT TestService_RequireScope_OIDC/static_token_may_admin1807=== CONT TestService_RequireScope_OIDC/reader_may_not_write1808=== CONT TestService_RequireScope_OIDC/ops_may_not_write1809=== CONT TestService_RequireScope_OIDC/ops_may_admin1810=== CONT TestService_RequireScope_OIDC/builder_may_not_admin1811=== CONT TestService_RequireScope_OIDC/empty_netrc_password_may_not_read18122026/10/05 11:22:54 WARN Failed to register uploaded object key=sam7f3qwj4ys1ixd7jm5bry67j8hsb6f.ls error="server returned 404: 404 page not found\n"18132026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/1ar3aa6dpfcds4xaasz64lxkc5j2al2jm9cibd60c942fx88z5f4.nar.zst error="server returned 404: 404 page not found\n"18142026/10/05 11:22:54 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"18152026/10/05 11:22:54 WARN Failed to register uploaded object key=z3dgh8q2m3273sgrpvag47x9bqjx8gib.ls error="server returned 404: 404 page not found\n"1816--- PASS: TestService_RequireScope_OIDC (0.61s)1817 --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)1818 --- PASS: TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read (0.00s)1819 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin_with_netrc (0.00s)1820 --- PASS: TestService_RequireScope_OIDC/reader_may_read_with_netrc (0.00s)1821 --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)1822 --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)1823 --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)1824 --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)1825 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)1826 --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)1827 --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)1828 --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)1829 --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)1830 --- PASS: TestService_RequireScope_OIDC/empty_netrc_password_may_not_read (0.00s)18312026/10/05 11:22:54 WARN Failed to register uploaded object key=s8idqnp4yypad7mw8x9yy89k2gdb58gg.ls error="server returned 404: 404 page not found\n"18322026/10/05 11:22:54 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign18332026/10/05 11:22:54 INFO Signed narinfos id=1 count=318342026/10/05 11:22:54 INFO Uploading 3 narinfos18352026/10/05 11:22:54 INFO Received complete push request method=POST path=/api/pushes/1/complete18362026/10/05 11:22:54 WARN Failed to register uploaded object key=s8idqnp4yypad7mw8x9yy89k2gdb58gg.narinfo error="server returned 404: 404 page not found\n"18372026/10/05 11:22:54 WARN Failed to register uploaded object key=z3dgh8q2m3273sgrpvag47x9bqjx8gib.narinfo error="server returned 404: 404 page not found\n"18382026/10/05 11:22:54 WARN Failed to register uploaded object key=sam7f3qwj4ys1ixd7jm5bry67j8hsb6f.narinfo error="server returned 404: 404 page not found\n"18392026/10/05 11:22:54 INFO Upload complete. (67ms)1840=== NAME TestClientPushesUseOnePush1841 client_pushes_test.go:97: Retrieved narinfo from S3:1842 StorePath: /build/TestClientPushesUseOnePush2222626464/001/store/s8idqnp4yypad7mw8x9yy89k2gdb58gg-shared-dep1843 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1844 Compression: zstd1845 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821846 NarSize: 1361847 References: 1848 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1849 client_pushes_test.go:97: Retrieved narinfo from S3:1850 StorePath: /build/TestClientPushesUseOnePush2222626464/001/store/z3dgh8q2m3273sgrpvag47x9bqjx8gib-a1851 URL: nar/1ar3aa6dpfcds4xaasz64lxkc5j2al2jm9cibd60c942fx88z5f4.nar.zst1852 Compression: zstd1853 NarHash: sha256:1ar3aa6dpfcds4xaasz64lxkc5j2al2jm9cibd60c942fx88z5f41854 NarSize: 2161855 References: /build/TestClientPushesUseOnePush2222626464/001/store/s8idqnp4yypad7mw8x9yy89k2gdb58gg-shared-dep1856 CA: text:sha256:0s6d8pifk1di02zsy0yma35gs9nagfmh669cmdhz5wb02rad95ri1857 client_pushes_test.go:97: Retrieved narinfo from S3:1858 StorePath: /build/TestClientPushesUseOnePush2222626464/001/store/sam7f3qwj4ys1ixd7jm5bry67j8hsb6f-b1859 URL: nar/1ar3aa6dpfcds4xaasz64lxkc5j2al2jm9cibd60c942fx88z5f4.nar.zst1860 Compression: zstd1861 NarHash: sha256:1ar3aa6dpfcds4xaasz64lxkc5j2al2jm9cibd60c942fx88z5f41862 NarSize: 2161863 References: /build/TestClientPushesUseOnePush2222626464/001/store/s8idqnp4yypad7mw8x9yy89k2gdb58gg-shared-dep1864 CA: text:sha256:0s6d8pifk1di02zsy0yma35gs9nagfmh669cmdhz5wb02rad95ri18652026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures1866--- PASS: TestClientPushesUseOnePush (0.75s)18672026/10/05 11:22:54 INFO Aborted multipart uploads count=0 kept=01868--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (0.87s)18692026/10/05 11:22:54 WARN Force mode enabled - objects will be deleted immediately without grace period18702026/10/05 11:22:54 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=1 objects-deleted-after-grace-period=1 objects-failed-to-delete=018712026/10/05 11:22:54 INFO Vacuumed table table=pending_closures18722026/10/05 11:22:54 INFO Vacuumed table table=pending_objects18732026/10/05 11:22:54 INFO Vacuumed table table=multipart_uploads18742026/10/05 11:22:54 INFO Vacuumed table table=closures18752026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures18762026/10/05 11:22:54 INFO Vacuumed table table=objects18772026/10/05 11:22:54 INFO Aborted multipart uploads count=0 kept=018782026/10/05 11:22:54 WARN Force mode enabled - objects will be deleted immediately without grace period18792026/10/05 11:22:54 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=018802026/10/05 11:22:54 INFO Vacuumed table table=pending_closures18812026/10/05 11:22:54 INFO Vacuumed table table=pending_objects18822026/10/05 11:22:54 INFO Vacuumed table table=multipart_uploads18832026/10/05 11:22:54 INFO Vacuumed table table=closures18842026/10/05 11:22:54 INFO Vacuumed table table=objects1885--- PASS: TestForceGCDuringPushOffersSweptObject (0.00s)1886 --- PASS: TestForceGCDuringPushOffersSweptObject/before_pending_rows (0.37s)1887 --- PASS: TestForceGCDuringPushOffersSweptObject/after_presence_check (0.38s)18882026/10/05 11:22:54 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=191.641626ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18892026/10/05 11:22:54 INFO Received cleanup request method=DELETE path=/api/pending_closures18902026/10/05 11:22:54 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket83/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""18912026/10/05 11:22:54 INFO Aborted multipart uploads count=0 kept=118922026/10/05 11:22:54 INFO Aborted multipart uploads count=0 kept=018932026/10/05 11:22:54 INFO Received cleanup request method=DELETE path=/api/pending_closures18942026/10/05 11:22:54 WARN Force mode enabled - objects will be deleted immediately without grace period18952026/10/05 11:22:54 INFO Aborted multipart uploads count=1 kept=01896--- PASS: TestMultipartCleanup (0.48s)18972026/10/05 11:22:54 INFO Aborted multipart uploads count=0 kept=018982026/10/05 11:22:54 WARN Force mode enabled - objects will be deleted immediately without grace period18992026/10/05 11:22:54 ERROR failed to remove object object=nar/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.nar.zst error="Post \"http://localhost:34857/bucket88/?delete=\": context canceled"1900--- PASS: TestGCEndsOnShutdown (0.01s)1901 --- PASS: TestGCEndsOnShutdown/before_the_run (0.34s)1902 --- PASS: TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark (0.33s)1903 --- PASS: TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete (0.34s)19042026/10/05 11:22:54 INFO Received uploads request method=POST path=/api/pending_closures1905=== NAME TestOrphanedObjectsGC1906 orphaned_objects_gc_test.go:290: GC Test Summary:1907 orphaned_objects_gc_test.go:291: - Kept: 2 objects from closure A1908 orphaned_objects_gc_test.go:292: - Deleted: 2 objects from closure B1909 orphaned_objects_gc_test.go:293: - Deleted: 6 orphaned chain objects (X1->X2->X3)1910 orphaned_objects_gc_test.go:294: - Deleted: 2 orphaned single objects (Y)1911 orphaned_objects_gc_test.go:295: - Total deleted: 10 objects1912--- PASS: TestOrphanedObjectsGC (0.66s)19132026/10/05 11:22:54 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"19142026/10/05 11:22:54 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=391.339779ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present19152026/10/05 11:22:54 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"1916--- PASS: TestUploadHandlersRejectOversizedBody (0.33s)1917 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.04s)1918 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.04s)1919 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (0.58s)19202026/10/05 11:22:55 INFO lead: released remote=192.0.2.1:12341921--- PASS: TestLeadEndsOnShutdown (1.61s)19222026/10/05 11:22:55 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=800.184166ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present19232026/10/05 11:22:55 INFO lead: released remote=192.0.2.1:123419242026/10/05 11:22:55 INFO lead: acquired remote=192.0.2.1:12341925--- PASS: TestPendingClosureWriteTimeout (0.00s)1926 --- PASS: TestPendingClosureWriteTimeout/empty (0.00s)1927 --- PASS: TestPendingClosureWriteTimeout/670k_objects (0.00s)1928 --- PASS: TestPendingClosureWriteTimeout/400_objects (0.00s)1929 --- PASS: TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline (1.08s)1930=== NAME TestOrphanedObjectsGCStressTest1931 orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains1932 orphaned_objects_gc_test.go:446: Marked 210 objects for deletion19332026/10/05 11:22:55 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=019342026/10/05 11:22:55 INFO Received create pin request method=POST path=/api/pins/myapp19352026/10/05 11:22:55 INFO Created/updated pin name=myapp store_path=/build/TestPinProtectsFromGC3194704088/001/store/h9a6iccmxnq9a75jm6a444flnf2l27ak-pinned-file.txt narinfo_key=h9a6iccmxnq9a75jm6a444flnf2l27ak.narinfo19362026/10/05 11:22:55 INFO Starting cleanup of old closures method=DELETE path=/api/closures19372026/10/05 11:22:55 INFO Garbage collection started19382026/10/05 11:22:55 INFO Aborted multipart uploads count=0 kept=019392026/10/05 11:22:55 WARN Force mode enabled - objects will be deleted immediately without grace period19402026/10/05 11:22:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=019412026/10/05 11:22:55 INFO Vacuumed table table=pending_closures19422026/10/05 11:22:55 INFO Vacuumed table table=pending_objects19432026/10/05 11:22:55 INFO Vacuumed table table=multipart_uploads19442026/10/05 11:22:55 INFO Vacuumed table table=closures19452026/10/05 11:22:55 INFO Vacuumed table table=objects19462026/10/05 11:22:55 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.521825323s error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present19472026/10/05 11:22:56 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=01948=== NAME TestClientIntegration1949 client_integration_test.go:323: Objects in database after GC:1950 client_integration_test.go:323: Successfully deleted all objects with GC --force1951--- PASS: TestClientIntegration (2.79s)1952=== NAME TestOrphanedObjectsGCStressTest1953 orphaned_objects_gc_test.go:509: Stress test completed successfully:1954 orphaned_objects_gc_test.go:510: - Active objects preserved: 201955 orphaned_objects_gc_test.go:511: - Objects deleted: 2101956 orphaned_objects_gc_test.go:512: - Total GC'd: 2101957--- PASS: TestOrphanedObjectsGCStressTest (2.16s)19582026/10/05 11:22:56 INFO lead: released remote=192.0.2.1:12341959--- PASS: TestLeadElectsOneAndHandsOver (2.82s)19602026/10/05 11:22:56 WARN Rate limiter enabled after throttle name=s3-test rate=519612026/10/05 11:22:56 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."1962=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1963 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=101964 throttle_test.go:215: Rate limiter: enabled=true, rate=5.001965--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (4.37s)1966--- PASS: TestReadProxyOutlastsServerWriteTimeout (4.82s)19672026/10/05 11:22:57 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19682026/10/05 11:22:57 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=214.288452ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19692026/10/05 11:22:57 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=439.090014ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1970=== NAME TestPinProtectsFromGC1971 client_integration_test.go:840: Pin successfully protected closure from garbage collection1972--- PASS: TestPinProtectsFromGC (4.95s)19732026/10/05 11:22:58 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=778.458205ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config1974--- PASS: TestConnectWaitsForAPeerMigration (5.17s)19752026/10/05 11:22:58 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.620335119s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19762026/10/05 11:23:00 INFO Aborted multipart uploads count=1 kept=019772026/10/05 11:23:00 INFO Received cleanup request method=DELETE path=/api/pending_closures19782026/10/05 11:23:00 INFO Aborted multipart uploads count=1 kept=01979--- PASS: TestPendingCleanupUsesOneCutoff (6.36s)19802026/10/05 11:23:00 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"19812026/10/05 11:23:00 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19822026/10/05 11:23:00 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=212.162394ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19832026/10/05 11:23:00 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=375.792158ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19842026/10/05 11:23:01 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=797.335133ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19852026/10/05 11:23:02 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.631441013s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config19862026/10/05 11:23:03 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19872026/10/05 11:23:03 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=213.845662ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19882026/10/05 11:23:04 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=408.379594ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19892026/10/05 11:23:04 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=824.691927ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures19902026/10/05 11:23:05 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.493640449s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures1991--- PASS: TestClientErrorHandling (0.00s)1992 --- PASS: TestClientErrorHandling/InvalidStorePath (0.27s)1993 --- PASS: TestClientErrorHandling/InvalidAuthToken (0.35s)1994 --- PASS: TestClientErrorHandling/ServerNotAvailable (12.47s)1995PASS1996{"timestamp":"2026-10-05T11:23:06.807745666Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:57780","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2354,"threadName":"rustfs-worker","threadId":"ThreadId(387)"}19972026-10-05 11:23:07.165 UTC [130] LOG: received smart shutdown request19982026-10-05 11:23:07.171 UTC [130] LOG: background worker "logical replication launcher" (PID 140) exited with exit code 119992026-10-05 11:23:07.181 UTC [135] LOG: shutting down20002026-10-05 11:23:07.182 UTC [135] LOG: checkpoint starting: shutdown immediate20012026-10-05 11:23:09.048 UTC [135] LOG: checkpoint complete: wrote 11100 buffers (67.7%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 26 recycled; write=0.275 s, sync=1.535 s, total=1.867 s; sync files=31000, longest=0.003 s, average=0.001 s; distance=428501 kB, estimate=428501 kB; lsn=0/1B9DB270, redo lsn=0/1B9DB27020022026-10-05 11:23:09.126 UTC [130] LOG: database system is shut down2003Running OIDC tests...2004=== RUN TestAudienceForIssuer2005=== PAUSE TestAudienceForIssuer2006=== RUN TestGlobMatch2007=== PAUSE TestGlobMatch2008=== RUN TestValidateToken_ValidToken2009=== PAUSE TestValidateToken_ValidToken2010=== RUN TestValidateToken_WrongAudience2011=== PAUSE TestValidateToken_WrongAudience2012=== RUN TestValidateToken_Expired2013=== PAUSE TestValidateToken_Expired2014=== RUN TestValidateToken_BoundClaimsMismatch2015=== PAUSE TestValidateToken_BoundClaimsMismatch2016=== RUN TestValidateToken_BoundSubjectMismatch2017=== PAUSE TestValidateToken_BoundSubjectMismatch2018=== RUN TestValidateToken_MultipleProviders2019=== PAUSE TestValidateToken_MultipleProviders2020=== RUN TestValidateToken_NoMatchingProvider2021=== PAUSE TestValidateToken_NoMatchingProvider2022=== RUN TestValidateToken_KubernetesServiceAccount2023=== PAUSE TestValidateToken_KubernetesServiceAccount2024=== RUN TestNewValidator_KubernetesRequiresCA2025=== PAUSE TestNewValidator_KubernetesRequiresCA2026=== RUN TestValidateToken_KubernetesIssuerFromOwnToken2027=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken2028=== RUN TestPins_ReservedForMatchingRule2029=== PAUSE TestPins_ReservedForMatchingRule2030=== RUN TestPins_TopLevelShorthand2031=== PAUSE TestPins_TopLevelShorthand2032=== RUN TestPins_ConfigValidation2033=== PAUSE TestPins_ConfigValidation2034=== RUN TestScopes_LegacyProviderDefaultsToWrite2035=== PAUSE TestScopes_LegacyProviderDefaultsToWrite2036=== RUN TestScopes_Rules2037=== PAUSE TestScopes_Rules2038=== RUN TestScopes_ConfigValidation2039=== PAUSE TestScopes_ConfigValidation2040=== CONT TestAudienceForIssuer2041=== CONT TestPins_ConfigValidation2042--- PASS: TestAudienceForIssuer (0.00s)2043=== CONT TestValidateToken_KubernetesServiceAccount2044=== CONT TestValidateToken_Expired2045=== CONT TestValidateToken_WrongAudience2046=== CONT TestValidateToken_ValidToken2047--- PASS: TestPins_ConfigValidation (0.00s)2048=== CONT TestPins_TopLevelShorthand2049=== CONT TestPins_ReservedForMatchingRule2050=== CONT TestGlobMatch2051=== CONT TestValidateToken_KubernetesIssuerFromOwnToken2052=== CONT TestScopes_Rules2053=== CONT TestNewValidator_KubernetesRequiresCA2054=== CONT TestScopes_ConfigValidation2055=== CONT TestValidateToken_MultipleProviders2056=== CONT TestScopes_LegacyProviderDefaultsToWrite2057=== CONT TestValidateToken_NoMatchingProvider2058=== CONT TestValidateToken_BoundSubjectMismatch2059=== CONT TestValidateToken_BoundClaimsMismatch2060=== RUN TestGlobMatch/foo_foo2061=== PAUSE TestGlobMatch/foo_foo2062=== RUN TestGlobMatch/foo_bar2063=== PAUSE TestGlobMatch/foo_bar2064=== RUN TestGlobMatch/*_2065=== PAUSE TestGlobMatch/*_2066=== RUN TestGlobMatch/*_anything2067=== PAUSE TestGlobMatch/*_anything2068=== RUN TestGlobMatch/foo*_foo2069=== PAUSE TestGlobMatch/foo*_foo2070=== RUN TestGlobMatch/foo*_foobar2071=== PAUSE TestGlobMatch/foo*_foobar2072=== RUN TestGlobMatch/foo*_bar2073=== PAUSE TestGlobMatch/foo*_bar2074=== RUN TestGlobMatch/*bar_bar2075=== PAUSE TestGlobMatch/*bar_bar2076=== RUN TestGlobMatch/*bar_foobar2077=== PAUSE TestGlobMatch/*bar_foobar2078=== RUN TestGlobMatch/*bar_foo2079=== PAUSE TestGlobMatch/*bar_foo2080=== RUN TestGlobMatch/foo*bar_foobar2081=== PAUSE TestGlobMatch/foo*bar_foobar2082=== RUN TestGlobMatch/foo*bar_foo123bar2083=== PAUSE TestGlobMatch/foo*bar_foo123bar2084=== RUN TestGlobMatch/foo*bar_foobarbaz2085=== PAUSE TestGlobMatch/foo*bar_foobarbaz2086=== RUN TestGlobMatch/*/*_foo/bar2087=== PAUSE TestGlobMatch/*/*_foo/bar2088=== RUN TestGlobMatch/*/*_foo2089=== PAUSE TestGlobMatch/*/*_foo2090=== RUN TestGlobMatch/refs/heads/*_refs/heads/main2091=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main2092=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.02093=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.02094=== RUN TestGlobMatch/refs/*/main_refs/heads/main2095=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main2096=== RUN TestGlobMatch/fo?_foo2097=== PAUSE TestGlobMatch/fo?_foo2098=== RUN TestGlobMatch/fo?_fo2099=== PAUSE TestGlobMatch/fo?_fo2100=== RUN TestGlobMatch/fo?_fooo2101=== PAUSE TestGlobMatch/fo?_fooo2102=== RUN TestGlobMatch/?oo_foo2103=== PAUSE TestGlobMatch/?oo_foo2104=== RUN TestGlobMatch/?oo_boo2105=== PAUSE TestGlobMatch/?oo_boo2106=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2107=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2108=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2109=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2110=== CONT TestGlobMatch/foo_foo2111=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main2112=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main2113=== CONT TestGlobMatch/?oo_boo2114=== CONT TestGlobMatch/?oo_foo2115=== CONT TestGlobMatch/fo?_fooo2116=== CONT TestGlobMatch/fo?_fo2117=== CONT TestGlobMatch/fo?_foo2118=== CONT TestGlobMatch/refs/*/main_refs/heads/main2119=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.02120=== CONT TestGlobMatch/refs/heads/*_refs/heads/main2121=== CONT TestGlobMatch/*/*_foo2122=== CONT TestGlobMatch/*/*_foo/bar2123=== CONT TestGlobMatch/foo*bar_foobarbaz2124=== CONT TestGlobMatch/foo*bar_foo123bar2125=== CONT TestGlobMatch/foo*bar_foobar2126=== CONT TestGlobMatch/*bar_foo2127=== CONT TestGlobMatch/*bar_foobar2128--- PASS: TestScopes_ConfigValidation (0.00s)2129=== CONT TestGlobMatch/*bar_bar2130=== CONT TestGlobMatch/foo*_bar2131=== CONT TestGlobMatch/foo*_foobar2132=== CONT TestGlobMatch/foo*_foo2133=== CONT TestGlobMatch/*_anything2134=== CONT TestGlobMatch/*_2135=== CONT TestGlobMatch/foo_bar2136--- PASS: TestGlobMatch (0.00s)2137 --- PASS: TestGlobMatch/foo_foo (0.00s)2138 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)2139 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)2140 --- PASS: TestGlobMatch/?oo_boo (0.00s)2141 --- PASS: TestGlobMatch/?oo_foo (0.00s)2142 --- PASS: TestGlobMatch/fo?_fooo (0.00s)2143 --- PASS: TestGlobMatch/fo?_fo (0.00s)2144 --- PASS: TestGlobMatch/fo?_foo (0.00s)2145 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)2146 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)2147 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)2148 --- PASS: TestGlobMatch/*/*_foo (0.00s)2149 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)2150 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)2151 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)2152 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)2153 --- PASS: TestGlobMatch/*bar_foo (0.00s)2154 --- PASS: TestGlobMatch/*bar_foobar (0.00s)2155 --- PASS: TestGlobMatch/*bar_bar (0.00s)2156 --- PASS: TestGlobMatch/foo*_bar (0.00s)2157 --- PASS: TestGlobMatch/foo*_foobar (0.00s)2158 --- PASS: TestGlobMatch/foo*_foo (0.00s)2159 --- PASS: TestGlobMatch/*_anything (0.00s)2160 --- PASS: TestGlobMatch/*_ (0.00s)2161 --- PASS: TestGlobMatch/foo_bar (0.00s)21622026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:39977/oidc21632026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:42373/oidc2164--- PASS: TestValidateToken_WrongAudience (0.02s)2165--- PASS: TestValidateToken_BoundClaimsMismatch (0.02s)21662026/10/05 11:23:11 http: TLS handshake error from 127.0.0.1:46540: remote error: tls: bad certificate2167--- PASS: TestNewValidator_KubernetesRequiresCA (0.04s)21682026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45931/oidc2169--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.05s)21702026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45593/oidc21712026/10/05 11:23:11 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:413232172--- PASS: TestPins_ReservedForMatchingRule (0.07s)2173--- PASS: TestValidateToken_KubernetesServiceAccount (0.07s)21742026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:33697/oidc2175--- PASS: TestValidateToken_ValidToken (0.08s)21762026/10/05 11:23:11 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC12321772026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:43151/oidc21782026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:42233/oidc2179--- PASS: TestValidateToken_Expired (0.09s)2180--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.09s)2181--- PASS: TestScopes_Rules (0.09s)21822026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:42259/oidc2183--- PASS: TestPins_TopLevelShorthand (0.10s)21842026/10/05 11:23:11 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:39461/oidc2185--- PASS: TestValidateToken_BoundSubjectMismatch (0.12s)21862026/10/05 11:23:11 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:43397/oidc21872026/10/05 11:23:11 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:39503/oidc2188--- PASS: TestValidateToken_MultipleProviders (0.15s)21892026/10/05 11:23:11 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:39391/oidc2190--- PASS: TestValidateToken_NoMatchingProvider (0.16s)2191PASS2192Running hook tests...2193=== RUN TestSendPathsEmpty2194=== PAUSE TestSendPathsEmpty2195=== RUN TestQueueEnqueueAndFetch2196=== PAUSE TestQueueEnqueueAndFetch2197=== RUN TestQueueDeduplication2198=== PAUSE TestQueueDeduplication2199=== RUN TestQueueRemove2200=== PAUSE TestQueueRemove2201=== RUN TestQueueFetchBatchLimit2202=== PAUSE TestQueueFetchBatchLimit2203=== RUN TestQueueRetryMovesToBack2204=== PAUSE TestQueueRetryMovesToBack2205=== RUN TestQueueFetchRemoveLifecycle2206=== PAUSE TestQueueFetchRemoveLifecycle2207=== RUN TestQueueConcurrentWriters2208=== PAUSE TestQueueConcurrentWriters2209=== RUN TestQueueRemoveLargeClosure2210=== PAUSE TestQueueRemoveLargeClosure2211=== RUN TestServerClientIntegration2212=== PAUSE TestServerClientIntegration2213=== RUN TestServerQueueError2214=== PAUSE TestServerQueueError2215=== RUN TestGetListenerSocketActivation2216 server_test.go:210: === RUN TestGetListenerSocketActivation2217 --- PASS: TestGetListenerSocketActivation (0.00s)2218 PASS2219 2220--- PASS: TestGetListenerSocketActivation (0.01s)2221=== RUN TestDrainIsolatesPoisonPath2222=== PAUSE TestDrainIsolatesPoisonPath2223=== RUN TestRunNotBlockedByPoisonHead2224=== PAUSE TestRunNotBlockedByPoisonHead2225=== RUN TestDrainGivesUpWhenServerDown2226=== PAUSE TestDrainGivesUpWhenServerDown2227=== RUN TestFailedPathPrunedByLaterClosure2228=== PAUSE TestFailedPathPrunedByLaterClosure2229=== RUN TestWorkerUploadsAndRemoves2230=== PAUSE TestWorkerUploadsAndRemoves2231=== RUN TestWorkerSkipsGCdPaths2232=== PAUSE TestWorkerSkipsGCdPaths2233=== RUN TestWorkerPrunesClosureDeps2234=== PAUSE TestWorkerPrunesClosureDeps2235=== RUN TestDrainTimeout2236=== PAUSE TestDrainTimeout2237=== CONT TestSendPathsEmpty2238=== CONT TestServerQueueError2239--- PASS: TestSendPathsEmpty (0.00s)2240=== CONT TestServerClientIntegration2241=== CONT TestQueueRemoveLargeClosure2242=== CONT TestQueueConcurrentWriters2243=== CONT TestQueueFetchRemoveLifecycle2244=== CONT TestQueueRetryMovesToBack22452026/10/05 11:23:11 ERROR Failed to queue paths error="permission denied" count=12246=== CONT TestQueueFetchBatchLimit2247=== CONT TestQueueRemove2248=== CONT TestQueueDeduplication2249=== CONT TestWorkerUploadsAndRemoves2250=== CONT TestQueueEnqueueAndFetch2251=== CONT TestDrainTimeout2252=== CONT TestDrainGivesUpWhenServerDown2253=== CONT TestWorkerPrunesClosureDeps2254=== CONT TestFailedPathPrunedByLaterClosure2255=== CONT TestWorkerSkipsGCdPaths2256=== CONT TestRunNotBlockedByPoisonHead2257=== CONT TestDrainIsolatesPoisonPath2258--- PASS: TestServerClientIntegration (0.00s)2259--- PASS: TestServerQueueError (0.00s)22602026/10/05 11:23:11 INFO Upload queue status pending=322612026/10/05 11:23:11 INFO Uploading batch count=122622026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=122632026/10/05 11:23:11 INFO Uploading batch count=422642026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=422652026/10/05 11:23:11 INFO Uploading batch count=222662026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=222672026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2059327734/002/a22682026/10/05 11:23:11 INFO Uploading batch count=222692026/10/05 11:23:11 INFO Upload queue status pending=222702026/10/05 11:23:11 INFO Uploading batch count=122712026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=12272--- PASS: TestQueueEnqueueAndFetch (0.02s)22732026/10/05 11:23:11 INFO Uploading batch count=122742026/10/05 11:23:11 INFO Upload queue status pending=222752026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2059327734/002/b2276--- PASS: TestQueueFetchBatchLimit (0.02s)22772026/10/05 11:23:11 INFO Upload queue status pending=222782026/10/05 11:23:11 INFO Uploading batch count=222792026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainIsolatesPoisonPath1050807877/002/bbb22802026/10/05 11:23:11 INFO Uploading batch count=12281--- PASS: TestQueueRemove (0.02s)22822026/10/05 11:23:11 WARN Store path no longer exists (garbage collected?), removing from queue path=/build/TestWorkerSkipsGCdPaths3949488543/002/nonexistent2283--- PASS: TestQueueDeduplication (0.02s)22842026/10/05 11:23:11 INFO Uploading batch count=222852026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=222862026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2059327734/002/c2287--- PASS: TestQueueRetryMovesToBack (0.02s)2288--- PASS: TestQueueFetchRemoveLifecycle (0.02s)22892026/10/05 11:23:11 INFO Uploading batch count=122902026/10/05 11:23:11 INFO Uploading batch count=122912026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2059327734/002/d22922026/10/05 11:23:11 INFO Uploading batch count=122932026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=122942026/10/05 11:23:11 INFO Uploading batch count=222952026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=222962026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2059327734/002/e22972026/10/05 11:23:11 INFO Uploading batch count=122982026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=122992026/10/05 11:23:11 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown2059327734/002/f2300--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)23012026/10/05 11:23:11 ERROR Drain finished with paths left in queue remaining=1023022026/10/05 11:23:11 INFO Uploading batch count=123032026/10/05 11:23:11 ERROR Upload failed error="upload failed" count=123042026/10/05 11:23:11 ERROR Drain finished with paths left in queue remaining=12305--- PASS: TestDrainGivesUpWhenServerDown (0.02s)2306--- PASS: TestDrainIsolatesPoisonPath (0.02s)2307--- PASS: TestWorkerPrunesClosureDeps (0.04s)2308--- PASS: TestWorkerSkipsGCdPaths (0.04s)2309--- PASS: TestWorkerUploadsAndRemoves (0.04s)2310--- PASS: TestQueueRemoveLargeClosure (0.09s)23112026/10/05 11:23:11 ERROR Upload failed error="context deadline exceeded" count=223122026/10/05 11:23:11 ERROR Drain finished with paths left in queue remaining=42313--- PASS: TestDrainTimeout (0.22s)2314--- PASS: TestQueueConcurrentWriters (0.38s)23152026/10/05 11:23:12 INFO Uploading batch count=123162026/10/05 11:23:12 INFO Uploading batch count=123172026/10/05 11:23:12 INFO Uploading batch count=123182026/10/05 11:23:12 ERROR Upload failed error="upload failed" count=123192026/10/05 11:23:12 INFO Uploading batch count=123202026/10/05 11:23:12 ERROR Upload failed error="upload failed" count=123212026/10/05 11:23:12 INFO Uploading batch count=123222026/10/05 11:23:12 ERROR Upload failed error="upload failed" count=123232026/10/05 11:23:12 INFO Uploading batch count=123242026/10/05 11:23:12 ERROR Upload failed error="upload failed" count=123252026/10/05 11:23:12 ERROR Drain finished with paths left in queue remaining=12326--- PASS: TestRunNotBlockedByPoisonHead (1.04s)2327PASS