niks3-go-unit-tests
checks.x86_64-linux.go-unit-tests
· build #338
· raw
1tribuchet: building on jamie2Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestRegisterUploadedObjectReusesConnections6=== PAUSE TestRegisterUploadedObjectReusesConnections7=== RUN TestCaseHackSuffix8=== PAUSE TestCaseHackSuffix9=== RUN TestFilterOversizedClosures10=== PAUSE TestFilterOversizedClosures11=== RUN TestUploadMultipart_PartsInParallel12=== PAUSE TestUploadMultipart_PartsInParallel13=== RUN TestPartSizeForNAR14=== PAUSE TestPartSizeForNAR15=== RUN TestUploadMultipart_SupersededByPeer16=== PAUSE TestUploadMultipart_SupersededByPeer17=== RUN TestDumpPathCaseHackMatchesNix18--- PASS: TestDumpPathCaseHackMatchesNix (0.04s)19=== RUN TestDumpPathCaseHackCollision20--- PASS: TestDumpPathCaseHackCollision (0.00s)21=== RUN TestDumpPathMatchesNix22=== PAUSE TestDumpPathMatchesNix23=== RUN TestDumpPathSingleFile24=== PAUSE TestDumpPathSingleFile25=== RUN TestDumpPathWriterError26=== PAUSE TestDumpPathWriterError27=== RUN TestEncodeNixBase3228=== PAUSE TestEncodeNixBase3229=== RUN TestEncodeNixBase32WithRealHash30=== PAUSE TestEncodeNixBase32WithRealHash31=== RUN TestConvertHashToNix3232=== PAUSE TestConvertHashToNix3233=== RUN TestGetStorePathHash34=== PAUSE TestGetStorePathHash35=== RUN TestPathInfoHashCompatibility36=== PAUSE TestPathInfoHashCompatibility37=== RUN TestParsePathInfoJSON38=== PAUSE TestParsePathInfoJSON39=== RUN TestParsePathInfoJSONMultiplePaths40=== PAUSE TestParsePathInfoJSONMultiplePaths41=== RUN TestPathInfoCACompatibility42=== PAUSE TestPathInfoCACompatibility43=== RUN TestRateLimiterFeedback44=== PAUSE TestRateLimiterFeedback45=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess46=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess47=== RUN TestResolveStorePath48=== PAUSE TestResolveStorePath49=== RUN TestDoWithRetry_BodyReplayedViaGetBody50=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody51=== RUN TestShellSplit52=== PAUSE TestShellSplit53=== RUN TestShellSplitErrors54=== PAUSE TestShellSplitErrors55=== RUN TestStreamPushReportsEveryPath56=== PAUSE TestStreamPushReportsEveryPath57=== RUN TestStreamPushBatchesUnderLoad58=== PAUSE TestStreamPushBatchesUnderLoad59=== RUN TestStreamPushIsolatesFailures60=== PAUSE TestStreamPushIsolatesFailures61=== RUN TestStreamPushGivesUpOnDeadServer62=== PAUSE TestStreamPushGivesUpOnDeadServer63=== RUN TestStreamPushRequestLine64=== PAUSE TestStreamPushRequestLine65=== RUN TestStreamPushReportsSignatures66=== PAUSE TestStreamPushReportsSignatures67=== RUN TestClientSignaturesByStorePath68=== PAUSE TestClientSignaturesByStorePath69=== RUN TestSetClientTLS70=== PAUSE TestSetClientTLS71=== RUN TestSetClientTLSDoesNotMutateDefaultTransport72=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport73=== RUN TestSetClientTLSErrors74=== PAUSE TestSetClientTLSErrors75=== RUN TestStaticToken76=== PAUSE TestStaticToken77=== RUN TestFileTokenReadsAndCaches78=== PAUSE TestFileTokenReadsAndCaches79=== RUN TestFileTokenMissing80=== PAUSE TestFileTokenMissing81=== RUN TestFileTokenEmpty82=== PAUSE TestFileTokenEmpty83=== RUN TestScriptTokenNoExpiryRerunsEveryCall84=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall85=== RUN TestScriptTokenCachesUntilRefresh86=== PAUSE TestScriptTokenCachesUntilRefresh87=== RUN TestScriptTokenEmptyToken88=== PAUSE TestScriptTokenEmptyToken89=== RUN TestScriptTokenBadJSON90=== PAUSE TestScriptTokenBadJSON91=== RUN TestScriptTokenScriptFails92=== PAUSE TestScriptTokenScriptFails93=== RUN TestScriptTokenEmptyCommand94=== PAUSE TestScriptTokenEmptyCommand95=== CONT TestDoServerRequestAttachesToken96=== CONT TestShellSplit97=== CONT TestStreamPushRequestLine98=== CONT TestScriptTokenEmptyCommand99--- PASS: TestShellSplit (0.00s)100--- PASS: TestScriptTokenEmptyCommand (0.00s)101=== CONT TestRateLimiterFeedback102=== CONT TestConvertHashToNix32103=== CONT TestScriptTokenScriptFails104=== RUN TestRateLimiterFeedback/429_enables_limiter105=== PAUSE TestRateLimiterFeedback/429_enables_limiter106=== RUN TestRateLimiterFeedback/503_enables_limiter107=== PAUSE TestRateLimiterFeedback/503_enables_limiter108=== CONT TestScriptTokenBadJSON109=== CONT TestScriptTokenEmptyToken110=== CONT TestSetClientTLSErrors111=== CONT TestScriptTokenCachesUntilRefresh112=== CONT TestSetClientTLS113=== CONT TestFileTokenMissing114--- PASS: TestScriptTokenScriptFails (0.00s)115=== CONT TestPathInfoCACompatibility116=== RUN TestPathInfoCACompatibility/null_ca_field117=== PAUSE TestPathInfoCACompatibility/null_ca_field118=== RUN TestPathInfoCACompatibility/old_string_format_-_text119=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text120=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive121=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive122=== RUN TestPathInfoCACompatibility/new_structured_format_-_text123=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text124=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method125=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method1262026/10/01 10:23:50 ERROR Upload failed error=boom count=1127--- PASS: TestFileTokenMissing (0.00s)128=== CONT TestStreamPushGivesUpOnDeadServer129=== CONT TestStaticToken130--- PASS: TestStaticToken (0.00s)131=== CONT TestEncodeNixBase32WithRealHash132=== CONT TestDoWithRetry_BodyReplayedViaGetBody133=== CONT TestParsePathInfoJSONMultiplePaths134=== CONT TestParsePathInfoJSON135=== CONT TestResolveStorePath136=== CONT TestPathInfoHashCompatibility137=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess138=== CONT TestGetStorePathHash139=== CONT TestScriptTokenNoExpiryRerunsEveryCall140=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter141=== RUN TestConvertHashToNix32/SRI_format_to_Nix32142=== CONT TestFileTokenEmpty143=== CONT TestFileTokenReadsAndCaches144=== CONT TestStreamPushIsolatesFailures1452026/10/01 10:23:50 ERROR Upload failed error="connection refused" count=201462026/10/01 10:23:50 ERROR Server seems unavailable, giving up on batch untried=17147=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32148=== CONT TestSetClientTLSDoesNotMutateDefaultTransport149--- PASS: TestEncodeNixBase32WithRealHash (0.00s)150=== CONT TestUploadMultipart_SupersededByPeer151=== RUN TestUploadMultipart_SupersededByPeer/exists1522026/10/01 10:23:50 WARN Rate limiter enabled after throttle name=server-test rate=5153=== PAUSE TestUploadMultipart_SupersededByPeer/exists154=== RUN TestUploadMultipart_SupersededByPeer/missing155=== PAUSE TestUploadMultipart_SupersededByPeer/missing156--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)157=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)1582026/10/01 10:23:50 ERROR Upload failed error="bad path" count=3159=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths160=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter161--- PASS: TestScriptTokenBadJSON (0.01s)162=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths163=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths164=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths165=== RUN TestGetStorePathHash/valid_store_path166=== RUN TestConvertHashToNix32/already_Nix32_format167=== CONT TestDumpPathWriterError168=== RUN TestParsePathInfoJSON/Nix_format169=== CONT TestEncodeNixBase32170=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)171=== CONT TestStreamPushBatchesUnderLoad172=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter173=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon174=== CONT TestDumpPathSingleFile175=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon176=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI177--- PASS: TestStreamPushIsolatesFailures (0.00s)178=== CONT TestStreamPushReportsSignatures179=== CONT TestDumpPathMatchesNix180=== CONT TestFilterOversizedClosures181=== CONT TestStreamPushReportsEveryPath182=== PAUSE TestParsePathInfoJSON/Nix_format183=== CONT TestPartSizeForNAR184=== PAUSE TestGetStorePathHash/valid_store_path1852026/10/01 10:23:50 WARN Rate limiter enabled after throttle name=server-test rate=5186=== PAUSE TestConvertHashToNix32/already_Nix32_format187=== RUN TestEncodeNixBase32/test_string_hash188=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter189=== RUN TestSetClientTLSErrors/missing_cert_file1902026/10/01 10:23:50 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:40081191=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI192=== RUN TestFilterOversizedClosures/no_limit_keeps_everything193=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512194=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything195=== RUN TestPartSizeForNAR/zero_stays_at_minimum196=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped197=== CONT TestCaseHackSuffix1982026/10/01 10:23:50 ERROR Upload failed error=boom count=1199=== CONT TestUploadMultipart_PartsInParallel200=== PAUSE TestEncodeNixBase32/test_string_hash201=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512202--- PASS: TestScriptTokenEmptyToken (0.01s)203--- PASS: TestFileTokenReadsAndCaches (0.00s)204--- PASS: TestFileTokenEmpty (0.00s)205=== CONT TestRegisterUploadedObjectReusesConnections206=== CONT TestShellSplitErrors207=== CONT TestPathInfoCACompatibility/null_ca_field208=== RUN TestGetStorePathHash/basename_without_hyphen_should_error209=== RUN TestConvertHashToNix32/invalid_format210=== PAUSE TestConvertHashToNix32/invalid_format211=== RUN TestParsePathInfoJSON/Lix_format212=== PAUSE TestSetClientTLSErrors/missing_cert_file213=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum214=== RUN TestEncodeNixBase32/empty_input215=== CONT TestClientSignaturesByStorePath216--- PASS: TestResolveStorePath (0.00s)217=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped218=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error219=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method220=== PAUSE TestParsePathInfoJSON/Lix_format221=== CONT TestPathInfoCACompatibility/new_structured_format_-_text222--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s)2232026/10/01 10:23:50 WARN Rate limiter backed off name=server-test rate=5224--- PASS: TestStreamPushReportsSignatures (0.00s)2252026/10/01 10:23:50 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:40081226=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive227=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths228=== RUN TestSetClientTLS/rejects_connection_without_client_cert229=== CONT TestPathInfoCACompatibility/old_string_format_-_text230=== CONT TestUploadMultipart_SupersededByPeer/exists231=== PAUSE TestEncodeNixBase32/empty_input232=== RUN TestPartSizeForNAR/small_stays_at_minimum233=== RUN TestSetClientTLSErrors/missing_key_file234=== RUN TestParsePathInfoJSON/empty_input235=== RUN TestFilterOversizedClosures/all_closures_skipped236=== CONT TestUploadMultipart_SupersededByPeer/missing237=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error238--- PASS: TestShellSplitErrors (0.00s)239=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths240--- PASS: TestClientSignaturesByStorePath (0.00s)241--- PASS: TestDoServerRequestAttachesToken (0.01s)242=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter243=== CONT TestRateLimiterFeedback/429_enables_limiter244=== CONT TestRateLimiterFeedback/503_enables_limiter245--- PASS: TestStreamPushReportsEveryPath (0.01s)246=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter247--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)248 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)249 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)250--- PASS: TestScriptTokenCachesUntilRefresh (0.02s)251=== PAUSE TestFilterOversizedClosures/all_closures_skipped252=== PAUSE TestParsePathInfoJSON/empty_input253=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)254=== RUN TestParsePathInfoJSON/whitespace_only255=== PAUSE TestParsePathInfoJSON/whitespace_only256=== RUN TestParsePathInfoJSON/invalid_JSON257=== PAUSE TestParsePathInfoJSON/invalid_JSON258=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512259=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI260=== CONT TestConvertHashToNix32/SRI_format_to_Nix32261=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon262--- PASS: TestPathInfoHashCompatibility (0.01s)263 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)264 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)265 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)266 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)267=== CONT TestConvertHashToNix32/invalid_format268=== CONT TestEncodeNixBase32/test_string_hash269=== CONT TestConvertHashToNix32/already_Nix32_format270--- PASS: TestConvertHashToNix32 (0.01s)271 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)272 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)273 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)274=== CONT TestEncodeNixBase32/empty_input275--- PASS: TestEncodeNixBase32 (0.01s)276 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)277 --- PASS: TestEncodeNixBase32/empty_input (0.00s)278=== CONT TestFilterOversizedClosures/no_limit_keeps_everything279=== CONT TestFilterOversizedClosures/all_closures_skipped2802026/10/01 10:23:50 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa-small nar_size=1000 max_nar_size=50281=== CONT TestParsePathInfoJSON/whitespace_only282=== CONT TestParsePathInfoJSON/invalid_JSON283=== CONT TestParsePathInfoJSON/empty_input284=== CONT TestParsePathInfoJSON/Lix_format285=== CONT TestParsePathInfoJSON/Nix_format286--- PASS: TestParsePathInfoJSON (0.04s)287 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)288 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)289 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)290 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)291 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)292=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped2932026/10/01 10:23:50 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000294--- PASS: TestFilterOversizedClosures (0.04s)295 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)296 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)297 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)298--- PASS: TestUploadMultipart_SupersededByPeer (0.00s)299 --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)300 --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.00s)301=== PAUSE TestPartSizeForNAR/small_stays_at_minimum302=== PAUSE TestSetClientTLSErrors/missing_key_file303=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum304=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum305=== RUN TestSetClientTLSErrors/missing_ca_file306=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts307=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts308=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert309=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error310--- PASS: TestPathInfoCACompatibility (0.00s)311 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)312 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)313 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)314 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)315 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)316--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.04s)317=== PAUSE TestSetClientTLSErrors/missing_ca_file318=== RUN TestPartSizeForNAR/1_TiB319=== PAUSE TestPartSizeForNAR/1_TiB320=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA3212026/10/01 10:23:50 WARN Rate limiter enabled after throttle name=server-test rate=5322=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error3232026/10/01 10:23:50 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:46033324=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error3252026/10/01 10:23:50 WARN Rate limiter enabled after throttle name=server-test rate=5326=== CONT TestGetStorePathHash/valid_store_path3272026/10/01 10:23:50 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:46177328=== RUN TestSetClientTLSErrors/invalid_ca_file3292026/10/01 10:23:50 WARN Rate limiter backed off name=server-test rate=5330=== PAUSE TestSetClientTLSErrors/invalid_ca_file3312026/10/01 10:23:50 WARN Rate limiter backed off name=server-test rate=5332=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error333=== RUN TestPartSizeForNAR/5_TiB_S3_max_object334=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object335--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.04s)336=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA337=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error338=== CONT TestGetStorePathHash/basename_without_hyphen_should_error339=== CONT TestSetClientTLSErrors/missing_cert_file340=== CONT TestSetClientTLSErrors/invalid_ca_file341=== CONT TestSetClientTLSErrors/missing_ca_file342=== CONT TestSetClientTLSErrors/missing_key_file343=== RUN TestPartSizeForNAR/capped_at_5_GiB344=== PAUSE TestPartSizeForNAR/capped_at_5_GiB345=== CONT TestPartSizeForNAR/zero_stays_at_minimum346=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum347=== CONT TestPartSizeForNAR/1_TiB348=== RUN TestSetClientTLS/preserves_debug_logging_transport349=== PAUSE TestSetClientTLS/preserves_debug_logging_transport350=== CONT TestSetClientTLS/rejects_connection_without_client_cert351=== CONT TestSetClientTLS/preserves_debug_logging_transport352=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA353--- PASS: TestRateLimiterFeedback (0.01s)354 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)355 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.00s)356 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)357 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)358=== CONT TestPartSizeForNAR/capped_at_5_GiB359=== CONT TestPartSizeForNAR/5_TiB_S3_max_object360=== CONT TestPartSizeForNAR/small_stays_at_minimum361=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts362--- PASS: TestGetStorePathHash (0.04s)363 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)364 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)365 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)366 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)367--- PASS: TestSetClientTLSErrors (0.05s)368 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)369 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)370 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)371 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)372--- PASS: TestPartSizeForNAR (0.04s)373 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)374 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)375 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)376 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)377 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)378 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)379 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)380--- PASS: TestDumpPathSingleFile (0.05s)381--- PASS: TestStreamPushRequestLine (0.06s)3822026/10/01 10:23:50 http: TLS handshake error from 127.0.0.1:33644: remote error: tls: bad certificate383--- PASS: TestSetClientTLS (0.05s)384 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.01s)385 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s)386 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.01s)387--- PASS: TestRegisterUploadedObjectReusesConnections (0.06s)388--- PASS: TestDumpPathWriterError (0.07s)389--- PASS: TestCaseHackSuffix (0.07s)390--- PASS: TestStreamPushBatchesUnderLoad (0.10s)391--- PASS: TestDumpPathMatchesNix (0.11s)392--- PASS: TestUploadMultipart_PartsInParallel (0.65s)393--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)394PASS395Running server tests...396The files belonging to this database system will be owned by user "nixbld".397This user must also own the server process.398399The database cluster will be initialized with locale "C".400The default database encoding has accordingly been set to "SQL_ASCII".401The default text search configuration will be set to "english".402403Data page checksums are enabled.404405creating directory /build/postgres788169117/data ... ok406creating subdirectories ... ok407selecting dynamic shared memory implementation ... posix408selecting default "max_connections" ... 100409selecting default "shared_buffers" ... 128MB410selecting default time zone ... UTC411creating configuration files ... ok412running bootstrap script ... ok413performing post-bootstrap initialization ... ok414syncing data to disk ... ok415416initdb: warning: enabling "trust" authentication for local connections417initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.418419Success. You can now start the database server using:420421 pg_ctl -D /build/postgres788169117/data -l logfile start422423/build/postgres788169117:5432 - no response4242026-10-01 10:23:52.614 UTC [128] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit4252026-10-01 10:23:52.614 UTC [128] LOG: listening on Unix socket "/build/postgres788169117/.s.PGSQL.5432"4262026-10-01 10:23:52.619 UTC [135] LOG: database system was shut down at 2026-10-01 10:23:52 UTC4272026-10-01 10:23:52.623 UTC [128] LOG: database system is ready to accept connections428/build/postgres788169117:5432 - accepting connections429{"timestamp":"2026-10-01T10:23:52.920506132Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"45b04f02-c3ca-4523-a350-fd7ef5537492","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(393)"}430{"timestamp":"2026-10-01T10:23:53.023144568Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c27ba83d-b071-46f6-b293-071a054368a6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":501,"threadName":"rustfs-worker","threadId":"ThreadId(395)"}431=== RUN TestService_AuthMiddleware432=== PAUSE TestService_AuthMiddleware433=== RUN TestService_AuthMiddleware_MTLSProxyHeader434=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader435=== RUN TestService_AuthMiddleware_MTLSBoundSubjects436=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects437=== RUN TestService_ReadAuthMiddleware438=== PAUSE TestService_ReadAuthMiddleware439=== RUN TestService_AuthMiddleware_OIDC440=== PAUSE TestService_AuthMiddleware_OIDC441=== RUN TestService_RequireScope_OIDC442=== PAUSE TestService_RequireScope_OIDC443=== RUN TestService_ReadScope_PublicByDefault444=== PAUSE TestService_ReadScope_PublicByDefault445=== RUN TestCacheConfigHandler446=== PAUSE TestCacheConfigHandler447=== RUN TestCacheStatsHandler448=== PAUSE TestCacheStatsHandler449=== RUN TestClientCADerivations450=== PAUSE TestClientCADerivations451=== RUN TestClientErrorHandling452=== PAUSE TestClientErrorHandling453=== RUN TestClientIntegration454=== PAUSE TestClientIntegration455=== RUN TestClientMultipleUploads456=== PAUSE TestClientMultipleUploads457=== RUN TestClientWithDependencies458=== PAUSE TestClientWithDependencies459=== RUN TestClientSharedPathCommittedMidPush460=== PAUSE TestClientSharedPathCommittedMidPush461=== RUN TestPinProtectsFromGC462=== PAUSE TestPinProtectsFromGC463=== RUN TestClientPushesUseOnePush464=== PAUSE TestClientPushesUseOnePush465=== RUN TestClientFallsBackToClosures466=== PAUSE TestClientFallsBackToClosures467=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock468=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock469=== RUN TestResolveDBConnectionString470=== PAUSE TestResolveDBConnectionString471=== RUN TestLeadElectsOneAndHandsOver472=== PAUSE TestLeadElectsOneAndHandsOver473=== RUN TestLeadIncumbentWinsAfterRestart4742026-10-01 10:23:53.229 UTC [566] ERROR: relation "goose_db_version" does not exist at character 364752026-10-01 10:23:53.229 UTC [566] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4762026/10/01 10:23:53 OK 20241026095416_initial_model.sql (8.45ms)4772026/10/01 10:23:53 OK 20251210153512_drop_unused_gin_index.sql (1.51ms)4782026/10/01 10:23:53 OK 20251218171726_add_pins.sql (2.07ms)4792026/10/01 10:23:53 OK 20260628120000_add_object_size_and_stats.sql (2ms)4802026/10/01 10:23:53 OK 20260905000000_add_claims.sql (2.55ms)4812026/10/01 10:23:53 OK 20260920000000_drop_claims.sql (1.79ms)4822026/10/01 10:23:53 OK 20260923120000_add_pushes.sql (997.21µs)4832026/10/01 10:23:53 goose: successfully migrated database to version: 202609231200004842026/10/01 10:23:53 OK 1_commit_pending_closure.sql (1.42ms)4852026/10/01 10:23:53 OK 2_object_stats_trigger.sql (775.13µs)4862026/10/01 10:23:53 OK 3_commit_push.sql (650.61µs)4872026/10/01 10:23:53 goose: up to current file version: 34882026/10/01 10:23:53 INFO lead: acquired remote=192.0.2.1:12344892026/10/01 10:23:53 INFO lead: released remote=192.0.2.1:12344902026/10/01 10:23:53 INFO lead: acquired remote=192.0.2.1:12344912026/10/01 10:23:53 INFO lead: released remote=192.0.2.1:1234492--- PASS: TestLeadIncumbentWinsAfterRestart (0.81s)493=== RUN TestLeadEndsOnShutdown494=== PAUSE TestLeadEndsOnShutdown495=== RUN TestGCAdvisoryLockBlocksConcurrentRun4962026-10-01 10:23:54.006 UTC [576] ERROR: relation "goose_db_version" does not exist at character 364972026-10-01 10:23:54.006 UTC [576] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4982026/10/01 10:23:54 OK 20241026095416_initial_model.sql (6.62ms)4992026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (1.47ms)5002026/10/01 10:23:54 OK 20251218171726_add_pins.sql (2.7ms)5012026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (3.03ms)5022026/10/01 10:23:54 OK 20260905000000_add_claims.sql (2.38ms)5032026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (1.43ms)5042026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (955.79µs)5052026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200005062026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.59ms)5072026/10/01 10:23:54 OK 2_object_stats_trigger.sql (713.25µs)5082026/10/01 10:23:54 OK 3_commit_push.sql (506.36µs)5092026/10/01 10:23:54 goose: up to current file version: 3510--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.13s)511=== RUN TestGCBugBareHashReferences512=== PAUSE TestGCBugBareHashReferences513=== RUN TestGCMetrics514=== PAUSE TestGCMetrics515=== RUN TestPushDedupSurvivesConcurrentGC516=== PAUSE TestPushDedupSurvivesConcurrentGC517=== RUN TestDeduplicatedObjectsRecordedAsPending518=== PAUSE TestDeduplicatedObjectsRecordedAsPending519=== RUN TestGCSweepSkipsPendingObjects520=== PAUSE TestGCSweepSkipsPendingObjects521=== RUN TestTombstonedObjectOfferedWithoutWaiting522=== PAUSE TestTombstonedObjectOfferedWithoutWaiting523=== RUN TestGCSweepDeliversEachKeyOnce524=== PAUSE TestGCSweepDeliversEachKeyOnce525=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection526=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection527=== RUN TestForceGCDuringPushOffersSweptObject528=== PAUSE TestForceGCDuringPushOffersSweptObject529=== RUN TestFailedS3DeleteKeepsTombstone530=== PAUSE TestFailedS3DeleteKeepsTombstone531=== RUN TestSweepSkipsRowsLockedByPush532=== PAUSE TestSweepSkipsRowsLockedByPush533=== RUN TestRegisterCompletedObjectNeedsPendingRow534=== PAUSE TestRegisterCompletedObjectNeedsPendingRow535=== RUN TestGetExistingObjectsLocksRows536=== PAUSE TestGetExistingObjectsLocksRows537=== RUN TestSweepRechecksPendingAfterLocking538=== PAUSE TestSweepRechecksPendingAfterLocking539=== RUN TestPushWaitsForSweepHoldingRow540=== PAUSE TestPushWaitsForSweepHoldingRow541=== RUN TestCommitRacingPendingCleanupKeepsObjects542=== PAUSE TestCommitRacingPendingCleanupKeepsObjects543=== RUN TestGCEndsOnShutdown544=== PAUSE TestGCEndsOnShutdown545=== RUN TestGCTaskStore_StartNew546=== PAUSE TestGCTaskStore_StartNew547=== RUN TestGCTaskStore_DeduplicateSameParams548=== PAUSE TestGCTaskStore_DeduplicateSameParams549=== RUN TestGCTaskStore_ConflictDifferentParams550=== PAUSE TestGCTaskStore_ConflictDifferentParams551=== RUN TestGCTaskStore_GetEmpty552=== PAUSE TestGCTaskStore_GetEmpty553=== RUN TestGCTaskStore_GetReturnsLatest554=== PAUSE TestGCTaskStore_GetReturnsLatest555=== RUN TestGCTaskStore_CompletedAllowsNewTask556=== PAUSE TestGCTaskStore_CompletedAllowsNewTask557=== RUN TestGCTaskStore_PhaseUpdates558=== PAUSE TestGCTaskStore_PhaseUpdates559=== RUN TestGCTaskStore_Fail560=== PAUSE TestGCTaskStore_Fail561=== RUN TestGracefulShutdownDrainsInflight562=== PAUSE TestGracefulShutdownDrainsInflight563=== RUN TestService_healthCheckHandler564=== PAUSE TestService_healthCheckHandler565=== RUN TestService_readinessHandler566=== PAUSE TestService_readinessHandler567=== RUN TestGenerateLandingPage568=== PAUSE TestGenerateLandingPage569=== RUN TestCacheConfigHandlerMaxNarSize570=== PAUSE TestCacheConfigHandlerMaxNarSize571=== RUN TestCreatePendingClosureRejectsOversizedNAR572=== PAUSE TestCreatePendingClosureRejectsOversizedNAR573=== RUN TestNARDeduplicationMetadataUploadBug574=== PAUSE TestNARDeduplicationMetadataUploadBug575=== RUN TestMetricsInventory576=== PAUSE TestMetricsInventory577=== RUN TestService_NativeMTLS578=== PAUSE TestService_NativeMTLS579=== RUN TestServerTLSConfig580=== PAUSE TestServerTLSConfig581=== RUN TestMultipartCleanup582=== PAUSE TestMultipartCleanup583=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded584=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded585=== RUN TestPendingCleanupUsesOneCutoff586=== PAUSE TestPendingCleanupUsesOneCutoff587=== RUN TestObjectStatsTrigger588=== PAUSE TestObjectStatsTrigger589=== RUN TestOrphanedObjectsGC590=== PAUSE TestOrphanedObjectsGC591=== RUN TestOrphanedObjectsGCStressTest592=== PAUSE TestOrphanedObjectsGCStressTest593=== RUN TestCreatePin_ReservedPins594=== PAUSE TestCreatePin_ReservedPins595=== RUN TestPresentReportsOnlyClosureRoots596=== PAUSE TestPresentReportsOnlyClosureRoots597=== RUN TestPresentNotReportedWhileGCDeletesClosure598=== PAUSE TestPresentNotReportedWhileGCDeletesClosure599=== RUN TestParseSingleRange600=== PAUSE TestParseSingleRange601=== RUN TestProxyHeadersOnlyTrustedOnSocket602=== PAUSE TestProxyHeadersOnlyTrustedOnSocket603=== RUN TestIsValidCachePath604=== PAUSE TestIsValidCachePath605=== RUN TestReadProxyNarinfo606=== PAUSE TestReadProxyNarinfo607=== RUN TestReadProxyNarinfoAlreadyDecompressed608=== PAUSE TestReadProxyNarinfoAlreadyDecompressed609=== RUN TestReadProxyNarStreaming610=== PAUSE TestReadProxyNarStreaming611=== RUN TestReadProxy404612=== PAUSE TestReadProxy404613=== RUN TestReadProxyInvalidPath614=== PAUSE TestReadProxyInvalidPath615=== RUN TestReadProxyHead616=== PAUSE TestReadProxyHead617=== RUN TestReadProxyConditionalGet618=== PAUSE TestReadProxyConditionalGet619=== RUN TestReadProxyRootRedirectsToIndexHTML620=== PAUSE TestReadProxyRootRedirectsToIndexHTML621=== RUN TestReadProxyDisabled622=== PAUSE TestReadProxyDisabled623=== RUN TestReadRedirectNar624=== PAUSE TestReadRedirectNar625=== RUN TestReadRedirectKeepsNarinfoProxied626=== PAUSE TestReadRedirectKeepsNarinfoProxied627=== RUN TestReadProxyRangeRequest628=== PAUSE TestReadProxyRangeRequest629=== RUN TestReadRedirectUsesPublicS3URL630=== PAUSE TestReadRedirectUsesPublicS3URL631=== RUN TestPush_OverlappingRootsStoreOneRowPerKey632=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey633=== RUN TestPush_CompleteCommitsEveryRoot634=== PAUSE TestPush_CompleteCommitsEveryRoot635=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit636=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit637=== RUN TestPush_RejectsBadRequests638=== PAUSE TestPush_RejectsBadRequests639=== RUN TestPush_SignsNarinfosOfItsPendingObjects640=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects641=== RUN TestRedundantMultipartUpload642=== PAUSE TestRedundantMultipartUpload643=== RUN TestCompleteMultipartUpload_ErrorButObjectExists644=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists645=== RUN TestCompletedNarNotReofferedAcrossClosures646=== PAUSE TestCompletedNarNotReofferedAcrossClosures647=== RUN TestPresignedUploadRegisteredBeforeCommit648=== PAUSE TestPresignedUploadRegisteredBeforeCommit649=== RUN TestService_Rustfstest650=== PAUSE TestService_Rustfstest651=== RUN TestParseSize652=== PAUSE TestParseSize653=== RUN TestSkippedUploadsHandler654=== PAUSE TestSkippedUploadsHandler655=== RUN TestSystemdListenerNotActivated656--- PASS: TestSystemdListenerNotActivated (0.00s)657=== RUN TestWatchdogBeatsWhenHealthy658--- PASS: TestWatchdogBeatsWhenHealthy (0.02s)659=== RUN TestWatchdogSkipsWhenUnhealthy6602026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6612026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6622026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6632026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6642026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6652026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6662026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6672026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6682026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"6692026/10/01 10:23:54 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"670--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)671=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle672=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle673=== RUN TestProxyWriteTimeout674=== PAUSE TestProxyWriteTimeout675=== RUN TestPendingClosureWriteTimeout676=== PAUSE TestPendingClosureWriteTimeout677=== RUN TestIsValidUploadKey678=== PAUSE TestIsValidUploadKey679=== RUN TestUploadHandlersRejectInvalidKeys680=== PAUSE TestUploadHandlersRejectInvalidKeys681=== RUN TestUploadHandlersRejectOversizedBody682=== PAUSE TestUploadHandlersRejectOversizedBody683=== RUN TestService_cleanupPendingClosuresHandler684=== PAUSE TestService_cleanupPendingClosuresHandler685=== RUN TestService_createPendingClosureHandler686=== PAUSE TestService_createPendingClosureHandler687=== RUN TestService_verifyS3Integrity688=== PAUSE TestService_verifyS3Integrity689=== RUN TestCompleteMultipartUnregistered690=== PAUSE TestCompleteMultipartUnregistered691=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT692=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT693=== CONT TestService_AuthMiddleware694=== CONT TestNARDeduplicationMetadataUploadBug695=== CONT TestGCSweepSkipsPendingObjects696=== CONT TestPushWaitsForSweepHoldingRow697=== CONT TestCreatePendingClosureRejectsOversizedNAR698=== CONT TestCacheConfigHandlerMaxNarSize699=== CONT TestGenerateLandingPage7002026/10/01 10:23:54 INFO Received uploads request method=POST path=/api/pending_closures701--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)702=== CONT TestService_readinessHandler703=== CONT TestService_healthCheckHandler704=== CONT TestGracefulShutdownDrainsInflight705=== CONT TestGCTaskStore_Fail706=== CONT TestGCTaskStore_PhaseUpdates707=== CONT TestGCTaskStore_CompletedAllowsNewTask708=== CONT TestGCTaskStore_GetReturnsLatest709=== CONT TestGCTaskStore_GetEmpty710=== CONT TestGCTaskStore_ConflictDifferentParams711=== CONT TestGCTaskStore_DeduplicateSameParams712=== CONT TestGCTaskStore_StartNew713=== CONT TestGCEndsOnShutdown714=== CONT TestClientSharedPathCommittedMidPush715=== CONT TestCommitRacingPendingCleanupKeepsObjects716=== CONT TestSweepRechecksPendingAfterLocking717=== CONT TestGetExistingObjectsLocksRows718=== CONT TestTombstonedObjectOfferedWithoutWaiting719=== CONT TestRegisterCompletedObjectNeedsPendingRow720--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)721=== CONT TestSweepSkipsRowsLockedByPush722--- PASS: TestGCTaskStore_StartNew (0.00s)723=== CONT TestFailedS3DeleteKeepsTombstone724--- PASS: TestGCTaskStore_Fail (0.00s)725=== CONT TestForceGCDuringPushOffersSweptObject726=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows727=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows728=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check729=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check730=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection731--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)7322026/10/01 10:23:54 INFO Starting HTTP server address=127.0.0.1:39481733=== CONT TestGCSweepDeliversEachKeyOnce734--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)735=== CONT TestParseSize736--- PASS: TestParseSize (0.00s)737=== CONT TestReadRedirectKeepsNarinfoProxied7382026/10/01 10:23:54 INFO Shutdown signal received, draining in-flight requests timeout=10s739--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)740=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT741--- PASS: TestGCTaskStore_GetEmpty (0.00s)742=== CONT TestCompleteMultipartUnregistered743--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)744=== CONT TestService_verifyS3Integrity745--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)746=== CONT TestService_Rustfstest747--- PASS: TestGenerateLandingPage (0.01s)748=== CONT TestService_createPendingClosureHandler749--- PASS: TestGracefulShutdownDrainsInflight (0.07s)750=== CONT TestPresignedUploadRegisteredBeforeCommit7512026-10-01 10:23:54.551 UTC [643] ERROR: relation "goose_db_version" does not exist at character 367522026-10-01 10:23:54.551 UTC [643] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7532026-10-01 10:23:54.643 UTC [644] ERROR: relation "goose_db_version" does not exist at character 367542026-10-01 10:23:54.643 UTC [644] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7552026-10-01 10:23:54.646 UTC [645] ERROR: relation "goose_db_version" does not exist at character 367562026-10-01 10:23:54.646 UTC [645] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7572026-10-01 10:23:54.653 UTC [646] ERROR: relation "goose_db_version" does not exist at character 367582026-10-01 10:23:54.653 UTC [646] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7592026-10-01 10:23:54.684 UTC [647] ERROR: relation "goose_db_version" does not exist at character 367602026-10-01 10:23:54.684 UTC [647] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7612026/10/01 10:23:54 OK 20241026095416_initial_model.sql (14.44ms)7622026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (5.83ms)7632026/10/01 10:23:54 OK 20241026095416_initial_model.sql (17.35ms)7642026/10/01 10:23:54 OK 20241026095416_initial_model.sql (17.45ms)7652026/10/01 10:23:54 OK 20241026095416_initial_model.sql (52.56ms)7662026/10/01 10:23:54 OK 20251218171726_add_pins.sql (7.04ms)7672026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (5.44ms)7682026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (5.59ms)7692026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (5.43ms)7702026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (8.61ms)7712026-10-01 10:23:54.718 UTC [651] ERROR: relation "goose_db_version" does not exist at character 367722026-10-01 10:23:54.718 UTC [651] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7732026/10/01 10:23:54 OK 20251218171726_add_pins.sql (22.58ms)7742026/10/01 10:23:54 OK 20251218171726_add_pins.sql (22.12ms)7752026/10/01 10:23:54 OK 20251218171726_add_pins.sql (27.89ms)7762026/10/01 10:23:54 OK 20260905000000_add_claims.sql (22.47ms)7772026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (8.13ms)7782026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (5.64ms)7792026/10/01 10:23:54 OK 20241026095416_initial_model.sql (38.34ms)7802026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (8.68ms)7812026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (5.72ms)7822026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200007832026/10/01 10:23:54 OK 20260905000000_add_claims.sql (6.61ms)7842026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (4.74ms)7852026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (13.78ms)7862026/10/01 10:23:54 OK 20260905000000_add_claims.sql (8.51ms)7872026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (4.43ms)7882026/10/01 10:23:54 OK 1_commit_pending_closure.sql (5.36ms)7892026-10-01 10:23:54.748 UTC [652] ERROR: relation "goose_db_version" does not exist at character 367902026-10-01 10:23:54.748 UTC [652] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC7912026/10/01 10:23:54 OK 20251218171726_add_pins.sql (6.65ms)7922026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.7ms)7932026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (3.38ms)7942026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200007952026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (5.33ms)7962026/10/01 10:23:54 OK 20260905000000_add_claims.sql (7.56ms)7972026/10/01 10:23:54 OK 3_commit_push.sql (2.73ms)7982026/10/01 10:23:54 goose: up to current file version: 37992026-10-01 10:23:54.754 UTC [653] ERROR: relation "goose_db_version" does not exist at character 368002026-10-01 10:23:54.754 UTC [653] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8012026/10/01 10:23:54 OK 1_commit_pending_closure.sql (3.96ms)8022026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (4.53ms)8032026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200008042026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (7.31ms)8052026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.57ms)8062026/10/01 10:23:54 OK 20241026095416_initial_model.sql (14.12ms)8072026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (5.99ms)8082026-10-01 10:23:54.759 UTC [654] ERROR: relation "goose_db_version" does not exist at character 368092026-10-01 10:23:54.759 UTC [654] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8102026-10-01 10:23:54.760 UTC [655] ERROR: relation "goose_db_version" does not exist at character 368112026-10-01 10:23:54.760 UTC [655] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8122026-10-01 10:23:54.760 UTC [657] ERROR: relation "goose_db_version" does not exist at character 368132026-10-01 10:23:54.760 UTC [657] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8142026-10-01 10:23:54.760 UTC [656] ERROR: relation "goose_db_version" does not exist at character 368152026-10-01 10:23:54.760 UTC [656] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8162026/10/01 10:23:54 OK 3_commit_push.sql (2.71ms)8172026/10/01 10:23:54 goose: up to current file version: 38182026/10/01 10:23:54 OK 20260905000000_add_claims.sql (5.33ms)8192026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (4.39ms)8202026/10/01 10:23:54 OK 1_commit_pending_closure.sql (5.72ms)8212026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (19.71ms)8222026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200008232026/10/01 10:23:54 OK 2_object_stats_trigger.sql (19.6ms)8242026/10/01 10:23:54 OK 20251218171726_add_pins.sql (19.73ms)8252026/10/01 10:23:54 OK 1_commit_pending_closure.sql (4.66ms)8262026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (20.64ms)8272026/10/01 10:23:54 OK 3_commit_push.sql (1.86ms)8282026/10/01 10:23:54 goose: up to current file version: 38292026/10/01 10:23:54 INFO Received uploads request method=POST path=/api/pending_closures8302026/10/01 10:23:54 OK 2_object_stats_trigger.sql (3.86ms)8312026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (4.9ms)8322026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200008332026/10/01 10:23:54 OK 3_commit_push.sql (2.42ms)8342026/10/01 10:23:54 goose: up to current file version: 38352026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (8.25ms)8362026/10/01 10:23:54 OK 20241026095416_initial_model.sql (27.21ms)8372026/10/01 10:23:54 OK 1_commit_pending_closure.sql (5.12ms)8382026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (3.67ms)8392026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.45ms)8402026/10/01 10:23:54 OK 20260905000000_add_claims.sql (5.25ms)8412026/10/01 10:23:54 OK 20241026095416_initial_model.sql (14.33ms)8422026/10/01 10:23:54 OK 3_commit_push.sql (2.36ms)8432026/10/01 10:23:54 goose: up to current file version: 38442026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.81ms)8452026-10-01 10:23:54.801 UTC [659] ERROR: relation "goose_db_version" does not exist at character 368462026-10-01 10:23:54.801 UTC [659] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8472026/10/01 10:23:54 OK 20251218171726_add_pins.sql (5.94ms)8482026/10/01 10:23:54 OK 20241026095416_initial_model.sql (17.11ms)8492026/10/01 10:23:54 OK 20241026095416_initial_model.sql (13.84ms)8502026/10/01 10:23:54 OK 20241026095416_initial_model.sql (13.41ms)8512026/10/01 10:23:54 OK 20241026095416_initial_model.sql (14.79ms)8522026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.18ms)8532026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (1.78ms)8542026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (1.96ms)8552026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.33ms)8562026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.17ms)8572026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200008582026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.79ms)8592026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.4ms)8602026/10/01 10:23:54 OK 20251218171726_add_pins.sql (4.31ms)8612026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (3.02ms)8622026/10/01 10:23:54 OK 1_commit_pending_closure.sql (3.09ms)8632026/10/01 10:23:54 OK 20251218171726_add_pins.sql (4.41ms)8642026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.95ms)8652026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.61ms)8662026/10/01 10:23:54 INFO Aborted multipart uploads count=0 kept=08672026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.07ms)8682026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.15ms)8692026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.62ms)8702026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.01ms)8712026-10-01 10:23:54.813 UTC [662] ERROR: relation "goose_db_version" does not exist at character 368722026-10-01 10:23:54.813 UTC [662] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8732026-10-01 10:23:54.813 UTC [660] ERROR: relation "goose_db_version" does not exist at character 368742026-10-01 10:23:54.813 UTC [660] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8752026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.54ms)8762026-10-01 10:23:54.814 UTC [663] ERROR: relation "goose_db_version" does not exist at character 368772026-10-01 10:23:54.814 UTC [663] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8782026/10/01 10:23:54 OK 3_commit_push.sql (2.43ms)8792026/10/01 10:23:54 goose: up to current file version: 38802026-10-01 10:23:54.815 UTC [664] ERROR: relation "goose_db_version" does not exist at character 368812026-10-01 10:23:54.815 UTC [664] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8822026/10/01 10:23:54 OK 20260905000000_add_claims.sql (2.85ms)8832026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.56ms)8842026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200008852026/10/01 10:23:54 WARN Force mode enabled - objects will be deleted immediately without grace period8862026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.53ms)8872026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (6.04ms)8882026-10-01 10:23:54.817 UTC [665] ERROR: relation "goose_db_version" does not exist at character 368892026-10-01 10:23:54.817 UTC [665] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8902026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.35ms)8912026-10-01 10:23:54.817 UTC [666] ERROR: relation "goose_db_version" does not exist at character 368922026-10-01 10:23:54.817 UTC [666] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8932026-10-01 10:23:54.818 UTC [667] ERROR: relation "goose_db_version" does not exist at character 368942026-10-01 10:23:54.818 UTC [667] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8952026-10-01 10:23:54.818 UTC [668] ERROR: relation "goose_db_version" does not exist at character 368962026-10-01 10:23:54.818 UTC [668] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC8972026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (5.84ms)8982026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (3.82ms)8992026/10/01 10:23:54 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=09002026/10/01 10:23:54 OK 20260905000000_add_claims.sql (4.03ms)9012026-10-01 10:23:54.820 UTC [670] ERROR: relation "goose_db_version" does not exist at character 369022026-10-01 10:23:54.820 UTC [670] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9032026-10-01 10:23:54.820 UTC [669] ERROR: relation "goose_db_version" does not exist at character 369042026-10-01 10:23:54.820 UTC [669] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9052026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.93ms)9062026/10/01 10:23:54 OK 1_commit_pending_closure.sql (4.34ms)9072026/10/01 10:23:54 OK 20241026095416_initial_model.sql (10.42ms)9082026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (3.34ms)9092026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.05ms)9102026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200009112026/10/01 10:23:54 OK 2_object_stats_trigger.sql (1.7ms)9122026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.39ms)9132026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.52ms)9142026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.89ms)9152026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.1ms)9162026/10/01 10:23:54 OK 3_commit_push.sql (1.11ms)9172026/10/01 10:23:54 goose: up to current file version: 39182026/10/01 10:23:54 INFO Vacuumed table table=pending_closures9192026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.51ms)9202026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200009212026/10/01 10:23:54 OK 1_commit_pending_closure.sql (2.63ms)9222026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.51ms)9232026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.1ms)9242026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200009252026-10-01 10:23:54.826 UTC [672] ERROR: relation "goose_db_version" does not exist at character 369262026-10-01 10:23:54.826 UTC [672] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC9272026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.84ms)9282026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200009292026/10/01 10:23:54 OK 2_object_stats_trigger.sql (1.64ms)9302026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.54ms)9312026/10/01 10:23:54 INFO Vacuumed table table=pending_objects9322026/10/01 10:23:54 INFO Vacuumed table table=multipart_uploads9332026/10/01 10:23:54 OK 1_commit_pending_closure.sql (3.91ms)9342026/10/01 10:23:54 OK 3_commit_push.sql (1.53ms)9352026/10/01 10:23:54 goose: up to current file version: 39362026/10/01 10:23:54 INFO Vacuumed table table=closures9372026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.85ms)9382026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200009392026/10/01 10:23:54 OK 1_commit_pending_closure.sql (2.43ms)9402026/10/01 10:23:54 OK 1_commit_pending_closure.sql (3.3ms)9412026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.12ms)9422026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.02ms)9432026/10/01 10:23:54 INFO Vacuumed table table=objects9442026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.1ms)9452026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.2ms)9462026/10/01 10:23:54 OK 3_commit_push.sql (1.81ms)9472026/10/01 10:23:54 goose: up to current file version: 39482026/10/01 10:23:54 OK 1_commit_pending_closure.sql (3.49ms)9492026/10/01 10:23:54 OK 20241026095416_initial_model.sql (11.51ms)9502026/10/01 10:23:54 OK 3_commit_push.sql (1.52ms)9512026/10/01 10:23:54 goose: up to current file version: 39522026/10/01 10:23:54 OK 3_commit_push.sql (2.3ms)9532026/10/01 10:23:54 goose: up to current file version: 39542026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.24ms)9552026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.47ms)9562026/10/01 10:23:54 OK 20241026095416_initial_model.sql (11.69ms)9572026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.72ms)9582026/10/01 10:23:54 OK 3_commit_push.sql (1.58ms)9592026/10/01 10:23:54 goose: up to current file version: 39602026/10/01 10:23:54 OK 20241026095416_initial_model.sql (12.85ms)9612026/10/01 10:23:54 OK 20241026095416_initial_model.sql (12.46ms)9622026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.27ms)9632026/10/01 10:23:54 INFO Received uploads request method=POST path=/api/pending_closures9642026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.8ms)9652026/10/01 10:23:54 OK 20241026095416_initial_model.sql (11.04ms)9662026/10/01 10:23:54 OK 20241026095416_initial_model.sql (11.16ms)9672026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.23ms)9682026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.34ms)9692026/10/01 10:23:54 OK 20251218171726_add_pins.sql (4.2ms)9702026/10/01 10:23:54 OK 20241026095416_initial_model.sql (12.48ms)9712026/10/01 10:23:54 OK 20241026095416_initial_model.sql (11.5ms)9722026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (1.92ms)9732026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.94ms)9742026/10/01 10:23:54 goose: successfully migrated database to version: 202609231200009752026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.7ms)9762026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.68ms)9772026/10/01 10:23:54 OK 20241026095416_initial_model.sql (11.58ms)9782026/10/01 10:23:54 OK 20241026095416_initial_model.sql (12.37ms)979--- PASS: TestGCSweepSkipsPendingObjects (0.55s)980=== CONT TestService_cleanupPendingClosuresHandler9812026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.63ms)9822026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.73ms)9832026/10/01 10:23:54 OK 20251218171726_add_pins.sql (4.46ms)9842026/10/01 10:23:54 OK 20241026095416_initial_model.sql (10.92ms)9852026/10/01 10:23:54 OK 1_commit_pending_closure.sql (2.82ms)9862026/10/01 10:23:54 OK 20251218171726_add_pins.sql (4.6ms)9872026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.59ms)9882026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (2.55ms)9892026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.32ms)9902026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.96ms)9912026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.18ms)9922026/10/01 10:23:54 OK 2_object_stats_trigger.sql (1.22ms)9932026/10/01 10:23:54 OK 20251218171726_add_pins.sql (2.69ms)9942026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.72ms)9952026/10/01 10:23:54 OK 20251218171726_add_pins.sql (2.78ms)9962026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (3.3ms)9972026/10/01 10:23:54 OK 20251218171726_add_pins.sql (3.22ms)9982026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.13ms)9992026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (3.65ms)10002026/10/01 10:23:54 OK 20260905000000_add_claims.sql (2.63ms)10012026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (2.58ms)10022026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (3.31ms)10032026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (1.9ms)10042026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.23ms)10052026/10/01 10:23:54 OK 20251218171726_add_pins.sql (7.43ms)10062026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.21ms)10072026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.56ms)10082026/10/01 10:23:54 OK 3_commit_push.sql (1.3ms)10092026/10/01 10:23:54 goose: up to current file version: 310102026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.12ms)10112026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.8ms)10122026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (8.07ms)10132026/10/01 10:23:54 OK 20260905000000_add_claims.sql (4.05ms)10142026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.54ms)10152026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010162026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (1.61ms)10172026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010182026/10/01 10:23:54 OK 20251210153512_drop_unused_gin_index.sql (1.74ms)10192026/10/01 10:23:54 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"1020--- PASS: TestService_AuthMiddleware (0.56s)1021=== CONT TestCompletedNarNotReofferedAcrossClosures10222026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.26ms)10232026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.43ms)10242026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.9ms)10252026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.24ms)10262026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (4.23ms)10272026/10/01 10:23:54 OK 1_commit_pending_closure.sql (2.95ms)10282026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (3.89ms)10292026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.38ms)10302026/10/01 10:23:54 OK 1_commit_pending_closure.sql (2.87ms)10312026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.62ms)10322026/10/01 10:23:54 OK 20251218171726_add_pins.sql (2.76ms)10332026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.08ms)10342026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010352026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.81ms)10362026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010372026/10/01 10:23:54 OK 2_object_stats_trigger.sql (1.81ms)10382026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.68ms)10392026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010402026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (2.79ms)10412026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010422026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.43ms)10432026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.29ms)10442026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.32ms)10452026/10/01 10:23:54 OK 3_commit_push.sql (1.11ms)10462026/10/01 10:23:54 goose: up to current file version: 310472026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.99ms)10482026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (2.9ms)10492026/10/01 10:23:54 OK 20260905000000_add_claims.sql (3.02ms)10502026/10/01 10:23:54 OK 3_commit_push.sql (566.86µs)10512026/10/01 10:23:54 goose: up to current file version: 310522026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.6ms)10532026/10/01 10:23:54 OK 20260628120000_add_object_size_and_stats.sql (3.23ms)10542026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.82ms)10552026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.96ms)10562026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (1.59ms)10572026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (1.65ms)10582026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010592026/10/01 10:23:54 OK 2_object_stats_trigger.sql (1.22ms)10602026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (1.16ms)10612026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010622026/10/01 10:23:54 OK 2_object_stats_trigger.sql (735.49µs)10632026/10/01 10:23:54 OK 2_object_stats_trigger.sql (1.06ms)10642026/10/01 10:23:54 OK 2_object_stats_trigger.sql (925.22µs)10652026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (1.68ms)10662026/10/01 10:23:54 OK 3_commit_push.sql (731.1µs)10672026/10/01 10:23:54 goose: up to current file version: 310682026/10/01 10:23:54 OK 3_commit_push.sql (614.64µs)10692026/10/01 10:23:54 goose: up to current file version: 310702026/10/01 10:23:54 OK 3_commit_push.sql (724.48µs)10712026/10/01 10:23:54 goose: up to current file version: 310722026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (1.46ms)10732026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010742026/10/01 10:23:54 OK 3_commit_push.sql (644.65µs)10752026/10/01 10:23:54 goose: up to current file version: 310762026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.35ms)10772026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.59ms)10782026/10/01 10:23:54 OK 20260905000000_add_claims.sql (2.51ms)10792026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (1.45ms)10802026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010812026/10/01 10:23:54 OK 2_object_stats_trigger.sql (863.92µs)10822026/10/01 10:23:54 OK 2_object_stats_trigger.sql (975.44µs)10832026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.78ms)10842026/10/01 10:23:54 OK 3_commit_push.sql (701.46µs)10852026/10/01 10:23:54 goose: up to current file version: 310862026/10/01 10:23:54 OK 3_commit_push.sql (773.74µs)10872026/10/01 10:23:54 goose: up to current file version: 310882026/10/01 10:23:54 OK 20260920000000_drop_claims.sql (1.61ms)10892026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.7ms)1090=== NAME TestNARDeduplicationMetadataUploadBug10912026/10/01 10:23:54 OK 2_object_stats_trigger.sql (956.52µs)1092 metadata_upload_test.go:48: First store path: /build/TestNARDeduplicationMetadataUploadBug3777126225/001/store/0bahw9prjmc776k9v104c77pc1hfbrqb-file1.txt10932026/10/01 10:23:54 OK 20260923120000_add_pushes.sql (1.76ms)10942026/10/01 10:23:54 goose: successfully migrated database to version: 2026092312000010952026/10/01 10:23:54 OK 3_commit_push.sql (1.92ms)10962026/10/01 10:23:54 goose: up to current file version: 310972026/10/01 10:23:54 OK 2_object_stats_trigger.sql (2.49ms)10982026/10/01 10:23:54 OK 1_commit_pending_closure.sql (1.64ms)10992026/10/01 10:23:54 OK 3_commit_push.sql (1.35ms)11002026/10/01 10:23:54 goose: up to current file version: 311012026/10/01 10:23:54 OK 2_object_stats_trigger.sql (842.15µs)11022026/10/01 10:23:54 OK 3_commit_push.sql (514.01µs)11032026/10/01 10:23:54 goose: up to current file version: 311042026/10/01 10:23:54 INFO Received uploads request method=POST path=/api/pending_closures11052026/10/01 10:23:54 WARN readiness check failed error="closed pool"1106--- PASS: TestService_readinessHandler (0.60s)1107=== CONT TestUploadHandlersRejectOversizedBody11082026/10/01 10:23:54 INFO Received push request method=POST path=/api/pushes1109--- PASS: TestGCEndsOnShutdown (0.66s)1110=== CONT TestCompleteMultipartUpload_ErrorButObjectExists11112026/10/01 10:23:54 INFO Aborted multipart uploads count=0 kept=011122026/10/01 10:23:54 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)11132026/10/01 10:23:54 INFO Uploading 0bahw9prjmc776k9v104c77pc1hfbrqb-file1.txt (160B)11142026/10/01 10:23:54 WARN Force mode enabled - objects will be deleted immediately without grace period11152026/10/01 10:23:54 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011162026/10/01 10:23:54 INFO Vacuumed table table=pending_closures11172026/10/01 10:23:54 INFO Vacuumed table table=pending_objects11182026/10/01 10:23:54 INFO Vacuumed table table=multipart_uploads11192026/10/01 10:23:54 INFO Vacuumed table table=closures11202026/10/01 10:23:54 INFO Vacuumed table table=objects11212026/10/01 10:23:54 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"11222026-10-01 10:23:54.976 UTC [735] ERROR: relation "goose_db_version" does not exist at character 3611232026-10-01 10:23:54.976 UTC [735] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC11242026/10/01 10:23:54 INFO Aborted multipart uploads count=0 kept=011252026-10-01 10:23:54.976 UTC [734] ERROR: relation "goose_db_version" does not exist at character 3611262026-10-01 10:23:54.976 UTC [734] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1127--- PASS: TestRegisterCompletedObjectNeedsPendingRow (0.68s)1128=== CONT TestUploadHandlersRejectInvalidKeys1129=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1130=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1131=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal11322026/10/01 10:23:54 WARN Force mode enabled - objects will be deleted immediately without grace period11332026/10/01 10:23:54 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=011342026/10/01 10:23:54 INFO Vacuumed table table=pending_closures11352026/10/01 10:23:54 INFO Vacuumed table table=pending_objects11362026/10/01 10:23:54 INFO Vacuumed table table=multipart_uploads11372026/10/01 10:23:54 INFO Vacuumed table table=closures11382026/10/01 10:23:54 INFO Vacuumed table table=objects1139=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal11402026/10/01 10:23:55 WARN Failed to register uploaded object key=0bahw9prjmc776k9v104c77pc1hfbrqb.ls error="server returned 404: 404 page not found\n"1141--- PASS: TestSweepSkipsRowsLockedByPush (0.72s)11422026/10/01 10:23:55 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1143=== CONT TestRedundantMultipartUpload1144=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1145=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1146=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1147=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1148=== CONT TestIsValidUploadKey1149=== RUN TestIsValidUploadKey/narinfo11502026/10/01 10:23:55 INFO Signed narinfos id=1 count=11151=== PAUSE TestIsValidUploadKey/narinfo1152=== RUN TestIsValidUploadKey/nar_zst1153=== PAUSE TestIsValidUploadKey/nar_zst11542026/10/01 10:23:55 INFO Uploading 1 narinfos1155=== RUN TestIsValidUploadKey/nar_xz1156=== PAUSE TestIsValidUploadKey/nar_xz1157=== RUN TestIsValidUploadKey/nar_plain1158=== PAUSE TestIsValidUploadKey/nar_plain1159=== RUN TestIsValidUploadKey/listing1160=== PAUSE TestIsValidUploadKey/listing1161=== RUN TestIsValidUploadKey/build_log1162=== PAUSE TestIsValidUploadKey/build_log1163=== RUN TestIsValidUploadKey/build_log_home-manager_file1164=== PAUSE TestIsValidUploadKey/build_log_home-manager_file1165=== RUN TestIsValidUploadKey/build_log_plus_in_name1166=== PAUSE TestIsValidUploadKey/build_log_plus_in_name1167=== RUN TestIsValidUploadKey/build_log_question_mark1168=== PAUSE TestIsValidUploadKey/build_log_question_mark1169=== RUN TestIsValidUploadKey/build_log_equals1170=== PAUSE TestIsValidUploadKey/build_log_equals1171=== RUN TestIsValidUploadKey/realisation1172=== PAUSE TestIsValidUploadKey/realisation1173=== RUN TestIsValidUploadKey/realisation_plus_in_output1174=== PAUSE TestIsValidUploadKey/realisation_plus_in_output1175=== RUN TestIsValidUploadKey/nix-cache-info1176=== PAUSE TestIsValidUploadKey/nix-cache-info1177=== RUN TestIsValidUploadKey/index.html1178=== PAUSE TestIsValidUploadKey/index.html1179=== RUN TestIsValidUploadKey/narinfo_key,_nar_type1180=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type1181=== RUN TestIsValidUploadKey/nar_key,_narinfo_type1182=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type1183=== RUN TestIsValidUploadKey/listing_key,_narinfo_type1184=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type1185=== RUN TestIsValidUploadKey/traversal1186=== PAUSE TestIsValidUploadKey/traversal1187=== RUN TestIsValidUploadKey/traversal_nar1188=== PAUSE TestIsValidUploadKey/traversal_nar1189=== RUN TestIsValidUploadKey/absolute1190=== PAUSE TestIsValidUploadKey/absolute11912026/10/01 10:23:55 OK 20241026095416_initial_model.sql (48ms)1192=== RUN TestIsValidUploadKey/empty_key1193=== PAUSE TestIsValidUploadKey/empty_key1194=== RUN TestIsValidUploadKey/unknown_type1195=== PAUSE TestIsValidUploadKey/unknown_type1196=== CONT TestPush_SignsNarinfosOfItsPendingObjects11972026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.13ms)11982026/10/01 10:23:55 INFO Received complete push request method=POST path=/api/pushes/1/complete11992026/10/01 10:23:55 WARN Failed to register uploaded object key=0bahw9prjmc776k9v104c77pc1hfbrqb.narinfo error="server returned 404: 404 page not found\n"12002026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.41ms)12012026/10/01 10:23:55 OK 20241026095416_initial_model.sql (12.73ms)12022026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (6.11ms)12032026/10/01 10:23:55 INFO Upload complete. (138ms)12042026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.11ms)1205=== NAME TestNARDeduplicationMetadataUploadBug1206 metadata_upload_test.go:54: Retrieved narinfo from S3:1207 StorePath: /build/TestNARDeduplicationMetadataUploadBug3777126225/001/store/0bahw9prjmc776k9v104c77pc1hfbrqb-file1.txt1208 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1209 Compression: zstd1210 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1211 NarSize: 1601212 References: 1213 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf12142026/10/01 10:23:55 OK 20260905000000_add_claims.sql (5.49ms)1215 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1216 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1217 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}12182026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.47ms)12192026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.9ms)12202026-10-01 10:23:55.053 UTC [740] ERROR: relation "goose_db_version" does not exist at character 3612212026-10-01 10:23:55.053 UTC [740] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12222026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.95ms)12232026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000012242026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (6.24ms)12252026/10/01 10:23:55 OK 1_commit_pending_closure.sql (3.15ms)12262026/10/01 10:23:55 OK 20260905000000_add_claims.sql (9.28ms)12272026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.86ms)12282026/10/01 10:23:55 OK 3_commit_push.sql (2.27ms)12292026/10/01 10:23:55 goose: up to current file version: 312302026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (3.43ms)12312026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.59ms)12322026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000012332026/10/01 10:23:55 OK 20241026095416_initial_model.sql (8.74ms)12342026/10/01 10:23:55 OK 1_commit_pending_closure.sql (4.63ms)12352026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.48ms)12362026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.14ms)12372026/10/01 10:23:55 OK 3_commit_push.sql (943.1µs)12382026/10/01 10:23:55 goose: up to current file version: 312392026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.89ms)1240--- PASS: TestService_healthCheckHandler (0.78s)1241=== CONT TestPendingClosureWriteTimeout1242=== RUN TestPendingClosureWriteTimeout/empty1243=== PAUSE TestPendingClosureWriteTimeout/empty1244=== RUN TestPendingClosureWriteTimeout/400_objects1245=== PAUSE TestPendingClosureWriteTimeout/400_objects1246=== RUN TestPendingClosureWriteTimeout/670k_objects1247=== PAUSE TestPendingClosureWriteTimeout/670k_objects1248=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1249=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1250=== CONT TestPush_RejectsBadRequests1251=== NAME TestNARDeduplicationMetadataUploadBug1252 metadata_upload_test.go:64: Second store path (same content): /build/TestNARDeduplicationMetadataUploadBug3777126225/001/store/i2l7ljz3pvz8hppjxkqic3kbbmfxh3hy-file2.txt12532026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.49ms)12542026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.12ms)12552026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.32ms)12562026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=012572026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.41ms)12582026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000012592026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.29ms)12602026/10/01 10:23:55 WARN Force mode enabled - objects will be deleted immediately without grace period12612026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.42ms)12622026/10/01 10:23:55 OK 3_commit_push.sql (1.38ms)12632026/10/01 10:23:55 goose: up to current file version: 31264--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (0.80s)1265=== CONT TestProxyWriteTimeout1266=== RUN TestProxyWriteTimeout/narinfo1267=== PAUSE TestProxyWriteTimeout/narinfo1268=== RUN TestProxyWriteTimeout/1_GiB_nar1269=== PAUSE TestProxyWriteTimeout/1_GiB_nar1270=== RUN TestProxyWriteTimeout/10_GiB_nar1271=== PAUSE TestProxyWriteTimeout/10_GiB_nar1272=== RUN TestProxyWriteTimeout/unknown_size1273=== PAUSE TestProxyWriteTimeout/unknown_size1274=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle12752026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures1276=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure1277=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure1278=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart1279=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart1280=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts1281=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts1282=== CONT TestSkippedUploadsHandler12832026/10/01 10:23:55 INFO Client skipped oversized paths paths=3 nar_bytes=500000000012842026/10/01 10:23:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=012852026-10-01 10:23:55.125 UTC [781] ERROR: relation "goose_db_version" does not exist at character 3612862026-10-01 10:23:55.125 UTC [781] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC12872026/10/01 10:23:55 INFO Vacuumed table table=pending_closures1288--- PASS: TestSkippedUploadsHandler (0.01s)12892026/10/01 10:23:55 INFO Vacuumed table table=pending_objects1290=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit12912026/10/01 10:23:55 INFO Vacuumed table table=multipart_uploads12922026/10/01 10:23:55 INFO Vacuumed table table=closures12932026-10-01 10:23:55.129 UTC [782] ERROR: relation "goose_db_version" does not exist at character 3612942026-10-01 10:23:55.129 UTC [782] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1295--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (0.83s)1296=== CONT TestReadRedirectUsesPublicS3URL12972026/10/01 10:23:55 INFO Vacuumed table table=objects1298--- PASS: TestGCSweepDeliversEachKeyOnce (0.83s)1299=== CONT TestPush_OverlappingRootsStoreOneRowPerKey13002026/10/01 10:23:55 OK 20241026095416_initial_model.sql (8.76ms)13012026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.61ms)13022026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (3.03ms)13032026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.17ms)13042026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.12ms)13052026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.41ms)13062026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (5.31ms)1307--- PASS: TestReadRedirectKeepsNarinfoProxied (0.85s)1308=== CONT TestReadProxyRangeRequest13092026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.94ms)13102026/10/01 10:23:55 OK 20260905000000_add_claims.sql (4.22ms)13112026/10/01 10:23:55 OK 20260905000000_add_claims.sql (4.19ms)13122026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes13132026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (5.15ms)13142026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (3.28ms)13152026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.69ms)13162026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000013172026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (3.04ms)13182026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000013192026/10/01 10:23:55 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)13202026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures13212026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures13222026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures13232026/10/01 10:23:55 OK 1_commit_pending_closure.sql (3.55ms)13242026/10/01 10:23:55 OK 1_commit_pending_closure.sql (3.73ms)13252026/10/01 10:23:55 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign13262026/10/01 10:23:55 INFO Signed narinfos id=2 count=113272026/10/01 10:23:55 WARN Failed to register uploaded object key=i2l7ljz3pvz8hppjxkqic3kbbmfxh3hy.ls error="server returned 404: 404 page not found\n"13282026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.55ms)13292026/10/01 10:23:55 INFO Uploading 1 narinfos13302026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.22ms)13312026/10/01 10:23:55 OK 3_commit_push.sql (1.88ms)13322026/10/01 10:23:55 goose: up to current file version: 313332026/10/01 10:23:55 OK 3_commit_push.sql (1.65ms)13342026/10/01 10:23:55 goose: up to current file version: 313352026/10/01 10:23:55 INFO Received complete push request method=POST path=/api/pushes/2/complete13362026/10/01 10:23:55 WARN Failed to register uploaded object key=i2l7ljz3pvz8hppjxkqic3kbbmfxh3hy.narinfo error="server returned 404: 404 page not found\n"13372026/10/01 10:23:55 INFO Upload complete. (57ms)1338=== NAME TestNARDeduplicationMetadataUploadBug1339 metadata_upload_test.go:76: Retrieved narinfo from S3:1340 StorePath: /build/TestNARDeduplicationMetadataUploadBug3777126225/001/store/i2l7ljz3pvz8hppjxkqic3kbbmfxh3hy-file2.txt1341 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1342 Compression: zstd1343 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1344 NarSize: 1601345 References: 1346 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1347 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1348 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1349 {"version":1,"root":{"type":"regular","size":44}}13502026-10-01 10:23:55.191 UTC [809] ERROR: relation "goose_db_version" does not exist at character 3613512026-10-01 10:23:55.191 UTC [809] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1352--- PASS: TestNARDeduplicationMetadataUploadBug (0.90s)1353=== CONT TestPush_CompleteCommitsEveryRoot1354--- PASS: TestService_Rustfstest (0.89s)1355=== CONT TestCacheConfigHandler1356=== RUN TestCacheConfigHandler/full_config,_no_issuer1357=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1358=== RUN TestCacheConfigHandler/no_cache_url_configured1359=== PAUSE TestCacheConfigHandler/no_cache_url_configured1360=== RUN TestCacheConfigHandler/no_signing_keys1361=== PAUSE TestCacheConfigHandler/no_signing_keys1362=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1363=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1364=== CONT TestParseSingleRange1365=== RUN TestParseSingleRange/none1366=== PAUSE TestParseSingleRange/none1367=== RUN TestParseSingleRange/unknown_unit1368=== PAUSE TestParseSingleRange/unknown_unit1369=== RUN TestParseSingleRange/multi-range_ignored1370=== PAUSE TestParseSingleRange/multi-range_ignored1371=== RUN TestParseSingleRange/malformed_no_dash1372=== PAUSE TestParseSingleRange/malformed_no_dash1373=== RUN TestParseSingleRange/malformed_both_empty1374=== PAUSE TestParseSingleRange/malformed_both_empty1375=== RUN TestParseSingleRange/malformed_end_before_start1376=== PAUSE TestParseSingleRange/malformed_end_before_start1377=== RUN TestParseSingleRange/closed1378=== PAUSE TestParseSingleRange/closed1379=== RUN TestParseSingleRange/open-ended1380=== PAUSE TestParseSingleRange/open-ended1381=== RUN TestParseSingleRange/end_clamped_to_size1382=== PAUSE TestParseSingleRange/end_clamped_to_size1383=== RUN TestParseSingleRange/suffix1384=== PAUSE TestParseSingleRange/suffix1385=== RUN TestParseSingleRange/suffix_exceeds_size1386=== PAUSE TestParseSingleRange/suffix_exceeds_size1387=== RUN TestParseSingleRange/single_byte1388=== PAUSE TestParseSingleRange/single_byte1389=== RUN TestParseSingleRange/start_past_EOF1390=== PAUSE TestParseSingleRange/start_past_EOF1391=== RUN TestParseSingleRange/start_far_past_EOF1392=== PAUSE TestParseSingleRange/start_far_past_EOF1393=== CONT TestClientWithDependencies13942026/10/01 10:23:55 OK 20241026095416_initial_model.sql (10.64ms)13952026-10-01 10:23:55.221 UTC [814] ERROR: relation "goose_db_version" does not exist at character 3613962026-10-01 10:23:55.221 UTC [814] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC13972026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (3.55ms)13982026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.01ms)13992026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4.25ms)14002026/10/01 10:23:55 OK 20260905000000_add_claims.sql (4.61ms)14012026/10/01 10:23:55 OK 20241026095416_initial_model.sql (11.51ms)14022026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.97ms)14032026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (3.66ms)14042026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.01ms)14052026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.41ms)14062026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000014072026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.99ms)14082026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4.06ms)14092026-10-01 10:23:55.252 UTC [815] ERROR: relation "goose_db_version" does not exist at character 3614102026-10-01 10:23:55.252 UTC [815] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14112026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.8ms)14122026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.85ms)14132026/10/01 10:23:55 OK 3_commit_push.sql (2.09ms)14142026-10-01 10:23:55.256 UTC [816] ERROR: relation "goose_db_version" does not exist at character 3614152026-10-01 10:23:55.256 UTC [816] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14162026/10/01 10:23:55 goose: up to current file version: 314172026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.76ms)14182026-10-01 10:23:55.260 UTC [817] ERROR: relation "goose_db_version" does not exist at character 3614192026-10-01 10:23:55.260 UTC [817] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14202026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.6ms)14212026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000014222026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.32ms)14232026/10/01 10:23:55 OK 2_object_stats_trigger.sql (10.13ms)14242026/10/01 10:23:55 OK 20241026095416_initial_model.sql (14.32ms)14252026/10/01 10:23:55 OK 20241026095416_initial_model.sql (19.54ms)14262026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=014272026/10/01 10:23:55 OK 3_commit_push.sql (3.66ms)14282026/10/01 10:23:55 goose: up to current file version: 314292026/10/01 10:23:55 WARN Force mode enabled - objects will be deleted immediately without grace period14302026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.33ms)14312026/10/01 10:23:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=014322026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.53ms)14332026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.18ms)14342026-10-01 10:23:55.286 UTC [822] ERROR: relation "goose_db_version" does not exist at character 3614352026-10-01 10:23:55.286 UTC [822] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14362026/10/01 10:23:55 INFO Vacuumed table table=pending_closures14372026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.19ms)14382026/10/01 10:23:55 OK 20241026095416_initial_model.sql (10.19ms)14392026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures14402026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.48ms)14412026/10/01 10:23:55 INFO Vacuumed table table=pending_objects14422026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.15ms)14432026/10/01 10:23:55 INFO Vacuumed table table=multipart_uploads14442026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4ms)14452026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.6ms)14462026/10/01 10:23:55 INFO Vacuumed table table=closures14472026/10/01 10:23:55 INFO Vacuumed table table=objects14482026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.35ms)14492026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.78ms)14502026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.07ms)14512026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.77ms)14522026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.63ms)14532026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000014542026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.91ms)14552026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.66ms)14562026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000014572026/10/01 10:23:55 OK 20241026095416_initial_model.sql (8.26ms)14582026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.89ms)14592026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.37ms)14602026/10/01 10:23:55 OK 2_object_stats_trigger.sql (660.62µs)1461--- PASS: TestCommitRacingPendingCleanupKeepsObjects (1.00s)1462=== CONT TestReadRedirectNar14632026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.18ms)14642026/10/01 10:23:55 OK 3_commit_push.sql (788.06µs)14652026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.61ms)14662026/10/01 10:23:55 goose: up to current file version: 314672026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (1.79ms)14682026/10/01 10:23:55 OK 2_object_stats_trigger.sql (710.88µs)14692026/10/01 10:23:55 OK 3_commit_push.sql (934.12µs)14702026/10/01 10:23:55 goose: up to current file version: 314712026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.66ms)14722026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000014732026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.7ms)14742026-10-01 10:23:55.304 UTC [839] ERROR: relation "goose_db_version" does not exist at character 3614752026-10-01 10:23:55.304 UTC [839] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14762026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.21ms)14772026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (2.57ms)14782026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.74ms)14792026/10/01 10:23:55 OK 3_commit_push.sql (742.6µs)14802026/10/01 10:23:55 goose: up to current file version: 314812026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.1ms)14822026-10-01 10:23:55.310 UTC [841] ERROR: relation "goose_db_version" does not exist at character 3614832026-10-01 10:23:55.310 UTC [841] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC14842026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (1.56ms)14852026/10/01 10:23:55 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst14862026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures14872026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.5ms)14882026/10/01 10:23:55 goose: successfully migrated database to version: 202609231200001489--- PASS: TestPresignedUploadRegisteredBeforeCommit (0.94s)1490=== CONT TestClientMultipleUploads14912026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.74ms)14922026/10/01 10:23:55 OK 20241026095416_initial_model.sql (7.2ms)14932026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.65ms)14942026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.05ms)14952026/10/01 10:23:55 OK 3_commit_push.sql (1.83ms)14962026/10/01 10:23:55 goose: up to current file version: 314972026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.43ms)14982026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.12ms)14992026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.93ms)15002026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.35ms)15012026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.42ms)15022026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.55ms)15032026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.05ms)15042026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.91ms)15052026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000015062026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.31ms)15072026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (5.07ms)15082026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.78ms)15092026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=015102026/10/01 10:23:55 OK 3_commit_push.sql (2.18ms)15112026/10/01 10:23:55 goose: up to current file version: 315122026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.66ms)1513--- PASS: TestPushWaitsForSweepHoldingRow (1.04s)1514=== CONT TestReadProxyDisabled15152026/10/01 10:23:55 WARN Force mode enabled - objects will be deleted immediately without grace period15162026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.56ms)15172026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.16ms)15182026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000015192026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.54ms)15202026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.5ms)15212026/10/01 10:23:55 OK 3_commit_push.sql (1.42ms)15222026/10/01 10:23:55 goose: up to current file version: 315232026/10/01 10:23:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=015242026/10/01 10:23:55 INFO Vacuumed table table=pending_closures1525--- PASS: TestGetExistingObjectsLocksRows (1.06s)1526=== CONT TestClientIntegration15272026/10/01 10:23:55 INFO Vacuumed table table=pending_objects15282026/10/01 10:23:55 INFO Vacuumed table table=multipart_uploads15292026/10/01 10:23:55 INFO Vacuumed table table=closures15302026/10/01 10:23:55 INFO Vacuumed table table=objects1531--- PASS: TestSweepRechecksPendingAfterLocking (1.07s)15322026/10/01 10:23:55 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1533=== CONT TestReadProxyRootRedirectsToIndexHTML15342026/10/01 10:23:55 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst1535--- PASS: TestCompleteMultipartUnregistered (1.08s)1536=== CONT TestClientErrorHandling1537=== RUN TestClientErrorHandling/InvalidStorePath1538=== PAUSE TestClientErrorHandling/InvalidStorePath1539=== RUN TestClientErrorHandling/InvalidAuthToken1540=== PAUSE TestClientErrorHandling/InvalidAuthToken1541=== RUN TestClientErrorHandling/ServerNotAvailable1542=== PAUSE TestClientErrorHandling/ServerNotAvailable1543=== CONT TestReadProxyConditionalGet15442026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures15452026-10-01 10:23:55.420 UTC [892] ERROR: relation "goose_db_version" does not exist at character 3615462026-10-01 10:23:55.420 UTC [892] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15472026-10-01 10:23:55.420 UTC [893] ERROR: relation "goose_db_version" does not exist at character 3615482026-10-01 10:23:55.420 UTC [893] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1549--- PASS: TestTombstonedObjectOfferedWithoutWaiting (1.12s)1550=== CONT TestClientCADerivations15512026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures15522026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes15532026/10/01 10:23:55 OK 20241026095416_initial_model.sql (10.56ms)15542026/10/01 10:23:55 OK 20241026095416_initial_model.sql (11.82ms)15552026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.92ms)15562026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.67ms)15572026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.85ms)15582026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.85ms)15592026/10/01 10:23:55 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)15602026/10/01 10:23:55 INFO Uploading gpjsmz5mfj125dp9b271471x35i36fd9-shared-dep (136B)15612026/10/01 10:23:55 INFO Uploading m59qhbpv1isq57j1fnjcfnphp0qrp1vx-top (224B)15622026/10/01 10:23:55 WARN Failed to register uploaded object key=nar/1xyzl93k28vkmmnjh29kpgfhzpc8a0sq6vpic12l6zw0h6bbwh3i.nar.zst error="server returned 404: 404 page not found\n"15632026/10/01 10:23:55 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"15642026/10/01 10:23:55 WARN Failed to register uploaded object key=gpjsmz5mfj125dp9b271471x35i36fd9.ls error="server returned 404: 404 page not found\n"15652026/10/01 10:23:55 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15662026/10/01 10:23:55 WARN Failed to register uploaded object key=m59qhbpv1isq57j1fnjcfnphp0qrp1vx.ls error="server returned 404: 404 page not found\n"15672026/10/01 10:23:55 INFO Signed narinfos id=1 count=215682026/10/01 10:23:55 INFO Uploading 2 narinfos15692026-10-01 10:23:55.458 UTC [914] ERROR: relation "goose_db_version" does not exist at character 3615702026-10-01 10:23:55.458 UTC [914] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15712026/10/01 10:23:55 INFO Received complete push request method=POST path=/api/pushes/1/complete15722026/10/01 10:23:55 WARN Failed to register uploaded object key=gpjsmz5mfj125dp9b271471x35i36fd9.narinfo error="server returned 404: 404 page not found\n"15732026/10/01 10:23:55 WARN Failed to register uploaded object key=m59qhbpv1isq57j1fnjcfnphp0qrp1vx.narinfo error="server returned 404: 404 page not found\n"15742026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (25.94ms)15752026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (26.8ms)15762026/10/01 10:23:55 OK 20260905000000_add_claims.sql (15.15ms)15772026/10/01 10:23:55 OK 20260905000000_add_claims.sql (16.3ms)15782026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.96ms)15792026/10/01 10:23:55 INFO Upload complete. (99ms)15802026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.89ms)15812026/10/01 10:23:55 goose: successfully migrated database to version: 202609231200001582=== NAME TestClientSharedPathCommittedMidPush1583 client_integration_test.go:680: Retrieved narinfo from S3:1584 StorePath: /build/TestClientSharedPathCommittedMidPush1372027021/001/store/gpjsmz5mfj125dp9b271471x35i36fd9-shared-dep1585 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1586 Compression: zstd1587 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821588 NarSize: 1361589 References: 1590 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n15912026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (5.97ms)15922026-10-01 10:23:55.493 UTC [915] ERROR: relation "goose_db_version" does not exist at character 3615932026-10-01 10:23:55.493 UTC [915] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC15942026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.85ms)15952026/10/01 10:23:55 OK 1_commit_pending_closure.sql (5.22ms)15962026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures1597 client_integration_test.go:680: Retrieved narinfo from S3:1598 StorePath: /build/TestClientSharedPathCommittedMidPush1372027021/001/store/m59qhbpv1isq57j1fnjcfnphp0qrp1vx-top1599 URL: nar/1xyzl93k28vkmmnjh29kpgfhzpc8a0sq6vpic12l6zw0h6bbwh3i.nar.zst1600 Compression: zstd1601 NarHash: sha256:1xyzl93k28vkmmnjh29kpgfhzpc8a0sq6vpic12l6zw0h6bbwh3i1602 NarSize: 2241603 References: /build/TestClientSharedPathCommittedMidPush1372027021/001/store/gpjsmz5mfj125dp9b271471x35i36fd9-shared-dep1604 CA: text:sha256:08756pmy7lpk33d872cb828fhy20ckni58404z4k4390gz5acz1d16052026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (5.67ms)16062026/10/01 10:23:55 goose: successfully migrated database to version: 202609231200001607--- PASS: TestClientSharedPathCommittedMidPush (1.20s)1608=== CONT TestReadProxyHead16092026/10/01 10:23:55 OK 2_object_stats_trigger.sql (19.76ms)16102026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (20.23ms)16112026/10/01 10:23:55 OK 1_commit_pending_closure.sql (21.9ms)16122026/10/01 10:23:55 OK 3_commit_push.sql (4.42ms)16132026/10/01 10:23:55 goose: up to current file version: 316142026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.36ms)16152026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.04ms)16162026/10/01 10:23:55 OK 3_commit_push.sql (1.76ms)16172026/10/01 10:23:55 goose: up to current file version: 316182026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4.25ms)16192026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.39ms)16202026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.45ms)16212026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.68ms)16222026-10-01 10:23:55.532 UTC [918] ERROR: relation "goose_db_version" does not exist at character 3616232026-10-01 10:23:55.532 UTC [918] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16242026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.55ms)16252026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.51ms)16262026-10-01 10:23:55.534 UTC [919] ERROR: relation "goose_db_version" does not exist at character 3616272026-10-01 10:23:55.534 UTC [919] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16282026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (3.62ms)16292026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000016302026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (8.92ms)16312026/10/01 10:23:55 OK 1_commit_pending_closure.sql (5.86ms)16322026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures16332026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.89ms)16342026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.18ms)16352026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=016362026/10/01 10:23:55 OK 3_commit_push.sql (1.26ms)16372026/10/01 10:23:55 goose: up to current file version: 316382026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.13ms)16392026/10/01 10:23:55 WARN Force mode enabled - objects will be deleted immediately without grace period16402026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.68ms)16412026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000016422026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.63ms)16432026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.75ms)16442026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.84ms)16452026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.64ms)16462026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.18ms)16472026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.1ms)16482026/10/01 10:23:55 OK 3_commit_push.sql (1.33ms)16492026/10/01 10:23:55 goose: up to current file version: 316502026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.92ms)16512026-10-01 10:23:55.558 UTC [921] ERROR: relation "goose_db_version" does not exist at character 3616522026-10-01 10:23:55.558 UTC [921] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC16532026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.14ms)16542026/10/01 10:23:55 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."16552026/10/01 10:23:55 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."16562026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.33ms)1657--- PASS: TestFailedS3DeleteKeepsTombstone (1.26s)1658=== CONT TestReadProxyInvalidPath16592026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.22ms)16602026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.9ms)16612026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.29ms)16622026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.24ms)16632026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.2ms)16642026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.9ms)16652026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000016662026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.07ms)16672026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000016682026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.32ms)16692026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.04ms)16702026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.42ms)16712026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.76ms)16722026/10/01 10:23:55 OK 3_commit_push.sql (1.46ms)16732026/10/01 10:23:55 goose: up to current file version: 316742026/10/01 10:23:55 OK 20241026095416_initial_model.sql (10ms)16752026/10/01 10:23:55 INFO Received cleanup request method=DELETE path=/api/pending_closures16762026/10/01 10:23:55 OK 3_commit_push.sql (1.5ms)16772026/10/01 10:23:55 goose: up to current file version: 316782026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.54ms)16792026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=016802026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.16ms)16812026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures16822026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4.58ms)16832026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.5ms)16842026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.83ms)16852026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.01ms)16862026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000016872026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.34ms)16882026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.63ms)16892026/10/01 10:23:55 OK 3_commit_push.sql (1.66ms)16902026/10/01 10:23:55 goose: up to current file version: 316912026/10/01 10:23:55 INFO Received cleanup request method=DELETE path=/api/pending_closures16922026/10/01 10:23:55 INFO Aborted multipart uploads count=1 kept=016932026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures16942026/10/01 10:23:55 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete16952026-10-01 10:23:55.608 UTC [734] ERROR: Closure does not exist: id=116962026-10-01 10:23:55.608 UTC [734] CONTEXT: PL/pgSQL function commit_pending_closure(bigint) line 12 at RAISE16972026-10-01 10:23:55.608 UTC [734] STATEMENT: -- name: CommitPendingClosure :exec1698 SELECT commit_pending_closure($1::bigint)1699 1700--- PASS: TestService_cleanupPendingClosuresHandler (0.77s)1701=== CONT TestReadProxy40417022026-10-01 10:23:55.615 UTC [924] ERROR: relation "goose_db_version" does not exist at character 3617032026-10-01 10:23:55.615 UTC [924] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17042026/10/01 10:23:55 OK 20241026095416_initial_model.sql (8.18ms)17052026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.02ms)17062026/10/01 10:23:55 OK 20251218171726_add_pins.sql (3.44ms)17072026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures17082026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.65ms)17092026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.13ms)17102026-10-01 10:23:55.657 UTC [929] ERROR: relation "goose_db_version" does not exist at character 3617112026-10-01 10:23:55.657 UTC [929] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17122026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.08ms)17132026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.95ms)17142026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000017152026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.43ms)17162026/10/01 10:23:55 OK 2_object_stats_trigger.sql (612.65µs)17172026/10/01 10:23:55 OK 3_commit_push.sql (912.58µs)17182026/10/01 10:23:55 goose: up to current file version: 317192026/10/01 10:23:55 INFO Received complete multipart upload request method=POST path=/api/multipart/complete17202026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures17212026/10/01 10:23:55 OK 20241026095416_initial_model.sql (8.3ms)17222026/10/01 10:23:55 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LmMwZjFiZjJhLWY0ODctNGQzNC1hZTg0LTRkZWQ3NDE5YjUwMngxNzkwODUwMjM1NjIwMTk4NTM417232026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1ms)17242026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.54ms)17252026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes17262026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (13.04ms)17272026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.7ms)17282026/10/01 10:23:55 INFO Received complete multipart upload request method=POST path=/api/multipart/complete17292026/10/01 10:23:55 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LmMwZjFiZjJhLWY0ODctNGQzNC1hZTg0LTRkZWQ3NDE5YjUwMngxNzkwODUwMjM1NjIwMTk4NTM4 parts=117302026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.12ms)1731--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (0.74s)1732=== CONT TestReadProxyNarStreaming17332026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.17ms)17342026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000017352026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.97ms)17362026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.58ms)17372026/10/01 10:23:55 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17382026/10/01 10:23:55 OK 3_commit_push.sql (596.57µs)17392026/10/01 10:23:55 goose: up to current file version: 317402026/10/01 10:23:55 INFO Signed narinfos id=1 count=11741--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (0.67s)1742=== CONT TestCacheStatsHandler1743=== RUN TestPush_RejectsBadRequests/no_roots1744=== PAUSE TestPush_RejectsBadRequests/no_roots1745=== RUN TestPush_RejectsBadRequests/no_objects1746=== PAUSE TestPush_RejectsBadRequests/no_objects1747=== RUN TestPush_RejectsBadRequests/bad_root1748=== PAUSE TestPush_RejectsBadRequests/bad_root1749=== RUN TestPush_RejectsBadRequests/root_not_in_objects1750=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects1751=== CONT TestReadProxyNarinfoAlreadyDecompressed17522026-10-01 10:23:55.716 UTC [953] ERROR: relation "goose_db_version" does not exist at character 3617532026-10-01 10:23:55.716 UTC [953] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17542026/10/01 10:23:55 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LjdkZjI3Yjg0LTUxM2UtNGMzYy05NWFhLThkMjJiMDQ3ZDZlYXgxNzkwODUwMjM1MTgyNDY5OTE5 parts=1017552026/10/01 10:23:55 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete17562026/10/01 10:23:55 INFO Completed upload id=117572026/10/01 10:23:55 INFO Received get closure request method=GET path=/api/closures/0000000000000000000000000000000017582026/10/01 10:23:55 OK 20241026095416_initial_model.sql (9.27ms)17592026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures17602026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (3.43ms)17612026/10/01 10:23:55 OK 20251218171726_add_pins.sql (11.42ms)17622026/10/01 10:23:55 INFO Starting cleanup of old closures method=DELETE path=/api/closures17632026/10/01 10:23:55 INFO Received uploads request method=POST path=/api/pending_closures17642026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4.71ms)17652026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.05ms)17662026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.21ms)17672026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.95ms)17682026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000017692026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.16ms)17702026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=017712026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.32ms)17722026/10/01 10:23:55 OK 3_commit_push.sql (1.26ms)17732026/10/01 10:23:55 goose: up to current file version: 317742026/10/01 10:23:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=017752026/10/01 10:23:55 INFO Vacuumed table table=pending_closures17762026/10/01 10:23:55 INFO Vacuumed table table=pending_objects17772026/10/01 10:23:55 INFO Vacuumed table table=multipart_uploads17782026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes17792026/10/01 10:23:55 INFO Vacuumed table table=closures17802026/10/01 10:23:55 INFO Vacuumed table table=objects17812026/10/01 10:23:55 INFO Received get closure request method=GET path=/api/closures/000000000000000000000000000000001782--- PASS: TestService_createPendingClosureHandler (1.50s)1783=== CONT TestProxyHeadersOnlyTrustedOnSocket17842026-10-01 10:23:55.803 UTC [956] ERROR: relation "goose_db_version" does not exist at character 3617852026-10-01 10:23:55.803 UTC [956] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17862026-10-01 10:23:55.812 UTC [960] ERROR: relation "goose_db_version" does not exist at character 3617872026-10-01 10:23:55.812 UTC [960] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC17882026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes1789--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (0.68s)1790=== CONT TestIsValidCachePath1791=== RUN TestIsValidCachePath/narinfo1792=== PAUSE TestIsValidCachePath/narinfo1793=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars1794=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars1795=== RUN TestIsValidCachePath/nar_zst1796=== PAUSE TestIsValidCachePath/nar_zst1797=== RUN TestIsValidCachePath/nar_xz1798=== PAUSE TestIsValidCachePath/nar_xz1799=== RUN TestIsValidCachePath/nar_bz21800=== PAUSE TestIsValidCachePath/nar_bz21801=== RUN TestIsValidCachePath/nar_uncompressed1802=== PAUSE TestIsValidCachePath/nar_uncompressed1803=== RUN TestIsValidCachePath/ls1804=== PAUSE TestIsValidCachePath/ls1805=== RUN TestIsValidCachePath/log1806=== PAUSE TestIsValidCachePath/log1807=== RUN TestIsValidCachePath/realisation1808=== PAUSE TestIsValidCachePath/realisation1809=== RUN TestIsValidCachePath/nix-cache-info1810=== PAUSE TestIsValidCachePath/nix-cache-info1811=== RUN TestIsValidCachePath/index.html1812=== PAUSE TestIsValidCachePath/index.html1813=== RUN TestIsValidCachePath/traversal_parent1814=== PAUSE TestIsValidCachePath/traversal_parent1815=== RUN TestIsValidCachePath/traversal_in_middle1816=== PAUSE TestIsValidCachePath/traversal_in_middle1817=== RUN TestIsValidCachePath/invalid_char_e1818=== PAUSE TestIsValidCachePath/invalid_char_e1819=== RUN TestIsValidCachePath/invalid_char_u18202026/10/01 10:23:55 OK 20241026095416_initial_model.sql (8.56ms)1821=== PAUSE TestIsValidCachePath/invalid_char_u1822=== RUN TestIsValidCachePath/random_path1823=== PAUSE TestIsValidCachePath/random_path1824=== RUN TestIsValidCachePath/empty1825=== PAUSE TestIsValidCachePath/empty1826=== RUN TestIsValidCachePath/leading_slash1827=== PAUSE TestIsValidCachePath/leading_slash1828=== RUN TestIsValidCachePath/wrong_extension1829=== PAUSE TestIsValidCachePath/wrong_extension1830=== RUN TestIsValidCachePath/short_hash1831=== PAUSE TestIsValidCachePath/short_hash1832=== CONT TestReadProxyNarinfo18332026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.74ms)18342026-10-01 10:23:55.820 UTC [962] ERROR: relation "goose_db_version" does not exist at character 3618352026-10-01 10:23:55.820 UTC [962] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18362026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.66ms)18372026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (11.75ms)18382026/10/01 10:23:55 OK 20241026095416_initial_model.sql (18.46ms)18392026/10/01 10:23:55 OK 20241026095416_initial_model.sql (11.33ms)18402026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.92ms)18412026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.94ms)18422026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (2.93ms)18432026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (3.2ms)18442026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.68ms)18452026/10/01 10:23:55 OK 20251218171726_add_pins.sql (2.55ms)18462026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.64ms)18472026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000018482026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.69ms)18492026/10/01 10:23:55 INFO Received complete push request method=POST path=/api/pushes/1/complete18502026/10/01 10:23:55 OK 1_commit_pending_closure.sql (3.09ms)18512026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (4.09ms)18522026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.21ms)18532026/10/01 10:23:55 OK 20260905000000_add_claims.sql (3.38ms)18542026/10/01 10:23:55 OK 20260905000000_add_claims.sql (4.75ms)18552026/10/01 10:23:55 OK 3_commit_push.sql (1.84ms)18562026/10/01 10:23:55 goose: up to current file version: 318572026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (1.8ms)18582026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (2.25ms)18592026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (2.15ms)18602026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000018612026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (3.09ms)18622026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000018632026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes18642026/10/01 10:23:55 OK 1_commit_pending_closure.sql (2.66ms)18652026/10/01 10:23:55 OK 1_commit_pending_closure.sql (4.08ms)18662026/10/01 10:23:55 OK 2_object_stats_trigger.sql (2.49ms)18672026/10/01 10:23:55 OK 3_commit_push.sql (1.45ms)18682026/10/01 10:23:55 goose: up to current file version: 318692026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.6ms)18702026/10/01 10:23:55 INFO Received complete multipart upload request method=POST path=/api/multipart/complete18712026/10/01 10:23:55 OK 3_commit_push.sql (1.44ms)18722026/10/01 10:23:55 goose: up to current file version: 31873--- PASS: TestReadRedirectUsesPublicS3URL (0.74s)1874=== CONT TestService_AuthMiddleware_OIDC1875--- PASS: TestReadProxyRangeRequest (0.74s)1876=== CONT TestService_RequireScope_OIDC18772026/10/01 10:23:55 INFO Received push request method=POST path=/api/pushes18782026-10-01 10:23:55.910 UTC [966] ERROR: relation "goose_db_version" does not exist at character 3618792026-10-01 10:23:55.910 UTC [966] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18802026-10-01 10:23:55.920 UTC [967] ERROR: relation "goose_db_version" does not exist at character 3618812026-10-01 10:23:55.920 UTC [967] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC18822026/10/01 10:23:55 INFO Aborted multipart uploads count=0 kept=018832026/10/01 10:23:55 OK 20241026095416_initial_model.sql (7.66ms)18842026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.16ms)18852026/10/01 10:23:55 OK 20251218171726_add_pins.sql (4.13ms)18862026/10/01 10:23:55 WARN Force mode enabled - objects will be deleted immediately without grace period18872026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.52ms)18882026/10/01 10:23:55 OK 20241026095416_initial_model.sql (7.55ms)18892026/10/01 10:23:55 INFO Received complete push request method=POST path=/api/pushes/1/complete18902026/10/01 10:23:55 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:41513/oidc18912026/10/01 10:23:55 OK 20251210153512_drop_unused_gin_index.sql (1.03ms)18922026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.95ms)18932026/10/01 10:23:55 OK 20251218171726_add_pins.sql (1.97ms)18942026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (1.93ms)18952026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.8ms)18962026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000018972026/10/01 10:23:55 OK 20260628120000_add_object_size_and_stats.sql (3.29ms)1898--- PASS: TestPush_CompleteCommitsEveryRoot (0.75s)1899=== CONT TestService_ReadScope_PublicByDefault19002026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.67ms)19012026/10/01 10:23:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=019022026/10/01 10:23:55 OK 20260905000000_add_claims.sql (2.52ms)19032026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.67ms)19042026/10/01 10:23:55 OK 3_commit_push.sql (1.08ms)19052026/10/01 10:23:55 goose: up to current file version: 319062026/10/01 10:23:55 OK 20260920000000_drop_claims.sql (1.84ms)19072026/10/01 10:23:55 OK 20260923120000_add_pushes.sql (1.74ms)19082026/10/01 10:23:55 goose: successfully migrated database to version: 2026092312000019092026/10/01 10:23:55 INFO Vacuumed table table=pending_closures19102026/10/01 10:23:55 OK 1_commit_pending_closure.sql (1.66ms)19112026/10/01 10:23:55 OK 2_object_stats_trigger.sql (1.72ms)19122026/10/01 10:23:55 INFO Vacuumed table table=pending_objects19132026/10/01 10:23:55 OK 3_commit_push.sql (1.44ms)19142026/10/01 10:23:55 goose: up to current file version: 319152026/10/01 10:23:55 INFO Vacuumed table table=multipart_uploads19162026/10/01 10:23:55 INFO Vacuumed table table=closures19172026/10/01 10:23:55 INFO Vacuumed table table=objects19182026/10/01 10:23:55 INFO Received complete push request method=POST path=/api/pushes/2/complete1919--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (0.84s)1920=== CONT TestService_AuthMiddleware_MTLSBoundSubjects1921--- PASS: TestReadRedirectNar (0.68s)1922=== CONT TestService_ReadAuthMiddleware19232026/10/01 10:23:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete19242026/10/01 10:23:56 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:35559/oidc1925--- PASS: TestReadProxyDisabled (0.69s)1926=== CONT TestObjectStatsTrigger1927=== NAME TestClientWithDependencies1928 client_integration_test.go:613: Built derivation: /build/TestClientWithDependencies1720201720/001/store/057yfkqvcflx4fkj8s663yln97am03pg-test-script19292026-10-01 10:23:56.044 UTC [1034] ERROR: relation "goose_db_version" does not exist at character 3619302026-10-01 10:23:56.044 UTC [1034] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19312026-10-01 10:23:56.044 UTC [1036] ERROR: relation "goose_db_version" does not exist at character 3619322026-10-01 10:23:56.044 UTC [1036] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19332026/10/01 10:23:56 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LjdkMGZmMDQ5LWExMTgtNGQyNy05NDk1LTkxMjFlN2QxMjI3ZXgxNzkwODUwMjM1NTI2ODA5NTk5 parts=1019342026/10/01 10:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete1935=== NAME TestClientMultipleUploads1936 client_integration_test.go:358: Created store path 0: /build/TestClientMultipleUploads138207954/001/store/p9lycpap94x47m9xzabqa5pzcvqmbi5b-test-file-0.txt19372026/10/01 10:23:56 INFO Completed upload id=119382026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures19392026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures19402026/10/01 10:23:56 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo19412026/10/01 10:23:56 WARN Found objects in DB but missing from S3, will re-upload count=11942--- PASS: TestService_verifyS3Integrity (1.76s)1943=== CONT TestPresentNotReportedWhileGCDeletesClosure19442026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.58ms)19452026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.78ms)19462026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.74ms)19472026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.93ms)1948=== NAME TestClientWithDependencies1949 client_integration_test.go:615: Found 1 dependencies (including self)19502026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.12ms)19512026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.45ms)19522026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.4ms)19532026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.77ms)19542026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.31ms)19552026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.1ms)19562026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.35ms)19572026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.36ms)19582026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.62ms)19592026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000019602026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.97ms)19612026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000019622026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.2ms)19632026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2ms)19642026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.93ms)1965--- PASS: TestReadProxyRootRedirectsToIndexHTML (0.71s)1966=== CONT TestMultipartCleanup19672026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.57ms)19682026/10/01 10:23:56 OK 3_commit_push.sql (1.56ms)19692026/10/01 10:23:56 goose: up to current file version: 319702026/10/01 10:23:56 OK 3_commit_push.sql (1.1ms)19712026/10/01 10:23:56 goose: up to current file version: 31972=== NAME TestClientMultipleUploads1973 client_integration_test.go:358: Created store path 1: /build/TestClientMultipleUploads138207954/001/store/y8j0g64q6cnr6n55d0gs1a7i5hfa6kry-test-file-1.txt1974=== NAME TestClientIntegration1975 client_integration_test.go:286: Created store path: /build/TestClientIntegration3171898893/002/store/hlgkshjrqbs6qrhh3m57asid0srrrb14-test-file.txt19762026-10-01 10:23:56.106 UTC [1110] ERROR: relation "goose_db_version" does not exist at character 3619772026-10-01 10:23:56.106 UTC [1110] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1978--- PASS: TestReadProxyConditionalGet (0.73s)1979=== CONT TestPresentReportsOnlyClosureRoots19802026/10/01 10:23:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1981=== NAME TestClientMultipleUploads1982 client_integration_test.go:358: Created store path 2: /build/TestClientMultipleUploads138207954/001/store/s7iyxzj0l34wg7rjcgw52x6qpbixfv56-test-file-2.txt19832026-10-01 10:23:56.128 UTC [1131] ERROR: relation "goose_db_version" does not exist at character 3619842026-10-01 10:23:56.128 UTC [1131] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19852026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.5ms)19862026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.16ms)19872026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes19882026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.69ms)19892026-10-01 10:23:56.143 UTC [1168] ERROR: relation "goose_db_version" does not exist at character 3619902026-10-01 10:23:56.143 UTC [1168] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC19912026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (8.06ms)19922026/10/01 10:23:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)19932026/10/01 10:23:56 INFO Uploading 057yfkqvcflx4fkj8s663yln97am03pg-test-script (136B)19942026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.31ms)19952026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.34ms)19962026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.78ms)19972026/10/01 10:23:56 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LmZiYWU0ZDM4LTk1MmMtNDlkNy1hYjkxLTVlNjUyYWFmZjNiNXgxNzkwODUwMjM1NTU3NjAyNDU1 parts=1219982026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures19992026/10/01 10:23:56 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"20002026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.27ms)20012026/10/01 10:23:56 WARN Failed to register uploaded object key=057yfkqvcflx4fkj8s663yln97am03pg.ls error="server returned 404: 404 page not found\n"20022026/10/01 10:23:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign20032026/10/01 10:23:56 WARN Failed to register uploaded object key=log/zhwdf09gkry1p7dja484n7r2vppfsxz4-test-script.drv error="server returned 404: 404 page not found\n"20042026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.34ms)20052026/10/01 10:23:56 INFO Signed narinfos id=1 count=120062026/10/01 10:23:56 INFO Uploading 1 narinfos2007--- PASS: TestCompletedNarNotReofferedAcrossClosures (1.30s)2008=== CONT TestPendingCleanupUsesOneCutoff20092026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.09ms)20102026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000020112026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.64ms)20122026-10-01 10:23:56.154 UTC [1170] ERROR: relation "goose_db_version" does not exist at character 3620132026-10-01 10:23:56.154 UTC [1170] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC20142026/10/01 10:23:56 INFO Received complete push request method=POST path=/api/pushes/1/complete20152026/10/01 10:23:56 WARN Failed to register uploaded object key=057yfkqvcflx4fkj8s663yln97am03pg.narinfo error="server returned 404: 404 page not found\n"20162026/10/01 10:23:56 OK 1_commit_pending_closure.sql (4.18ms)20172026/10/01 10:23:56 OK 20260905000000_add_claims.sql (5.07ms)2018--- PASS: TestReadProxyHead (0.65s)2019=== CONT TestCreatePin_ReservedPins20202026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.38ms)20212026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.05ms)20222026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.13ms)20232026/10/01 10:23:56 OK 3_commit_push.sql (1.49ms)20242026/10/01 10:23:56 goose: up to current file version: 320252026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.85ms)20262026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.97ms)20272026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000020282026/10/01 10:23:56 INFO Upload complete. (67ms)20292026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.23ms)20302026/10/01 10:23:56 OK 1_commit_pending_closure.sql (1.73ms)2031=== NAME TestClientWithDependencies2032 client_integration_test.go:617: Skipping nix copy test - isolated store (/build/TestClientWithDependencies1720201720/001/store) requires matching store prefix20332026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.46ms)20342026/10/01 10:23:56 OK 3_commit_push.sql (1.44ms)20352026/10/01 10:23:56 goose: up to current file version: 320362026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.12ms)2037--- PASS: TestClientWithDependencies (0.97s)2038=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded20392026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.11ms)20402026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.68ms)20412026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.22ms)20422026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (1.76ms)20432026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes20442026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.23ms)20452026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.34ms)20462026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000020472026-10-01 10:23:56.176 UTC [1226] ERROR: relation "goose_db_version" does not exist at character 3620482026-10-01 10:23:56.176 UTC [1226] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2049--- PASS: TestReadProxyInvalidPath (0.61s)2050=== CONT TestOrphanedObjectsGCStressTest20512026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.36ms)20522026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.32ms)20532026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4ms)20542026/10/01 10:23:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)20552026/10/01 10:23:56 INFO Uploading hlgkshjrqbs6qrhh3m57asid0srrrb14-test-file.txt (152B)20562026/10/01 10:23:56 OK 3_commit_push.sql (727.48µs)20572026/10/01 10:23:56 goose: up to current file version: 320582026/10/01 10:23:56 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:43769/oidc20592026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.92ms)20602026/10/01 10:23:56 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"20612026/10/01 10:23:56 WARN Failed to register uploaded object key=hlgkshjrqbs6qrhh3m57asid0srrrb14.ls error="server returned 404: 404 page not found\n"20622026/10/01 10:23:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign20632026/10/01 10:23:56 INFO Signed narinfos id=1 count=120642026/10/01 10:23:56 INFO Uploading 1 narinfos20652026/10/01 10:23:56 INFO Received complete push request method=POST path=/api/pushes/1/complete20662026/10/01 10:23:56 WARN Failed to register uploaded object key=hlgkshjrqbs6qrhh3m57asid0srrrb14.narinfo error="server returned 404: 404 page not found\n"20672026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (9.73ms)20682026/10/01 10:23:56 OK 20241026095416_initial_model.sql (13.07ms)20692026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.76ms)20702026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000020712026/10/01 10:23:56 INFO Upload complete. (64ms)20722026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.22ms)20732026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.29ms)20742026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes20752026/10/01 10:23:56 OK 20251218171726_add_pins.sql (4.12ms)20762026/10/01 10:23:56 OK 2_object_stats_trigger.sql (3.61ms)20772026/10/01 10:23:56 OK 3_commit_push.sql (1.54ms)20782026/10/01 10:23:56 goose: up to current file version: 320792026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.36ms)20802026/10/01 10:23:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete20812026/10/01 10:23:56 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)20822026/10/01 10:23:56 INFO Uploading s7iyxzj0l34wg7rjcgw52x6qpbixfv56-test-file-2.txt (160B)20832026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.41ms)20842026-10-01 10:23:56.209 UTC [1268] ERROR: relation "goose_db_version" does not exist at character 3620852026-10-01 10:23:56.209 UTC [1268] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC20862026/10/01 10:23:56 INFO Uploading y8j0g64q6cnr6n55d0gs1a7i5hfa6kry-test-file-1.txt (160B)20872026/10/01 10:23:56 INFO Uploading p9lycpap94x47m9xzabqa5pzcvqmbi5b-test-file-0.txt (160B)20882026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.16ms)20892026/10/01 10:23:56 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"20902026/10/01 10:23:56 WARN Failed to register uploaded object key=y8j0g64q6cnr6n55d0gs1a7i5hfa6kry.ls error="server returned 404: 404 page not found\n"20912026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (3.55ms)20922026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000020932026/10/01 10:23:56 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"20942026/10/01 10:23:56 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"20952026/10/01 10:23:56 WARN Failed to register uploaded object key=p9lycpap94x47m9xzabqa5pzcvqmbi5b.ls error="server returned 404: 404 page not found\n"20962026/10/01 10:23:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign20972026/10/01 10:23:56 WARN Failed to register uploaded object key=s7iyxzj0l34wg7rjcgw52x6qpbixfv56.ls error="server returned 404: 404 page not found\n"20982026/10/01 10:23:56 INFO Signed narinfos id=1 count=320992026/10/01 10:23:56 INFO Uploading 3 narinfos21002026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.39ms)21012026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.96ms)21022026/10/01 10:23:56 WARN Failed to register uploaded object key=s7iyxzj0l34wg7rjcgw52x6qpbixfv56.narinfo error="server returned 404: 404 page not found\n"21032026/10/01 10:23:56 WARN Failed to register uploaded object key=p9lycpap94x47m9xzabqa5pzcvqmbi5b.narinfo error="server returned 404: 404 page not found\n"21042026/10/01 10:23:56 INFO Received complete push request method=POST path=/api/pushes/1/complete21052026/10/01 10:23:56 WARN Failed to register uploaded object key=y8j0g64q6cnr6n55d0gs1a7i5hfa6kry.narinfo error="server returned 404: 404 page not found\n"2106=== NAME TestClientCADerivations2107 client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations799893930/001/store/5wfahx4yprq68xfv8jf2vd2ai2lrn0mb-ca-test21082026/10/01 10:23:56 OK 3_commit_push.sql (1.19ms)21092026/10/01 10:23:56 goose: up to current file version: 321102026-10-01 10:23:56.225 UTC [1271] ERROR: relation "goose_db_version" does not exist at character 3621112026-10-01 10:23:56.225 UTC [1271] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2112--- PASS: TestReadProxyNarStreaming (0.53s)2113=== CONT TestService_NativeMTLS21142026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.26ms)21152026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.41ms)2116--- PASS: TestReadProxy404 (0.62s)2117=== CONT TestOrphanedObjectsGC21182026/10/01 10:23:56 INFO All 1 paths already cached2119=== NAME TestClientIntegration2120 client_integration_test.go:312: Retrieved narinfo from S3:2121 StorePath: /build/TestClientIntegration3171898893/002/store/hlgkshjrqbs6qrhh3m57asid0srrrb14-test-file.txt2122 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst2123 Compression: zstd2124 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk12125 NarSize: 1522126 References: 2127 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk121282026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.97ms)21292026/10/01 10:23:56 INFO Upload complete. (70ms)2130=== NAME TestClientMultipleUploads2131 client_integration_test.go:369: Uploaded 3 paths in 104.423118ms21322026/10/01 10:23:56 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LmE3M2UzNmRiLTg3Y2UtNGQ0MS04YjJhLWI5OWJjOGI2YjZkNngxNzkwODUwMjM1NjY0MzMzNzQ1 parts=1221332026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures2134=== NAME TestClientIntegration2135 client_integration_test.go:313: Retrieved .ls file from S3 (compressed size: 77 bytes)2136 client_integration_test.go:313: Decompressed .ls content (64 bytes):2137 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}2138 client_integration_test.go:316: Testing garbage collection...21392026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.42ms)21402026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures21412026/10/01 10:23:56 OK 20260905000000_add_claims.sql (4.3ms)2142--- PASS: TestClientMultipleUploads (0.93s)2143=== CONT TestServerTLSConfig2144=== RUN TestServerTLSConfig/no_client_CA2145=== PAUSE TestServerTLSConfig/no_client_CA2146=== RUN TestServerTLSConfig/missing_CA_file2147=== PAUSE TestServerTLSConfig/missing_CA_file2148=== RUN TestServerTLSConfig/not_a_PEM_file2149=== PAUSE TestServerTLSConfig/not_a_PEM_file2150=== CONT TestLeadElectsOneAndHandsOver21512026/10/01 10:23:56 OK 20241026095416_initial_model.sql (11.22ms)21522026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.38ms)21532026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (4.02ms)21542026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (4.21ms)21552026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000021562026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.86ms)21572026/10/01 10:23:56 OK 20251218171726_add_pins.sql (4.16ms)21582026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.25ms)21592026/10/01 10:23:56 OK 3_commit_push.sql (1.16ms)21602026/10/01 10:23:56 goose: up to current file version: 321612026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (6.08ms)2162=== NAME TestClientCADerivations2163 client_ca_test.go:139: Found 1 dependencies (including self)2164--- PASS: TestCacheStatsHandler (0.56s)2165=== CONT TestMetricsInventory21662026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.88ms)2167--- PASS: TestReadProxyNarinfoAlreadyDecompressed (0.56s)2168=== CONT TestDeduplicatedObjectsRecordedAsPending21692026/10/01 10:23:56 INFO Starting cleanup of old closures method=DELETE path=/api/closures21702026/10/01 10:23:56 INFO Garbage collection started21712026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (12.62ms)21722026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (4.88ms)21732026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000021742026/10/01 10:23:56 INFO Starting HTTP server address=/build/TestProxyHeadersOnlyTrustedOnSocket93252501/001/proxy.sock21752026/10/01 10:23:56 INFO Starting HTTP server address=127.0.0.1:3410321762026/10/01 10:23:56 WARN mTLS auth: subject not in bound subjects subject="CN=someone"21772026/10/01 10:23:56 INFO Shutdown signal received, draining in-flight requests timeout=10s2178--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.48s)2179=== CONT TestService_AuthMiddleware_MTLSProxyHeader21802026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.63ms)21812026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.88ms)21822026/10/01 10:23:56 OK 3_commit_push.sql (1.47ms)21832026/10/01 10:23:56 goose: up to current file version: 321842026/10/01 10:23:56 INFO Aborted multipart uploads count=0 kept=021852026/10/01 10:23:56 WARN Force mode enabled - objects will be deleted immediately without grace period21862026-10-01 10:23:56.295 UTC [1354] ERROR: relation "goose_db_version" does not exist at character 3621872026-10-01 10:23:56.295 UTC [1354] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC21882026-10-01 10:23:56.298 UTC [1355] ERROR: relation "goose_db_version" does not exist at character 3621892026-10-01 10:23:56.298 UTC [1355] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC21902026/10/01 10:23:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=021912026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.16ms)21922026-10-01 10:23:56.314 UTC [1357] ERROR: relation "goose_db_version" does not exist at character 3621932026-10-01 10:23:56.314 UTC [1357] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC21942026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.1ms)21952026/10/01 10:23:56 INFO Vacuumed table table=pending_closures21962026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.3ms)21972026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.55ms)21982026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.94ms)21992026/10/01 10:23:56 INFO Vacuumed table table=pending_objects22002026/10/01 10:23:56 INFO Vacuumed table table=multipart_uploads22012026-10-01 10:23:56.322 UTC [1358] ERROR: relation "goose_db_version" does not exist at character 3622022026-10-01 10:23:56.322 UTC [1358] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC22032026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.3ms)22042026/10/01 10:23:56 OK 20251218171726_add_pins.sql (4.61ms)22052026/10/01 10:23:56 INFO Vacuumed table table=closures2206=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token2207=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token2208=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected2209=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected2210=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected2211=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected2212=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2213=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2214=== CONT TestPushDedupSurvivesConcurrentGC22152026/10/01 10:23:56 OK 20241026095416_initial_model.sql (17.1ms)22162026/10/01 10:23:56 OK 20260905000000_add_claims.sql (14.84ms)22172026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (14.75ms)22182026/10/01 10:23:56 INFO Vacuumed table table=objects22192026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.89ms)22202026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.45ms)22212026/10/01 10:23:56 OK 20260905000000_add_claims.sql (4.71ms)22222026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.49ms)22232026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000022242026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.26ms)22252026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.64ms)22262026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.7ms)22272026/10/01 10:23:56 OK 1_commit_pending_closure.sql (4.18ms)22282026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.94ms)22292026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.37ms)22302026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.83ms)22312026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000022322026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.9ms)22332026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.01ms)22342026/10/01 10:23:56 OK 1_commit_pending_closure.sql (3.33ms)22352026/10/01 10:23:56 OK 3_commit_push.sql (2.55ms)22362026/10/01 10:23:56 goose: up to current file version: 322372026/10/01 10:23:56 OK 20260905000000_add_claims.sql (4.25ms)22382026/10/01 10:23:56 ERROR Failed to decompress narinfo error="decompressed size exceeds configured limit"22392026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.93ms)22402026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.37ms)22412026-10-01 10:23:56.358 UTC [1379] ERROR: relation "goose_db_version" does not exist at character 3622422026-10-01 10:23:56.358 UTC [1379] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2243--- PASS: TestService_ReadScope_PublicByDefault (0.42s)2244=== CONT TestClientFallsBackToClosures22452026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.57ms)22462026/10/01 10:23:56 OK 3_commit_push.sql (1.27ms)22472026/10/01 10:23:56 goose: up to current file version: 322482026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.43ms)22492026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000022502026/10/01 10:23:56 OK 20260905000000_add_claims.sql (4.19ms)22512026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.18ms)22522026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.7ms)22532026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.75ms)22542026/10/01 10:23:56 OK 3_commit_push.sql (1.6ms)22552026/10/01 10:23:56 goose: up to current file version: 322562026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (3.1ms)22572026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000022582026-10-01 10:23:56.370 UTC [1394] ERROR: relation "goose_db_version" does not exist at character 3622592026-10-01 10:23:56.370 UTC [1394] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC22602026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.32ms)22612026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes22622026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.27ms)22632026/10/01 10:23:56 OK 3_commit_push.sql (1.75ms)22642026/10/01 10:23:56 goose: up to current file version: 322652026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.31ms)22662026-10-01 10:23:56.378 UTC [1400] ERROR: relation "goose_db_version" does not exist at character 3622672026-10-01 10:23:56.378 UTC [1400] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC22682026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.66ms)22692026/10/01 10:23:56 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)22702026/10/01 10:23:56 INFO Uploading 5wfahx4yprq68xfv8jf2vd2ai2lrn0mb-ca-test (144B)22712026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.58ms)22722026/10/01 10:23:56 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"22732026/10/01 10:23:56 WARN Failed to register uploaded object key=5wfahx4yprq68xfv8jf2vd2ai2lrn0mb.ls error="server returned 404: 404 page not found\n"2274--- PASS: TestService_ReadAuthMiddleware (0.41s)2275=== CONT TestResolveDBConnectionString22762026/10/01 10:23:56 WARN Failed to register uploaded object key=log/37zch7bz84z34macqvf30qd9xg9qfpi5-ca-test.drv error="server returned 404: 404 page not found\n"22772026/10/01 10:23:56 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign2278=== RUN TestResolveDBConnectionString/flag_wins22792026/10/01 10:23:56 INFO Signed narinfos id=1 count=12280=== PAUSE TestResolveDBConnectionString/flag_wins2281=== RUN TestResolveDBConnectionString/file_when_flag_empty22822026/10/01 10:23:56 INFO Uploading 1 narinfos2283=== PAUSE TestResolveDBConnectionString/file_when_flag_empty22842026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.44ms)2285=== RUN TestResolveDBConnectionString/missing_file_is_an_error2286=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error22872026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.7ms)2288=== RUN TestResolveDBConnectionString/PGHOST_allows_empty2289=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty2290=== RUN TestResolveDBConnectionString/nothing_configured22912026-10-01 10:23:56.387 UTC [1401] ERROR: relation "goose_db_version" does not exist at character 3622922026-10-01 10:23:56.387 UTC [1401] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2293=== PAUSE TestResolveDBConnectionString/nothing_configured2294=== CONT TestGCMetrics22952026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.67ms)22962026/10/01 10:23:56 OK 20260905000000_add_claims.sql (4.62ms)22972026/10/01 10:23:56 INFO Received complete push request method=POST path=/api/pushes/1/complete22982026/10/01 10:23:56 WARN Failed to register uploaded object key=5wfahx4yprq68xfv8jf2vd2ai2lrn0mb.narinfo error="server returned 404: 404 page not found\n"22992026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.96ms)23002026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.84ms)23012026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.07ms)23022026-10-01 10:23:56.396 UTC [1403] ERROR: relation "goose_db_version" does not exist at character 3623032026-10-01 10:23:56.396 UTC [1403] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC23042026-10-01 10:23:56.400 UTC [1405] ERROR: relation "goose_db_version" does not exist at character 3623052026-10-01 10:23:56.400 UTC [1405] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC23062026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (12.14ms)23072026/10/01 10:23:56 OK 20241026095416_initial_model.sql (13.78ms)23082026/10/01 10:23:56 INFO Upload complete. (114ms)23092026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (13.36ms)23102026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000023112026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (13.02ms)23122026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.76ms)23132026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.97ms)2314=== NAME TestClientCADerivations2315 client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations799893930/001/store/5wfahx4yprq68xfv8jf2vd2ai2lrn0mb-ca-test2316 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst2317 Compression: zstd2318 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2319 NarSize: 1442320 References: 2321 Deriver: /build/TestClientCADerivations799893930/001/store/37zch7bz84z34macqvf30qd9xg9qfpi5-ca-test.drv23222026/10/01 10:23:56 OK 1_commit_pending_closure.sql (4.27ms)2323 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n2324 client_ca_test.go:185: Checking for realisation files in S3...23252026/10/01 10:23:56 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"23262026/10/01 10:23:56 WARN mTLS auth: bound subjects configured but subject DN unavailable23272026/10/01 10:23:56 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"2328 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations2329 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache2330--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (0.44s)2331=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock23322026/10/01 10:23:56 OK 20251218171726_add_pins.sql (9.45ms)23332026/10/01 10:23:56 OK 20251218171726_add_pins.sql (10.97ms)23342026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (11.47ms)23352026/10/01 10:23:56 OK 2_object_stats_trigger.sql (7.64ms)23362026/10/01 10:23:56 OK 20241026095416_initial_model.sql (13.63ms)23372026/10/01 10:23:56 OK 3_commit_push.sql (2.59ms)23382026/10/01 10:23:56 goose: up to current file version: 323392026/10/01 10:23:56 OK 20241026095416_initial_model.sql (14.97ms)23402026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.71ms)23412026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (3.99ms)23422026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000023432026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.47ms)23442026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (5.91ms)23452026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (3.91ms)23462026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.72ms)23472026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.95ms)23482026/10/01 10:23:56 OK 1_commit_pending_closure.sql (3.74ms)23492026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.98ms)23502026/10/01 10:23:56 OK 20260905000000_add_claims.sql (5.86ms)23512026/10/01 10:23:56 OK 20251218171726_add_pins.sql (4.34ms)23522026/10/01 10:23:56 OK 2_object_stats_trigger.sql (3.13ms)23532026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.23ms)23542026/10/01 10:23:56 OK 3_commit_push.sql (1.49ms)23552026/10/01 10:23:56 goose: up to current file version: 323562026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.98ms)23572026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000023582026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (4.15ms)23592026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.21ms)23602026/10/01 10:23:56 OK 20260905000000_add_claims.sql (6.83ms)23612026/10/01 10:23:56 OK 20260905000000_add_claims.sql (9.01ms)23622026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (9.67ms)23632026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000023642026/10/01 10:23:56 OK 1_commit_pending_closure.sql (11ms)23652026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (7.67ms)23662026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.21ms)23672026/10/01 10:23:56 OK 1_commit_pending_closure.sql (3.19ms)23682026/10/01 10:23:56 OK 2_object_stats_trigger.sql (3.1ms)23692026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.66ms)23702026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000023712026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.19ms)23722026/10/01 10:23:56 OK 3_commit_push.sql (2.3ms)23732026/10/01 10:23:56 goose: up to current file version: 323742026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (4.08ms)23752026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000023762026/10/01 10:23:56 OK 3_commit_push.sql (3.73ms)23772026/10/01 10:23:56 goose: up to current file version: 323782026/10/01 10:23:56 OK 1_commit_pending_closure.sql (4.98ms)23792026/10/01 10:23:56 OK 1_commit_pending_closure.sql (6.97ms)23802026/10/01 10:23:56 OK 2_object_stats_trigger.sql (11.99ms)23812026-10-01 10:23:56.469 UTC [1427] ERROR: relation "goose_db_version" does not exist at character 3623822026-10-01 10:23:56.469 UTC [1427] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC23832026/10/01 10:23:56 OK 2_object_stats_trigger.sql (7.96ms)23842026/10/01 10:23:56 OK 3_commit_push.sql (1.81ms)23852026/10/01 10:23:56 goose: up to current file version: 323862026/10/01 10:23:56 OK 3_commit_push.sql (1.99ms)23872026/10/01 10:23:56 goose: up to current file version: 323882026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.36ms)23892026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.32ms)2390=== RUN TestService_RequireScope_OIDC/builder_may_write2391=== PAUSE TestService_RequireScope_OIDC/builder_may_write2392=== RUN TestService_RequireScope_OIDC/builder_may_not_admin2393=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin2394=== RUN TestService_RequireScope_OIDC/ops_may_admin2395=== PAUSE TestService_RequireScope_OIDC/ops_may_admin2396=== RUN TestService_RequireScope_OIDC/ops_may_not_write2397=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write2398=== RUN TestService_RequireScope_OIDC/reader_may_not_write2399=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write2400=== RUN TestService_RequireScope_OIDC/static_token_may_admin2401=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin2402=== RUN TestService_RequireScope_OIDC/static_token_may_write2403=== PAUSE TestService_RequireScope_OIDC/static_token_may_write2404=== RUN TestService_RequireScope_OIDC/reader_may_read24052026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.69ms)2406=== PAUSE TestService_RequireScope_OIDC/reader_may_read2407=== RUN TestService_RequireScope_OIDC/writer_implies_read2408=== PAUSE TestService_RequireScope_OIDC/writer_implies_read2409=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read2410=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read2411=== CONT TestGCBugBareHashReferences24122026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.59ms)24132026-10-01 10:23:56.494 UTC [1552] ERROR: relation "goose_db_version" does not exist at character 3624142026-10-01 10:23:56.494 UTC [1552] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC24152026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.74ms)24162026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.17ms)24172026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.69ms)24182026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000024192026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.11ms)24202026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.24ms)24212026/10/01 10:23:56 OK 3_commit_push.sql (1.44ms)24222026/10/01 10:23:56 goose: up to current file version: 324232026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8.73ms)24242026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.72ms)24252026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.66ms)24262026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.9ms)24272026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.68ms)24282026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.26ms)24292026-10-01 10:23:56.524 UTC [1555] ERROR: relation "goose_db_version" does not exist at character 3624302026-10-01 10:23:56.524 UTC [1555] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC24312026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (6.85ms)24322026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000024332026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures24342026/10/01 10:23:56 OK 1_commit_pending_closure.sql (19.11ms)2435--- PASS: TestObjectStatsTrigger (0.52s)2436=== CONT TestClientPushesUseOnePush24372026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.63ms)24382026/10/01 10:23:56 OK 3_commit_push.sql (687.32µs)24392026/10/01 10:23:56 goose: up to current file version: 32440=== NAME TestClientCADerivations24412026/10/01 10:23:56 ERROR Refusing narinfo larger than the limit key=5hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=167772162442 client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features2443 warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable2444 error: binary cache 's3://bucket46?endpoint=http://localhost:35663®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations799893930/001/store'2445 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 124462026-10-01 10:23:56.558 UTC [1626] ERROR: relation "goose_db_version" does not exist at character 3624472026-10-01 10:23:56.558 UTC [1626] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2448--- PASS: TestReadProxyNarinfo (0.74s)2449=== CONT TestLeadEndsOnShutdown24502026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.79ms)24512026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.72ms)2452--- PASS: TestClientCADerivations (1.14s)2453=== CONT TestPinProtectsFromGC24542026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.39ms)24552026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.11ms)24562026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.68ms)24572026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8.3ms)24582026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.44ms)24592026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.56ms)24602026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.9ms)24612026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000024622026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.15ms)24632026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.3ms)24642026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.7ms)24652026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.72ms)2466--- PASS: TestPresentReportsOnlyClosureRoots (0.47s)2467=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows24682026/10/01 10:23:56 OK 3_commit_push.sql (2.81ms)24692026/10/01 10:23:56 goose: up to current file version: 324702026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.34ms)24712026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.07ms)24722026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.36ms)24732026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000024742026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures24752026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.52ms)24762026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.46ms)24772026/10/01 10:23:56 OK 3_commit_push.sql (1.29ms)24782026/10/01 10:23:56 goose: up to current file version: 324792026-10-01 10:23:56.608 UTC [1635] ERROR: relation "goose_db_version" does not exist at character 3624802026-10-01 10:23:56.608 UTC [1635] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2481--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (0.45s)2482=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check24832026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures24842026/10/01 10:23:56 OK 20241026095416_initial_model.sql (10.9ms)24852026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.69ms)24862026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.25ms)24872026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.32ms)24882026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures24892026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.48ms)24902026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (19.4ms)24912026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (3.82ms)24922026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000024932026/10/01 10:23:56 OK 1_commit_pending_closure.sql (3.23ms)24942026/10/01 10:23:56 INFO Received cleanup request method=DELETE path=/api/pending_closures24952026/10/01 10:23:56 INFO Received cleanup request method=DELETE path=/api/pending_closures24962026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.79ms)24972026/10/01 10:23:56 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket62/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""24982026/10/01 10:23:56 INFO Aborted multipart uploads count=0 kept=124992026-10-01 10:23:56.669 UTC [1638] ERROR: relation "goose_db_version" does not exist at character 3625002026-10-01 10:23:56.669 UTC [1638] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC25012026/10/01 10:23:56 OK 3_commit_push.sql (1.54ms)25022026/10/01 10:23:56 goose: up to current file version: 325032026/10/01 10:23:56 INFO Received cleanup request method=DELETE path=/api/pending_closures25042026/10/01 10:23:56 INFO Aborted multipart uploads count=1 kept=025052026-10-01 10:23:56.675 UTC [1639] ERROR: relation "goose_db_version" does not exist at character 3625062026-10-01 10:23:56.675 UTC [1639] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2507--- PASS: TestMultipartCleanup (0.60s)2508=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info25092026/10/01 10:23:56 INFO Received uploads request method=POST path=/2510=== CONT TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key25112026/10/01 10:23:56 INFO Received request for more parts method=POST path=/2512=== CONT TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key25132026/10/01 10:23:56 INFO Received complete multipart upload request method=POST path=/2514=== CONT TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal25152026/10/01 10:23:56 INFO Received uploads request method=POST path=/2516--- PASS: TestUploadHandlersRejectInvalidKeys (0.05s)2517 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)2518 --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)2519 --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)2520 --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)2521=== CONT TestIsValidUploadKey/narinfo2522=== CONT TestIsValidUploadKey/realisation_plus_in_output2523=== CONT TestIsValidUploadKey/unknown_type2524=== CONT TestIsValidUploadKey/empty_key2525=== CONT TestIsValidUploadKey/absolute2526=== CONT TestIsValidUploadKey/traversal_nar2527=== CONT TestIsValidUploadKey/traversal2528=== CONT TestIsValidUploadKey/listing_key,_narinfo_type2529=== CONT TestIsValidUploadKey/nar_key,_narinfo_type2530=== CONT TestIsValidUploadKey/narinfo_key,_nar_type2531=== CONT TestIsValidUploadKey/index.html2532=== CONT TestIsValidUploadKey/nix-cache-info2533=== CONT TestIsValidUploadKey/build_log_equals2534=== CONT TestIsValidUploadKey/build_log_home-manager_file2535=== CONT TestIsValidUploadKey/realisation2536=== CONT TestIsValidUploadKey/build_log_question_mark2537=== CONT TestIsValidUploadKey/build_log_plus_in_name2538=== CONT TestIsValidUploadKey/nar_plain2539=== CONT TestIsValidUploadKey/build_log2540=== CONT TestIsValidUploadKey/listing2541=== CONT TestIsValidUploadKey/nar_xz2542=== CONT TestIsValidUploadKey/nar_zst2543--- PASS: TestIsValidUploadKey (0.00s)2544 --- PASS: TestIsValidUploadKey/narinfo (0.00s)2545 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)2546 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)2547 --- PASS: TestIsValidUploadKey/empty_key (0.00s)2548 --- PASS: TestIsValidUploadKey/absolute (0.00s)2549 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)2550 --- PASS: TestIsValidUploadKey/traversal (0.00s)2551 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)2552 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)2553 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)2554 --- PASS: TestIsValidUploadKey/index.html (0.00s)2555 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)2556 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)2557 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)2558 --- PASS: TestIsValidUploadKey/realisation (0.00s)2559 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)2560 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)2561 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)2562 --- PASS: TestIsValidUploadKey/build_log (0.00s)2563 --- PASS: TestIsValidUploadKey/listing (0.00s)2564 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)2565 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)2566=== CONT TestPendingClosureWriteTimeout/empty2567=== CONT TestPendingClosureWriteTimeout/670k_objects25682026-10-01 10:23:56.681 UTC [1640] ERROR: relation "goose_db_version" does not exist at character 3625692026-10-01 10:23:56.681 UTC [1640] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2570=== CONT TestPendingClosureWriteTimeout/400_objects2571=== CONT TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline25722026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8.68ms)25732026/10/01 10:23:56 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux25742026/10/01 10:23:56 WARN Refused reserved pin name=worker-x86_64-linux25752026/10/01 10:23:56 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux25762026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.19ms)25772026/10/01 10:23:56 INFO Received create pin request method=POST path=/api/pins/my-app25782026/10/01 10:23:56 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux2579--- PASS: TestCreatePin_ReservedPins (0.53s)2580=== CONT TestProxyWriteTimeout/narinfo2581=== CONT TestProxyWriteTimeout/10_GiB_nar2582=== CONT TestProxyWriteTimeout/unknown_size2583=== CONT TestProxyWriteTimeout/1_GiB_nar2584=== CONT TestUploadHandlersRejectOversizedBody/create_pending_closure25852026/10/01 10:23:56 INFO Received uploads request method=POST path=/2586--- PASS: TestProxyWriteTimeout (0.00s)2587 --- PASS: TestProxyWriteTimeout/narinfo (0.00s)2588 --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)2589 --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)2590 --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)25912026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.33ms)25922026/10/01 10:23:56 OK 20241026095416_initial_model.sql (9.65ms)25932026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.09ms)25942026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.84ms)25952026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8.89ms)25962026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.58ms)25972026/10/01 10:23:56 OK 20260905000000_add_claims.sql (4.83ms)25982026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (2.26ms)25992026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.13ms)26002026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (4.48ms)26012026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.31ms)26022026-10-01 10:23:56.702 UTC [1643] ERROR: relation "goose_db_version" does not exist at character 3626032026-10-01 10:23:56.702 UTC [1643] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC26042026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.81ms)26052026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000026062026/10/01 10:23:56 INFO Received complete multipart upload request method=POST path=/api/multipart/complete26072026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.74ms)26082026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (2.99ms)26092026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.12ms)26102026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.66ms)26112026/10/01 10:23:56 OK 20260905000000_add_claims.sql (3.31ms)26122026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (3.9ms)26132026/10/01 10:23:56 OK 3_commit_push.sql (1.11ms)26142026/10/01 10:23:56 goose: up to current file version: 326152026/10/01 10:23:56 WARN mTLS auth: subject not in bound subjects subject="CN=reader"26162026/10/01 10:23:56 WARN mTLS auth: subject not in bound subjects subject="CN=reader"2617--- PASS: TestService_NativeMTLS (0.49s)2618=== CONT TestUploadHandlersRejectOversizedBody/request_more_parts26192026/10/01 10:23:56 INFO Received request for more parts method=POST path=/26202026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (2.58ms)26212026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.78ms)26222026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000026232026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (2.16ms)26242026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000026252026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.81ms)26262026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8.08ms)26272026/10/01 10:23:56 OK 1_commit_pending_closure.sql (3.08ms)26282026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.05ms)26292026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.28ms)26302026/10/01 10:23:56 OK 3_commit_push.sql (2.35ms)26312026/10/01 10:23:56 goose: up to current file version: 326322026/10/01 10:23:56 OK 2_object_stats_trigger.sql (2.45ms)26332026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.31ms)26342026/10/01 10:23:56 OK 3_commit_push.sql (1.25ms)26352026/10/01 10:23:56 goose: up to current file version: 326362026-10-01 10:23:56.722 UTC [1644] ERROR: relation "goose_db_version" does not exist at character 3626372026-10-01 10:23:56.722 UTC [1644] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC26382026/10/01 10:23:56 WARN Failed to abort redundant multipart upload, keeping its row object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LjVkMmJiNjkwLWM2YjQtNGIxNi1iMDYyLWFkZWJlZWM2NTI2ZngxNzkwODUwMjM2MjQ2MzE5MDQ1 error="Get \"http://127.0.0.1:1/bucket30/?location=\": dial tcp 127.0.0.1:1: connect: connection refused"26392026/10/01 10:23:56 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0200000000000000000000.nar.zst upload_id=ZDYwODJkMTMtOTU3Ny00MzUyLWE0ZWEtMWIwYjNjN2YyZmE4LjZlNmNiZTdhLTA2M2UtNDAzZS04NWIzLTk0NDJmMTZmZTkxMXgxNzkwODUwMjM2MjM2NTMzMzM3 parts=1226402026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.18ms)26412026/10/01 10:23:56 INFO Received cleanup request method=DELETE path=/api/pending_closures26422026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.58ms)26432026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (1.63ms)26442026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.54ms)26452026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000026462026/10/01 10:23:56 INFO Aborted multipart uploads count=1 kept=026472026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.04ms)26482026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.31ms)26492026/10/01 10:23:56 OK 3_commit_push.sql (927.2µs)26502026/10/01 10:23:56 goose: up to current file version: 326512026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8ms)26522026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.79ms)2653--- PASS: TestRedundantMultipartUpload (1.71s)2654=== CONT TestUploadHandlersRejectOversizedBody/complete_multipart26552026/10/01 10:23:56 INFO Received complete multipart upload request method=POST path=/26562026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.81ms)26572026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.23ms)26582026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.61ms)26592026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (1.87ms)26602026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.88ms)26612026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000026622026/10/01 10:23:56 OK 1_commit_pending_closure.sql (2.16ms)26632026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.31ms)26642026/10/01 10:23:56 OK 3_commit_push.sql (1.12ms)26652026/10/01 10:23:56 goose: up to current file version: 326662026-10-01 10:23:56.775 UTC [1645] ERROR: relation "goose_db_version" does not exist at character 3626672026-10-01 10:23:56.775 UTC [1645] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC2668--- PASS: TestMetricsInventory (0.52s)2669=== CONT TestCacheConfigHandler/full_config,_no_issuer2670=== CONT TestCacheConfigHandler/no_signing_keys2671=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator2672=== CONT TestCacheConfigHandler/no_cache_url_configured2673--- PASS: TestCacheConfigHandler (0.00s)2674 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)2675 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)2676 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)2677 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)2678=== CONT TestParseSingleRange/none2679=== CONT TestParseSingleRange/open-ended2680=== CONT TestParseSingleRange/start_far_past_EOF2681=== CONT TestParseSingleRange/start_past_EOF2682=== CONT TestParseSingleRange/single_byte2683=== CONT TestParseSingleRange/suffix_exceeds_size2684=== CONT TestParseSingleRange/suffix2685=== CONT TestParseSingleRange/end_clamped_to_size2686=== CONT TestParseSingleRange/malformed_both_empty2687=== CONT TestParseSingleRange/closed2688=== CONT TestParseSingleRange/malformed_end_before_start2689=== CONT TestParseSingleRange/multi-range_ignored2690=== CONT TestParseSingleRange/malformed_no_dash2691=== CONT TestParseSingleRange/unknown_unit2692--- PASS: TestParseSingleRange (0.00s)2693 --- PASS: TestParseSingleRange/none (0.00s)2694 --- PASS: TestParseSingleRange/open-ended (0.00s)2695 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)2696 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)2697 --- PASS: TestParseSingleRange/single_byte (0.00s)2698 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)2699 --- PASS: TestParseSingleRange/suffix (0.00s)2700 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)2701 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)2702 --- PASS: TestParseSingleRange/closed (0.00s)2703 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)2704 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)2705 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)2706 --- PASS: TestParseSingleRange/unknown_unit (0.00s)2707=== CONT TestClientErrorHandling/InvalidStorePath27082026/10/01 10:23:56 OK 20241026095416_initial_model.sql (7.42ms)27092026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.1ms)2710=== CONT TestClientErrorHandling/ServerNotAvailable27112026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.23ms)27122026/10/01 10:23:56 INFO lead: acquired remote=192.0.2.1:123427132026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (2.98ms)27142026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.51ms)27152026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (1.79ms)27162026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.2ms)27172026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000027182026/10/01 10:23:56 OK 1_commit_pending_closure.sql (1.95ms)27192026/10/01 10:23:56 OK 2_object_stats_trigger.sql (1.25ms)27202026/10/01 10:23:56 OK 3_commit_push.sql (1.19ms)27212026/10/01 10:23:56 goose: up to current file version: 32722--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (0.54s)2723=== CONT TestClientErrorHandling/InvalidAuthToken2724=== CONT TestPush_RejectsBadRequests/no_roots27252026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes2726=== CONT TestPush_RejectsBadRequests/bad_root27272026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes2728=== CONT TestPush_RejectsBadRequests/root_not_in_objects27292026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes2730=== CONT TestPush_RejectsBadRequests/no_objects27312026/10/01 10:23:56 INFO Received push request method=POST path=/api/pushes2732=== CONT TestIsValidCachePath/narinfo2733=== CONT TestIsValidCachePath/index.html2734=== CONT TestIsValidCachePath/nix-cache-info2735=== CONT TestIsValidCachePath/realisation2736=== CONT TestIsValidCachePath/log2737=== CONT TestIsValidCachePath/ls2738--- PASS: TestPush_RejectsBadRequests (0.63s)2739 --- PASS: TestPush_RejectsBadRequests/no_roots (0.00s)2740 --- PASS: TestPush_RejectsBadRequests/bad_root (0.00s)2741 --- PASS: TestPush_RejectsBadRequests/root_not_in_objects (0.00s)2742 --- PASS: TestPush_RejectsBadRequests/no_objects (0.00s)2743=== CONT TestIsValidCachePath/nar_uncompressed2744=== CONT TestIsValidCachePath/nar_bz22745=== CONT TestIsValidCachePath/nar_xz2746=== CONT TestIsValidCachePath/nar_zst2747=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars2748=== CONT TestIsValidCachePath/traversal_parent2749=== CONT TestIsValidCachePath/empty2750=== CONT TestIsValidCachePath/short_hash2751=== CONT TestIsValidCachePath/wrong_extension2752=== CONT TestIsValidCachePath/leading_slash2753=== CONT TestIsValidCachePath/invalid_char_u2754=== CONT TestIsValidCachePath/random_path2755=== CONT TestIsValidCachePath/invalid_char_e2756=== CONT TestIsValidCachePath/traversal_in_middle2757--- PASS: TestIsValidCachePath (0.00s)2758 --- PASS: TestIsValidCachePath/narinfo (0.00s)2759 --- PASS: TestIsValidCachePath/index.html (0.00s)2760 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)2761 --- PASS: TestIsValidCachePath/realisation (0.00s)2762 --- PASS: TestIsValidCachePath/log (0.00s)2763 --- PASS: TestIsValidCachePath/ls (0.00s)2764 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)2765 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)2766 --- PASS: TestIsValidCachePath/nar_xz (0.00s)2767 --- PASS: TestIsValidCachePath/nar_zst (0.00s)2768 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)2769 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)2770 --- PASS: TestIsValidCachePath/empty (0.00s)2771 --- PASS: TestIsValidCachePath/short_hash (0.00s)2772 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)2773 --- PASS: TestIsValidCachePath/leading_slash (0.00s)2774 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)2775 --- PASS: TestIsValidCachePath/random_path (0.00s)2776 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)2777 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)2778=== CONT TestServerTLSConfig/no_client_CA2779=== CONT TestServerTLSConfig/not_a_PEM_file2780=== CONT TestServerTLSConfig/missing_CA_file2781--- PASS: TestServerTLSConfig (0.00s)2782 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)2783 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)2784 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)2785=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token2786=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured2787=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected27882026/10/01 10:23:56 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]2789=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected27902026/10/01 10:23:56 WARN Authentication failed token_preview=eyJhbGciOi...5Ea_cXoNqw token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test tried_providers=[test]2791=== CONT TestResolveDBConnectionString/flag_wins2792=== CONT TestResolveDBConnectionString/PGHOST_allows_empty2793=== CONT TestResolveDBConnectionString/nothing_configured2794=== CONT TestResolveDBConnectionString/missing_file_is_an_error2795=== CONT TestResolveDBConnectionString/file_when_flag_empty2796=== CONT TestService_RequireScope_OIDC/builder_may_write2797--- PASS: TestService_AuthMiddleware_OIDC (0.46s)2798 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.00s)2799 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)2800 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)2801 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.00s)2802--- PASS: TestResolveDBConnectionString (0.00s)2803 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)2804 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)2805 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)2806 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)2807 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)2808=== CONT TestService_RequireScope_OIDC/static_token_may_admin2809=== CONT TestService_RequireScope_OIDC/reader_may_not_write2810=== CONT TestService_RequireScope_OIDC/ops_may_not_write2811=== CONT TestService_RequireScope_OIDC/ops_may_admin2812=== CONT TestService_RequireScope_OIDC/builder_may_not_admin2813=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read2814=== CONT TestService_RequireScope_OIDC/static_token_may_write2815=== CONT TestService_RequireScope_OIDC/writer_implies_read2816=== CONT TestService_RequireScope_OIDC/reader_may_read2817--- PASS: TestService_RequireScope_OIDC (0.60s)2818 --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)2819 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)2820 --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)2821 --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)2822 --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)2823 --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)2824 --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)2825 --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)2826 --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)2827 --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)28282026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures2829--- PASS: TestDeduplicatedObjectsRecordedAsPending (0.60s)28302026-10-01 10:23:56.882 UTC [1686] ERROR: relation "goose_db_version" does not exist at character 3628312026-10-01 10:23:56.882 UTC [1686] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC28322026/10/01 10:23:56 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present28332026/10/01 10:23:56 OK 20241026095416_initial_model.sql (8.53ms)28342026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (1.7ms)28352026/10/01 10:23:56 INFO Received uploads request method=POST path=/api/pending_closures28362026/10/01 10:23:56 OK 20251218171726_add_pins.sql (3.06ms)28372026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.14ms)28382026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.75ms)28392026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (1.6ms)28402026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.15ms)28412026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000028422026/10/01 10:23:56 OK 1_commit_pending_closure.sql (1.61ms)28432026/10/01 10:23:56 OK 2_object_stats_trigger.sql (665.87µs)28442026/10/01 10:23:56 OK 3_commit_push.sql (544.97µs)28452026/10/01 10:23:56 goose: up to current file version: 328462026-10-01 10:23:56.919 UTC [1688] ERROR: relation "goose_db_version" does not exist at character 3628472026-10-01 10:23:56.919 UTC [1688] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC28482026/10/01 10:23:56 OK 20241026095416_initial_model.sql (7.19ms)28492026/10/01 10:23:56 OK 20251210153512_drop_unused_gin_index.sql (897.42µs)28502026/10/01 10:23:56 OK 20251218171726_add_pins.sql (2.24ms)28512026/10/01 10:23:56 OK 20260628120000_add_object_size_and_stats.sql (3.13ms)28522026/10/01 10:23:56 OK 20260905000000_add_claims.sql (2.6ms)28532026/10/01 10:23:56 OK 20260920000000_drop_claims.sql (1.42ms)28542026/10/01 10:23:56 INFO lead: released remote=192.0.2.1:123428552026/10/01 10:23:56 OK 20260923120000_add_pushes.sql (1.07ms)28562026/10/01 10:23:56 goose: successfully migrated database to version: 2026092312000028572026/10/01 10:23:56 OK 1_commit_pending_closure.sql (1.43ms)28582026/10/01 10:23:56 OK 2_object_stats_trigger.sql (571.72µs)28592026/10/01 10:23:56 OK 3_commit_push.sql (497.8µs)28602026/10/01 10:23:56 goose: up to current file version: 328612026/10/01 10:23:56 INFO Aborted multipart uploads count=0 kept=028622026/10/01 10:23:56 WARN Force mode enabled - objects will be deleted immediately without grace period28632026/10/01 10:23:56 INFO Aborted multipart uploads count=0 kept=028642026/10/01 10:23:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028652026/10/01 10:23:56 INFO Vacuumed table table=pending_closures28662026/10/01 10:23:56 INFO Vacuumed table table=pending_objects28672026/10/01 10:23:56 INFO Vacuumed table table=multipart_uploads28682026/10/01 10:23:56 INFO Vacuumed table table=closures28692026/10/01 10:23:56 INFO Vacuumed table table=objects28702026/10/01 10:23:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028712026/10/01 10:23:56 INFO Vacuumed table table=pending_closures28722026/10/01 10:23:56 INFO Vacuumed table table=pending_objects28732026/10/01 10:23:56 INFO Vacuumed table table=multipart_uploads2874--- PASS: TestGCMetrics (0.59s)28752026/10/01 10:23:56 INFO Vacuumed table table=closures28762026/10/01 10:23:56 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=189.347494ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present28772026/10/01 10:23:56 INFO Vacuumed table table=objects28782026/10/01 10:23:56 INFO Aborted multipart uploads count=0 kept=028792026/10/01 10:23:56 WARN Force mode enabled - objects will be deleted immediately without grace period28802026/10/01 10:23:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028812026/10/01 10:23:56 INFO Vacuumed table table=pending_closures28822026/10/01 10:23:56 INFO lead: acquired remote=192.0.2.1:123428832026/10/01 10:23:56 INFO Vacuumed table table=pending_objects28842026/10/01 10:23:56 INFO Vacuumed table table=multipart_uploads28852026/10/01 10:23:56 INFO Vacuumed table table=closures28862026/10/01 10:23:56 INFO Vacuumed table table=objects2887--- PASS: TestPushDedupSurvivesConcurrentGC (0.67s)28882026/10/01 10:23:57 INFO lead: released remote=192.0.2.1:12342889--- PASS: TestLeadElectsOneAndHandsOver (0.76s)2890=== NAME TestOrphanedObjectsGC2891 orphaned_objects_gc_test.go:290: GC Test Summary:2892 orphaned_objects_gc_test.go:291: - Kept: 2 objects from closure A2893 orphaned_objects_gc_test.go:292: - Deleted: 2 objects from closure B2894 orphaned_objects_gc_test.go:293: - Deleted: 6 orphaned chain objects (X1->X2->X3)2895 orphaned_objects_gc_test.go:294: - Deleted: 2 orphaned single objects (Y)2896 orphaned_objects_gc_test.go:295: - Total deleted: 10 objects2897--- PASS: TestOrphanedObjectsGC (0.82s)2898--- PASS: TestPresentNotReportedWhileGCDeletesClosure (0.99s)28992026/10/01 10:23:57 INFO lead: acquired remote=192.0.2.1:123429002026/10/01 10:23:57 INFO lead: released remote=192.0.2.1:12342901--- PASS: TestLeadEndsOnShutdown (0.50s)29022026/10/01 10:23:57 INFO Received uploads request method=POST path=/api/pending_closures29032026/10/01 10:23:57 INFO Aborted multipart uploads count=0 kept=029042026/10/01 10:23:57 WARN Force mode enabled - objects will be deleted immediately without grace period29052026/10/01 10:23:57 INFO Received uploads request method=POST path=/api/pending_closures29062026/10/01 10:23:57 INFO Received uploads request method=POST path=/api/pending_closures29072026/10/01 10:23:57 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)29082026/10/01 10:23:57 INFO Uploading 5g8y7w91pypcyakfd6l78m2phyg53zhc-shared-dep (136B)29092026/10/01 10:23:57 INFO Uploading j0a7zlly52vr4fya7h3mwjv65018ixzq-b (216B)29102026/10/01 10:23:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=1 objects-deleted-after-grace-period=1 objects-failed-to-delete=029112026/10/01 10:23:57 INFO Vacuumed table table=pending_closures29122026/10/01 10:23:57 INFO Vacuumed table table=pending_objects29132026/10/01 10:23:57 INFO Received uploads request method=POST path=/api/pending_closures29142026/10/01 10:23:57 INFO Vacuumed table table=multipart_uploads29152026/10/01 10:23:57 INFO Vacuumed table table=closures29162026/10/01 10:23:57 WARN Failed to register uploaded object key=vwg9z537qiv6yy6b20kqz9kppfql5svf.ls error="server returned 404: 404 page not found\n"29172026/10/01 10:23:57 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"29182026/10/01 10:23:57 WARN Failed to register uploaded object key=5g8y7w91pypcyakfd6l78m2phyg53zhc.ls error="server returned 404: 404 page not found\n"29192026/10/01 10:23:57 WARN Failed to register uploaded object key=nar/1z924sfby4vxbl7zfg7fac5mygdgjpssfkggxf3bib5lh06gznrx.nar.zst error="server returned 404: 404 page not found\n"29202026/10/01 10:23:57 INFO Vacuumed table table=objects29212026/10/01 10:23:57 WARN Failed to register uploaded object key=j0a7zlly52vr4fya7h3mwjv65018ixzq.ls error="server returned 404: 404 page not found\n"29222026/10/01 10:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign29232026/10/01 10:23:57 INFO Signed narinfos id=1 count=229242026/10/01 10:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign29252026/10/01 10:23:57 INFO Signed narinfos id=2 count=229262026/10/01 10:23:57 INFO Uploading 4 narinfos29272026/10/01 10:23:57 WARN Failed to register uploaded object key=vwg9z537qiv6yy6b20kqz9kppfql5svf.narinfo error="server returned 404: 404 page not found\n"29282026/10/01 10:23:57 WARN Failed to register uploaded object key=j0a7zlly52vr4fya7h3mwjv65018ixzq.narinfo error="server returned 404: 404 page not found\n"29292026/10/01 10:23:57 WARN Failed to register uploaded object key=5g8y7w91pypcyakfd6l78m2phyg53zhc.narinfo error="server returned 404: 404 page not found\n"29302026/10/01 10:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete29312026/10/01 10:23:57 WARN Failed to register uploaded object key=5g8y7w91pypcyakfd6l78m2phyg53zhc.narinfo error="server returned 404: 404 page not found\n"29322026/10/01 10:23:57 INFO Aborted multipart uploads count=0 kept=029332026/10/01 10:23:57 WARN Force mode enabled - objects will be deleted immediately without grace period29342026/10/01 10:23:57 INFO Completed upload id=129352026/10/01 10:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete29362026/10/01 10:23:57 INFO Received uploads request method=POST path=/api/pending_closures29372026/10/01 10:23:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029382026/10/01 10:23:57 INFO Completed upload id=229392026/10/01 10:23:57 INFO Upload complete. (67ms)29402026/10/01 10:23:57 INFO Vacuumed table table=pending_closures2941=== NAME TestClientFallsBackToClosures2942 client_pushes_test.go:112: Retrieved narinfo from S3:2943 StorePath: /build/TestClientFallsBackToClosures381112887/001/store/5g8y7w91pypcyakfd6l78m2phyg53zhc-shared-dep2944 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst2945 Compression: zstd2946 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y822947 NarSize: 1362948 References: 2949 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n29502026/10/01 10:23:57 INFO Vacuumed table table=pending_objects29512026/10/01 10:23:57 INFO Vacuumed table table=multipart_uploads29522026/10/01 10:23:57 INFO Vacuumed table table=closures2953 client_pushes_test.go:112: Retrieved narinfo from S3:2954 StorePath: /build/TestClientFallsBackToClosures381112887/001/store/vwg9z537qiv6yy6b20kqz9kppfql5svf-a2955 URL: nar/1z924sfby4vxbl7zfg7fac5mygdgjpssfkggxf3bib5lh06gznrx.nar.zst2956 Compression: zstd2957 NarHash: sha256:1z924sfby4vxbl7zfg7fac5mygdgjpssfkggxf3bib5lh06gznrx2958 NarSize: 2162959 References: /build/TestClientFallsBackToClosures381112887/001/store/5g8y7w91pypcyakfd6l78m2phyg53zhc-shared-dep2960 CA: text:sha256:1qmfb9fqxxcyp3yznkb6rm2df30909z3jkjl54rf3y26hkk77vxc29612026/10/01 10:23:57 INFO Vacuumed table table=objects2962 client_pushes_test.go:112: Retrieved narinfo from S3:2963 StorePath: /build/TestClientFallsBackToClosures381112887/001/store/j0a7zlly52vr4fya7h3mwjv65018ixzq-b2964 URL: nar/1z924sfby4vxbl7zfg7fac5mygdgjpssfkggxf3bib5lh06gznrx.nar.zst2965 Compression: zstd2966 NarHash: sha256:1z924sfby4vxbl7zfg7fac5mygdgjpssfkggxf3bib5lh06gznrx2967 NarSize: 2162968 References: /build/TestClientFallsBackToClosures381112887/001/store/5g8y7w91pypcyakfd6l78m2phyg53zhc-shared-dep2969 CA: text:sha256:1qmfb9fqxxcyp3yznkb6rm2df30909z3jkjl54rf3y26hkk77vxc2970--- PASS: TestClientFallsBackToClosures (0.80s)2971--- PASS: TestForceGCDuringPushOffersSweptObject (0.00s)2972 --- PASS: TestForceGCDuringPushOffersSweptObject/before_pending_rows (0.56s)2973 --- PASS: TestForceGCDuringPushOffersSweptObject/after_presence_check (0.54s)2974=== NAME TestPinProtectsFromGC2975 client_integration_test.go:731: Pinned store path: /build/TestPinProtectsFromGC3153214415/001/store/861yvzlr7v0pdcjhd67sspydb0kfv206-pinned-file.txt2976 client_integration_test.go:732: Unpinned store path: /build/TestPinProtectsFromGC3153214415/001/store/766c9s3fgmsmhx7a0hzx4gp4wjfkfv8i-unpinned-file.txt29772026/10/01 10:23:57 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=360.767956ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present2978--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (0.81s)29792026/10/01 10:23:57 INFO Received push request method=POST path=/api/pushes2980--- PASS: TestGCBugBareHashReferences (0.74s)29812026/10/01 10:23:57 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)29822026/10/01 10:23:57 INFO Uploading iginra2gfc4cwh2aa7d4fsrhl4dhgm4j-a (216B)29832026/10/01 10:23:57 INFO Uploading pfm2jw7bfwgggr62vhz10ablvvzdp116-shared-dep (136B)29842026/10/01 10:23:57 INFO Received push request method=POST path=/api/pushes29852026/10/01 10:23:57 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)29862026/10/01 10:23:57 WARN Failed to register uploaded object key=nar/0iil6fvbdqwxh5vghl6zz2s24sdzfnxxy81f2mbhchv3rimvj07c.nar.zst error="server returned 404: 404 page not found\n"29872026/10/01 10:23:57 INFO Uploading 861yvzlr7v0pdcjhd67sspydb0kfv206-pinned-file.txt (128B)29882026/10/01 10:23:57 WARN Failed to register uploaded object key=3zqy2rsy0v3v08siqm60k7pdj0s94ad8.ls error="server returned 404: 404 page not found\n"29892026/10/01 10:23:57 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"29902026/10/01 10:23:57 WARN Failed to register uploaded object key=iginra2gfc4cwh2aa7d4fsrhl4dhgm4j.ls error="server returned 404: 404 page not found\n"29912026/10/01 10:23:57 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign29922026/10/01 10:23:57 WARN Failed to register uploaded object key=pfm2jw7bfwgggr62vhz10ablvvzdp116.ls error="server returned 404: 404 page not found\n"29932026/10/01 10:23:57 INFO Signed narinfos id=1 count=329942026/10/01 10:23:57 INFO Uploading 3 narinfos29952026/10/01 10:23:57 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"29962026/10/01 10:23:57 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign29972026/10/01 10:23:57 WARN Failed to register uploaded object key=861yvzlr7v0pdcjhd67sspydb0kfv206.ls error="server returned 404: 404 page not found\n"29982026/10/01 10:23:57 INFO Signed narinfos id=1 count=129992026/10/01 10:23:57 INFO Uploading 1 narinfos30002026/10/01 10:23:57 WARN Failed to register uploaded object key=3zqy2rsy0v3v08siqm60k7pdj0s94ad8.narinfo error="server returned 404: 404 page not found\n"30012026/10/01 10:23:57 WARN Failed to register uploaded object key=iginra2gfc4cwh2aa7d4fsrhl4dhgm4j.narinfo error="server returned 404: 404 page not found\n"30022026/10/01 10:23:57 INFO Received complete push request method=POST path=/api/pushes/1/complete30032026/10/01 10:23:57 WARN Failed to register uploaded object key=pfm2jw7bfwgggr62vhz10ablvvzdp116.narinfo error="server returned 404: 404 page not found\n"30042026/10/01 10:23:57 INFO Received complete push request method=POST path=/api/pushes/1/complete30052026/10/01 10:23:57 WARN Failed to register uploaded object key=861yvzlr7v0pdcjhd67sspydb0kfv206.narinfo error="server returned 404: 404 page not found\n"30062026/10/01 10:23:57 INFO Upload complete. (52ms)30072026/10/01 10:23:57 INFO Upload complete. (62ms)3008=== NAME TestClientPushesUseOnePush3009 client_pushes_test.go:97: Retrieved narinfo from S3:3010 StorePath: /build/TestClientPushesUseOnePush1170239586/001/store/pfm2jw7bfwgggr62vhz10ablvvzdp116-shared-dep3011 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst3012 Compression: zstd3013 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y823014 NarSize: 1363015 References: 3016 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n30172026/10/01 10:23:57 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"3018 client_pushes_test.go:97: Retrieved narinfo from S3:3019 StorePath: /build/TestClientPushesUseOnePush1170239586/001/store/iginra2gfc4cwh2aa7d4fsrhl4dhgm4j-a3020 URL: nar/0iil6fvbdqwxh5vghl6zz2s24sdzfnxxy81f2mbhchv3rimvj07c.nar.zst3021 Compression: zstd3022 NarHash: sha256:0iil6fvbdqwxh5vghl6zz2s24sdzfnxxy81f2mbhchv3rimvj07c3023 NarSize: 2163024 References: /build/TestClientPushesUseOnePush1170239586/001/store/pfm2jw7bfwgggr62vhz10ablvvzdp116-shared-dep3025 CA: text:sha256:0q00r80qav8ad3ihlxvnbh01yz7igfh2fbdqr1gv5xr39qy3xh6x3026 client_pushes_test.go:97: Retrieved narinfo from S3:3027 StorePath: /build/TestClientPushesUseOnePush1170239586/001/store/3zqy2rsy0v3v08siqm60k7pdj0s94ad8-b3028 URL: nar/0iil6fvbdqwxh5vghl6zz2s24sdzfnxxy81f2mbhchv3rimvj07c.nar.zst3029 Compression: zstd3030 NarHash: sha256:0iil6fvbdqwxh5vghl6zz2s24sdzfnxxy81f2mbhchv3rimvj07c3031 NarSize: 2163032 References: /build/TestClientPushesUseOnePush1170239586/001/store/pfm2jw7bfwgggr62vhz10ablvvzdp116-shared-dep3033 CA: text:sha256:0q00r80qav8ad3ihlxvnbh01yz7igfh2fbdqr1gv5xr39qy3xh6x3034--- PASS: TestClientPushesUseOnePush (0.71s)30352026/10/01 10:23:57 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"3036--- PASS: TestUploadHandlersRejectOversizedBody (0.22s)3037 --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.08s)3038 --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.09s)3039 --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (0.78s)30402026/10/01 10:23:57 INFO Received push request method=POST path=/api/pushes30412026/10/01 10:23:57 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)30422026/10/01 10:23:57 INFO Uploading 766c9s3fgmsmhx7a0hzx4gp4wjfkfv8i-unpinned-file.txt (128B)30432026/10/01 10:23:57 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"30442026/10/01 10:23:57 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign30452026/10/01 10:23:57 WARN Failed to register uploaded object key=766c9s3fgmsmhx7a0hzx4gp4wjfkfv8i.ls error="server returned 404: 404 page not found\n"30462026/10/01 10:23:57 INFO Signed narinfos id=2 count=130472026/10/01 10:23:57 INFO Uploading 1 narinfos30482026/10/01 10:23:57 INFO Received complete push request method=POST path=/api/pushes/2/complete30492026/10/01 10:23:57 WARN Failed to register uploaded object key=766c9s3fgmsmhx7a0hzx4gp4wjfkfv8i.narinfo error="server returned 404: 404 page not found\n"30502026/10/01 10:23:57 INFO Upload complete. (204ms)30512026/10/01 10:23:57 INFO Starting cleanup of old closures method=DELETE path=/api/closures30522026/10/01 10:23:57 INFO Garbage collection started30532026/10/01 10:23:57 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=770.696911ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present30542026/10/01 10:23:57 INFO Aborted multipart uploads count=0 kept=030552026/10/01 10:23:57 WARN Force mode enabled - objects will be deleted immediately without grace period30562026/10/01 10:23:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=030572026/10/01 10:23:57 INFO Vacuumed table table=pending_closures30582026/10/01 10:23:57 INFO Vacuumed table table=pending_objects30592026/10/01 10:23:57 INFO Vacuumed table table=multipart_uploads30602026/10/01 10:23:57 INFO Vacuumed table table=closures30612026/10/01 10:23:57 INFO Vacuumed table table=objects3062--- PASS: TestPendingClosureWriteTimeout (0.00s)3063 --- PASS: TestPendingClosureWriteTimeout/empty (0.00s)3064 --- PASS: TestPendingClosureWriteTimeout/670k_objects (0.00s)3065 --- PASS: TestPendingClosureWriteTimeout/400_objects (0.00s)3066 --- PASS: TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline (1.27s)3067=== NAME TestOrphanedObjectsGCStressTest3068 orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains3069 orphaned_objects_gc_test.go:446: Marked 210 objects for deletion30702026/10/01 10:23:58 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=03071=== NAME TestClientIntegration3072 client_integration_test.go:323: Objects in database after GC:3073 client_integration_test.go:323: Successfully deleted all objects with GC --force3074--- PASS: TestClientIntegration (2.91s)30752026/10/01 10:23:58 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.704980959s error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present3076=== NAME TestOrphanedObjectsGCStressTest3077 orphaned_objects_gc_test.go:509: Stress test completed successfully:3078 orphaned_objects_gc_test.go:510: - Active objects preserved: 203079 orphaned_objects_gc_test.go:511: - Objects deleted: 2103080 orphaned_objects_gc_test.go:512: - Total GC'd: 2103081--- PASS: TestOrphanedObjectsGCStressTest (2.28s)30822026/10/01 10:23:59 WARN Rate limiter enabled after throttle name=s3-test rate=530832026/10/01 10:23:59 WARN S3 rate limit hit operation="complete multipart upload" error="Please reduce your request rate."3084=== NAME TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle3085 throttle_test.go:213: Proxy stats: total=13, throttled=10, completeMultipart=103086 throttle_test.go:215: Rate limiter: enabled=true, rate=5.003087--- PASS: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (3.98s)30882026/10/01 10:23:59 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=030892026/10/01 10:23:59 INFO Received create pin request method=POST path=/api/pins/myapp30902026/10/01 10:23:59 INFO Created/updated pin name=myapp store_path=/build/TestPinProtectsFromGC3153214415/001/store/861yvzlr7v0pdcjhd67sspydb0kfv206-pinned-file.txt narinfo_key=861yvzlr7v0pdcjhd67sspydb0kfv206.narinfo30912026/10/01 10:23:59 INFO Starting cleanup of old closures method=DELETE path=/api/closures30922026/10/01 10:23:59 INFO Garbage collection started30932026/10/01 10:23:59 INFO Aborted multipart uploads count=0 kept=030942026/10/01 10:23:59 WARN Force mode enabled - objects will be deleted immediately without grace period30952026/10/01 10:23:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030962026/10/01 10:23:59 INFO Vacuumed table table=pending_closures30972026/10/01 10:23:59 INFO Vacuumed table table=pending_objects30982026/10/01 10:23:59 INFO Vacuumed table table=multipart_uploads30992026/10/01 10:23:59 INFO Vacuumed table table=closures31002026/10/01 10:23:59 INFO Vacuumed table table=objects31012026/10/01 10:24:00 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31022026/10/01 10:24:00 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=215.967818ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31032026/10/01 10:24:00 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=428.055124ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31042026/10/01 10:24:00 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=737.57737ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31052026/10/01 10:24:01 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.590991431s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config3106=== NAME TestPinProtectsFromGC3107 client_integration_test.go:840: Pin successfully protected closure from garbage collection3108--- PASS: TestPinProtectsFromGC (4.98s)31092026/10/01 10:24:02 INFO Aborted multipart uploads count=1 kept=031102026/10/01 10:24:02 INFO Received cleanup request method=DELETE path=/api/pending_closures31112026/10/01 10:24:02 INFO Aborted multipart uploads count=1 kept=03112--- PASS: TestPendingCleanupUsesOneCutoff (6.53s)31132026/10/01 10:24:03 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"31142026/10/01 10:24:03 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31152026/10/01 10:24:03 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=207.548946ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31162026/10/01 10:24:03 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=362.778597ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31172026/10/01 10:24:03 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=744.022281ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31182026/10/01 10:24:04 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.47445736s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config31192026/10/01 10:24:06 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures31202026/10/01 10:24:06 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=193.886003ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures31212026/10/01 10:24:06 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=430.815006ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures31222026/10/01 10:24:06 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=743.512545ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures31232026/10/01 10:24:07 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.751065786s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures3124--- PASS: TestClientErrorHandling (0.00s)3125 --- PASS: TestClientErrorHandling/InvalidStorePath (0.41s)3126 --- PASS: TestClientErrorHandling/InvalidAuthToken (0.47s)3127 --- PASS: TestClientErrorHandling/ServerNotAvailable (12.47s)3128PASS3129{"timestamp":"2026-10-01T10:24:09.265211807Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:59662","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2354,"threadName":"rustfs-worker","threadId":"ThreadId(395)"}31302026-10-01 10:24:09.643 UTC [128] LOG: received smart shutdown request31312026-10-01 10:24:09.648 UTC [128] LOG: background worker "logical replication launcher" (PID 138) exited with exit code 131322026-10-01 10:24:09.655 UTC [133] LOG: shutting down31332026-10-01 10:24:09.656 UTC [133] LOG: checkpoint starting: shutdown immediate31342026-10-01 10:24:10.372 UTC [133] LOG: checkpoint complete: wrote 10827 buffers (66.1%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 24 recycled; write=0.312 s, sync=0.361 s, total=0.717 s; sync files=28984, longest=0.053 s, average=0.001 s; distance=401140 kB, estimate=401140 kB; lsn=0/19F22F28, redo lsn=0/19F22F2831352026-10-01 10:24:10.460 UTC [128] LOG: database system is shut down3136Running OIDC tests...3137=== RUN TestAudienceForIssuer3138=== PAUSE TestAudienceForIssuer3139=== RUN TestGlobMatch3140=== PAUSE TestGlobMatch3141=== RUN TestValidateToken_ValidToken3142=== PAUSE TestValidateToken_ValidToken3143=== RUN TestValidateToken_WrongAudience3144=== PAUSE TestValidateToken_WrongAudience3145=== RUN TestValidateToken_Expired3146=== PAUSE TestValidateToken_Expired3147=== RUN TestValidateToken_BoundClaimsMismatch3148=== PAUSE TestValidateToken_BoundClaimsMismatch3149=== RUN TestValidateToken_BoundSubjectMismatch3150=== PAUSE TestValidateToken_BoundSubjectMismatch3151=== RUN TestValidateToken_MultipleProviders3152=== PAUSE TestValidateToken_MultipleProviders3153=== RUN TestValidateToken_NoMatchingProvider3154=== PAUSE TestValidateToken_NoMatchingProvider3155=== RUN TestValidateToken_KubernetesServiceAccount3156=== PAUSE TestValidateToken_KubernetesServiceAccount3157=== RUN TestNewValidator_KubernetesRequiresCA3158=== PAUSE TestNewValidator_KubernetesRequiresCA3159=== RUN TestValidateToken_KubernetesIssuerFromOwnToken3160=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken3161=== RUN TestPins_ReservedForMatchingRule3162=== PAUSE TestPins_ReservedForMatchingRule3163=== RUN TestPins_TopLevelShorthand3164=== PAUSE TestPins_TopLevelShorthand3165=== RUN TestPins_ConfigValidation3166=== PAUSE TestPins_ConfigValidation3167=== RUN TestScopes_LegacyProviderDefaultsToWrite3168=== PAUSE TestScopes_LegacyProviderDefaultsToWrite3169=== RUN TestScopes_Rules3170=== PAUSE TestScopes_Rules3171=== RUN TestScopes_ConfigValidation3172=== PAUSE TestScopes_ConfigValidation3173=== CONT TestAudienceForIssuer3174=== CONT TestPins_ConfigValidation3175--- PASS: TestAudienceForIssuer (0.00s)3176=== CONT TestValidateToken_NoMatchingProvider3177=== CONT TestValidateToken_MultipleProviders3178=== CONT TestValidateToken_BoundSubjectMismatch3179=== CONT TestValidateToken_BoundClaimsMismatch3180=== CONT TestValidateToken_Expired3181--- PASS: TestPins_ConfigValidation (0.00s)3182=== CONT TestValidateToken_WrongAudience3183=== CONT TestValidateToken_ValidToken3184=== CONT TestGlobMatch3185=== CONT TestScopes_Rules3186=== CONT TestScopes_ConfigValidation3187=== CONT TestValidateToken_KubernetesServiceAccount3188=== CONT TestScopes_LegacyProviderDefaultsToWrite3189=== CONT TestValidateToken_KubernetesIssuerFromOwnToken3190=== CONT TestNewValidator_KubernetesRequiresCA3191=== CONT TestPins_TopLevelShorthand3192=== CONT TestPins_ReservedForMatchingRule3193=== RUN TestGlobMatch/foo_foo3194=== PAUSE TestGlobMatch/foo_foo3195=== RUN TestGlobMatch/foo_bar3196=== PAUSE TestGlobMatch/foo_bar3197=== RUN TestGlobMatch/*_3198=== PAUSE TestGlobMatch/*_3199=== RUN TestGlobMatch/*_anything3200=== PAUSE TestGlobMatch/*_anything3201=== RUN TestGlobMatch/foo*_foo3202=== PAUSE TestGlobMatch/foo*_foo3203=== RUN TestGlobMatch/foo*_foobar3204=== PAUSE TestGlobMatch/foo*_foobar3205=== RUN TestGlobMatch/foo*_bar3206=== PAUSE TestGlobMatch/foo*_bar3207=== RUN TestGlobMatch/*bar_bar3208=== PAUSE TestGlobMatch/*bar_bar3209=== RUN TestGlobMatch/*bar_foobar3210=== PAUSE TestGlobMatch/*bar_foobar3211=== RUN TestGlobMatch/*bar_foo3212=== PAUSE TestGlobMatch/*bar_foo3213=== RUN TestGlobMatch/foo*bar_foobar3214=== PAUSE TestGlobMatch/foo*bar_foobar3215=== RUN TestGlobMatch/foo*bar_foo123bar3216=== PAUSE TestGlobMatch/foo*bar_foo123bar3217=== RUN TestGlobMatch/foo*bar_foobarbaz3218=== PAUSE TestGlobMatch/foo*bar_foobarbaz3219=== RUN TestGlobMatch/*/*_foo/bar3220=== PAUSE TestGlobMatch/*/*_foo/bar3221=== RUN TestGlobMatch/*/*_foo3222=== PAUSE TestGlobMatch/*/*_foo3223=== RUN TestGlobMatch/refs/heads/*_refs/heads/main3224=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main3225=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.03226=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.03227=== RUN TestGlobMatch/refs/*/main_refs/heads/main3228=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main3229=== RUN TestGlobMatch/fo?_foo3230=== PAUSE TestGlobMatch/fo?_foo3231=== RUN TestGlobMatch/fo?_fo3232=== PAUSE TestGlobMatch/fo?_fo3233=== RUN TestGlobMatch/fo?_fooo3234=== PAUSE TestGlobMatch/fo?_fooo3235=== RUN TestGlobMatch/?oo_foo3236=== PAUSE TestGlobMatch/?oo_foo3237=== RUN TestGlobMatch/?oo_boo3238=== PAUSE TestGlobMatch/?oo_boo3239=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main3240=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main3241=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main3242=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main3243=== CONT TestGlobMatch/foo_foo3244=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main3245=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main3246=== CONT TestGlobMatch/?oo_boo3247=== CONT TestGlobMatch/?oo_foo3248=== CONT TestGlobMatch/fo?_fooo3249=== CONT TestGlobMatch/*bar_foo3250=== CONT TestGlobMatch/*bar_foobar3251=== CONT TestGlobMatch/*bar_bar3252=== CONT TestGlobMatch/foo*_bar3253=== CONT TestGlobMatch/foo*_foobar3254=== CONT TestGlobMatch/foo*_foo3255=== CONT TestGlobMatch/*_anything3256=== CONT TestGlobMatch/foo*bar_foobar3257=== CONT TestGlobMatch/*_3258=== CONT TestGlobMatch/refs/*/main_refs/heads/main3259=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.03260=== CONT TestGlobMatch/foo_bar3261=== CONT TestGlobMatch/*/*_foo3262=== CONT TestGlobMatch/*/*_foo/bar3263=== CONT TestGlobMatch/foo*bar_foobarbaz3264=== CONT TestGlobMatch/foo*bar_foo123bar3265=== CONT TestGlobMatch/refs/heads/*_refs/heads/main3266=== CONT TestGlobMatch/fo?_fo3267=== CONT TestGlobMatch/fo?_foo3268--- PASS: TestGlobMatch (0.00s)3269 --- PASS: TestGlobMatch/foo_foo (0.00s)3270 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)3271 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)3272 --- PASS: TestGlobMatch/?oo_boo (0.00s)3273 --- PASS: TestGlobMatch/?oo_foo (0.00s)3274 --- PASS: TestGlobMatch/fo?_fooo (0.00s)3275 --- PASS: TestGlobMatch/*bar_foo (0.00s)3276 --- PASS: TestGlobMatch/*bar_foobar (0.00s)3277 --- PASS: TestGlobMatch/*bar_bar (0.00s)3278 --- PASS: TestGlobMatch/foo*_bar (0.00s)3279 --- PASS: TestGlobMatch/foo*_foobar (0.00s)3280 --- PASS: TestGlobMatch/foo*_foo (0.00s)3281 --- PASS: TestGlobMatch/*_anything (0.00s)3282 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)3283 --- PASS: TestGlobMatch/*_ (0.00s)3284 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)3285 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)3286 --- PASS: TestGlobMatch/foo_bar (0.00s)3287 --- PASS: TestGlobMatch/*/*_foo (0.00s)3288 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)3289 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)3290 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)3291 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)3292 --- PASS: TestGlobMatch/fo?_fo (0.00s)3293 --- PASS: TestGlobMatch/fo?_foo (0.00s)3294--- PASS: TestScopes_ConfigValidation (0.00s)32952026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:41033/oidc32962026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45927/oidc3297--- PASS: TestScopes_Rules (0.02s)32982026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45985/oidc3299--- PASS: TestValidateToken_Expired (0.03s)3300--- PASS: TestPins_ReservedForMatchingRule (0.03s)33012026/10/01 10:24:12 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC1233302--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.04s)33032026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:43279/oidc3304--- PASS: TestPins_TopLevelShorthand (0.04s)33052026/10/01 10:24:12 http: TLS handshake error from 127.0.0.1:42760: remote error: tls: bad certificate3306--- PASS: TestNewValidator_KubernetesRequiresCA (0.05s)33072026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:45567/oidc33082026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:37577/oidc3309--- PASS: TestValidateToken_BoundSubjectMismatch (0.08s)3310--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.07s)33112026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:35375/oidc33122026/10/01 10:24:12 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:43439/oidc3313--- PASS: TestValidateToken_BoundClaimsMismatch (0.09s)33142026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:35365/oidc3315--- PASS: TestValidateToken_NoMatchingProvider (0.09s)3316--- PASS: TestValidateToken_WrongAudience (0.09s)33172026/10/01 10:24:12 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:453633318--- PASS: TestValidateToken_KubernetesServiceAccount (0.11s)33192026/10/01 10:24:12 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:40893/oidc33202026/10/01 10:24:12 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:40509/oidc33212026/10/01 10:24:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:33641/oidc3322--- PASS: TestValidateToken_MultipleProviders (0.13s)3323--- PASS: TestValidateToken_ValidToken (0.13s)3324PASS3325Running hook tests...3326=== RUN TestSendPathsEmpty3327=== PAUSE TestSendPathsEmpty3328=== RUN TestQueueEnqueueAndFetch3329=== PAUSE TestQueueEnqueueAndFetch3330=== RUN TestQueueDeduplication3331=== PAUSE TestQueueDeduplication3332=== RUN TestQueueRemove3333=== PAUSE TestQueueRemove3334=== RUN TestQueueFetchBatchLimit3335=== PAUSE TestQueueFetchBatchLimit3336=== RUN TestQueueRetryMovesToBack3337=== PAUSE TestQueueRetryMovesToBack3338=== RUN TestQueueFetchRemoveLifecycle3339=== PAUSE TestQueueFetchRemoveLifecycle3340=== RUN TestQueueConcurrentWriters3341=== PAUSE TestQueueConcurrentWriters3342=== RUN TestQueueRemoveLargeClosure3343=== PAUSE TestQueueRemoveLargeClosure3344=== RUN TestServerClientIntegration3345=== PAUSE TestServerClientIntegration3346=== RUN TestServerQueueError3347=== PAUSE TestServerQueueError3348=== RUN TestGetListenerSocketActivation3349 server_test.go:210: === RUN TestGetListenerSocketActivation3350 --- PASS: TestGetListenerSocketActivation (0.00s)3351 PASS3352 3353--- PASS: TestGetListenerSocketActivation (0.01s)3354=== RUN TestDrainIsolatesPoisonPath3355=== PAUSE TestDrainIsolatesPoisonPath3356=== RUN TestRunNotBlockedByPoisonHead3357=== PAUSE TestRunNotBlockedByPoisonHead3358=== RUN TestDrainGivesUpWhenServerDown3359=== PAUSE TestDrainGivesUpWhenServerDown3360=== RUN TestFailedPathPrunedByLaterClosure3361=== PAUSE TestFailedPathPrunedByLaterClosure3362=== RUN TestWorkerUploadsAndRemoves3363=== PAUSE TestWorkerUploadsAndRemoves3364=== RUN TestWorkerSkipsGCdPaths3365=== PAUSE TestWorkerSkipsGCdPaths3366=== RUN TestWorkerPrunesClosureDeps3367=== PAUSE TestWorkerPrunesClosureDeps3368=== RUN TestDrainTimeout3369=== PAUSE TestDrainTimeout3370=== CONT TestSendPathsEmpty3371=== CONT TestServerQueueError3372--- PASS: TestSendPathsEmpty (0.00s)3373=== CONT TestServerClientIntegration3374=== CONT TestQueueRemoveLargeClosure3375=== CONT TestQueueConcurrentWriters3376=== CONT TestQueueFetchRemoveLifecycle3377=== CONT TestQueueRetryMovesToBack33782026/10/01 10:24:12 ERROR Failed to queue paths error="permission denied" count=13379=== CONT TestQueueFetchBatchLimit3380=== CONT TestQueueRemove3381=== CONT TestQueueDeduplication3382=== CONT TestQueueEnqueueAndFetch3383=== CONT TestWorkerUploadsAndRemoves3384=== CONT TestDrainTimeout3385=== CONT TestWorkerPrunesClosureDeps3386=== CONT TestWorkerSkipsGCdPaths3387=== CONT TestFailedPathPrunedByLaterClosure3388=== CONT TestRunNotBlockedByPoisonHead3389=== CONT TestDrainIsolatesPoisonPath3390=== CONT TestDrainGivesUpWhenServerDown3391--- PASS: TestServerQueueError (0.00s)3392--- PASS: TestServerClientIntegration (0.00s)33932026/10/01 10:24:12 INFO Uploading batch count=133942026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=133952026/10/01 10:24:12 INFO Uploading batch count=233962026/10/01 10:24:12 INFO Uploading batch count=433972026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=433982026/10/01 10:24:12 INFO Uploading batch count=233992026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=234002026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown1246308088/002/a34012026/10/01 10:24:12 INFO Upload queue status pending=234022026/10/01 10:24:12 WARN Store path no longer exists (garbage collected?), removing from queue path=/build/TestWorkerSkipsGCdPaths129313605/002/nonexistent34032026/10/01 10:24:12 INFO Upload queue status pending=234042026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainIsolatesPoisonPath2024812905/002/bbb3405--- PASS: TestQueueEnqueueAndFetch (0.02s)34062026/10/01 10:24:12 INFO Upload queue status pending=334072026/10/01 10:24:12 INFO Uploading batch count=134082026/10/01 10:24:12 INFO Uploading batch count=13409--- PASS: TestQueueFetchBatchLimit (0.02s)34102026/10/01 10:24:12 INFO Upload queue status pending=234112026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown1246308088/002/b34122026/10/01 10:24:12 INFO Uploading batch count=13413--- PASS: TestQueueRetryMovesToBack (0.02s)34142026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=134152026/10/01 10:24:12 INFO Uploading batch count=23416--- PASS: TestQueueFetchRemoveLifecycle (0.02s)34172026/10/01 10:24:12 INFO Uploading batch count=13418--- PASS: TestQueueDeduplication (0.02s)34192026/10/01 10:24:12 INFO Uploading batch count=234202026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=234212026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown1246308088/002/c34222026/10/01 10:24:12 INFO Uploading batch count=134232026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown1246308088/002/d34242026/10/01 10:24:12 INFO Uploading batch count=134252026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=13426--- PASS: TestQueueRemove (0.02s)34272026/10/01 10:24:12 INFO Uploading batch count=234282026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=234292026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown1246308088/002/e34302026/10/01 10:24:12 INFO Uploading batch count=134312026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=134322026/10/01 10:24:12 ERROR Upload failed, will retry later error="upload failed" path=/build/TestDrainGivesUpWhenServerDown1246308088/002/f34332026/10/01 10:24:12 INFO Uploading batch count=134342026/10/01 10:24:12 ERROR Upload failed error="upload failed" count=134352026/10/01 10:24:12 ERROR Drain finished with paths left in queue remaining=1034362026/10/01 10:24:12 ERROR Drain finished with paths left in queue remaining=13437--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)3438--- PASS: TestDrainIsolatesPoisonPath (0.02s)3439--- PASS: TestDrainGivesUpWhenServerDown (0.02s)3440--- PASS: TestWorkerPrunesClosureDeps (0.04s)3441--- PASS: TestWorkerSkipsGCdPaths (0.04s)3442--- PASS: TestWorkerUploadsAndRemoves (0.04s)3443--- PASS: TestQueueRemoveLargeClosure (0.08s)34442026/10/01 10:24:12 ERROR Upload failed error="context deadline exceeded" count=234452026/10/01 10:24:12 ERROR Drain finished with paths left in queue remaining=43446--- PASS: TestDrainTimeout (0.22s)3447--- PASS: TestQueueConcurrentWriters (0.27s)34482026/10/01 10:24:13 INFO Uploading batch count=134492026/10/01 10:24:13 INFO Uploading batch count=134502026/10/01 10:24:13 INFO Uploading batch count=134512026/10/01 10:24:13 ERROR Upload failed error="upload failed" count=134522026/10/01 10:24:13 INFO Uploading batch count=134532026/10/01 10:24:13 ERROR Upload failed error="upload failed" count=134542026/10/01 10:24:13 INFO Uploading batch count=134552026/10/01 10:24:13 ERROR Upload failed error="upload failed" count=134562026/10/01 10:24:13 INFO Uploading batch count=134572026/10/01 10:24:13 ERROR Upload failed error="upload failed" count=134582026/10/01 10:24:13 ERROR Drain finished with paths left in queue remaining=13459--- PASS: TestRunNotBlockedByPoisonHead (1.04s)3460PASS