niks3-go-unit-tests
checks.aarch64-darwin.go-unit-tests
· build #509
· raw
1tribuchet: building on mac022Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestUploadBuildLog_FileBodyReplayedOnRetry6=== PAUSE TestUploadBuildLog_FileBodyReplayedOnRetry7=== RUN TestRegisterUploadedObjectReusesConnections8=== PAUSE TestRegisterUploadedObjectReusesConnections9=== RUN TestRunGarbageCollection_FinishedOnAnotherReplica10=== PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica11=== RUN TestRunGarbageCollection_NotFoundAfterLocalRun12=== PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun13=== RUN TestCaseHackSuffix14=== PAUSE TestCaseHackSuffix15=== RUN TestFilterOversizedClosures16=== PAUSE TestFilterOversizedClosures17=== RUN TestUploadMultipart_PartsInParallel18=== PAUSE TestUploadMultipart_PartsInParallel19=== RUN TestUploadMultipart_ReturnsAfterDroppedBody20=== PAUSE TestUploadMultipart_ReturnsAfterDroppedBody21=== RUN TestUploadMultipart_FailedProducerIsNotCompleted22=== PAUSE TestUploadMultipart_FailedProducerIsNotCompleted23=== RUN TestPartSizeForNAR24=== PAUSE TestPartSizeForNAR25=== RUN TestDumpPathCaseHackMatchesNix26--- PASS: TestDumpPathCaseHackMatchesNix (0.05s)27=== RUN TestDumpPathCaseHackCollision28--- PASS: TestDumpPathCaseHackCollision (0.00s)29=== RUN TestDumpPathMatchesNix30=== PAUSE TestDumpPathMatchesNix31=== RUN TestDumpPathSingleFile32=== PAUSE TestDumpPathSingleFile33=== RUN TestDumpPathWriterError34=== PAUSE TestDumpPathWriterError35=== RUN TestEncodeNixBase3236=== PAUSE TestEncodeNixBase3237=== RUN TestEncodeNixBase32WithRealHash38=== PAUSE TestEncodeNixBase32WithRealHash39=== RUN TestConvertHashToNix3240=== PAUSE TestConvertHashToNix3241=== RUN TestGetStorePathHash42=== PAUSE TestGetStorePathHash43=== RUN TestPathInfoHashCompatibility44=== PAUSE TestPathInfoHashCompatibility45=== RUN TestParsePathInfoJSON46=== PAUSE TestParsePathInfoJSON47=== RUN TestParsePathInfoJSONMultiplePaths48=== PAUSE TestParsePathInfoJSONMultiplePaths49=== RUN TestPathInfoCACompatibility50=== PAUSE TestPathInfoCACompatibility51=== RUN TestRateLimiterFeedback52=== PAUSE TestRateLimiterFeedback53=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess54=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess55=== RUN TestRegisterUploadedObject_BoundedAgainstSilentServer56=== PAUSE TestRegisterUploadedObject_BoundedAgainstSilentServer57=== RUN TestRegisterUploadedObject_OutlivesPush58=== PAUSE TestRegisterUploadedObject_OutlivesPush59=== RUN TestResolveStorePath60=== PAUSE TestResolveStorePath61=== RUN TestDoWithRetry_BodyReplayedViaGetBody62=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody63=== RUN TestRetryTimeoutOutlastsMaxRetries64=== PAUSE TestRetryTimeoutOutlastsMaxRetries65=== RUN TestDoWithRetry_FinalResponseBodyReadable66=== PAUSE TestDoWithRetry_FinalResponseBodyReadable67=== RUN TestShellSplit68=== PAUSE TestShellSplit69=== RUN TestShellSplitErrors70=== PAUSE TestShellSplitErrors71=== RUN TestStreamPushReportsEveryPath72=== PAUSE TestStreamPushReportsEveryPath73=== RUN TestStreamPushBatchesUnderLoad74=== PAUSE TestStreamPushBatchesUnderLoad75=== RUN TestStreamPushIsolatesFailures76=== PAUSE TestStreamPushIsolatesFailures77=== RUN TestStreamPushGivesUpOnDeadServer78=== PAUSE TestStreamPushGivesUpOnDeadServer79=== RUN TestStreamPushRequestLine80=== PAUSE TestStreamPushRequestLine81=== RUN TestStreamPushReportsSignatures82=== PAUSE TestStreamPushReportsSignatures83=== RUN TestStreamPushReportsSkippedPaths84=== PAUSE TestStreamPushReportsSkippedPaths85=== RUN TestClientSignaturesByStorePath86=== PAUSE TestClientSignaturesByStorePath87=== RUN TestStreamPushAnswersEveryLineWhenCanceled88=== PAUSE TestStreamPushAnswersEveryLineWhenCanceled89=== RUN TestStreamPushStopsWhenCanceled90=== PAUSE TestStreamPushStopsWhenCanceled91=== RUN TestSetClientTLS92=== PAUSE TestSetClientTLS93=== RUN TestSetClientTLSDoesNotMutateDefaultTransport94=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport95=== RUN TestSetClientTLSErrors96=== PAUSE TestSetClientTLSErrors97=== RUN TestStaticToken98=== PAUSE TestStaticToken99=== RUN TestFileTokenReadsAndCaches100=== PAUSE TestFileTokenReadsAndCaches101=== RUN TestFileTokenMissing102=== PAUSE TestFileTokenMissing103=== RUN TestFileTokenEmpty104=== PAUSE TestFileTokenEmpty105=== RUN TestScriptTokenNoExpiryRerunsEveryCall106=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall107=== RUN TestScriptTokenCachesUntilRefresh108=== PAUSE TestScriptTokenCachesUntilRefresh109=== RUN TestScriptTokenEmptyToken110=== PAUSE TestScriptTokenEmptyToken111=== RUN TestScriptTokenBadJSON112=== PAUSE TestScriptTokenBadJSON113=== RUN TestScriptTokenScriptFails114=== PAUSE TestScriptTokenScriptFails115=== RUN TestScriptTokenEmptyCommand116=== PAUSE TestScriptTokenEmptyCommand117=== CONT TestDoServerRequestAttachesToken118=== CONT TestShellSplitErrors119=== CONT TestConvertHashToNix32120--- PASS: TestShellSplitErrors (0.00s)121=== CONT TestStreamPushReportsSignatures122=== RUN TestConvertHashToNix32/SRI_format_to_Nix32123=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32124=== CONT TestScriptTokenEmptyCommand125--- PASS: TestScriptTokenEmptyCommand (0.00s)126=== CONT TestShellSplit127=== CONT TestScriptTokenScriptFails128=== CONT TestScriptTokenBadJSON129=== CONT TestScriptTokenEmptyToken130=== CONT TestScriptTokenCachesUntilRefresh131=== CONT TestScriptTokenNoExpiryRerunsEveryCall132=== CONT TestFileTokenEmpty133=== CONT TestFileTokenMissing1342026/11/12 11:50:00 ERROR Upload failed error=boom count=1135=== CONT TestRetryTimeoutOutlastsMaxRetries136=== CONT TestFileTokenReadsAndCaches137=== CONT TestStaticToken138=== CONT TestSetClientTLSErrors139=== CONT TestRegisterUploadedObject_OutlivesPush140=== CONT TestStreamPushIsolatesFailures141=== CONT TestStreamPushRequestLine142=== CONT TestStreamPushGivesUpOnDeadServer143=== CONT TestSetClientTLS144=== CONT TestStreamPushStopsWhenCanceled145=== CONT TestStreamPushAnswersEveryLineWhenCanceled146=== CONT TestClientSignaturesByStorePath147=== CONT TestStreamPushReportsSkippedPaths148=== CONT TestSetClientTLSDoesNotMutateDefaultTransport149=== CONT TestRegisterUploadedObject_BoundedAgainstSilentServer150=== RUN TestConvertHashToNix32/already_Nix32_format151=== CONT TestParsePathInfoJSONMultiplePaths152=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess153=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths154=== CONT TestRateLimiterFeedback155=== RUN TestRateLimiterFeedback/429_enables_limiter156=== PAUSE TestRateLimiterFeedback/429_enables_limiter157=== RUN TestRateLimiterFeedback/503_enables_limiter158=== PAUSE TestRateLimiterFeedback/503_enables_limiter159=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter160=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter161=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter162--- PASS: TestShellSplit (0.00s)163=== CONT TestResolveStorePath164=== CONT TestPathInfoCACompatibility1652000/01/01 00:00:00 ERROR Upload failed error="context canceled" count=2166=== RUN TestPathInfoCACompatibility/null_ca_field167=== PAUSE TestPathInfoCACompatibility/null_ca_field168=== RUN TestPathInfoCACompatibility/old_string_format_-_text169=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text170=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive171=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive172=== RUN TestPathInfoCACompatibility/new_structured_format_-_text173=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text174=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method175=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method176=== CONT TestDoWithRetry_BodyReplayedViaGetBody177=== CONT TestDoWithRetry_FinalResponseBodyReadable178=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths179=== CONT TestUploadMultipart_ReturnsAfterDroppedBody1802026/11/12 11:50:00 ERROR Upload failed error="bad path" count=3181--- PASS: TestStreamPushReportsSignatures (0.00s)182--- PASS: TestStaticToken (0.00s)183--- PASS: TestFileTokenEmpty (0.00s)184--- PASS: TestFileTokenMissing (0.00s)185--- PASS: TestFileTokenReadsAndCaches (0.00s)1862026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:52445187--- PASS: TestClientSignaturesByStorePath (0.00s)188--- PASS: TestStreamPushStopsWhenCanceled (0.00s)189--- PASS: TestStreamPushReportsSkippedPaths (0.00s)190--- PASS: TestStreamPushAnswersEveryLineWhenCanceled (0.00s)191--- PASS: TestScriptTokenScriptFails (0.00s)192--- PASS: TestStreamPushIsolatesFailures (0.00s)193=== CONT TestEncodeNixBase32WithRealHash194--- PASS: TestEncodeNixBase32WithRealHash (0.00s)195=== CONT TestDumpPathSingleFile196=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths197=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths198--- PASS: TestResolveStorePath (0.00s)199=== PAUSE TestConvertHashToNix32/already_Nix32_format200=== CONT TestEncodeNixBase32201=== CONT TestDumpPathMatchesNix2022026/11/12 11:50:00 ERROR Upload failed error=boom count=12032026/11/12 11:50:00 WARN Rate limiter enabled after throttle name=server-test rate=52042026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:52453205=== RUN TestConvertHashToNix32/invalid_format206=== PAUSE TestConvertHashToNix32/invalid_format207=== RUN TestEncodeNixBase32/test_string_hash208=== PAUSE TestEncodeNixBase32/test_string_hash209=== RUN TestEncodeNixBase32/empty_input210=== PAUSE TestEncodeNixBase32/empty_input211=== CONT TestRunGarbageCollection_NotFoundAfterLocalRun2122026/11/12 11:50:00 WARN Rate limiter backed off name=server-test rate=5213=== CONT TestFilterOversizedClosures214=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter215=== CONT TestUploadMultipart_PartsInParallel216=== CONT TestPartSizeForNAR217=== CONT TestDumpPathWriterError218--- PASS: TestDoServerRequestAttachesToken (0.01s)219=== CONT TestUploadMultipart_FailedProducerIsNotCompleted2202026/11/12 11:50:00 WARN Rate limiter enabled after throttle name=server-test rate=5221--- PASS: TestDoWithRetry_FinalResponseBodyReadable (0.00s)222=== CONT TestCaseHackSuffix223=== RUN TestSetClientTLSErrors/missing_cert_file224--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s)225=== PAUSE TestSetClientTLSErrors/missing_cert_file226=== RUN TestSetClientTLSErrors/missing_key_file227=== PAUSE TestSetClientTLSErrors/missing_key_file228=== CONT TestRegisterUploadedObjectReusesConnections229=== RUN TestSetClientTLS/rejects_connection_without_client_cert230=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert2312026/11/12 11:50:00 ERROR Upload failed error="connection refused" count=202322026/11/12 11:50:00 ERROR Server seems unavailable, giving up on batch untried=17233=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA234=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA235=== RUN TestSetClientTLS/preserves_debug_logging_transport236=== PAUSE TestSetClientTLS/preserves_debug_logging_transport237=== RUN TestFilterOversizedClosures/no_limit_keeps_everything2382026/11/12 11:50:00 INFO Garbage collection started2392026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:52445240=== CONT TestRunGarbageCollection_FinishedOnAnotherReplica241=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything242=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped243=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped244=== RUN TestPartSizeForNAR/zero_stays_at_minimum245=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum246=== RUN TestSetClientTLSErrors/missing_ca_file247=== RUN TestUploadMultipart_FailedProducerIsNotCompleted/on_a_part_boundary248--- PASS: TestStreamPushGivesUpOnDeadServer (0.01s)249--- PASS: TestRegisterUploadedObject_OutlivesPush (0.01s)250=== CONT TestStreamPushBatchesUnderLoad251=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=false252=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=false253=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=true254=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=true255=== CONT TestPathInfoHashCompatibility256=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)257=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)258=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon259=== CONT TestParsePathInfoJSON260=== RUN TestParsePathInfoJSON/Nix_format261=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon262=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI263=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI264=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512265=== RUN TestPartSizeForNAR/small_stays_at_minimum266=== PAUSE TestPartSizeForNAR/small_stays_at_minimum267=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum268=== PAUSE TestSetClientTLSErrors/missing_ca_file269=== RUN TestSetClientTLSErrors/invalid_ca_file270=== PAUSE TestSetClientTLSErrors/invalid_ca_file271=== PAUSE TestUploadMultipart_FailedProducerIsNotCompleted/on_a_part_boundary272=== RUN TestUploadMultipart_FailedProducerIsNotCompleted/inside_a_part273=== PAUSE TestUploadMultipart_FailedProducerIsNotCompleted/inside_a_part274=== RUN TestFilterOversizedClosures/all_closures_skipped275=== PAUSE TestFilterOversizedClosures/all_closures_skipped276=== CONT TestGetStorePathHash277=== RUN TestGetStorePathHash/valid_store_path278=== PAUSE TestGetStorePathHash/valid_store_path279=== CONT TestUploadBuildLog_FileBodyReplayedOnRetry280=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512281=== PAUSE TestParsePathInfoJSON/Nix_format282=== CONT TestPathInfoCACompatibility/null_ca_field283=== RUN TestParsePathInfoJSON/Lix_format284=== PAUSE TestParsePathInfoJSON/Lix_format285=== CONT TestStreamPushReportsEveryPath286=== CONT TestPathInfoCACompatibility/new_structured_format_-_text287=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum288=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts289=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts290=== RUN TestPartSizeForNAR/1_TiB291=== PAUSE TestPartSizeForNAR/1_TiB292=== RUN TestPartSizeForNAR/5_TiB_S3_max_object293=== CONT TestPathInfoCACompatibility/old_string_format_-_text294=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object295=== RUN TestPartSizeForNAR/capped_at_5_GiB296=== PAUSE TestPartSizeForNAR/capped_at_5_GiB297=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths298=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method299=== RUN TestGetStorePathHash/basename_without_hyphen_should_error3002026/11/12 11:50:00 INFO Garbage collection started301=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error302=== RUN TestParsePathInfoJSON/empty_input303=== PAUSE TestParsePathInfoJSON/empty_input304=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive305=== CONT TestConvertHashToNix32/SRI_format_to_Nix32306=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error307=== CONT TestEncodeNixBase32/test_string_hash308=== CONT TestConvertHashToNix32/invalid_format309=== CONT TestConvertHashToNix32/already_Nix32_format310=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter311=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths312=== CONT TestRateLimiterFeedback/503_enables_limiter313=== CONT TestRateLimiterFeedback/429_enables_limiter314=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error315=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error316=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error317--- PASS: TestStreamPushReportsEveryPath (0.00s)3182026/11/12 11:50:00 WARN Rate limiter enabled after throttle name=server-test rate=53192026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:524523202026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:524453212026/11/12 11:50:00 WARN Rate limiter backed off name=server-test rate=53222026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:52452323=== RUN TestParsePathInfoJSON/whitespace_only324=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter325=== PAUSE TestParsePathInfoJSON/whitespace_only326=== RUN TestParsePathInfoJSON/invalid_JSON327=== PAUSE TestParsePathInfoJSON/invalid_JSON328=== CONT TestSetClientTLS/rejects_connection_without_client_cert329--- PASS: TestPathInfoCACompatibility (0.00s)330 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)331 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)332 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)333 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)334 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)335--- PASS: TestConvertHashToNix32 (0.01s)336 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)337 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)338 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)339=== CONT TestEncodeNixBase32/empty_input340--- PASS: TestEncodeNixBase32 (0.00s)341 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)342 --- PASS: TestEncodeNixBase32/empty_input (0.00s)343--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)344 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)345 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)346=== CONT TestSetClientTLS/preserves_debug_logging_transport347--- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.01s)348--- PASS: TestScriptTokenEmptyToken (0.02s)349=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA350--- PASS: TestScriptTokenBadJSON (0.02s)351=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=false352=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=true353--- PASS: TestStreamPushBatchesUnderLoad (0.00s)354 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=false (0.00s)355 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=true (0.00s)356=== CONT TestSetClientTLSErrors/missing_cert_file357=== CONT TestSetClientTLSErrors/invalid_ca_file358=== CONT TestSetClientTLSErrors/missing_ca_file359--- PASS: TestUploadMultipart_ReturnsAfterDroppedBody (0.01s)360=== CONT TestSetClientTLSErrors/missing_key_file361=== CONT TestUploadMultipart_FailedProducerIsNotCompleted/on_a_part_boundary362--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.01s)363=== CONT TestFilterOversizedClosures/no_limit_keeps_everything364=== CONT TestFilterOversizedClosures/all_closures_skipped365=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped3662026/11/12 11:50:00 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=03672026/11/12 11:50:00 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=50368=== CONT TestUploadMultipart_FailedProducerIsNotCompleted/inside_a_part3692026/11/12 11:50:00 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000370--- PASS: TestFilterOversizedClosures (0.01s)371 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)372 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)373 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)374=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)375=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI3762026/11/12 11:50:00 WARN Rate limiter enabled after throttle name=s3-test rate=53772026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:525273782026/11/12 11:50:00 WARN Rate limiter enabled after throttle name=server-test rate=53792026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:525183802026/11/12 11:50:00 WARN Rate limiter backed off name=server-test rate=5381=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512382=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon383=== CONT TestPartSizeForNAR/zero_stays_at_minimum384=== CONT TestPartSizeForNAR/1_TiB385=== CONT TestPartSizeForNAR/5_TiB_S3_max_object386=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum387=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts388=== CONT TestPartSizeForNAR/small_stays_at_minimum389=== CONT TestGetStorePathHash/valid_store_path390=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error391=== CONT TestGetStorePathHash/basename_without_hyphen_should_error392=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error393=== CONT TestParsePathInfoJSON/invalid_JSON394=== CONT TestParsePathInfoJSON/Nix_format395=== CONT TestParsePathInfoJSON/whitespace_only396=== CONT TestParsePathInfoJSON/empty_input397=== CONT TestParsePathInfoJSON/Lix_format398=== CONT TestPartSizeForNAR/capped_at_5_GiB399--- PASS: TestGetStorePathHash (0.00s)400 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)401 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)402 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)403 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)404--- PASS: TestPathInfoHashCompatibility (0.00s)405 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)406 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)407 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)408 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)409--- PASS: TestParsePathInfoJSON (0.00s)410 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)411 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)412 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)413 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)414 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)415--- PASS: TestPartSizeForNAR (0.01s)416 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)417 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)418 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)419 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)420 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)421 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)422 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)4232026/11/12 11:50:00 WARN Rate limiter enabled after throttle name=server-test rate=54242026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:525334252026/11/12 11:50:00 WARN Rate limiter backed off name=server-test rate=5426--- PASS: TestUploadBuildLog_FileBodyReplayedOnRetry (0.01s)427--- PASS: TestSetClientTLSErrors (0.01s)428 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)429 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)430 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)431 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)4322026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:524454332026/11/12 11:50:00 WARN Garbage collection finished on another replica. Its statistics are not available here434--- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.01s)435--- PASS: TestRateLimiterFeedback (0.00s)436 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)437 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)438 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.00s)439 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.01s)440--- PASS: TestUploadMultipart_FailedProducerIsNotCompleted (0.00s)441 --- PASS: TestUploadMultipart_FailedProducerIsNotCompleted/on_a_part_boundary (0.01s)442 --- PASS: TestUploadMultipart_FailedProducerIsNotCompleted/inside_a_part (0.01s)4432026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:52445444--- PASS: TestStreamPushRequestLine (0.02s)4452026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:524454462026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:524454472026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:524454482026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:524454492026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:524454502026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:524454512026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:524454522026/11/12 11:50:00 http: TLS handshake error from 127.0.0.1:52528: read tcp 127.0.0.1:52455->127.0.0.1:52528: use of closed network connection453--- PASS: TestScriptTokenCachesUntilRefresh (0.04s)4542026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:52445455--- PASS: TestSetClientTLS (0.01s)456 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s)457 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.01s)458 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.03s)4592026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:52445460--- PASS: TestRegisterUploadedObjectReusesConnections (0.04s)4612026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:524454622026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:52445463--- PASS: TestDumpPathWriterError (0.05s)4642026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:524454652026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:52445466--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.06s)4672026/11/12 11:50:00 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:52445468--- PASS: TestRetryTimeoutOutlastsMaxRetries (0.06s)469--- PASS: TestDumpPathSingleFile (0.05s)470--- PASS: TestCaseHackSuffix (0.05s)471--- PASS: TestDumpPathMatchesNix (0.07s)4722026/11/12 11:50:00 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:52449/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:52449/api/uploads/complete4732026/11/12 11:50:00 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4742026/11/12 11:50:00 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:52449/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:52449/api/uploads/complete4752026/11/12 11:50:00 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4762026/11/12 11:50:00 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:52449/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:52449/api/uploads/complete4772026/11/12 11:50:00 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"478--- PASS: TestRegisterUploadedObject_BoundedAgainstSilentServer (0.10s)479--- PASS: TestUploadMultipart_PartsInParallel (0.62s)480--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.01s)481PASS482Running server tests...483The files belonging to this database system will be owned by user "_tribuchetbld1".484This user must also own the server process.485486The database cluster will be initialized with locale "C".487The default database encoding has accordingly been set to "SQL_ASCII".488The default text search configuration will be set to "english".489490Data page checksums are enabled.491492creating directory /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/postgres2661651684/data ... ok493creating subdirectories ... ok494selecting dynamic shared memory implementation ... posix495selecting default "max_connections" ... 100496selecting default "shared_buffers" ... 128MB497selecting default time zone ... UTC498creating configuration files ... ok499running bootstrap script ... ok500performing post-bootstrap initialization ... ok501syncing data to disk ... ok502503initdb: warning: enabling "trust" authentication for local connections504initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.505506Success. You can now start the database server using:507508 pg_ctl -D /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/postgres2661651684/data -l logfile start509510/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/postgres2661651684:5432 - no response5112026-11-12 11:50:02.338 UTC [56706] LOG: starting PostgreSQL 18.6 on aarch64-apple-darwin25.6.0, compiled by clang version 21.1.8, 64-bit5122026-11-12 11:50:02.339 UTC [56706] LOG: listening on Unix socket "/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/postgres2661651684/.s.PGSQL.5432"5132026-11-12 11:50:02.341 UTC [56713] LOG: database system was shut down at 2026-11-12 11:50:02 UTC5142026-11-12 11:50:02.342 UTC [56706] LOG: database system is ready to accept connections515/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/postgres2661651684:5432 - accepting connections516{"timestamp":"2026-11-12T11:50:02.550283Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b5c273ce-5404-4be1-b67c-183f69d085cb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(5)"}517=== RUN TestAbortSucceeded518=== PAUSE TestAbortSucceeded519=== RUN TestService_AuthMiddleware520=== PAUSE TestService_AuthMiddleware521=== RUN TestService_AuthMiddleware_MTLSProxyHeader522=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader523=== RUN TestService_AuthMiddleware_MTLSBoundSubjects524=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects525=== RUN TestService_ReadAuthMiddleware526=== PAUSE TestService_ReadAuthMiddleware527=== RUN TestService_AuthMiddleware_OIDC528=== PAUSE TestService_AuthMiddleware_OIDC529=== RUN TestService_RequireScope_OIDC530=== PAUSE TestService_RequireScope_OIDC531=== RUN TestService_ReadScope_PublicByDefault532=== PAUSE TestService_ReadScope_PublicByDefault533=== RUN TestCacheConfigHandler534=== PAUSE TestCacheConfigHandler535=== RUN TestCacheStatsHandler536=== PAUSE TestCacheStatsHandler537=== RUN TestClientCADerivations538=== PAUSE TestClientCADerivations539=== RUN TestClientErrorHandling540=== PAUSE TestClientErrorHandling541=== RUN TestClientIntegration542=== PAUSE TestClientIntegration543=== RUN TestClientMultipleUploads544=== PAUSE TestClientMultipleUploads545=== RUN TestClientWithDependencies546=== PAUSE TestClientWithDependencies547=== RUN TestClientSharedPathCommittedMidPush548=== PAUSE TestClientSharedPathCommittedMidPush549=== RUN TestPinProtectsFromGC550=== PAUSE TestPinProtectsFromGC551=== RUN TestClientPushesUseOnePush552=== PAUSE TestClientPushesUseOnePush553=== RUN TestClientFallsBackToClosures554=== PAUSE TestClientFallsBackToClosures555=== RUN TestDeleteClosuresRacingPins556=== PAUSE TestDeleteClosuresRacingPins557=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock558=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock559=== RUN TestResolveDBConnectionString560=== PAUSE TestResolveDBConnectionString561=== RUN TestConnectWaitsForAPeerMigration562=== PAUSE TestConnectWaitsForAPeerMigration563=== RUN TestLeadElectsOneAndHandsOver564=== PAUSE TestLeadElectsOneAndHandsOver565=== RUN TestLeadIncumbentWinsAfterRestart5662026/11/12 11:50:02 INFO lead: acquired remote=192.0.2.1:12345672026/11/12 11:50:03 INFO lead: released remote=192.0.2.1:12345682026/11/12 11:50:03 INFO lead: acquired remote=192.0.2.1:12345692026/11/12 11:50:04 INFO lead: released remote=192.0.2.1:1234570--- PASS: TestLeadIncumbentWinsAfterRestart (1.93s)571=== RUN TestLeadUnannouncedStandbyYieldsToIncumbent572=== PAUSE TestLeadUnannouncedStandbyYieldsToIncumbent573=== RUN TestLeadIncumbentAnnouncesAtOnce574=== PAUSE TestLeadIncumbentAnnouncesAtOnce575=== RUN TestLeadEndsOnShutdown576=== PAUSE TestLeadEndsOnShutdown577=== RUN TestLeadEndsWhenItsConnectionHangs5782026/11/12 11:50:04 INFO lead: acquired remote=192.0.2.1:12345792026-11-12 11:50:06.160 UTC [56757] FATAL: terminating connection due to administrator command5802026/11/12 11:50:06 INFO lead: acquired remote=192.0.2.1:12345812026/11/12 11:50:07 WARN lead: lock connection lost error="timeout: context deadline exceeded"5822026/11/12 11:50:07 INFO lead: released remote=192.0.2.1:12345832026/11/12 11:50:07 INFO lead: released remote=192.0.2.1:1234584--- PASS: TestLeadEndsWhenItsConnectionHangs (2.97s)585=== RUN TestGCAdvisoryLockBlocksConcurrentRun586=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun587=== RUN TestGCBugBareHashReferences588=== PAUSE TestGCBugBareHashReferences589=== RUN TestGCMetrics590=== PAUSE TestGCMetrics591=== RUN TestPushDedupSurvivesConcurrentGC592=== PAUSE TestPushDedupSurvivesConcurrentGC593=== RUN TestDeduplicatedObjectsRecordedAsPending594=== PAUSE TestDeduplicatedObjectsRecordedAsPending595=== RUN TestGCSweepSkipsPendingObjects596=== PAUSE TestGCSweepSkipsPendingObjects597=== RUN TestTombstonedObjectOfferedWithoutWaiting598=== PAUSE TestTombstonedObjectOfferedWithoutWaiting599=== RUN TestGCSweepDeliversEachKeyOnce600=== PAUSE TestGCSweepDeliversEachKeyOnce601=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection602=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection603=== RUN TestForceGCDuringPushOffersSweptObject604=== PAUSE TestForceGCDuringPushOffersSweptObject605=== RUN TestFailedS3DeleteKeepsTombstone606=== PAUSE TestFailedS3DeleteKeepsTombstone607=== RUN TestSweepSkipsRowsLockedByPush608=== PAUSE TestSweepSkipsRowsLockedByPush609=== RUN TestRegisterCompletedObjectNeedsPendingRow610=== PAUSE TestRegisterCompletedObjectNeedsPendingRow611=== RUN TestGetExistingObjectsLocksRows612=== PAUSE TestGetExistingObjectsLocksRows613=== RUN TestSweepRechecksPendingAfterLocking614=== PAUSE TestSweepRechecksPendingAfterLocking615=== RUN TestPushWaitsForSweepHoldingRow616=== PAUSE TestPushWaitsForSweepHoldingRow617=== RUN TestCommitRacingPendingCleanupKeepsObjects618=== PAUSE TestCommitRacingPendingCleanupKeepsObjects619=== RUN TestGCEndsOnShutdown620=== PAUSE TestGCEndsOnShutdown621=== RUN TestGCTaskStore_StartNew622=== PAUSE TestGCTaskStore_StartNew623=== RUN TestGCTaskStore_DeduplicateSameParams624=== PAUSE TestGCTaskStore_DeduplicateSameParams625=== RUN TestGCTaskStore_ConflictDifferentParams626=== PAUSE TestGCTaskStore_ConflictDifferentParams627=== RUN TestGCTaskStore_GetEmpty628=== PAUSE TestGCTaskStore_GetEmpty629=== RUN TestGCTaskStore_GetReturnsLatest630=== PAUSE TestGCTaskStore_GetReturnsLatest631=== RUN TestGCTaskStore_CompletedAllowsNewTask632=== PAUSE TestGCTaskStore_CompletedAllowsNewTask633=== RUN TestGCTaskStore_PhaseUpdates634=== PAUSE TestGCTaskStore_PhaseUpdates635=== RUN TestGCTaskStore_Fail636=== PAUSE TestGCTaskStore_Fail637=== RUN TestGracefulShutdownDrainsInflight638=== PAUSE TestGracefulShutdownDrainsInflight639=== RUN TestService_healthCheckHandler640=== PAUSE TestService_healthCheckHandler641=== RUN TestService_readinessHandler642=== PAUSE TestService_readinessHandler643=== RUN TestGenerateLandingPage644=== PAUSE TestGenerateLandingPage645=== RUN TestEnsureAbortUploadsRule646=== PAUSE TestEnsureAbortUploadsRule647=== RUN TestCacheConfigHandlerMaxNarSize648=== PAUSE TestCacheConfigHandlerMaxNarSize649=== RUN TestCreatePendingClosureRejectsOversizedNAR650=== PAUSE TestCreatePendingClosureRejectsOversizedNAR651=== RUN TestNARDeduplicationMetadataUploadBug652=== PAUSE TestNARDeduplicationMetadataUploadBug653=== RUN TestMetricsInventory654=== PAUSE TestMetricsInventory655=== RUN TestMetricsCommit656=== PAUSE TestMetricsCommit657=== RUN TestService_NativeMTLS658=== PAUSE TestService_NativeMTLS659=== RUN TestServerTLSConfig660=== PAUSE TestServerTLSConfig661=== RUN TestMultipartCleanup662=== PAUSE TestMultipartCleanup663=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded664=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded665=== RUN TestPendingCleanupUsesOneCutoff666=== PAUSE TestPendingCleanupUsesOneCutoff667=== RUN TestObjectStatsTrigger668=== PAUSE TestObjectStatsTrigger669=== RUN TestObjectStatsUpdatedOncePerCommit670=== PAUSE TestObjectStatsUpdatedOncePerCommit671=== RUN TestOrphanedObjectsGC672=== PAUSE TestOrphanedObjectsGC673=== RUN TestOrphanedObjectsGCStressTest674=== PAUSE TestOrphanedObjectsGCStressTest675=== RUN TestCreatePin_ReservedPins676=== PAUSE TestCreatePin_ReservedPins677=== RUN TestPresentReportsOnlyClosureRoots678=== PAUSE TestPresentReportsOnlyClosureRoots679=== RUN TestPresentRefreshesOnlyStaleClosures680=== PAUSE TestPresentRefreshesOnlyStaleClosures681=== RUN TestPresentNotReportedWhileGCDeletesClosure682=== PAUSE TestPresentNotReportedWhileGCDeletesClosure683=== RUN TestParseSingleRange684=== PAUSE TestParseSingleRange685=== RUN TestProxyHeadersOnlyTrustedOnSocket6862026/11/12 11:50:07 INFO Starting HTTP server address=127.0.0.1:525766872026/11/12 11:50:07 INFO Starting HTTP server address=proxy.sock6882026/11/12 11:50:07 WARN mTLS auth: subject not in bound subjects subject="CN=someone"6892026/11/12 11:50:07 INFO Shutdown signal received, draining in-flight requests timeout=10s690--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.16s)691=== RUN TestIsValidCachePath692=== PAUSE TestIsValidCachePath693=== RUN TestReadProxyNarinfo694=== PAUSE TestReadProxyNarinfo695=== RUN TestReadProxyNarinfoAlreadyDecompressed696=== PAUSE TestReadProxyNarinfoAlreadyDecompressed697=== RUN TestReadProxyContentNegotiation698=== PAUSE TestReadProxyContentNegotiation699=== RUN TestReadProxyNarStreaming700=== PAUSE TestReadProxyNarStreaming701=== RUN TestReadProxy404702=== PAUSE TestReadProxy404703=== RUN TestReadProxyInvalidPath704=== PAUSE TestReadProxyInvalidPath705=== RUN TestReadProxyHead706=== PAUSE TestReadProxyHead707=== RUN TestReadProxyOutlastsServerWriteTimeout708=== PAUSE TestReadProxyOutlastsServerWriteTimeout709=== RUN TestReadProxyConditionalGet710=== PAUSE TestReadProxyConditionalGet711=== RUN TestReadProxyRootRedirectsToIndexHTML712=== PAUSE TestReadProxyRootRedirectsToIndexHTML713=== RUN TestReadProxyDisabled714=== PAUSE TestReadProxyDisabled715=== RUN TestReadRedirectNar716=== PAUSE TestReadRedirectNar717=== RUN TestReadRedirectKeepsNarinfoProxied718=== PAUSE TestReadRedirectKeepsNarinfoProxied719=== RUN TestReadProxyRangeRequest720=== PAUSE TestReadProxyRangeRequest721=== RUN TestReadRedirectUsesPublicS3URL722=== PAUSE TestReadRedirectUsesPublicS3URL723=== RUN TestPush_OverlappingRootsStoreOneRowPerKey724=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey725=== RUN TestPush_CompleteCommitsEveryRoot726=== PAUSE TestPush_CompleteCommitsEveryRoot727=== RUN TestPush_RepeatedRootCommitsOnce728=== PAUSE TestPush_RepeatedRootCommitsOnce729=== RUN TestPush_CompleteWaitsForCleanupOfThePush730=== PAUSE TestPush_CompleteWaitsForCleanupOfThePush731=== RUN TestPush_RootsAreLockedInByteOrder732=== PAUSE TestPush_RootsAreLockedInByteOrder733=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit734=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit735=== RUN TestPush_RejectsBadRequests736=== PAUSE TestPush_RejectsBadRequests737=== RUN TestPush_SignsNarinfosOfItsPendingObjects738=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects739=== RUN TestCommitCanBeRepeatedUntilCleanup740=== PAUSE TestCommitCanBeRepeatedUntilCleanup741=== RUN TestSharedNarBothUploadsComplete742=== PAUSE TestSharedNarBothUploadsComplete743=== RUN TestCompleteMultipartUpload_ErrorButObjectExists744=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists745=== RUN TestCompletedNarNotReofferedAcrossClosures746=== PAUSE TestCompletedNarNotReofferedAcrossClosures747=== RUN TestPresignedUploadRegisteredBeforeCommit748=== PAUSE TestPresignedUploadRegisteredBeforeCommit749=== RUN TestService_Rustfstest750=== PAUSE TestService_Rustfstest751=== RUN TestParseSize752=== PAUSE TestParseSize753=== RUN TestSkippedUploadsHandler754=== PAUSE TestSkippedUploadsHandler755=== RUN TestSystemdListenerNotActivated756--- PASS: TestSystemdListenerNotActivated (0.00s)757=== RUN TestWatchdogBeatsWhenHealthy758--- PASS: TestWatchdogBeatsWhenHealthy (0.03s)759=== RUN TestWatchdogSkipsWhenUnhealthy7602026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7612026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7622026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7632026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7642026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7652026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7662026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7672026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7682026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7692026/11/12 11:50:07 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"770--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)771=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle772=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle773=== RUN TestProxyWriteTimeout774=== PAUSE TestProxyWriteTimeout775=== RUN TestPendingClosureWriteTimeout776=== PAUSE TestPendingClosureWriteTimeout777=== RUN TestIsValidUploadKey778=== PAUSE TestIsValidUploadKey779=== RUN TestUploadHandlersRejectInvalidKeys780=== PAUSE TestUploadHandlersRejectInvalidKeys781=== RUN TestUploadHandlersRejectOversizedBody782=== PAUSE TestUploadHandlersRejectOversizedBody783=== RUN TestService_cleanupPendingClosuresHandler784=== PAUSE TestService_cleanupPendingClosuresHandler785=== RUN TestService_createPendingClosureHandler786=== PAUSE TestService_createPendingClosureHandler787=== RUN TestService_verifyS3Integrity788=== PAUSE TestService_verifyS3Integrity789=== RUN TestService_verifyS3ReuploadsStaleNarinfo790=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo791=== RUN TestCompleteMultipartUnregistered792=== PAUSE TestCompleteMultipartUnregistered793=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT794=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT795=== CONT TestReadRedirectNar796=== CONT TestGCTaskStore_StartNew797=== CONT TestCompleteMultipartUnregistered798=== CONT TestAbortSucceeded799=== CONT TestReadProxyRootRedirectsToIndexHTML800=== CONT TestCommitRacingPendingCleanupKeepsObjects801=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection802=== CONT TestGCEndsOnShutdown803=== RUN TestGCEndsOnShutdown/before_the_run804=== CONT TestPushWaitsForSweepHoldingRow805=== CONT TestSweepRechecksPendingAfterLocking806=== CONT TestGetExistingObjectsLocksRows807=== CONT TestRegisterCompletedObjectNeedsPendingRow808=== CONT TestSweepSkipsRowsLockedByPush809=== CONT TestFailedS3DeleteKeepsTombstone810=== CONT TestForceGCDuringPushOffersSweptObject811=== CONT TestPresignedUploadRegisteredBeforeCommit812=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows813=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT814=== CONT TestGCSweepDeliversEachKeyOnce815=== CONT TestTombstonedObjectOfferedWithoutWaiting816=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows817=== CONT TestGCSweepSkipsPendingObjects818=== CONT TestDeduplicatedObjectsRecordedAsPending819=== CONT TestPushDedupSurvivesConcurrentGC820=== CONT TestGCBugBareHashReferences821--- PASS: TestGCTaskStore_StartNew (0.00s)822--- PASS: TestAbortSucceeded (0.00s)823=== CONT TestReadProxyDisabled824=== CONT TestGCAdvisoryLockBlocksConcurrentRun825=== PAUSE TestGCEndsOnShutdown/before_the_run826=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check827=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check828=== CONT TestReadProxyConditionalGet829=== RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete830=== PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete831=== RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark832=== CONT TestGCMetrics833=== PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark834=== CONT TestReadProxyOutlastsServerWriteTimeout835--- PASS: TestReadProxyRootRedirectsToIndexHTML (1.09s)836=== CONT TestReadProxyHead8372026/11/12 11:50:09 INFO Aborted multipart uploads count=0 kept=08382026/11/12 11:50:09 WARN Force mode enabled - objects will be deleted immediately without grace period8392026/11/12 11:50:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=08402026/11/12 11:50:09 INFO Vacuumed table table=pending_closures8412026/11/12 11:50:09 INFO Vacuumed table table=commit_receipts8422026/11/12 11:50:09 INFO Vacuumed table table=pending_objects8432026/11/12 11:50:09 INFO Vacuumed table table=multipart_uploads8442026/11/12 11:50:09 INFO Vacuumed table table=closures8452026/11/12 11:50:09 INFO Vacuumed table table=objects8462026/11/12 11:50:09 INFO Received complete multipart upload request method=POST path=/api/multipart/complete8472026/11/12 11:50:09 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst848--- PASS: TestCompleteMultipartUnregistered (1.72s)849=== CONT TestReadProxyInvalidPath850--- PASS: TestCommitRacingPendingCleanupKeepsObjects (1.73s)851=== CONT TestReadProxy4048522026/11/12 11:50:10 INFO Aborted multipart uploads count=0 kept=08532026/11/12 11:50:10 WARN Force mode enabled - objects will be deleted immediately without grace period8542026/11/12 11:50:10 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=08552026/11/12 11:50:10 INFO Vacuumed table table=pending_closures8562026/11/12 11:50:10 INFO Vacuumed table table=commit_receipts8572026/11/12 11:50:10 INFO Vacuumed table table=pending_objects8582026/11/12 11:50:10 INFO Vacuumed table table=multipart_uploads8592026/11/12 11:50:10 INFO Vacuumed table table=closures8602026/11/12 11:50:10 INFO Vacuumed table table=objects861--- PASS: TestGCMetrics (2.13s)862=== CONT TestClientMultipleUploads8632026/11/12 11:50:10 INFO Received uploads request method=POST path=/api/pending_closures864--- PASS: TestReadProxyDisabled (2.39s)865=== CONT TestReadProxyNarStreaming866--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (2.49s)867=== CONT TestClientIntegration8682026/11/12 11:50:10 INFO Aborted multipart uploads count=0 kept=08692026/11/12 11:50:10 WARN Force mode enabled - objects will be deleted immediately without grace period8702026/11/12 11:50:10 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=08712026/11/12 11:50:10 INFO Vacuumed table table=pending_closures8722026/11/12 11:50:10 INFO Vacuumed table table=commit_receipts8732026/11/12 11:50:10 INFO Vacuumed table table=pending_objects8742026/11/12 11:50:10 INFO Vacuumed table table=multipart_uploads8752026/11/12 11:50:10 INFO Vacuumed table table=closures8762026/11/12 11:50:10 INFO Vacuumed table table=objects8772026/11/12 11:50:10 INFO Aborted multipart uploads count=0 kept=08782026/11/12 11:50:10 WARN Force mode enabled - objects will be deleted immediately without grace period8792026/11/12 11:50:10 INFO Aborted multipart uploads count=0 kept=08802026/11/12 11:50:10 WARN Force mode enabled - objects will be deleted immediately without grace period8812026/11/12 11:50:10 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=08822026/11/12 11:50:10 INFO Vacuumed table table=pending_closures8832026/11/12 11:50:10 INFO Vacuumed table table=commit_receipts8842026/11/12 11:50:10 INFO Vacuumed table table=pending_objects8852026/11/12 11:50:10 INFO Vacuumed table table=multipart_uploads8862026/11/12 11:50:10 INFO Vacuumed table table=closures8872026/11/12 11:50:10 INFO Vacuumed table table=objects8882026/11/12 11:50:10 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=0889--- PASS: TestSweepSkipsRowsLockedByPush (2.92s)890=== CONT TestReadProxyContentNegotiation8912026/11/12 11:50:10 INFO Vacuumed table table=pending_closures8922026/11/12 11:50:10 INFO Vacuumed table table=commit_receipts8932026/11/12 11:50:10 INFO Vacuumed table table=pending_objects8942026/11/12 11:50:10 INFO Vacuumed table table=multipart_uploads8952026/11/12 11:50:10 INFO Vacuumed table table=closures8962026/11/12 11:50:10 INFO Vacuumed table table=objects897--- PASS: TestSweepRechecksPendingAfterLocking (2.96s)898=== CONT TestReadProxyNarinfoAlreadyDecompressed899--- PASS: TestRegisterCompletedObjectNeedsPendingRow (3.05s)900=== CONT TestReadProxyNarinfo9012026/11/12 11:50:11 ERROR failed to check GC advisory lock error="query pg_locks: failed to connect to `user=_tribuchetbld1 database=niks3`: /nonexistent/.s.PGSQL.5432 (/nonexistent): dial error: dial unix /nonexistent/.s.PGSQL.5432: connect: no such file or directory"902--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (3.21s)903=== CONT TestClientWithDependencies9042026/11/12 11:50:11 INFO Received uploads request method=POST path=/api/pending_closures9052026/11/12 11:50:11 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst9062026/11/12 11:50:11 INFO Received uploads request method=POST path=/api/pending_closures907--- PASS: TestPresignedUploadRegisteredBeforeCommit (3.46s)908=== CONT TestIsValidCachePath909=== RUN TestIsValidCachePath/narinfo910=== PAUSE TestIsValidCachePath/narinfo911=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars912=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars913=== RUN TestIsValidCachePath/nar_zst914=== PAUSE TestIsValidCachePath/nar_zst915=== RUN TestIsValidCachePath/nar_xz916=== PAUSE TestIsValidCachePath/nar_xz917=== RUN TestIsValidCachePath/nar_bz2918=== PAUSE TestIsValidCachePath/nar_bz2919=== RUN TestIsValidCachePath/nar_uncompressed920=== PAUSE TestIsValidCachePath/nar_uncompressed921=== RUN TestIsValidCachePath/ls922=== PAUSE TestIsValidCachePath/ls923=== RUN TestIsValidCachePath/log924=== PAUSE TestIsValidCachePath/log925=== RUN TestIsValidCachePath/realisation926=== PAUSE TestIsValidCachePath/realisation927=== RUN TestIsValidCachePath/nix-cache-info928=== PAUSE TestIsValidCachePath/nix-cache-info929=== RUN TestIsValidCachePath/index.html930=== PAUSE TestIsValidCachePath/index.html931=== RUN TestIsValidCachePath/traversal_parent932=== PAUSE TestIsValidCachePath/traversal_parent933=== RUN TestIsValidCachePath/traversal_in_middle934=== PAUSE TestIsValidCachePath/traversal_in_middle935=== RUN TestIsValidCachePath/invalid_char_e936=== PAUSE TestIsValidCachePath/invalid_char_e937=== RUN TestIsValidCachePath/invalid_char_u938=== PAUSE TestIsValidCachePath/invalid_char_u939=== RUN TestIsValidCachePath/random_path940=== PAUSE TestIsValidCachePath/random_path941=== RUN TestIsValidCachePath/empty942=== PAUSE TestIsValidCachePath/empty943=== RUN TestIsValidCachePath/leading_slash944=== PAUSE TestIsValidCachePath/leading_slash945=== RUN TestIsValidCachePath/wrong_extension946=== PAUSE TestIsValidCachePath/wrong_extension947=== RUN TestIsValidCachePath/short_hash948=== PAUSE TestIsValidCachePath/short_hash949=== CONT TestParseSingleRange950=== RUN TestParseSingleRange/none951=== PAUSE TestParseSingleRange/none952=== RUN TestParseSingleRange/unknown_unit953=== PAUSE TestParseSingleRange/unknown_unit954=== RUN TestParseSingleRange/multi-range_ignored955=== PAUSE TestParseSingleRange/multi-range_ignored956=== RUN TestParseSingleRange/malformed_no_dash957=== PAUSE TestParseSingleRange/malformed_no_dash958=== RUN TestParseSingleRange/malformed_both_empty959=== PAUSE TestParseSingleRange/malformed_both_empty960=== RUN TestParseSingleRange/malformed_end_before_start961=== PAUSE TestParseSingleRange/malformed_end_before_start962=== RUN TestParseSingleRange/closed963=== PAUSE TestParseSingleRange/closed964=== RUN TestParseSingleRange/open-ended965=== PAUSE TestParseSingleRange/open-ended966=== RUN TestParseSingleRange/end_clamped_to_size967=== PAUSE TestParseSingleRange/end_clamped_to_size968=== RUN TestParseSingleRange/suffix969=== PAUSE TestParseSingleRange/suffix970=== RUN TestParseSingleRange/suffix_exceeds_size971=== PAUSE TestParseSingleRange/suffix_exceeds_size972=== RUN TestParseSingleRange/single_byte973=== PAUSE TestParseSingleRange/single_byte974=== RUN TestParseSingleRange/start_past_EOF975=== PAUSE TestParseSingleRange/start_past_EOF976=== RUN TestParseSingleRange/start_far_past_EOF977=== PAUSE TestParseSingleRange/start_far_past_EOF978=== CONT TestClientErrorHandling979=== RUN TestClientErrorHandling/InvalidStorePath980=== PAUSE TestClientErrorHandling/InvalidStorePath981=== RUN TestClientErrorHandling/InvalidAuthToken982=== PAUSE TestClientErrorHandling/InvalidAuthToken983=== RUN TestClientErrorHandling/ServerNotAvailable984=== PAUSE TestClientErrorHandling/ServerNotAvailable985=== CONT TestPresentNotReportedWhileGCDeletesClosure986=== RUN TestPresentNotReportedWhileGCDeletesClosure/stale987=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/stale988=== RUN TestPresentNotReportedWhileGCDeletesClosure/fresh989=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/fresh990=== CONT TestClientCADerivations991--- PASS: TestGetExistingObjectsLocksRows (3.57s)992=== CONT TestPresentRefreshesOnlyStaleClosures9932026/11/12 11:50:11 INFO Aborted multipart uploads count=0 kept=09942026/11/12 11:50:11 WARN Force mode enabled - objects will be deleted immediately without grace period9952026/11/12 11:50:12 INFO Received uploads request method=POST path=/api/pending_closures9962026/11/12 11:50:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=09972026/11/12 11:50:12 INFO Received uploads request method=POST path=/api/pending_closures9982026/11/12 11:50:12 INFO Vacuumed table table=pending_closures9992026/11/12 11:50:12 INFO Vacuumed table table=commit_receipts10002026/11/12 11:50:12 INFO Vacuumed table table=pending_objects10012026/11/12 11:50:12 INFO Vacuumed table table=multipart_uploads10022026/11/12 11:50:12 INFO Vacuumed table table=closures10032026/11/12 11:50:12 INFO Vacuumed table table=objects1004--- PASS: TestGCSweepDeliversEachKeyOnce (4.41s)1005=== CONT TestCacheStatsHandler1006--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (4.45s)1007=== CONT TestPresentReportsOnlyClosureRoots1008--- PASS: TestPushWaitsForSweepHoldingRow (4.54s)1009=== CONT TestCacheConfigHandler1010=== RUN TestCacheConfigHandler/full_config,_no_issuer1011=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1012=== RUN TestCacheConfigHandler/no_cache_url_configured1013=== PAUSE TestCacheConfigHandler/no_cache_url_configured1014=== RUN TestCacheConfigHandler/no_signing_keys1015=== PAUSE TestCacheConfigHandler/no_signing_keys1016=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1017=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1018=== CONT TestLeadEndsOnShutdown10192026/11/12 11:50:12 INFO Received uploads request method=POST path=/api/pending_closures1020--- PASS: TestDeduplicatedObjectsRecordedAsPending (4.60s)1021=== CONT TestCreatePin_ReservedPins10222026/11/12 11:50:12 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:52619/oidc10232026/11/12 11:50:12 INFO Received uploads request method=POST path=/api/pending_closures1024--- PASS: TestGCBugBareHashReferences (4.97s)1025=== CONT TestService_ReadScope_PublicByDefault10262026/11/12 11:50:12 INFO Aborted multipart uploads count=0 kept=010272026/11/12 11:50:12 WARN Force mode enabled - objects will be deleted immediately without grace period10282026/11/12 11:50:12 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010292026/11/12 11:50:12 INFO Vacuumed table table=pending_closures10302026/11/12 11:50:12 INFO Vacuumed table table=commit_receipts10312026/11/12 11:50:13 INFO Vacuumed table table=pending_objects10322026/11/12 11:50:13 INFO Vacuumed table table=multipart_uploads10332026/11/12 11:50:13 INFO Vacuumed table table=closures10342026/11/12 11:50:13 INFO Vacuumed table table=objects1035--- PASS: TestGCSweepSkipsPendingObjects (5.08s)1036=== CONT TestLeadIncumbentAnnouncesAtOnce10372026/11/12 11:50:13 INFO Received uploads request method=POST path=/api/pending_closures10382026/11/12 11:50:13 INFO Aborted multipart uploads count=0 kept=010392026/11/12 11:50:13 WARN Force mode enabled - objects will be deleted immediately without grace period10402026/11/12 11:50:13 INFO Received uploads request method=POST path=/api/pending_closures10412026/11/12 11:50:13 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."10422026/11/12 11:50:13 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1043--- PASS: TestFailedS3DeleteKeepsTombstone (5.34s)1044=== CONT TestLeadUnannouncedStandbyYieldsToIncumbent1045--- PASS: TestTombstonedObjectOfferedWithoutWaiting (5.35s)1046=== CONT TestService_RequireScope_OIDC10472026/11/12 11:50:13 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:52631/oidc1048--- PASS: TestReadProxyConditionalGet (5.72s)1049=== CONT TestService_AuthMiddleware_OIDC10502026/11/12 11:50:13 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:52641/oidc10512026/11/12 11:50:13 INFO Received uploads request method=POST path=/api/pending_closures10522026/11/12 11:50:14 INFO Aborted multipart uploads count=0 kept=01053--- PASS: TestReadRedirectNar (6.17s)1054=== CONT TestService_ReadAuthMiddleware10552026/11/12 11:50:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010562026/11/12 11:50:14 INFO Vacuumed table table=pending_closures10572026/11/12 11:50:14 INFO Vacuumed table table=commit_receipts10582026/11/12 11:50:14 INFO Vacuumed table table=pending_objects10592026/11/12 11:50:14 INFO Vacuumed table table=multipart_uploads10602026/11/12 11:50:14 INFO Vacuumed table table=closures10612026/11/12 11:50:14 INFO Vacuumed table table=objects10622026/11/12 11:50:14 INFO Aborted multipart uploads count=0 kept=010632026/11/12 11:50:14 WARN Force mode enabled - objects will be deleted immediately without grace period10642026/11/12 11:50:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010652026/11/12 11:50:14 INFO Vacuumed table table=pending_closures10662026/11/12 11:50:14 INFO Vacuumed table table=commit_receipts10672026/11/12 11:50:14 INFO Vacuumed table table=pending_objects10682026/11/12 11:50:14 INFO Vacuumed table table=multipart_uploads10692026/11/12 11:50:14 INFO Vacuumed table table=closures10702026/11/12 11:50:14 INFO Vacuumed table table=objects1071--- PASS: TestPushDedupSurvivesConcurrentGC (6.32s)1072=== CONT TestService_AuthMiddleware_MTLSBoundSubjects1073--- PASS: TestReadProxyInvalidPath (4.62s)1074=== CONT TestService_AuthMiddleware_MTLSProxyHeader1075--- PASS: TestReadProxyHead (5.76s)1076=== CONT TestService_AuthMiddleware1077--- PASS: TestReadProxy404 (5.25s)1078=== CONT TestLeadElectsOneAndHandsOver1079=== NAME TestClientMultipleUploads1080 client_integration_test.go:406: Created store path 0: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientMultipleUploads3599784845/001/store/k8sqh8d0rayankwj860in2x6zqvwkzrn-test-file-0.txt1081--- PASS: TestReadProxyNarStreaming (4.99s)1082=== CONT TestConnectWaitsForAPeerMigration1083=== NAME TestClientMultipleUploads1084 client_integration_test.go:406: Created store path 1: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientMultipleUploads3599784845/001/store/z8rjg2046z44mhjidrinbql806zgw6b0-test-file-1.txt1085 client_integration_test.go:406: Created store path 2: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientMultipleUploads3599784845/001/store/jq7clcynd0db3brfavkcpcrxyk1nangm-test-file-2.txt10862026/11/12 11:50:15 INFO Received push request method=POST path=/api/pushes10872026/11/12 11:50:15 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)10882026/11/12 11:50:15 INFO Uploading jq7clcynd0db3brfavkcpcrxyk1nangm-test-file-2.txt (160B)10892026/11/12 11:50:15 INFO Uploading z8rjg2046z44mhjidrinbql806zgw6b0-test-file-1.txt (160B)10902026/11/12 11:50:15 INFO Uploading k8sqh8d0rayankwj860in2x6zqvwkzrn-test-file-0.txt (160B)10912026/11/12 11:50:15 WARN Failed to register uploaded object key=z8rjg2046z44mhjidrinbql806zgw6b0.ls error="server returned 404: 404 page not found\n"10922026/11/12 11:50:15 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"10932026/11/12 11:50:15 WARN Failed to register uploaded object key=k8sqh8d0rayankwj860in2x6zqvwkzrn.ls error="server returned 404: 404 page not found\n"10942026/11/12 11:50:15 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"10952026/11/12 11:50:15 WARN Failed to register uploaded object key=jq7clcynd0db3brfavkcpcrxyk1nangm.ls error="server returned 404: 404 page not found\n"10962026/11/12 11:50:15 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign10972026/11/12 11:50:15 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"10982026/11/12 11:50:15 INFO Signed narinfos id=1 count=310992026/11/12 11:50:15 INFO Uploading 3 narinfos11002026/11/12 11:50:15 WARN Failed to register uploaded object key=z8rjg2046z44mhjidrinbql806zgw6b0.narinfo error="server returned 404: 404 page not found\n"11012026/11/12 11:50:15 WARN Failed to register uploaded object key=jq7clcynd0db3brfavkcpcrxyk1nangm.narinfo error="server returned 404: 404 page not found\n"11022026/11/12 11:50:15 INFO Received complete push request method=POST path=/api/pushes/1/complete11032026/11/12 11:50:15 WARN Failed to register uploaded object key=k8sqh8d0rayankwj860in2x6zqvwkzrn.narinfo error="server returned 404: 404 page not found\n"11042026/11/12 11:50:15 INFO Completed push id=1 objects=9 duration=16.371417ms11052026/11/12 11:50:15 INFO Upload complete. (256ms)1106 client_integration_test.go:417: Uploaded 3 paths in 290.394167ms1107=== NAME TestClientIntegration1108 client_integration_test.go:292: Created store path: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientIntegration4156995140/002/store/grfv6ay8ldvkqy47bgh2h8xsw56cms9n-test-file.txt1109--- PASS: TestClientMultipleUploads (5.72s)1110=== CONT TestResolveDBConnectionString1111=== RUN TestResolveDBConnectionString/flag_wins1112=== PAUSE TestResolveDBConnectionString/flag_wins1113=== RUN TestResolveDBConnectionString/file_when_flag_empty1114=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1115=== RUN TestResolveDBConnectionString/missing_file_is_an_error1116=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1117=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1118=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1119=== RUN TestResolveDBConnectionString/nothing_configured1120=== PAUSE TestResolveDBConnectionString/nothing_configured1121=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock11222026/11/12 11:50:15 INFO Received push request method=POST path=/api/pushes11232026/11/12 11:50:15 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)11242026/11/12 11:50:15 INFO Uploading grfv6ay8ldvkqy47bgh2h8xsw56cms9n-test-file.txt (152B)11252026/11/12 11:50:15 WARN Failed to register uploaded object key=grfv6ay8ldvkqy47bgh2h8xsw56cms9n.ls error="server returned 404: 404 page not found\n"11262026/11/12 11:50:15 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign11272026/11/12 11:50:15 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"11282026/11/12 11:50:15 INFO Signed narinfos id=1 count=111292026/11/12 11:50:15 INFO Uploading 1 narinfos1130--- PASS: TestReadProxyContentNegotiation (5.09s)1131=== CONT TestCacheConfigHandlerMaxNarSize1132--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1133=== CONT TestEnsureAbortUploadsRule11342026/11/12 11:50:16 INFO Received complete push request method=POST path=/api/pushes/1/complete11352026/11/12 11:50:16 WARN Failed to register uploaded object key=grfv6ay8ldvkqy47bgh2h8xsw56cms9n.narinfo error="server returned 404: 404 page not found\n"11362026/11/12 11:50:16 INFO Completed push id=1 objects=3 duration=40.393167ms11372026/11/12 11:50:16 INFO Upload complete. (228ms)11382026/11/12 11:50:16 INFO All 1 paths already cached1139=== NAME TestClientIntegration1140 client_integration_test.go:318: Retrieved narinfo from S3:1141 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientIntegration4156995140/002/store/grfv6ay8ldvkqy47bgh2h8xsw56cms9n-test-file.txt1142 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1143 Compression: zstd1144 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11145 NarSize: 1521146 References: 1147 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11148 client_integration_test.go:319: Retrieved .ls file from S3 (compressed size: 77 bytes)1149 client_integration_test.go:319: Decompressed .ls content (64 bytes):1150 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}1151--- PASS: TestReadProxyNarinfoAlreadyDecompressed (5.23s)1152=== CONT TestGenerateLandingPage1153--- PASS: TestGenerateLandingPage (0.00s)1154=== CONT TestCreatePendingClosureRejectsOversizedNAR11552026/11/12 11:50:16 INFO Received uploads request method=POST path=/api/pending_closures1156--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.01s)1157=== CONT TestService_readinessHandler11582026/11/12 11:50:16 INFO Received push request method=POST path=/api/pushes11592026/11/12 11:50:16 INFO Object in database but missing from S3 key=grfv6ay8ldvkqy47bgh2h8xsw56cms9n.ls11602026/11/12 11:50:16 WARN Found objects in DB but missing from S3, will re-upload count=111612026/11/12 11:50:16 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)11622026/11/12 11:50:16 INFO Received complete push request method=POST path=/api/pushes/2/complete11632026/11/12 11:50:16 WARN Failed to register uploaded object key=grfv6ay8ldvkqy47bgh2h8xsw56cms9n.ls error="server returned 404: 404 page not found\n"11642026/11/12 11:50:16 INFO Completed push id=2 objects=3 duration=771.292µs11652026/11/12 11:50:16 INFO Upload complete. (116ms)1166=== NAME TestClientIntegration1167 client_integration_test.go:336: Retrieved .ls file from S3 (compressed size: 62 bytes)1168 client_integration_test.go:336: Decompressed .ls content (49 bytes):1169 {"version":1,"root":{"type":"regular","size":39}}11702026/11/12 11:50:16 ERROR Failed to decode narinfo key=3hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216 error=<nil>1171--- PASS: TestReadProxyNarinfo (5.51s)1172=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded11732026/11/12 11:50:16 INFO Received push request method=POST path=/api/pushes11742026/11/12 11:50:16 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)11752026/11/12 11:50:16 INFO Received complete push request method=POST path=/api/pushes/3/complete11762026/11/12 11:50:16 WARN Failed to register uploaded object key=grfv6ay8ldvkqy47bgh2h8xsw56cms9n.ls error="server returned 404: 404 page not found\n"11772026/11/12 11:50:16 INFO Completed push id=3 objects=3 duration=605.75µs11782026/11/12 11:50:16 INFO Upload complete. (121ms)1179=== NAME TestClientIntegration1180 client_integration_test.go:353: Retrieved .ls file from S3 (compressed size: 62 bytes)1181 client_integration_test.go:353: Decompressed .ls content (49 bytes):1182 {"version":1,"root":{"type":"regular","size":39}}1183 client_integration_test.go:364: Testing garbage collection...11842026/11/12 11:50:16 INFO Starting cleanup of old closures method=DELETE path=/api/closures11852026/11/12 11:50:16 INFO Garbage collection started11862026/11/12 11:50:16 INFO Aborted multipart uploads count=0 kept=011872026/11/12 11:50:16 WARN Force mode enabled - objects will be deleted immediately without grace period1188=== NAME TestClientWithDependencies1189 client_integration_test.go:661: Built derivation: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientWithDependencies4274407728/001/store/md55p2jskk2nx8nqbnv2x78agzcnxrrz-test-script1190 client_integration_test.go:663: Found 1 dependencies (including self)1191--- PASS: TestPresentRefreshesOnlyStaleClosures (5.81s)1192=== CONT TestMultipartCleanup11932026/11/12 11:50:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=011942026/11/12 11:50:17 INFO Vacuumed table table=pending_closures11952026/11/12 11:50:17 INFO Vacuumed table table=commit_receipts11962026/11/12 11:50:17 INFO Vacuumed table table=pending_objects11972026/11/12 11:50:17 INFO Vacuumed table table=multipart_uploads11982026/11/12 11:50:17 INFO Vacuumed table table=closures11992026/11/12 11:50:17 INFO Vacuumed table table=objects12002026/11/12 11:50:17 INFO Received push request method=POST path=/api/pushes12012026/11/12 11:50:17 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12022026/11/12 11:50:17 INFO Uploading md55p2jskk2nx8nqbnv2x78agzcnxrrz-test-script (136B)12032026/11/12 11:50:17 WARN Failed to register uploaded object key=md55p2jskk2nx8nqbnv2x78agzcnxrrz.ls error="server returned 404: 404 page not found\n"12042026/11/12 11:50:17 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"12052026/11/12 11:50:17 WARN Failed to register uploaded object key=log/qljaa1wpfykbvfanwawpyfb0n17ing82-test-script.drv error="server returned 404: 404 page not found\n"12062026/11/12 11:50:17 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12072026/11/12 11:50:17 INFO Signed narinfos id=1 count=112082026/11/12 11:50:17 INFO Uploading 1 narinfos12092026/11/12 11:50:17 INFO Received complete push request method=POST path=/api/pushes/1/complete12102026/11/12 11:50:17 WARN Failed to register uploaded object key=md55p2jskk2nx8nqbnv2x78agzcnxrrz.narinfo error="server returned 404: 404 page not found\n"1211=== NAME TestClientCADerivations1212 client_ca_test.go:136: Built CA derivation: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientCADerivations4022832559/001/store/4r88p3kh05qq5jlr6knv2asgqp0vrgv8-ca-test1213 client_ca_test.go:139: Found 1 dependencies (including self)12142026/11/12 11:50:17 INFO Completed push id=1 objects=4 duration=68.008ms12152026/11/12 11:50:17 INFO Upload complete. (263ms)1216--- PASS: TestCacheStatsHandler (5.25s)1217=== CONT TestServerTLSConfig1218=== RUN TestServerTLSConfig/no_client_CA1219=== PAUSE TestServerTLSConfig/no_client_CA1220=== RUN TestServerTLSConfig/missing_CA_file1221=== PAUSE TestServerTLSConfig/missing_CA_file1222=== RUN TestServerTLSConfig/not_a_PEM_file1223=== PAUSE TestServerTLSConfig/not_a_PEM_file1224=== CONT TestDeleteClosuresRacingPins12252026/11/12 11:50:17 INFO Aborted multipart uploads count=0 kept=012262026/11/12 11:50:17 WARN Force mode enabled - objects will be deleted immediately without grace period12272026/11/12 11:50:17 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=012282026/11/12 11:50:17 INFO Vacuumed table table=pending_closures12292026/11/12 11:50:17 INFO Vacuumed table table=commit_receipts12302026/11/12 11:50:17 INFO Vacuumed table table=pending_objects12312026/11/12 11:50:17 INFO Vacuumed table table=multipart_uploads12322026/11/12 11:50:17 INFO Vacuumed table table=closures12332026/11/12 11:50:17 INFO Vacuumed table table=objects1234--- PASS: TestReadProxyOutlastsServerWriteTimeout (9.76s)1235=== CONT TestService_NativeMTLS1236=== NAME TestClientWithDependencies1237 client_integration_test.go:677: Skipping nix copy test - isolated store (/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientWithDependencies4274407728/001/store) requires matching store prefix1238--- PASS: TestClientWithDependencies (6.57s)1239=== CONT TestClientFallsBackToClosures12402026/11/12 11:50:17 INFO Received push request method=POST path=/api/pushes1241--- PASS: TestPresentReportsOnlyClosureRoots (5.36s)1242=== CONT TestMetricsCommit12432026/11/12 11:50:17 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12442026/11/12 11:50:17 INFO Uploading 4r88p3kh05qq5jlr6knv2asgqp0vrgv8-ca-test (144B)12452026/11/12 11:50:17 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"12462026/11/12 11:50:17 WARN Failed to register uploaded object key=4r88p3kh05qq5jlr6knv2asgqp0vrgv8.ls error="server returned 404: 404 page not found\n"12472026/11/12 11:50:17 WARN Failed to register uploaded object key=log/6sz00mfwscds4syzz5cp8ziqh682h53a-ca-test.drv error="server returned 404: 404 page not found\n"12482026/11/12 11:50:17 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12492026/11/12 11:50:17 INFO Signed narinfos id=1 count=112502026/11/12 11:50:17 INFO Uploading 1 narinfos12512026/11/12 11:50:17 INFO Received complete push request method=POST path=/api/pushes/1/complete12522026/11/12 11:50:17 WARN Failed to register uploaded object key=4r88p3kh05qq5jlr6knv2asgqp0vrgv8.narinfo error="server returned 404: 404 page not found\n"12532026/11/12 11:50:17 INFO Completed push id=1 objects=4 duration=19.250458ms12542026/11/12 11:50:17 INFO Upload complete. (254ms)1255=== NAME TestClientCADerivations1256 client_ca_test.go:180: Narinfo contains CA field: StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientCADerivations4022832559/001/store/4r88p3kh05qq5jlr6knv2asgqp0vrgv8-ca-test1257 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1258 Compression: zstd1259 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1260 NarSize: 1441261 References: 1262 Deriver: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientCADerivations4022832559/001/store/6sz00mfwscds4syzz5cp8ziqh682h53a-ca-test.drv1263 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1264 client_ca_test.go:185: Checking for realisation files in S3...1265 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations1266 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache12672026/11/12 11:50:17 INFO lead: acquired remote=192.0.2.1:12341268 client_ca_test.go:258: nix copy output: error: binary cache 's3://bucket38?endpoint=http://localhost:52556®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientCADerivations4022832559/001/store'1269 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 11270--- PASS: TestClientCADerivations (6.62s)1271=== CONT TestClientPushesUseOnePush12722026/11/12 11:50:18 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux12732026/11/12 11:50:18 WARN Refused reserved pin name=worker-x86_64-linux12742026/11/12 11:50:18 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux12752026/11/12 11:50:18 INFO Received create pin request method=POST path=/api/pins/my-app12762026/11/12 11:50:18 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux1277--- PASS: TestCreatePin_ReservedPins (5.59s)1278=== CONT TestMetricsInventory1279--- PASS: TestService_ReadScope_PublicByDefault (5.41s)1280=== CONT TestService_healthCheckHandler12812026/11/12 11:50:18 INFO lead: acquired remote=192.0.2.1:123412822026/11/12 11:50:18 INFO lead: released remote=192.0.2.1:12341283--- PASS: TestLeadIncumbentAnnouncesAtOnce (5.59s)1284=== CONT TestPinProtectsFromGC12852026/11/12 11:50:18 INFO lead: acquired remote=192.0.2.1:123412862026/11/12 11:50:18 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=01287=== NAME TestClientIntegration1288 client_integration_test.go:371: Objects in database after GC:1289 client_integration_test.go:371: Successfully deleted all objects with GC --force1290--- PASS: TestClientIntegration (8.53s)1291=== CONT TestNARDeduplicationMetadataUploadBug12922026/11/12 11:50:19 INFO lead: released remote=192.0.2.1:12341293=== CONT TestOrphanedObjectsGCStressTest1294--- PASS: TestLeadEndsOnShutdown (6.57s)1295=== RUN TestService_RequireScope_OIDC/builder_may_write1296=== PAUSE TestService_RequireScope_OIDC/builder_may_write1297=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1298=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1299=== RUN TestService_RequireScope_OIDC/ops_may_admin1300=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1301=== RUN TestService_RequireScope_OIDC/ops_may_not_write1302=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1303=== RUN TestService_RequireScope_OIDC/reader_may_not_write1304=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1305=== RUN TestService_RequireScope_OIDC/static_token_may_admin1306=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1307=== RUN TestService_RequireScope_OIDC/static_token_may_write1308=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1309=== RUN TestService_RequireScope_OIDC/reader_may_read1310=== PAUSE TestService_RequireScope_OIDC/reader_may_read1311=== RUN TestService_RequireScope_OIDC/writer_implies_read1312=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1313=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1314=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1315=== RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1316=== PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1317=== RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1318=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1319=== RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1320=== PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1321=== RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1322=== PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1323=== CONT TestGracefulShutdownDrainsInflight13242026/11/12 11:50:19 INFO Starting HTTP server address=127.0.0.1:5277113252026/11/12 11:50:19 INFO Shutdown signal received, draining in-flight requests timeout=10s1326--- PASS: TestGracefulShutdownDrainsInflight (0.07s)1327=== CONT TestClientSharedPathCommittedMidPush1328=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1329=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1330=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1331=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1332=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1333=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1334=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1335=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1336=== CONT TestObjectStatsUpdatedOncePerCommit1337--- PASS: TestService_ReadAuthMiddleware (5.74s)1338=== CONT TestObjectStatsTrigger13392026/11/12 11:50:20 INFO lead: released remote=192.0.2.1:123413402026/11/12 11:50:20 INFO lead: acquired remote=192.0.2.1:123413412026/11/12 11:50:20 INFO lead: given back to the incumbent remote=192.0.2.1:123413422026/11/12 11:50:20 INFO lead: acquired remote=192.0.2.1:123413432026/11/12 11:50:20 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"13442026/11/12 11:50:20 WARN mTLS auth: bound subjects configured but subject DN unavailable13452026/11/12 11:50:20 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1346--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (5.87s)1347=== CONT TestGCTaskStore_Fail1348--- PASS: TestGCTaskStore_Fail (0.00s)1349=== CONT TestOrphanedObjectsGC1350--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (6.05s)1351=== CONT TestPendingCleanupUsesOneCutoff13522026/11/12 11:50:20 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"1353--- PASS: TestService_AuthMiddleware (5.75s)1354=== CONT TestPush_RootsAreLockedInByteOrder13552026/11/12 11:50:20 INFO lead: acquired remote=192.0.2.1:123413562026/11/12 11:50:21 INFO Installed lifecycle rule aborting incomplete NAR uploads bucket=bucket55 days=21357--- PASS: TestEnsureAbortUploadsRule (5.37s)1358=== CONT TestGCTaskStore_PhaseUpdates1359--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1360=== CONT TestPush_OverlappingRootsStoreOneRowPerKey13612026/11/12 11:50:21 WARN readiness check failed error="closed pool"1362--- PASS: TestService_readinessHandler (5.29s)1363=== CONT TestCompletedNarNotReofferedAcrossClosures13642026/11/12 11:50:21 INFO Received uploads request method=POST path=/api/pending_closures1365--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (5.14s)1366=== CONT TestGCTaskStore_ConflictDifferentParams1367--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1368=== CONT TestPush_CompleteWaitsForCleanupOfThePush1369--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (5.85s)1370=== CONT TestCompleteMultipartUpload_ErrorButObjectExists13712026/11/12 11:50:21 INFO Received uploads request method=POST path=/api/pending_closures13722026/11/12 11:50:21 INFO Received cleanup request method=DELETE path=/api/pending_closures13732026/11/12 11:50:21 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket58/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""13742026/11/12 11:50:21 INFO Aborted multipart uploads count=0 kept=113752026/11/12 11:50:21 INFO Received cleanup request method=DELETE path=/api/pending_closures13762026/11/12 11:50:21 INFO Aborted multipart uploads count=1 kept=01377--- PASS: TestMultipartCleanup (4.63s)1378=== CONT TestGCTaskStore_DeduplicateSameParams1379--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)1380=== CONT TestPush_RepeatedRootCommitsOnce13812026/11/12 11:50:22 INFO lead: released remote=192.0.2.1:12341382--- PASS: TestLeadUnannouncedStandbyYieldsToIncumbent (8.73s)1383=== CONT TestSharedNarBothUploadsComplete13842026/11/12 11:50:22 WARN mTLS auth: subject not in bound subjects subject="CN=reader"13852026/11/12 11:50:22 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1386--- PASS: TestService_NativeMTLS (4.33s)1387=== CONT TestPush_CompleteCommitsEveryRoot13882026/11/12 11:50:22 INFO lead: released remote=192.0.2.1:123413892026/11/12 11:50:22 INFO lead: acquired remote=192.0.2.1:12341390--- PASS: TestConnectWaitsForAPeerMigration (6.89s)1391=== CONT TestCommitCanBeRepeatedUntilCleanup1392=== RUN TestCommitCanBeRepeatedUntilCleanup/push1393=== PAUSE TestCommitCanBeRepeatedUntilCleanup/push1394=== RUN TestCommitCanBeRepeatedUntilCleanup/pending_closure1395=== PAUSE TestCommitCanBeRepeatedUntilCleanup/pending_closure1396=== CONT TestReadRedirectKeepsNarinfoProxied13972026/11/12 11:50:22 INFO Received push request method=POST path=/api/pushes13982026/11/12 11:50:22 INFO Received complete push request method=POST path=/api/pushes/1/complete13992026/11/12 11:50:22 INFO Completed push id=1 objects=4 duration=35.024334ms14002026/11/12 11:50:22 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete14012026/11/12 11:50:22 INFO Completed upload id=2 objects=2 duration=617.375µs1402--- PASS: TestMetricsCommit (4.81s)1403=== CONT TestPush_SignsNarinfosOfItsPendingObjects14042026/11/12 11:50:22 INFO Received uploads request method=POST path=/api/pending_closures14052026/11/12 11:50:22 INFO Received uploads request method=POST path=/api/pending_closures14062026/11/12 11:50:22 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)14072026/11/12 11:50:22 INFO Uploading mwm6k9y96x881ajd9i6cbx8pxvl9431h-shared-dep (136B)14082026/11/12 11:50:22 INFO Uploading qv4x0j70gz08m7k73g6dbdbllwkz8ql1-a (256B)14092026/11/12 11:50:22 WARN Failed to register uploaded object key=nar/1wkj693ijad07px5cixf0gknl8cjpwv592axkhdz4jzxc0ri6zf6.nar.zst error="server returned 404: 404 page not found\n"14102026/11/12 11:50:22 WARN Failed to register uploaded object key=qv4x0j70gz08m7k73g6dbdbllwkz8ql1.ls error="server returned 404: 404 page not found\n"14112026/11/12 11:50:22 WARN Failed to register uploaded object key=0w0r45m4flb96skz3hxllxcvz4sjfrn7.ls error="server returned 404: 404 page not found\n"14122026/11/12 11:50:22 WARN Failed to register uploaded object key=mwm6k9y96x881ajd9i6cbx8pxvl9431h.ls error="server returned 404: 404 page not found\n"14132026/11/12 11:50:22 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"14142026/11/12 11:50:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign14152026/11/12 11:50:22 INFO Signed narinfos id=2 count=214162026/11/12 11:50:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign14172026/11/12 11:50:22 INFO Signed narinfos id=1 count=214182026/11/12 11:50:22 INFO Uploading 4 narinfos14192026/11/12 11:50:22 WARN Failed to register uploaded object key=mwm6k9y96x881ajd9i6cbx8pxvl9431h.narinfo error="server returned 404: 404 page not found\n"14202026/11/12 11:50:22 WARN Failed to register uploaded object key=0w0r45m4flb96skz3hxllxcvz4sjfrn7.narinfo error="server returned 404: 404 page not found\n"14212026/11/12 11:50:22 WARN Failed to register uploaded object key=qv4x0j70gz08m7k73g6dbdbllwkz8ql1.narinfo error="server returned 404: 404 page not found\n"14222026/11/12 11:50:22 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete14232026/11/12 11:50:22 WARN Failed to register uploaded object key=mwm6k9y96x881ajd9i6cbx8pxvl9431h.narinfo error="server returned 404: 404 page not found\n"14242026/11/12 11:50:22 INFO Completed upload id=2 objects=6 duration=18.967917ms14252026/11/12 11:50:22 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete14262026/11/12 11:50:22 INFO Completed upload id=1 objects=6 duration=486.167µs14272026/11/12 11:50:22 INFO Upload complete. (303ms)1428=== NAME TestClientFallsBackToClosures1429 client_pushes_test.go:112: Retrieved narinfo from S3:1430 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientFallsBackToClosures517937917/001/store/mwm6k9y96x881ajd9i6cbx8pxvl9431h-shared-dep1431 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1432 Compression: zstd1433 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821434 NarSize: 1361435 References: 1436 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1437 client_pushes_test.go:112: Retrieved narinfo from S3:1438 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientFallsBackToClosures517937917/001/store/qv4x0j70gz08m7k73g6dbdbllwkz8ql1-a1439 URL: nar/1wkj693ijad07px5cixf0gknl8cjpwv592axkhdz4jzxc0ri6zf6.nar.zst1440 Compression: zstd1441 NarHash: sha256:1wkj693ijad07px5cixf0gknl8cjpwv592axkhdz4jzxc0ri6zf61442 NarSize: 2561443 References: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientFallsBackToClosures517937917/001/store/mwm6k9y96x881ajd9i6cbx8pxvl9431h-shared-dep1444 CA: text:sha256:0qn040h4klg1f48aga0iacmvfm9rv1837hikwsxmxqr1z855azsb1445 client_pushes_test.go:112: Retrieved narinfo from S3:1446 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientFallsBackToClosures517937917/001/store/0w0r45m4flb96skz3hxllxcvz4sjfrn7-b1447 URL: nar/1wkj693ijad07px5cixf0gknl8cjpwv592axkhdz4jzxc0ri6zf6.nar.zst1448 Compression: zstd1449 NarHash: sha256:1wkj693ijad07px5cixf0gknl8cjpwv592axkhdz4jzxc0ri6zf61450 NarSize: 2561451 References: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientFallsBackToClosures517937917/001/store/mwm6k9y96x881ajd9i6cbx8pxvl9431h-shared-dep1452 CA: text:sha256:0qn040h4klg1f48aga0iacmvfm9rv1837hikwsxmxqr1z855azsb1453--- PASS: TestClientFallsBackToClosures (5.22s)1454=== CONT TestGCTaskStore_CompletedAllowsNewTask1455--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1456=== CONT TestPush_RejectsBadRequests1457--- PASS: TestMetricsInventory (4.84s)1458=== CONT TestReadRedirectUsesPublicS3URL14592026/11/12 11:50:23 INFO Received push request method=POST path=/api/pushes14602026/11/12 11:50:23 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)14612026/11/12 11:50:23 INFO Uploading 8srwygrvr2wcylwqvlb6qcb08dl9phz0-shared-dep (136B)14622026/11/12 11:50:23 INFO Uploading 9ch8zsf7lzys46f38mqzj0a0h240r4mg-a (256B)14632026/11/12 11:50:23 WARN Failed to register uploaded object key=9ch8zsf7lzys46f38mqzj0a0h240r4mg.ls error="server returned 404: 404 page not found\n"14642026/11/12 11:50:23 WARN Failed to register uploaded object key=0hfqbdbrqva92s2vhvj5jxk82dg693kj.ls error="server returned 404: 404 page not found\n"14652026/11/12 11:50:23 WARN Failed to register uploaded object key=8srwygrvr2wcylwqvlb6qcb08dl9phz0.ls error="server returned 404: 404 page not found\n"14662026/11/12 11:50:23 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"14672026/11/12 11:50:23 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign14682026/11/12 11:50:23 WARN Failed to register uploaded object key=nar/07yj42v4qqjkp0gc0xjyg7iqg2z4nqi3zg25658ymp4gk6gc9xgi.nar.zst error="server returned 404: 404 page not found\n"14692026/11/12 11:50:23 INFO Signed narinfos id=1 count=314702026/11/12 11:50:23 INFO Uploading 3 narinfos1471--- PASS: TestService_healthCheckHandler (4.84s)1472=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit14732026/11/12 11:50:23 WARN Failed to register uploaded object key=0hfqbdbrqva92s2vhvj5jxk82dg693kj.narinfo error="server returned 404: 404 page not found\n"14742026/11/12 11:50:23 WARN Failed to register uploaded object key=9ch8zsf7lzys46f38mqzj0a0h240r4mg.narinfo error="server returned 404: 404 page not found\n"14752026/11/12 11:50:23 INFO Received complete push request method=POST path=/api/pushes/1/complete14762026/11/12 11:50:23 WARN Failed to register uploaded object key=8srwygrvr2wcylwqvlb6qcb08dl9phz0.narinfo error="server returned 404: 404 page not found\n"14772026/11/12 11:50:23 INFO Completed push id=1 objects=8 duration=12.883208ms14782026/11/12 11:50:23 INFO Upload complete. (233ms)1479=== NAME TestClientPushesUseOnePush1480 client_pushes_test.go:97: Retrieved narinfo from S3:1481 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientPushesUseOnePush3307344530/001/store/8srwygrvr2wcylwqvlb6qcb08dl9phz0-shared-dep1482 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1483 Compression: zstd1484 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821485 NarSize: 1361486 References: 1487 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1488 client_pushes_test.go:97: Retrieved narinfo from S3:1489 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientPushesUseOnePush3307344530/001/store/9ch8zsf7lzys46f38mqzj0a0h240r4mg-a1490 URL: nar/07yj42v4qqjkp0gc0xjyg7iqg2z4nqi3zg25658ymp4gk6gc9xgi.nar.zst1491 Compression: zstd1492 NarHash: sha256:07yj42v4qqjkp0gc0xjyg7iqg2z4nqi3zg25658ymp4gk6gc9xgi1493 NarSize: 2561494 References: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientPushesUseOnePush3307344530/001/store/8srwygrvr2wcylwqvlb6qcb08dl9phz0-shared-dep1495 CA: text:sha256:11f9b36brpqf71swxd1cqiyzl7n20amra5n575wrfbyhww773ii21496 client_pushes_test.go:97: Retrieved narinfo from S3:1497 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientPushesUseOnePush3307344530/001/store/0hfqbdbrqva92s2vhvj5jxk82dg693kj-b1498 URL: nar/07yj42v4qqjkp0gc0xjyg7iqg2z4nqi3zg25658ymp4gk6gc9xgi.nar.zst1499 Compression: zstd1500 NarHash: sha256:07yj42v4qqjkp0gc0xjyg7iqg2z4nqi3zg25658ymp4gk6gc9xgi1501 NarSize: 2561502 References: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientPushesUseOnePush3307344530/001/store/8srwygrvr2wcylwqvlb6qcb08dl9phz0-shared-dep1503 CA: text:sha256:11f9b36brpqf71swxd1cqiyzl7n20amra5n575wrfbyhww773ii215042026/11/12 11:50:23 INFO lead: released remote=192.0.2.1:12341505--- PASS: TestLeadElectsOneAndHandsOver (8.34s)1506=== CONT TestGCTaskStore_GetReturnsLatest1507--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1508=== CONT TestIsValidUploadKey1509=== RUN TestIsValidUploadKey/narinfo1510=== PAUSE TestIsValidUploadKey/narinfo1511=== RUN TestIsValidUploadKey/nar_zst1512=== PAUSE TestIsValidUploadKey/nar_zst1513=== RUN TestIsValidUploadKey/nar_xz1514=== PAUSE TestIsValidUploadKey/nar_xz1515=== RUN TestIsValidUploadKey/nar_plain1516=== PAUSE TestIsValidUploadKey/nar_plain1517=== RUN TestIsValidUploadKey/listing1518=== PAUSE TestIsValidUploadKey/listing1519=== RUN TestIsValidUploadKey/build_log1520=== PAUSE TestIsValidUploadKey/build_log1521=== RUN TestIsValidUploadKey/build_log_home-manager_file1522=== PAUSE TestIsValidUploadKey/build_log_home-manager_file1523=== RUN TestIsValidUploadKey/build_log_plus_in_name1524=== PAUSE TestIsValidUploadKey/build_log_plus_in_name1525=== RUN TestIsValidUploadKey/build_log_question_mark1526=== PAUSE TestIsValidUploadKey/build_log_question_mark1527=== RUN TestIsValidUploadKey/build_log_equals1528=== PAUSE TestIsValidUploadKey/build_log_equals1529=== RUN TestIsValidUploadKey/realisation1530=== PAUSE TestIsValidUploadKey/realisation1531=== RUN TestIsValidUploadKey/realisation_plus_in_output1532=== PAUSE TestIsValidUploadKey/realisation_plus_in_output1533=== RUN TestIsValidUploadKey/nix-cache-info1534=== PAUSE TestIsValidUploadKey/nix-cache-info1535=== RUN TestIsValidUploadKey/index.html1536=== PAUSE TestIsValidUploadKey/index.html1537=== RUN TestIsValidUploadKey/narinfo_key,_nar_type1538=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type1539=== RUN TestIsValidUploadKey/nar_key,_narinfo_type1540=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type1541=== RUN TestIsValidUploadKey/listing_key,_narinfo_type1542=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type1543=== RUN TestIsValidUploadKey/traversal1544=== PAUSE TestIsValidUploadKey/traversal1545=== RUN TestIsValidUploadKey/traversal_nar1546=== PAUSE TestIsValidUploadKey/traversal_nar1547=== RUN TestIsValidUploadKey/absolute1548=== PAUSE TestIsValidUploadKey/absolute1549=== RUN TestIsValidUploadKey/empty_key1550=== PAUSE TestIsValidUploadKey/empty_key1551=== RUN TestIsValidUploadKey/unknown_type1552=== PAUSE TestIsValidUploadKey/unknown_type1553=== CONT TestService_verifyS3ReuploadsStaleNarinfo1554=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed1555=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed1556=== RUN TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed1557=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed1558=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost1559=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost1560=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed1561=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed1562=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed1563=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed1564=== CONT TestService_cleanupPendingClosuresHandler1565--- PASS: TestClientPushesUseOnePush (5.25s)1566=== CONT TestUploadHandlersRejectOversizedBody1567=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts1568=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts1569=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure1570=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure1571=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart1572=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart1573=== CONT TestService_verifyS3Integrity1574=== NAME TestPinProtectsFromGC1575 client_integration_test.go:791: Pinned store path: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestPinProtectsFromGC1136431392/001/store/5chmjbw69l0k9q85yl9hc4gvffbmvc7w-pinned-file.txt1576 client_integration_test.go:792: Unpinned store path: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestPinProtectsFromGC1136431392/001/store/z544p52qq2j75rqvvg0gi9flp2yyd0hh-unpinned-file.txt15772026/11/12 11:50:23 INFO Received push request method=POST path=/api/pushes1578=== NAME TestNARDeduplicationMetadataUploadBug1579 metadata_upload_test.go:48: First store path: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestNARDeduplicationMetadataUploadBug2879442853/001/store/6ykl8l1gw2f62ygd59mk19zspv8f0w5a-file1.txt15802026/11/12 11:50:23 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)15812026/11/12 11:50:23 INFO Uploading 5chmjbw69l0k9q85yl9hc4gvffbmvc7w-pinned-file.txt (128B)15822026/11/12 11:50:23 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"15832026/11/12 11:50:23 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15842026/11/12 11:50:23 WARN Failed to register uploaded object key=5chmjbw69l0k9q85yl9hc4gvffbmvc7w.ls error="server returned 404: 404 page not found\n"15852026/11/12 11:50:23 INFO Signed narinfos id=1 count=115862026/11/12 11:50:23 INFO Uploading 1 narinfos15872026/11/12 11:50:23 INFO Received push request method=POST path=/api/pushes15882026/11/12 11:50:23 INFO Received complete push request method=POST path=/api/pushes/1/complete15892026/11/12 11:50:23 WARN Failed to register uploaded object key=5chmjbw69l0k9q85yl9hc4gvffbmvc7w.narinfo error="server returned 404: 404 page not found\n"15902026/11/12 11:50:23 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)15912026/11/12 11:50:23 INFO Uploading 6ykl8l1gw2f62ygd59mk19zspv8f0w5a-file1.txt (160B)15922026/11/12 11:50:23 INFO Completed push id=1 objects=3 duration=18.104708ms15932026/11/12 11:50:23 INFO Upload complete. (218ms)15942026/11/12 11:50:23 WARN Failed to register uploaded object key=6ykl8l1gw2f62ygd59mk19zspv8f0w5a.ls error="server returned 404: 404 page not found\n"15952026/11/12 11:50:23 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15962026/11/12 11:50:23 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"15972026/11/12 11:50:23 INFO Signed narinfos id=1 count=115982026/11/12 11:50:23 INFO Uploading 1 narinfos15992026/11/12 11:50:23 INFO Received push request method=POST path=/api/pushes16002026/11/12 11:50:23 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16012026/11/12 11:50:23 INFO Uploading z544p52qq2j75rqvvg0gi9flp2yyd0hh-unpinned-file.txt (128B)16022026/11/12 11:50:24 INFO Received complete push request method=POST path=/api/pushes/1/complete16032026/11/12 11:50:24 WARN Failed to register uploaded object key=6ykl8l1gw2f62ygd59mk19zspv8f0w5a.narinfo error="server returned 404: 404 page not found\n"16042026/11/12 11:50:24 WARN Failed to register uploaded object key=z544p52qq2j75rqvvg0gi9flp2yyd0hh.ls error="server returned 404: 404 page not found\n"16052026/11/12 11:50:24 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign16062026/11/12 11:50:24 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"16072026/11/12 11:50:24 INFO Signed narinfos id=2 count=116082026/11/12 11:50:24 INFO Uploading 1 narinfos16092026/11/12 11:50:24 INFO Completed push id=1 objects=3 duration=32.761417ms16102026/11/12 11:50:24 INFO Upload complete. (261ms)1611 metadata_upload_test.go:54: Retrieved narinfo from S3:1612 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestNARDeduplicationMetadataUploadBug2879442853/001/store/6ykl8l1gw2f62ygd59mk19zspv8f0w5a-file1.txt1613 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1614 Compression: zstd1615 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1616 NarSize: 1601617 References: 1618 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1619 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1620 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1621 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}16222026/11/12 11:50:24 INFO Received complete push request method=POST path=/api/pushes/2/complete16232026/11/12 11:50:24 WARN Failed to register uploaded object key=z544p52qq2j75rqvvg0gi9flp2yyd0hh.narinfo error="server returned 404: 404 page not found\n"16242026/11/12 11:50:24 INFO Completed push id=2 objects=3 duration=783.917µs16252026/11/12 11:50:24 INFO Upload complete. (164ms)16262026/11/12 11:50:24 INFO Starting cleanup of old closures method=DELETE path=/api/closures16272026/11/12 11:50:24 INFO Garbage collection started16282026/11/12 11:50:24 INFO Aborted multipart uploads count=0 kept=01629 metadata_upload_test.go:64: Second store path (same content): /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestNARDeduplicationMetadataUploadBug2879442853/001/store/j7y33mcb939zmcs2w6f64rsvpbaq28v7-file2.txt16302026/11/12 11:50:24 WARN Force mode enabled - objects will be deleted immediately without grace period16312026/11/12 11:50:24 INFO Received push request method=POST path=/api/pushes16322026/11/12 11:50:24 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)16332026/11/12 11:50:24 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign16342026/11/12 11:50:24 WARN Failed to register uploaded object key=j7y33mcb939zmcs2w6f64rsvpbaq28v7.ls error="server returned 404: 404 page not found\n"16352026/11/12 11:50:24 INFO Signed narinfos id=2 count=116362026/11/12 11:50:24 INFO Uploading 1 narinfos16372026/11/12 11:50:24 INFO Received complete push request method=POST path=/api/pushes/2/complete16382026/11/12 11:50:24 WARN Failed to register uploaded object key=j7y33mcb939zmcs2w6f64rsvpbaq28v7.narinfo error="server returned 404: 404 page not found\n"16392026/11/12 11:50:24 INFO Completed push id=2 objects=3 duration=987.375µs16402026/11/12 11:50:24 INFO Upload complete. (191ms)1641 metadata_upload_test.go:76: Retrieved narinfo from S3:1642 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestNARDeduplicationMetadataUploadBug2879442853/001/store/j7y33mcb939zmcs2w6f64rsvpbaq28v7-file2.txt1643 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1644 Compression: zstd1645 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1646 NarSize: 1601647 References: 1648 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1649 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1650 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1651 {"version":1,"root":{"type":"regular","size":44}}1652--- PASS: TestNARDeduplicationMetadataUploadBug (5.66s)1653=== CONT TestUploadHandlersRejectInvalidKeys16542026/11/12 11:50:24 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=01655=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1656=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1657=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal1658=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal1659=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1660=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1661=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1662=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1663=== CONT TestService_createPendingClosureHandler16642026/11/12 11:50:24 INFO Vacuumed table table=pending_closures16652026/11/12 11:50:24 INFO Vacuumed table table=commit_receipts16662026/11/12 11:50:24 INFO Vacuumed table table=pending_objects16672026/11/12 11:50:24 INFO Vacuumed table table=multipart_uploads16682026/11/12 11:50:24 INFO Vacuumed table table=closures16692026/11/12 11:50:24 INFO Vacuumed table table=objects1670--- PASS: TestObjectStatsUpdatedOncePerCommit (5.24s)1671=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1672--- PASS: TestDeleteClosuresRacingPins (7.16s)1673=== CONT TestPendingClosureWriteTimeout1674=== RUN TestPendingClosureWriteTimeout/empty1675=== PAUSE TestPendingClosureWriteTimeout/empty1676=== RUN TestPendingClosureWriteTimeout/400_objects1677=== PAUSE TestPendingClosureWriteTimeout/400_objects1678=== RUN TestPendingClosureWriteTimeout/670k_objects1679=== PAUSE TestPendingClosureWriteTimeout/670k_objects1680=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1681=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1682=== CONT TestProxyWriteTimeout1683=== RUN TestProxyWriteTimeout/narinfo1684=== PAUSE TestProxyWriteTimeout/narinfo1685=== RUN TestProxyWriteTimeout/1_GiB_nar1686=== PAUSE TestProxyWriteTimeout/1_GiB_nar1687=== RUN TestProxyWriteTimeout/10_GiB_nar1688=== PAUSE TestProxyWriteTimeout/10_GiB_nar1689=== RUN TestProxyWriteTimeout/unknown_size1690=== PAUSE TestProxyWriteTimeout/unknown_size1691=== CONT TestParseSize1692--- PASS: TestParseSize (0.00s)1693=== CONT TestSkippedUploadsHandler16942026/11/12 11:50:24 INFO Client skipped oversized paths paths=3 nar_bytes=50000000001695--- PASS: TestSkippedUploadsHandler (0.01s)1696=== CONT TestService_Rustfstest16972026/11/12 11:50:24 INFO Received push request method=POST path=/api/pushes16982026/11/12 11:50:24 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)16992026/11/12 11:50:24 INFO Uploading 5fprk6xvmn11xjbp1a7pyx9m9bxm3imd-top (264B)17002026/11/12 11:50:24 INFO Uploading 4wx3ni8gms12519y7z50yprmwk4hihy3-shared-dep (136B)17012026/11/12 11:50:24 WARN Failed to register uploaded object key=5fprk6xvmn11xjbp1a7pyx9m9bxm3imd.ls error="server returned 404: 404 page not found\n"17022026/11/12 11:50:24 WARN Failed to register uploaded object key=nar/00j2yysbyizkqh7i4w9vrpf55zynwamgsrvyd9mz578ja0rwjz9c.nar.zst error="server returned 404: 404 page not found\n"17032026/11/12 11:50:24 WARN Failed to register uploaded object key=4wx3ni8gms12519y7z50yprmwk4hihy3.ls error="server returned 404: 404 page not found\n"17042026/11/12 11:50:24 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17052026/11/12 11:50:24 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"17062026/11/12 11:50:24 INFO Signed narinfos id=1 count=217072026/11/12 11:50:24 INFO Uploading 2 narinfos1708--- PASS: TestObjectStatsTrigger (5.07s)1709=== CONT TestGCTaskStore_GetEmpty1710--- PASS: TestGCTaskStore_GetEmpty (0.00s)1711=== CONT TestReadProxyRangeRequest17122026/11/12 11:50:24 WARN Failed to register uploaded object key=5fprk6xvmn11xjbp1a7pyx9m9bxm3imd.narinfo error="server returned 404: 404 page not found\n"17132026/11/12 11:50:24 INFO Received complete push request method=POST path=/api/pushes/1/complete17142026/11/12 11:50:24 WARN Failed to register uploaded object key=4wx3ni8gms12519y7z50yprmwk4hihy3.narinfo error="server returned 404: 404 page not found\n"17152026/11/12 11:50:25 INFO Completed push id=1 objects=6 duration=25.197334ms17162026/11/12 11:50:25 INFO Upload complete. (274ms)1717=== NAME TestClientSharedPathCommittedMidPush1718 client_integration_test.go:740: Retrieved narinfo from S3:1719 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientSharedPathCommittedMidPush4201761299/001/store/4wx3ni8gms12519y7z50yprmwk4hihy3-shared-dep1720 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1721 Compression: zstd1722 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821723 NarSize: 1361724 References: 1725 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1726 client_integration_test.go:740: Retrieved narinfo from S3:1727 StorePath: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientSharedPathCommittedMidPush4201761299/001/store/5fprk6xvmn11xjbp1a7pyx9m9bxm3imd-top1728 URL: nar/00j2yysbyizkqh7i4w9vrpf55zynwamgsrvyd9mz578ja0rwjz9c.nar.zst1729 Compression: zstd1730 NarHash: sha256:00j2yysbyizkqh7i4w9vrpf55zynwamgsrvyd9mz578ja0rwjz9c1731 NarSize: 2641732 References: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestClientSharedPathCommittedMidPush4201761299/001/store/4wx3ni8gms12519y7z50yprmwk4hihy3-shared-dep1733 CA: text:sha256:1cln44kk7qidq6qlmqa21gaxcy8vh4l3skxp3wjr24hry3yjia0q1734--- PASS: TestClientSharedPathCommittedMidPush (5.77s)1735=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows17362026/11/12 11:50:25 INFO Received uploads request method=POST path=/api/pending_closures17372026/11/12 11:50:25 INFO Received uploads request method=POST path=/api/pending_closures17382026/11/12 11:50:25 INFO Received cleanup request method=DELETE path=/api/pending_closures17392026/11/12 11:50:25 INFO Received push request method=POST path=/api/pushes17402026-11-12 11:50:25.953 UTC [57132] ERROR: could not obtain lock on row in relation "closures"17412026-11-12 11:50:25.953 UTC [57132] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT17422026-11-12 11:50:25.958 UTC [57132] ERROR: could not obtain lock on row in relation "closures"17432026-11-12 11:50:25.958 UTC [57132] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT17442026-11-12 11:50:25.963 UTC [57132] ERROR: could not obtain lock on row in relation "closures"17452026-11-12 11:50:25.963 UTC [57132] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT17462026-11-12 11:50:25.967 UTC [57132] ERROR: could not obtain lock on row in relation "closures"17472026-11-12 11:50:25.967 UTC [57132] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT17482026-11-12 11:50:25.971 UTC [57132] ERROR: could not obtain lock on row in relation "closures"17492026-11-12 11:50:25.971 UTC [57132] STATEMENT: SELECT 1 FROM closures WHERE key = $1 FOR UPDATE NOWAIT1750--- PASS: TestPush_RootsAreLockedInByteOrder (5.43s)1751=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check17522026/11/12 11:50:26 INFO Received push request method=POST path=/api/pushes17532026/11/12 11:50:26 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=017542026/11/12 11:50:26 INFO Received create pin request method=POST path=/api/pins/myapp1755--- PASS: TestPush_OverlappingRootsStoreOneRowPerKey (4.86s)1756=== CONT TestGCEndsOnShutdown/before_the_run17572026/11/12 11:50:26 INFO Created/updated pin name=myapp store_path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestPinProtectsFromGC1136431392/001/store/5chmjbw69l0k9q85yl9hc4gvffbmvc7w-pinned-file.txt narinfo_key=5chmjbw69l0k9q85yl9hc4gvffbmvc7w.narinfo17582026/11/12 11:50:26 INFO Starting cleanup of old closures method=DELETE path=/api/closures17592026/11/12 11:50:26 INFO Garbage collection started17602026/11/12 11:50:26 INFO Aborted multipart uploads count=0 kept=017612026/11/12 11:50:26 WARN Force mode enabled - objects will be deleted immediately without grace period17622026/11/12 11:50:26 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=017632026/11/12 11:50:26 INFO Vacuumed table table=pending_closures17642026/11/12 11:50:26 INFO Vacuumed table table=commit_receipts17652026/11/12 11:50:26 INFO Vacuumed table table=pending_objects17662026/11/12 11:50:26 INFO Vacuumed table table=multipart_uploads17672026/11/12 11:50:26 INFO Vacuumed table table=closures17682026/11/12 11:50:26 INFO Vacuumed table table=objects17692026/11/12 11:50:26 INFO Received uploads request method=POST path=/api/pending_closures17702026/11/12 11:50:26 INFO Received push request method=POST path=/api/pushes1771=== NAME TestOrphanedObjectsGC1772 orphaned_objects_gc_test.go:287: GC Test Summary:1773 orphaned_objects_gc_test.go:288: - Kept: 2 objects from closure A1774 orphaned_objects_gc_test.go:289: - Deleted: 2 objects from closure B1775 orphaned_objects_gc_test.go:290: - Deleted: 6 orphaned chain objects (X1->X2->X3)1776 orphaned_objects_gc_test.go:291: - Deleted: 2 orphaned single objects (Y)1777 orphaned_objects_gc_test.go:292: - Total deleted: 10 objects1778--- PASS: TestOrphanedObjectsGC (7.22s)1779=== CONT TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark17802026-11-12 11:50:27.493 UTC [57140] ERROR: Push does not exist: id=117812026-11-12 11:50:27.493 UTC [57140] CONTEXT: PL/pgSQL function commit_push(bigint) line 15 at RAISE17822026-11-12 11:50:27.493 UTC [57140] STATEMENT: SELECT commit_push($1)1783--- PASS: TestPush_CompleteWaitsForCleanupOfThePush (5.83s)1784=== CONT TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete17852026/11/12 11:50:27 INFO Received uploads request method=POST path=/api/pending_closures17862026/11/12 11:50:27 INFO Received complete multipart upload request method=POST path=/api/multipart/complete17872026/11/12 11:50:27 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NGNhNjk5MDUtZjkwNi00YjUxLWFjYmQtNGJiNzBiYWM1ODcxLjNjZjZlZTY5LTk2MTUtNGQxMy1hNzg1LTZlZTJlYjFmODNkNXgxNzk0NDg0MjI3NjIyMzgzMDAw17882026/11/12 11:50:27 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NGNhNjk5MDUtZjkwNi00YjUxLWFjYmQtNGJiNzBiYWM1ODcxLjNjZjZlZTY5LTk2MTUtNGQxMy1hNzg1LTZlZTJlYjFmODNkNXgxNzk0NDg0MjI3NjIyMzgzMDAw parts=117892026/11/12 11:50:27 INFO Received push request method=POST path=/api/pushes1790--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (6.31s)1791=== CONT TestIsValidCachePath/narinfo1792=== CONT TestIsValidCachePath/index.html1793=== CONT TestIsValidCachePath/short_hash1794=== CONT TestIsValidCachePath/wrong_extension1795=== CONT TestIsValidCachePath/leading_slash1796=== CONT TestIsValidCachePath/empty1797=== CONT TestIsValidCachePath/random_path1798=== CONT TestIsValidCachePath/invalid_char_u1799=== CONT TestIsValidCachePath/invalid_char_e1800=== CONT TestIsValidCachePath/traversal_in_middle1801=== CONT TestIsValidCachePath/traversal_parent1802=== CONT TestIsValidCachePath/nar_uncompressed1803=== CONT TestIsValidCachePath/nix-cache-info1804=== CONT TestIsValidCachePath/realisation1805=== CONT TestIsValidCachePath/log1806=== CONT TestIsValidCachePath/ls1807=== CONT TestIsValidCachePath/nar_xz1808=== CONT TestIsValidCachePath/nar_bz21809=== CONT TestIsValidCachePath/nar_zst1810=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1811--- PASS: TestIsValidCachePath (0.01s)1812 --- PASS: TestIsValidCachePath/narinfo (0.00s)1813 --- PASS: TestIsValidCachePath/index.html (0.00s)1814 --- PASS: TestIsValidCachePath/short_hash (0.00s)1815 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1816 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1817 --- PASS: TestIsValidCachePath/empty (0.00s)1818 --- PASS: TestIsValidCachePath/random_path (0.00s)1819 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1820 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1821 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1822 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1823 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1824 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1825 --- PASS: TestIsValidCachePath/realisation (0.00s)1826 --- PASS: TestIsValidCachePath/log (0.00s)1827 --- PASS: TestIsValidCachePath/ls (0.00s)1828 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1829 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1830 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1831 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1832=== CONT TestParseSingleRange/none1833=== CONT TestParseSingleRange/open-ended1834=== CONT TestParseSingleRange/start_far_past_EOF1835=== CONT TestParseSingleRange/start_past_EOF1836=== CONT TestParseSingleRange/single_byte1837=== CONT TestParseSingleRange/suffix_exceeds_size1838=== CONT TestParseSingleRange/suffix1839=== CONT TestParseSingleRange/end_clamped_to_size1840=== CONT TestParseSingleRange/malformed_both_empty1841=== CONT TestParseSingleRange/closed1842=== CONT TestParseSingleRange/malformed_end_before_start1843=== CONT TestParseSingleRange/multi-range_ignored1844=== CONT TestParseSingleRange/malformed_no_dash1845=== CONT TestParseSingleRange/unknown_unit1846--- PASS: TestParseSingleRange (0.00s)1847 --- PASS: TestParseSingleRange/none (0.00s)1848 --- PASS: TestParseSingleRange/open-ended (0.00s)1849 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1850 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1851 --- PASS: TestParseSingleRange/single_byte (0.00s)1852 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1853 --- PASS: TestParseSingleRange/suffix (0.00s)1854 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1855 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1856 --- PASS: TestParseSingleRange/closed (0.00s)1857 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1858 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1859 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1860 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1861=== CONT TestClientErrorHandling/InvalidStorePath18622026/11/12 11:50:28 INFO Received complete push request method=POST path=/api/pushes/1/complete18632026/11/12 11:50:28 INFO Completed push id=1 objects=4 duration=67.725209ms1864--- PASS: TestPush_RepeatedRootCommitsOnce (6.27s)1865=== CONT TestClientErrorHandling/ServerNotAvailable1866=== NAME TestPinProtectsFromGC1867 client_integration_test.go:900: Pin successfully protected closure from garbage collection1868--- PASS: TestPinProtectsFromGC (9.70s)1869=== CONT TestClientErrorHandling/InvalidAuthToken18702026/11/12 11:50:28 INFO Received uploads request method=POST path=/api/pending_closures18712026/11/12 11:50:28 INFO Received uploads request method=POST path=/api/pending_closures18722026/11/12 11:50:28 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18732026/11/12 11:50:28 WARN Request failed, retrying attempt=2 backoff=189.469073ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18742026/11/12 11:50:28 INFO Received push request method=POST path=/api/pushes18752026/11/12 11:50:28 INFO Received complete push request method=POST path=/api/pushes/1/complete18762026/11/12 11:50:28 WARN Request failed, retrying attempt=3 backoff=366.484189ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18772026/11/12 11:50:28 INFO Completed push id=1 objects=6 duration=68.178333ms1878--- PASS: TestPush_CompleteCommitsEveryRoot (6.87s)1879=== CONT TestPresentNotReportedWhileGCDeletesClosure/stale18802026/11/12 11:50:29 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1881--- PASS: TestReadRedirectKeepsNarinfoProxied (7.00s)1882=== CONT TestPresentNotReportedWhileGCDeletesClosure/fresh18832026/11/12 11:50:29 WARN Request failed, retrying attempt=4 backoff=842.493166ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18842026/11/12 11:50:29 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=NGNhNjk5MDUtZjkwNi00YjUxLWFjYmQtNGJiNzBiYWM1ODcxLjQzNzFhY2FkLWVhNDYtNGZhZC1hMTQ2LWY1OTkxNDhhNThjMngxNzk0NDg0MjI2NTU0NTk0MDAw parts=1218852026/11/12 11:50:29 INFO Received uploads request method=POST path=/api/pending_closures1886--- PASS: TestCompletedNarNotReofferedAcrossClosures (7.82s)1887=== CONT TestCacheConfigHandler/full_config,_no_issuer1888=== CONT TestCacheConfigHandler/no_signing_keys1889=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1890=== CONT TestCacheConfigHandler/no_cache_url_configured1891--- PASS: TestCacheConfigHandler (0.00s)1892 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1893 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1894 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1895 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1896=== CONT TestResolveDBConnectionString/flag_wins1897=== CONT TestResolveDBConnectionString/PGHOST_allows_empty1898=== CONT TestResolveDBConnectionString/nothing_configured1899=== CONT TestResolveDBConnectionString/missing_file_is_an_error1900=== CONT TestResolveDBConnectionString/file_when_flag_empty1901=== CONT TestServerTLSConfig/no_client_CA1902=== CONT TestServerTLSConfig/not_a_PEM_file1903--- PASS: TestResolveDBConnectionString (0.03s)1904 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1905 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1906 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1907 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1908 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)1909=== CONT TestServerTLSConfig/missing_CA_file1910--- PASS: TestServerTLSConfig (0.00s)1911 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1912 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.03s)1913 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1914=== CONT TestService_RequireScope_OIDC/builder_may_write1915=== CONT TestService_RequireScope_OIDC/reader_may_read1916=== CONT TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1917=== CONT TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read19182026/11/12 11:50:29 WARN Authentication failed token_preview=wrong token_length=5 oidc_error="not a JWT" oidc_provider=""1919=== CONT TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1920=== CONT TestService_RequireScope_OIDC/reader_may_read_with_netrc1921=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read1922=== CONT TestService_RequireScope_OIDC/writer_implies_read1923=== CONT TestService_RequireScope_OIDC/reader_may_not_write1924=== CONT TestService_RequireScope_OIDC/static_token_may_write1925=== CONT TestService_RequireScope_OIDC/static_token_may_admin1926=== CONT TestService_RequireScope_OIDC/ops_may_admin1927=== CONT TestService_RequireScope_OIDC/ops_may_not_write1928=== CONT TestService_RequireScope_OIDC/builder_may_not_admin1929=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token1930=== CONT TestService_AuthMiddleware_OIDC/malformed_token_rejected19312026/11/12 11:50:29 WARN Authentication failed token_preview=not-a-valid-jwt token_length=15 oidc_error="not a JWT" oidc_provider=""1932=== CONT TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1933=== CONT TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1934--- PASS: TestService_RequireScope_OIDC (5.94s)1935 --- PASS: TestService_RequireScope_OIDC/builder_may_write (0.00s)1936 --- PASS: TestService_RequireScope_OIDC/reader_may_read (0.00s)1937 --- PASS: TestService_RequireScope_OIDC/empty_netrc_password_may_not_read (0.00s)1938 --- PASS: TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read (0.00s)1939 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin_with_netrc (0.00s)1940 --- PASS: TestService_RequireScope_OIDC/reader_may_read_with_netrc (0.00s)1941 --- PASS: TestService_RequireScope_OIDC/anonymous_may_not_read (0.00s)1942 --- PASS: TestService_RequireScope_OIDC/writer_implies_read (0.00s)1943 --- PASS: TestService_RequireScope_OIDC/reader_may_not_write (0.00s)1944 --- PASS: TestService_RequireScope_OIDC/static_token_may_write (0.00s)1945 --- PASS: TestService_RequireScope_OIDC/static_token_may_admin (0.00s)1946 --- PASS: TestService_RequireScope_OIDC/ops_may_admin (0.00s)1947 --- PASS: TestService_RequireScope_OIDC/ops_may_not_write (0.00s)1948 --- PASS: TestService_RequireScope_OIDC/builder_may_not_admin (0.00s)19492026/11/12 11:50:29 WARN Authentication failed token_preview=eyJhbGciOi..._u4kOpJ05Q token_length=701 oidc_error="no rule matched: claim \"repository_owner\" value [otherorg] not in allowed patterns [myorg]" oidc_provider=test1950=== CONT TestCommitCanBeRepeatedUntilCleanup/push1951--- PASS: TestService_AuthMiddleware_OIDC (5.86s)1952 --- PASS: TestService_AuthMiddleware_OIDC/valid_OIDC_token (0.00s)1953 --- PASS: TestService_AuthMiddleware_OIDC/malformed_token_rejected (0.00s)1954 --- PASS: TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured (0.00s)1955 --- PASS: TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected (0.01s)19562026/11/12 11:50:29 INFO Received push request method=POST path=/api/pushes19572026/11/12 11:50:29 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19582026/11/12 11:50:29 INFO Signed narinfos id=1 count=119592026/11/12 11:50:29 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19602026/11/12 11:50:29 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19612026/11/12 11:50:29 ERROR Failed to sign narinfos signer="index 1" error="signing key cannot be nil"19622026/11/12 11:50:29 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19632026/11/12 11:50:29 ERROR Failed to sign narinfos signer=niks3-test-1 error="signer failed"19642026/11/12 11:50:29 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19652026/11/12 11:50:29 ERROR Signer returned unexpected signature count signer=niks3-test-1 got=0 want=119662026/11/12 11:50:29 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign19672026/11/12 11:50:29 ERROR Signer returned unexpected object key signer=niks3-test-1 object_key=unexpected.narinfo1968--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (7.04s)1969=== CONT TestCommitCanBeRepeatedUntilCleanup/pending_closure1970=== RUN TestPush_RejectsBadRequests/no_roots1971=== PAUSE TestPush_RejectsBadRequests/no_roots1972=== RUN TestPush_RejectsBadRequests/no_objects1973=== PAUSE TestPush_RejectsBadRequests/no_objects1974=== RUN TestPush_RejectsBadRequests/bad_root1975=== PAUSE TestPush_RejectsBadRequests/bad_root1976=== RUN TestPush_RejectsBadRequests/root_not_in_objects1977=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects1978=== CONT TestIsValidUploadKey/narinfo1979=== CONT TestIsValidUploadKey/realisation_plus_in_output1980=== CONT TestIsValidUploadKey/unknown_type1981=== CONT TestIsValidUploadKey/empty_key1982=== CONT TestIsValidUploadKey/absolute1983=== CONT TestIsValidUploadKey/traversal_nar1984=== CONT TestIsValidUploadKey/traversal1985=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1986=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1987=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1988=== CONT TestIsValidUploadKey/index.html1989=== CONT TestIsValidUploadKey/nix-cache-info1990=== CONT TestIsValidUploadKey/build_log_home-manager_file1991=== CONT TestIsValidUploadKey/realisation1992=== CONT TestIsValidUploadKey/build_log_equals1993=== CONT TestIsValidUploadKey/build_log_question_mark1994=== CONT TestIsValidUploadKey/build_log_plus_in_name1995=== CONT TestIsValidUploadKey/nar_plain1996=== CONT TestIsValidUploadKey/build_log1997=== CONT TestIsValidUploadKey/listing1998=== CONT TestIsValidUploadKey/nar_xz1999=== CONT TestIsValidUploadKey/nar_zst2000=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed
loading 890 hidden lines…
28912026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads28922026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts28932026/11/12 11:50:55 INFO Vacuumed table table=closures28942026/11/12 11:50:55 INFO Vacuumed table table=objects28952026/11/12 11:50:55 INFO Received complete upload request method=POST path=/28962026/11/12 11:50:55 INFO Vacuumed table table=pending_objects28972026/11/12 11:50:55 INFO Vacuumed table table=objects28982026/11/12 11:50:55 INFO Received complete push request method=POST path=/28992026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29002026/11/12 11:50:55 INFO Completed push id=5 objects=8 duration=10.690083ms29012026/11/12 11:50:55 INFO Completed upload id=11 objects=14 duration=10.784167ms29022026/11/12 11:50:55 INFO Vacuumed table table=closures29032026/11/12 11:50:55 INFO Received complete upload request method=POST path=/29042026/11/12 11:50:55 INFO Vacuumed table table=objects29052026/11/12 11:50:55 INFO Received push request method=POST path=/29062026/11/12 11:50:55 INFO Received push request method=POST path=/29072026/11/12 11:50:55 INFO Completed upload id=10 objects=6 duration=1.189125ms29082026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029092026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period29102026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029112026/11/12 11:50:55 INFO Received uploads request method=POST path=/29122026/11/12 11:50:55 INFO Received push request method=POST path=/29132026/11/12 11:50:55 INFO Received uploads request method=POST path=/29142026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029152026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029162026/11/12 11:50:55 INFO Vacuumed table table=pending_closures29172026/11/12 11:50:55 INFO Vacuumed table table=pending_closures29182026/11/12 11:50:55 INFO Received complete upload request method=POST path=/29192026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts29202026/11/12 11:50:55 INFO Received push request method=POST path=/29212026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts29222026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029232026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029242026/11/12 11:50:55 INFO Completed upload id=9 objects=2 duration=383.542µs29252026/11/12 11:50:55 INFO Vacuumed table table=pending_objects29262026/11/12 11:50:55 INFO Received push request method=POST path=/29272026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029282026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29292026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029302026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period29312026/11/12 11:50:55 INFO Received complete push request method=POST path=/29322026/11/12 11:50:55 INFO Received complete upload request method=POST path=/29332026/11/12 11:50:55 INFO Vacuumed table table=closures29342026/11/12 11:50:55 INFO Vacuumed table table=pending_closures29352026/11/12 11:50:55 INFO Completed push id=8 objects=3 duration=6.403084ms29362026/11/12 11:50:55 INFO Completed upload id=23 objects=15 duration=6.390917ms29372026/11/12 11:50:55 INFO Vacuumed table table=pending_objects29382026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period29392026/11/12 11:50:55 INFO Vacuumed table table=objects29402026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029412026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts29422026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29432026/11/12 11:50:55 INFO Vacuumed table table=pending_closures29442026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029452026/11/12 11:50:55 INFO Received uploads request method=POST path=/29462026/11/12 11:50:55 INFO Received push request method=POST path=/29472026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts29482026/11/12 11:50:55 INFO Vacuumed table table=pending_closures29492026/11/12 11:50:55 INFO Vacuumed table table=closures29502026/11/12 11:50:55 INFO Vacuumed table table=pending_objects29512026/11/12 11:50:55 INFO Vacuumed table table=pending_objects29522026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29532026/11/12 11:50:55 INFO Vacuumed table table=objects29542026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29552026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts29562026/11/12 11:50:55 INFO Vacuumed table table=closures29572026/11/12 11:50:55 INFO Received uploads request method=POST path=/29582026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029592026/11/12 11:50:55 INFO Received complete push request method=POST path=/29602026/11/12 11:50:55 INFO Vacuumed table table=closures29612026/11/12 11:50:55 INFO Vacuumed table table=objects29622026/11/12 11:50:55 INFO Vacuumed table table=pending_objects29632026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029642026/11/12 11:50:55 INFO Received complete upload request method=POST path=/29652026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period29662026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29672026/11/12 11:50:55 INFO Vacuumed table table=objects29682026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029692026/11/12 11:50:55 INFO Completed upload id=13 objects=10 duration=458.25µs29702026/11/12 11:50:55 INFO Received uploads request method=POST path=/29712026/11/12 11:50:55 INFO Vacuumed table table=pending_closures29722026/11/12 11:50:55 INFO Vacuumed table table=closures29732026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts29742026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=029752026/11/12 11:50:55 INFO Received uploads request method=POST path=/29762026/11/12 11:50:55 INFO Received uploads request method=POST path=/29772026/11/12 11:50:55 INFO Completed push id=1 objects=7 duration=27.693709ms29782026/11/12 11:50:55 INFO Vacuumed table table=pending_objects29792026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period29802026/11/12 11:50:55 INFO Vacuumed table table=objects29812026/11/12 11:50:55 INFO Received push request method=POST path=/29822026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads29832026/11/12 11:50:55 INFO Received complete upload request method=POST path=/29842026/11/12 11:50:55 INFO Vacuumed table table=closures29852026/11/12 11:50:55 INFO Completed upload id=19 objects=6 duration=5.827083ms29862026/11/12 11:50:55 INFO Vacuumed table table=objects29872026/11/12 11:50:55 INFO Received complete upload request method=POST path=/29882026/11/12 11:50:55 INFO Received uploads request method=POST path=/29892026/11/12 11:50:55 INFO Received uploads request method=POST path=/29902026/11/12 11:50:55 INFO Received uploads request method=POST path=/29912026/11/12 11:50:55 INFO Completed upload id=8 objects=3 duration=873.875µs29922026/11/12 11:50:55 INFO Received uploads request method=POST path=/29932026/11/12 11:50:55 INFO Received push request method=POST path=/29942026/11/12 11:50:55 INFO Received complete push request method=POST path=/29952026/11/12 11:50:55 INFO Received push request method=POST path=/29962026/11/12 11:50:55 INFO Received push request method=POST path=/29972026/11/12 11:50:55 INFO Received complete push request method=POST path=/29982026/11/12 11:50:55 INFO Completed push id=14 objects=3 duration=1.528083ms29992026/11/12 11:50:55 INFO Completed push id=6 objects=6 duration=578.042µs30002026/11/12 11:50:55 INFO Received push request method=POST path=/30012026/11/12 11:50:55 INFO Received complete push request method=POST path=/30022026/11/12 11:50:55 INFO Received push request method=POST path=/30032026/11/12 11:50:55 INFO Received push request method=POST path=/30042026/11/12 11:50:55 INFO Received uploads request method=POST path=/30052026/11/12 11:50:55 INFO Completed push id=5 objects=6 duration=469.959µs30062026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=030072026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=030082026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period30092026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period30102026/11/12 11:50:55 INFO Received complete upload request method=POST path=/30112026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030122026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030132026/11/12 11:50:55 INFO Completed upload id=22 objects=7 duration=245.75µs30142026/11/12 11:50:55 INFO Vacuumed table table=pending_closures30152026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts30162026/11/12 11:50:55 INFO Received complete push request method=POST path=/30172026/11/12 11:50:55 INFO Vacuumed table table=pending_objects30182026/11/12 11:50:55 INFO Completed push id=24 objects=9 duration=11.232375ms30192026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads30202026/11/12 11:50:55 INFO Vacuumed table table=closures30212026/11/12 11:50:55 INFO Received push request method=POST path=/30222026/11/12 11:50:55 INFO Vacuumed table table=objects30232026/11/12 11:50:55 INFO Vacuumed table table=pending_closures30242026/11/12 11:50:55 INFO Received push request method=POST path=/30252026/11/12 11:50:55 INFO Received uploads request method=POST path=/30262026/11/12 11:50:55 INFO Received complete push request method=POST path=/30272026/11/12 11:50:55 INFO Completed push id=21 objects=3 duration=297.584µs30282026/11/12 11:50:55 INFO Received uploads request method=POST path=/30292026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts30302026/11/12 11:50:55 INFO Received complete push request method=POST path=/30312026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=030322026/11/12 11:50:55 INFO Completed push id=10 objects=15 duration=471.917µs30332026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=3 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030342026/11/12 11:50:55 INFO Vacuumed table table=pending_closures30352026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts30362026/11/12 11:50:55 INFO Vacuumed table table=pending_objects30372026/11/12 11:50:55 INFO Vacuumed table table=pending_objects30382026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads30392026/11/12 11:50:55 INFO Vacuumed table table=multipart_uploads30402026/11/12 11:50:55 INFO Aborted multipart uploads count=0 kept=030412026/11/12 11:50:55 INFO Vacuumed table table=closures30422026/11/12 11:50:55 INFO Vacuumed table table=objects30432026/11/12 11:50:55 WARN Force mode enabled - objects will be deleted immediately without grace period30442026/11/12 11:50:55 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=030452026/11/12 11:50:55 INFO Vacuumed table table=closures30462026/11/12 11:50:55 INFO Vacuumed table table=pending_closures30472026/11/12 11:50:55 INFO Vacuumed table table=commit_receipts30482026/11/12 11:50:55 INFO Received push request method=POST path=/30492026/11/12 11:50:55 INFO Received push request method=POST path=/30502026/11/12 11:50:55 INFO Received complete push request method=POST path=/30512026/11/12 11:50:55 INFO Completed push id=30 objects=4 duration=813.625µs30522026/11/12 11:50:56 INFO Received push request method=POST path=/30532026/11/12 11:50:56 INFO Received uploads request method=POST path=/30542026/11/12 11:50:56 INFO Vacuumed table table=objects30552026/11/12 11:50:56 INFO Vacuumed table table=pending_objects30562026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads30572026/11/12 11:50:56 INFO Received push request method=POST path=/30582026/11/12 11:50:56 INFO Vacuumed table table=closures30592026/11/12 11:50:56 INFO Vacuumed table table=objects30602026/11/12 11:50:56 INFO Received push request method=POST path=/30612026/11/12 11:50:56 INFO Received complete upload request method=POST path=/30622026/11/12 11:50:56 INFO Received push request method=POST path=/30632026/11/12 11:50:56 INFO Received complete push request method=POST path=/30642026/11/12 11:50:56 INFO Completed upload id=11 objects=6 duration=11.639834ms30652026/11/12 11:50:56 INFO Completed push id=32 objects=7 duration=370.666µs30662026/11/12 11:50:56 INFO Received push request method=POST path=/30672026/11/12 11:50:56 INFO Received uploads request method=POST path=/30682026/11/12 11:50:56 INFO Received complete push request method=POST path=/30692026/11/12 11:50:56 INFO Completed push id=26 objects=4 duration=415.5µs30702026/11/12 11:50:56 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."30712026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."30722026/11/12 11:50:56 INFO Received uploads request method=POST path=/30732026/11/12 11:50:56 INFO Received uploads request method=POST path=/30742026/11/12 11:50:56 INFO Received complete upload request method=POST path=/30752026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=030762026/11/12 11:50:56 INFO Received push request method=POST path=/30772026/11/12 11:50:56 INFO Completed upload id=28 objects=13 duration=308µs30782026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period30792026/11/12 11:50:56 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."30802026/11/12 11:50:56 INFO Received complete push request method=POST path=/30812026/11/12 11:50:56 INFO Completed push id=9 objects=5 duration=1.192083ms30822026/11/12 11:50:56 INFO Received complete push request method=POST path=/30832026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=030842026/11/12 11:50:56 INFO Completed push id=29 objects=3 duration=261.25µs30852026/11/12 11:50:56 INFO Received complete push request method=POST path=/30862026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period30872026/11/12 11:50:56 INFO Received complete upload request method=POST path=/30882026/11/12 11:50:56 INFO Completed push id=6 objects=5 duration=1.144291ms30892026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030902026/11/12 11:50:56 INFO Completed upload id=31 objects=2 duration=252.542µs30912026/11/12 11:50:56 INFO Vacuumed table table=pending_closures30922026/11/12 11:50:56 INFO Received push request method=POST path=/30932026/11/12 11:50:56 INFO Received complete push request method=POST path=/30942026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts30952026/11/12 11:50:56 INFO Completed push id=33 objects=6 duration=297.041µs30962026/11/12 11:50:56 INFO Vacuumed table table=pending_objects30972026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads30982026/11/12 11:50:56 INFO Received complete upload request method=POST path=/30992026/11/12 11:50:56 INFO Vacuumed table table=closures31002026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031012026/11/12 11:50:56 INFO Completed upload id=14 objects=8 duration=861.958µs31022026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031032026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period31042026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period31052026/11/12 11:50:56 INFO Vacuumed table table=objects31062026/11/12 11:50:56 INFO Received uploads request method=POST path=/31072026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031082026/11/12 11:50:56 INFO Vacuumed table table=pending_closures31092026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts31102026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031112026/11/12 11:50:56 INFO Received push request method=POST path=/31122026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period31132026/11/12 11:50:56 INFO Received complete push request method=POST path=/31142026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=031152026/11/12 11:50:56 INFO Vacuumed table table=pending_objects31162026/11/12 11:50:56 INFO Completed push id=7 objects=20 duration=5.754459ms31172026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads31182026/11/12 11:50:56 INFO Received complete upload request method=POST path=/31192026/11/12 11:50:56 INFO Vacuumed table table=closures31202026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031212026/11/12 11:50:56 INFO Completed upload id=3 objects=8 duration=720.208µs31222026/11/12 11:50:56 INFO Vacuumed table table=objects31232026/11/12 11:50:56 INFO Vacuumed table table=pending_closures31242026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031252026/11/12 11:50:56 INFO Received push request method=POST path=/31262026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts31272026/11/12 11:50:56 INFO Vacuumed table table=pending_closures31282026/11/12 11:50:56 INFO Received uploads request method=POST path=/31292026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts31302026/11/12 11:50:56 INFO Vacuumed table table=pending_objects31312026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031322026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads31332026/11/12 11:50:56 INFO Received complete push request method=POST path=/31342026/11/12 11:50:56 INFO Vacuumed table table=closures31352026/11/12 11:50:56 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."31362026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."31372026/11/12 11:50:56 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."31382026/11/12 11:50:56 INFO Vacuumed table table=pending_objects31392026/11/12 11:50:56 INFO Vacuumed table table=objects31402026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=11 objects-failed-to-delete=031412026/11/12 11:50:56 INFO Received complete upload request method=POST path=/31422026/11/12 11:50:56 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."31432026/11/12 11:50:56 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."31442026/11/12 11:50:56 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."31452026/11/12 11:50:56 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."31462026/11/12 11:50:56 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."31472026/11/12 11:50:56 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."31482026/11/12 11:50:56 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."31492026/11/12 11:50:56 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."31502026/11/12 11:50:56 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."31512026/11/12 11:50:56 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."31522026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads31532026/11/12 11:50:56 INFO Vacuumed table table=pending_closures31542026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:aaaaaaaa!out.doi error="Access Denied."31552026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."31562026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts31572026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."31582026/11/12 11:50:56 INFO Vacuumed table table=closures31592026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."31602026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."31612026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."31622026/11/12 11:50:56 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."31632026/11/12 11:50:56 INFO Vacuumed table table=objects31642026/11/12 11:50:56 INFO Vacuumed table table=pending_objects31652026/11/12 11:50:56 INFO Received uploads request method=POST path=/31662026/11/12 11:50:56 INFO Received push request method=POST path=/31672026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads31682026/11/12 11:50:56 INFO Completed push id=1 objects=24 duration=46.035083ms31692026/11/12 11:50:56 INFO Completed upload id=1 objects=9 duration=31.0305ms31702026/11/12 11:50:56 INFO Vacuumed table table=closures31712026/11/12 11:50:56 INFO Received uploads request method=POST path=/31722026/11/12 11:50:56 INFO Vacuumed table table=objects31732026/11/12 11:50:56 INFO Received push request method=POST path=/31742026/11/12 11:50:56 INFO Received uploads request method=POST path=/31752026/11/12 11:50:56 INFO Received push request method=POST path=/31762026/11/12 11:50:56 INFO Received push request method=POST path=/31772026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031782026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=031792026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period31802026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031812026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=16 objects-failed-to-delete=031822026/11/12 11:50:56 INFO Vacuumed table table=pending_closures31832026/11/12 11:50:56 INFO Received complete push request method=POST path=/31842026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts31852026/11/12 11:50:56 INFO Completed push id=5 objects=3 duration=1.156084ms31862026/11/12 11:50:56 INFO Received push request method=POST path=/31872026/11/12 11:50:56 INFO Vacuumed table table=pending_closures31882026/11/12 11:50:56 INFO Vacuumed table table=pending_objects31892026/11/12 11:50:56 INFO Received push request method=POST path=/31902026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads31912026/11/12 11:50:56 INFO Received complete upload request method=POST path=/31922026/11/12 11:50:56 INFO Received complete push request method=POST path=/31932026/11/12 11:50:56 INFO Received complete push request method=POST path=/31942026/11/12 11:50:56 INFO Vacuumed table table=closures31952026/11/12 11:50:56 INFO Received complete push request method=POST path=/31962026/11/12 11:50:56 INFO Completed upload id=16 objects=17 duration=753.458µs31972026/11/12 11:50:56 INFO Completed push id=8 objects=6 duration=506.958µs31982026/11/12 11:50:56 INFO Completed push id=14 objects=4 duration=10.937708ms31992026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts32002026/11/12 11:50:56 INFO Vacuumed table table=objects32012026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=032022026/11/12 11:50:56 INFO Received push request method=POST path=/32032026/11/12 11:50:56 INFO Completed push id=1 objects=6 duration=19.424333ms32042026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period32052026/11/12 11:50:56 INFO Received uploads request method=POST path=/32062026/11/12 11:50:56 INFO Received push request method=POST path=/32072026/11/12 11:50:56 INFO Received push request method=POST path=/32082026/11/12 11:50:56 INFO Received push request method=POST path=/32092026/11/12 11:50:56 INFO Received uploads request method=POST path=/32102026/11/12 11:50:56 INFO Received uploads request method=POST path=/32112026/11/12 11:50:56 INFO Vacuumed table table=pending_objects32122026/11/12 11:50:56 INFO Received push request method=POST path=/32132026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads32142026/11/12 11:50:56 INFO Received push request method=POST path=/32152026/11/12 11:50:56 INFO Received push request method=POST path=/32162026/11/12 11:50:56 INFO Received push request method=POST path=/32172026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=032182026/11/12 11:50:56 INFO Received uploads request method=POST path=/32192026/11/12 11:50:56 INFO Vacuumed table table=closures32202026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period32212026/11/12 11:50:56 INFO Received push request method=POST path=/32222026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032232026/11/12 11:50:56 INFO Vacuumed table table=pending_closures32242026/11/12 11:50:56 INFO Received push request method=POST path=/32252026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts32262026/11/12 11:50:56 INFO Received uploads request method=POST path=/32272026/11/12 11:50:56 INFO Vacuumed table table=pending_objects32282026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads32292026/11/12 11:50:56 INFO Vacuumed table table=objects32302026/11/12 11:50:56 INFO Received push request method=POST path=/32312026/11/12 11:50:56 INFO Vacuumed table table=closures32322026/11/12 11:50:56 INFO Vacuumed table table=objects32332026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=032342026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=032352026/11/12 11:50:56 INFO Vacuumed table table=pending_closures32362026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts32372026/11/12 11:50:56 INFO Vacuumed table table=pending_objects32382026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads32392026/11/12 11:50:56 INFO Vacuumed table table=closures32402026/11/12 11:50:56 INFO Vacuumed table table=objects32412026/11/12 11:50:56 INFO Received push request method=POST path=/32422026/11/12 11:50:56 INFO Received complete upload request method=POST path=/32432026/11/12 11:50:56 INFO Received push request method=POST path=/32442026/11/12 11:50:56 INFO Received push request method=POST path=/32452026/11/12 11:50:56 INFO Completed upload id=10 objects=17 duration=554.334µs32462026/11/12 11:50:56 INFO Received uploads request method=POST path=/32472026/11/12 11:50:56 INFO Received uploads request method=POST path=/32482026/11/12 11:50:56 INFO Received push request method=POST path=/32492026/11/12 11:50:56 INFO Received uploads request method=POST path=/32502026/11/12 11:50:56 INFO Received push request method=POST path=/32512026/11/12 11:50:56 INFO Received push request method=POST path=/32522026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=032532026/11/12 11:50:56 WARN Force mode enabled - objects will be deleted immediately without grace period32542026/11/12 11:50:56 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032552026/11/12 11:50:56 INFO Received uploads request method=POST path=/32562026/11/12 11:50:56 INFO Received complete push request method=POST path=/32572026/11/12 11:50:56 INFO Vacuumed table table=pending_closures32582026/11/12 11:50:56 INFO Completed push id=14 objects=6 duration=483µs32592026/11/12 11:50:56 INFO Received uploads request method=POST path=/32602026/11/12 11:50:56 INFO Vacuumed table table=commit_receipts32612026/11/12 11:50:56 INFO Received push request method=POST path=/32622026/11/12 11:50:56 INFO Received push request method=POST path=/32632026/11/12 11:50:56 INFO Vacuumed table table=pending_objects32642026/11/12 11:50:56 INFO Aborted multipart uploads count=0 kept=032652026/11/12 11:50:56 INFO Vacuumed table table=multipart_uploads32662026/11/12 11:50:56 INFO Vacuumed table table=closures32672026/11/12 11:50:57 INFO Vacuumed table table=objects32682026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=1 objects-deleted-after-grace-period=0 objects-failed-to-delete=032692026/11/12 11:50:57 INFO Vacuumed table table=pending_closures32702026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts32712026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=032722026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032732026/11/12 11:50:57 INFO Vacuumed table table=pending_closures32742026/11/12 11:50:57 INFO Vacuumed table table=pending_objects32752026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts32762026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads32772026/11/12 11:50:57 INFO Vacuumed table table=pending_objects32782026/11/12 11:50:57 INFO Vacuumed table table=closures32792026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads32802026/11/12 11:50:57 INFO Vacuumed table table=objects32812026/11/12 11:50:57 INFO Vacuumed table table=closures32822026/11/12 11:50:57 INFO Vacuumed table table=objects32832026/11/12 11:50:57 INFO Received push request method=POST path=/32842026/11/12 11:50:57 INFO Received push request method=POST path=/32852026/11/12 11:50:57 INFO Received uploads request method=POST path=/32862026/11/12 11:50:57 INFO Received uploads request method=POST path=/32872026/11/12 11:50:57 INFO Received complete push request method=POST path=/32882026/11/12 11:50:57 INFO Completed push id=12 objects=2 duration=1.546959ms32892026/11/12 11:50:57 INFO Received uploads request method=POST path=/32902026/11/12 11:50:57 INFO Received complete push request method=POST path=/32912026/11/12 11:50:57 INFO Completed push id=2 objects=4 duration=657.417µs32922026/11/12 11:50:57 INFO Received push request method=POST path=/32932026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=032942026/11/12 11:50:57 INFO Received complete upload request method=POST path=/32952026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032962026/11/12 11:50:57 INFO Completed upload id=5 objects=7 duration=1.044917ms32972026/11/12 11:50:57 INFO Received uploads request method=POST path=/32982026/11/12 11:50:57 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."32992026/11/12 11:50:57 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."33002026/11/12 11:50:57 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."33012026/11/12 11:50:57 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."33022026/11/12 11:50:57 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."33032026/11/12 11:50:57 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."33042026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."33052026/11/12 11:50:57 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."33062026/11/12 11:50:57 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."33072026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."33082026/11/12 11:50:57 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."33092026/11/12 11:50:57 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."33102026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033112026/11/12 11:50:57 INFO Received uploads request method=POST path=/33122026/11/12 11:50:57 INFO Received uploads request method=POST path=/33132026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033142026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33152026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts33162026/11/12 11:50:57 INFO Vacuumed table table=pending_objects33172026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads33182026/11/12 11:50:57 INFO Received push request method=POST path=/33192026/11/12 11:50:57 INFO Vacuumed table table=closures33202026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33212026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033222026/11/12 11:50:57 INFO Received uploads request method=POST path=/33232026/11/12 11:50:57 INFO Received push request method=POST path=/33242026/11/12 11:50:57 INFO Vacuumed table table=objects33252026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period33262026/11/12 11:50:57 INFO Received push request method=POST path=/33272026/11/12 11:50:57 INFO Received complete upload request method=POST path=/33282026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033292026/11/12 11:50:57 INFO Received push request method=POST path=/33302026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033312026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts33322026/11/12 11:50:57 INFO Completed upload id=6 objects=9 duration=446.584µs33332026/11/12 11:50:57 INFO Received uploads request method=POST path=/33342026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=033352026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33362026/11/12 11:50:57 INFO Received uploads request method=POST path=/33372026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033382026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts33392026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033402026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33412026/11/12 11:50:57 INFO Vacuumed table table=pending_objects33422026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts33432026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33442026/11/12 11:50:57 INFO Received complete upload request method=POST path=/33452026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads33462026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts33472026/11/12 11:50:57 INFO Completed upload id=3 objects=5 duration=445.042µs33482026/11/12 11:50:57 INFO Vacuumed table table=pending_objects33492026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads33502026/11/12 11:50:57 INFO Vacuumed table table=pending_objects33512026/11/12 11:50:57 INFO Received complete push request method=POST path=/33522026/11/12 11:50:57 INFO Vacuumed table table=closures33532026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033542026/11/12 11:50:57 INFO Vacuumed table table=pending_objects33552026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads33562026/11/12 11:50:57 INFO Completed push id=16 objects=16 duration=1.551208ms33572026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads33582026/11/12 11:50:57 INFO Vacuumed table table=closures33592026/11/12 11:50:57 INFO Vacuumed table table=objects33602026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=033612026/11/12 11:50:57 INFO Received complete push request method=POST path=/33622026/11/12 11:50:57 INFO Vacuumed table table=closures33632026/11/12 11:50:57 INFO Vacuumed table table=closures33642026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033652026/11/12 11:50:57 INFO Vacuumed table table=objects33662026/11/12 11:50:57 INFO Vacuumed table table=objects33672026/11/12 11:50:57 INFO Received push request method=POST path=/33682026/11/12 11:50:57 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."33692026/11/12 11:50:57 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."33702026/11/12 11:50:57 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."33712026/11/12 11:50:57 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."33722026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."33732026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."33742026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."33752026/11/12 11:50:57 INFO Received complete upload request method=POST path=/33762026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33772026/11/12 11:50:57 INFO Received complete push request method=POST path=/33782026/11/12 11:50:57 INFO Received uploads request method=POST path=/33792026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts33802026/11/12 11:50:57 INFO Received push request method=POST path=/33812026/11/12 11:50:57 INFO Completed upload id=10 objects=2 duration=13.444666ms33822026/11/12 11:50:57 INFO Vacuumed table table=objects33832026/11/12 11:50:57 INFO Completed push id=22 objects=3 duration=12.71975ms33842026/11/12 11:50:57 INFO Received push request method=POST path=/33852026/11/12 11:50:57 INFO Received push request method=POST path=/33862026/11/12 11:50:57 INFO Vacuumed table table=pending_objects33872026/11/12 11:50:57 INFO Received uploads request method=POST path=/33882026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033892026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads33902026/11/12 11:50:57 INFO Completed push id=1 objects=8 duration=66.122042ms33912026/11/12 11:50:57 INFO Vacuumed table table=closures33922026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=033932026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=033942026/11/12 11:50:57 INFO Received push request method=POST path=/33952026/11/12 11:50:57 INFO Received uploads request method=POST path=/33962026/11/12 11:50:57 INFO Vacuumed table table=objects33972026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period33982026/11/12 11:50:57 INFO Vacuumed table table=pending_closures33992026/11/12 11:50:57 INFO Received complete push request method=POST path=/34002026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts34012026/11/12 11:50:57 INFO Completed push id=9 objects=4 duration=6.217792ms34022026/11/12 11:50:57 INFO Vacuumed table table=pending_objects34032026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads34042026/11/12 11:50:57 INFO Received uploads request method=POST path=/34052026/11/12 11:50:57 INFO Received push request method=POST path=/34062026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034072026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period34082026/11/12 11:50:57 INFO Vacuumed table table=closures34092026/11/12 11:50:57 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."34102026/11/12 11:50:57 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."34112026/11/12 11:50:57 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."34122026/11/12 11:50:57 INFO Vacuumed table table=objects34132026/11/12 11:50:57 INFO Received push request method=POST path=/34142026/11/12 11:50:57 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."34152026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."34162026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."34172026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."34182026/11/12 11:50:57 INFO Received uploads request method=POST path=/34192026/11/12 11:50:57 INFO Received complete upload request method=POST path=/34202026/11/12 11:50:57 INFO Completed upload id=21 objects=3 duration=287.167µs34212026/11/12 11:50:57 INFO Received push request method=POST path=/34222026/11/12 11:50:57 INFO Received push request method=POST path=/34232026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034242026/11/12 11:50:57 INFO Received complete push request method=POST path=/34252026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period34262026/11/12 11:50:57 INFO Completed push id=6 objects=7 duration=918.875µs34272026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=7 objects-failed-to-delete=034282026/11/12 11:50:57 INFO Received uploads request method=POST path=/34292026/11/12 11:50:57 INFO Received push request method=POST path=/34302026/11/12 11:50:57 INFO Received uploads request method=POST path=/34312026/11/12 11:50:57 INFO Received complete push request method=POST path=/34322026/11/12 11:50:57 INFO Vacuumed table table=pending_closures34332026/11/12 11:50:57 INFO Completed push id=2 objects=10 duration=4.636ms34342026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts34352026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034362026/11/12 11:50:57 INFO Received push request method=POST path=/34372026/11/12 11:50:57 INFO Received complete push request method=POST path=/34382026/11/12 11:50:57 INFO Completed push id=8 objects=7 duration=458.75µs34392026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period34402026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034412026/11/12 11:50:57 INFO Received uploads request method=POST path=/34422026/11/12 11:50:57 INFO Vacuumed table table=pending_objects34432026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034442026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads34452026/11/12 11:50:57 INFO Vacuumed table table=closures34462026/11/12 11:50:57 INFO Vacuumed table table=pending_closures34472026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts34482026/11/12 11:50:57 INFO Vacuumed table table=objects34492026/11/12 11:50:57 INFO Vacuumed table table=pending_objects34502026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads34512026/11/12 11:50:57 INFO Vacuumed table table=closures34522026/11/12 11:50:57 INFO Vacuumed table table=objects34532026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034542026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034552026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period34562026/11/12 11:50:57 WARN Force mode enabled - objects will be deleted immediately without grace period34572026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034582026/11/12 11:50:57 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034592026/11/12 11:50:57 INFO Vacuumed table table=pending_closures34602026/11/12 11:50:57 INFO Vacuumed table table=pending_closures34612026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts34622026/11/12 11:50:57 INFO Vacuumed table table=commit_receipts34632026/11/12 11:50:57 INFO Vacuumed table table=pending_objects34642026/11/12 11:50:57 INFO Vacuumed table table=pending_objects34652026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads34662026/11/12 11:50:57 INFO Vacuumed table table=multipart_uploads34672026/11/12 11:50:57 INFO Vacuumed table table=closures34682026/11/12 11:50:57 INFO Vacuumed table table=objects34692026/11/12 11:50:57 INFO Vacuumed table table=closures34702026/11/12 11:50:57 INFO Received push request method=POST path=/34712026/11/12 11:50:57 INFO Vacuumed table table=objects34722026/11/12 11:50:57 INFO Received push request method=POST path=/34732026/11/12 11:50:57 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."34742026/11/12 11:50:57 INFO Received complete push request method=POST path=/34752026/11/12 11:50:57 INFO Received uploads request method=POST path=/34762026/11/12 11:50:57 INFO Completed push id=22 objects=3 duration=1.766167ms34772026/11/12 11:50:57 INFO Received uploads request method=POST path=/34782026/11/12 11:50:57 INFO Received uploads request method=POST path=/34792026/11/12 11:50:57 INFO Received push request method=POST path=/34802026/11/12 11:50:57 INFO Received complete push request method=POST path=/34812026/11/12 11:50:57 INFO Completed push id=24 objects=3 duration=656.916µs34822026/11/12 11:50:57 INFO Aborted multipart uploads count=0 kept=034832026/11/12 11:50:58 INFO Received push request method=POST path=/34842026/11/12 11:50:58 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."34852026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."34862026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=034872026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period34882026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034892026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=034902026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period34912026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=3 objects-failed-to-delete=034922026/11/12 11:50:58 INFO Vacuumed table table=pending_closures34932026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts34942026/11/12 11:50:58 INFO Vacuumed table table=pending_closures34952026/11/12 11:50:58 INFO Received complete push request method=POST path=/34962026/11/12 11:50:58 INFO Vacuumed table table=pending_objects34972026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts34982026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads34992026/11/12 11:50:58 INFO Received complete push request method=POST path=/35002026/11/12 11:50:58 INFO Received complete upload request method=POST path=/35012026/11/12 11:50:58 INFO Completed push id=6 objects=26 duration=1.699875ms35022026/11/12 11:50:58 INFO Vacuumed table table=closures35032026/11/12 11:50:58 INFO Completed upload id=9 objects=16 duration=649.167µs35042026/11/12 11:50:58 INFO Completed push id=2 objects=25 duration=1.119375ms35052026/11/12 11:50:58 INFO Vacuumed table table=objects35062026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035072026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period35082026/11/12 11:50:58 INFO Received push request method=POST path=/35092026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035102026/11/12 11:50:58 INFO Received push request method=POST path=/35112026/11/12 11:50:58 INFO Received complete upload request method=POST path=/35122026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35132026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35142026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035152026/11/12 11:50:58 INFO Received push request method=POST path=/35162026/11/12 11:50:58 INFO Completed upload id=21 objects=7 duration=1.216208ms35172026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=035182026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35192026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35202026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035212026/11/12 11:50:58 INFO Received complete push request method=POST path=/35222026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35232026/11/12 11:50:58 INFO Received push request method=POST path=/35242026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35252026/11/12 11:50:58 INFO Vacuumed table table=closures35262026/11/12 11:50:58 INFO Completed push id=10 objects=3 duration=567.083µs35272026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35282026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35292026/11/12 11:50:58 INFO Received uploads request method=POST path=/35302026/11/12 11:50:58 INFO Vacuumed table table=objects35312026/11/12 11:50:58 INFO Received complete push request method=POST path=/35322026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35332026/11/12 11:50:58 INFO Received uploads request method=POST path=/35342026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35352026/11/12 11:50:58 INFO Received uploads request method=POST path=/35362026/11/12 11:50:58 INFO Completed push id=11 objects=8 duration=990.167µs35372026/11/12 11:50:58 INFO Vacuumed table table=closures35382026/11/12 11:50:58 INFO Received push request method=POST path=/35392026/11/12 11:50:58 INFO Received complete push request method=POST path=/35402026/11/12 11:50:58 INFO Vacuumed table table=closures35412026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35422026/11/12 11:50:58 INFO Vacuumed table table=objects35432026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035442026/11/12 11:50:58 INFO Vacuumed table table=objects35452026/11/12 11:50:58 INFO Completed push id=15 objects=24 duration=1.204917ms35462026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035472026/11/12 11:50:58 INFO Received complete upload request method=POST path=/35482026/11/12 11:50:58 INFO Completed upload id=27 objects=4 duration=844.916µs35492026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035502026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035512026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35522026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period35532026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=035542026/11/12 11:50:58 INFO Received uploads request method=POST path=/35552026/11/12 11:50:58 INFO Received complete push request method=POST path=/35562026/11/12 11:50:58 INFO Received uploads request method=POST path=/35572026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35582026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035592026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35602026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035612026/11/12 11:50:58 INFO Received uploads request method=POST path=/35622026/11/12 11:50:58 INFO Completed push id=13 objects=11 duration=453.709µs35632026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35642026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period35652026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035662026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35672026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35682026/11/12 11:50:58 INFO Received uploads request method=POST path=/35692026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35702026/11/12 11:50:58 INFO Received uploads request method=POST path=/35712026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035722026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period35732026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35742026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35752026/11/12 11:50:58 INFO Vacuumed table table=closures35762026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35772026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35782026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=035792026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35802026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35812026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35822026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35832026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period35842026/11/12 11:50:58 INFO Vacuumed table table=pending_objects35852026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35862026/11/12 11:50:58 INFO Vacuumed table table=objects35872026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35882026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads35892026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035902026/11/12 11:50:58 INFO Vacuumed table table=closures35912026/11/12 11:50:58 INFO Vacuumed table table=closures35922026/11/12 11:50:58 INFO Vacuumed table table=closures35932026/11/12 11:50:58 INFO Vacuumed table table=pending_closures35942026/11/12 11:50:58 INFO Vacuumed table table=objects35952026/11/12 11:50:58 INFO Vacuumed table table=objects35962026/11/12 11:50:58 INFO Vacuumed table table=objects35972026/11/12 11:50:58 INFO Vacuumed table table=closures35982026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts35992026/11/12 11:50:58 INFO Vacuumed table table=pending_objects36002026/11/12 11:50:58 INFO Received complete upload request method=POST path=/36012026/11/12 11:50:58 INFO Received uploads request method=POST path=/36022026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads36032026/11/12 11:50:58 INFO Received uploads request method=POST path=/36042026/11/12 11:50:58 INFO Received uploads request method=POST path=/36052026/11/12 11:50:58 INFO Completed upload id=15 objects=3 duration=745.917µs36062026/11/12 11:50:58 INFO Vacuumed table table=closures36072026/11/12 11:50:58 INFO Received uploads request method=POST path=/36082026/11/12 11:50:58 INFO Vacuumed table table=objects36092026/11/12 11:50:58 INFO Received push request method=POST path=/36102026/11/12 11:50:58 INFO Received complete upload request method=POST path=/36112026/11/12 11:50:58 INFO Received push request method=POST path=/36122026/11/12 11:50:58 INFO Received complete upload request method=POST path=/36132026/11/12 11:50:58 INFO Vacuumed table table=objects36142026/11/12 11:50:58 INFO Completed upload id=26 objects=2 duration=689.75µs36152026/11/12 11:50:58 INFO Received uploads request method=POST path=/36162026/11/12 11:50:58 INFO Received uploads request method=POST path=/36172026/11/12 11:50:58 INFO Completed upload id=6 objects=6 duration=587.167µs36182026/11/12 11:50:58 INFO Received uploads request method=POST path=/36192026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=036202026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=036212026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=036222026/11/12 11:50:58 INFO Received push request method=POST path=/36232026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036242026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period36252026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036262026/11/12 11:50:58 INFO Vacuumed table table=pending_closures36272026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts36282026/11/12 11:50:58 INFO Received push request method=POST path=/36292026/11/12 11:50:58 INFO Vacuumed table table=pending_objects36302026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=036312026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads36322026/11/12 11:50:58 INFO Vacuumed table table=closures36332026/11/12 11:50:58 INFO Received complete push request method=POST path=/36342026/11/12 11:50:58 INFO Received complete push request method=POST path=/36352026/11/12 11:50:58 INFO Vacuumed table table=pending_closures36362026/11/12 11:50:58 INFO Vacuumed table table=objects36372026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036382026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036392026/11/12 11:50:58 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."36402026/11/12 11:50:58 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.narinfo error="Access Denied."36412026/11/12 11:50:58 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."36422026/11/12 11:50:58 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."36432026/11/12 11:50:58 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."36442026/11/12 11:50:58 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."36452026/11/12 11:50:58 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."36462026/11/12 11:50:58 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."36472026/11/12 11:50:58 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."36482026/11/12 11:50:58 INFO Completed push id=16 objects=14 duration=727.75µs36492026/11/12 11:50:58 INFO Received complete upload request method=POST path=/36502026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts36512026/11/12 11:50:58 INFO Received push request method=POST path=/36522026/11/12 11:50:58 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."36532026/11/12 11:50:58 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."36542026/11/12 11:50:58 INFO Vacuumed table table=pending_closures36552026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=036562026/11/12 11:50:58 INFO Completed upload id=17 objects=6 duration=1.186791ms36572026/11/12 11:50:58 INFO Received uploads request method=POST path=/36582026/11/12 11:50:58 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."36592026/11/12 11:50:58 ERROR failed to remove object object=nar/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.nar.zst error="Access Denied."36602026/11/12 11:50:58 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."36612026/11/12 11:50:58 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."36622026/11/12 11:50:58 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."36632026/11/12 11:50:58 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."36642026/11/12 11:50:58 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."36652026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."36662026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."36672026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."36682026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."36692026/11/12 11:50:58 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."36702026/11/12 11:50:58 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."36712026/11/12 11:50:58 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."36722026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts36732026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period36742026/11/12 11:50:58 INFO Vacuumed table table=pending_closures36752026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036762026/11/12 11:50:58 INFO Received push request method=POST path=/36772026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=036782026/11/12 11:50:58 INFO Received uploads request method=POST path=/36792026/11/12 11:50:58 INFO Completed push id=1 objects=7 duration=56.4565ms36802026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts36812026/11/12 11:50:58 INFO Vacuumed table table=pending_closures36822026/11/12 11:50:58 INFO Vacuumed table table=pending_objects36832026/11/12 11:50:58 INFO Vacuumed table table=pending_objects36842026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period36852026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads36862026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts36872026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads36882026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036892026/11/12 11:50:58 INFO Vacuumed table table=closures36902026/11/12 11:50:58 INFO Vacuumed table table=pending_objects36912026/11/12 11:50:58 INFO Received uploads request method=POST path=/36922026/11/12 11:50:58 INFO Received push request method=POST path=/36932026/11/12 11:50:58 INFO Received push request method=POST path=/36942026/11/12 11:50:58 INFO Vacuumed table table=closures36952026/11/12 11:50:58 INFO Vacuumed table table=objects36962026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads36972026/11/12 11:50:58 INFO Vacuumed table table=pending_closures36982026/11/12 11:50:58 INFO Received uploads request method=POST path=/36992026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts37002026/11/12 11:50:58 INFO Vacuumed table table=closures37012026/11/12 11:50:58 INFO Vacuumed table table=objects37022026/11/12 11:50:58 INFO Received uploads request method=POST path=/37032026/11/12 11:50:58 INFO Vacuumed table table=pending_objects37042026/11/12 11:50:58 INFO Received push request method=POST path=/37052026/11/12 11:50:58 INFO Vacuumed table table=objects37062026/11/12 11:50:58 INFO Received complete push request method=POST path=/37072026/11/12 11:50:58 INFO Received push request method=POST path=/37082026/11/12 11:50:58 INFO Received push request method=POST path=/37092026/11/12 11:50:58 INFO Vacuumed table table=pending_objects37102026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads37112026/11/12 11:50:58 INFO Completed push id=4 objects=4 duration=1.368416ms37122026/11/12 11:50:58 INFO Received push request method=POST path=/37132026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037142026/11/12 11:50:58 INFO Received uploads request method=POST path=/37152026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads37162026/11/12 11:50:58 INFO Vacuumed table table=closures37172026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037182026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037192026/11/12 11:50:58 INFO Received complete upload request method=POST path=/37202026/11/12 11:50:58 INFO Vacuumed table table=closures37212026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037222026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."37232026/11/12 11:50:58 INFO Vacuumed table table=pending_closures37242026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period37252026/11/12 11:50:58 INFO Completed upload id=15 objects=9 duration=213.084µs37262026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts37272026/11/12 11:50:58 INFO Vacuumed table table=objects37282026/11/12 11:50:58 INFO Vacuumed table table=pending_objects37292026/11/12 11:50:58 INFO Vacuumed table table=objects37302026/11/12 11:50:58 INFO Received complete push request method=POST path=/37312026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads37322026/11/12 11:50:58 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."37332026/11/12 11:50:58 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."37342026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."37352026/11/12 11:50:58 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."37362026/11/12 11:50:58 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."37372026/11/12 11:50:58 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."37382026/11/12 11:50:58 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."37392026/11/12 11:50:58 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."37402026/11/12 11:50:58 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."37412026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."37422026/11/12 11:50:58 INFO Vacuumed table table=closures37432026/11/12 11:50:58 INFO Completed push id=13 objects=6 duration=1.081959ms37442026/11/12 11:50:58 INFO Received push request method=POST path=/37452026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."37462026/11/12 11:50:58 INFO Vacuumed table table=objects37472026/11/12 11:50:58 INFO Received push request method=POST path=/37482026/11/12 11:50:58 INFO Received push request method=POST path=/37492026/11/12 11:50:58 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."37502026/11/12 11:50:58 INFO Received push request method=POST path=/37512026/11/12 11:50:58 INFO Received push request method=POST path=/37522026/11/12 11:50:58 INFO Received push request method=POST path=/37532026/11/12 11:50:58 INFO Received uploads request method=POST path=/37542026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037552026/11/12 11:50:58 INFO Received complete push request method=POST path=/37562026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period37572026/11/12 11:50:58 INFO Completed push id=28 objects=11 duration=5.861542ms37582026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=9 objects-failed-to-delete=037592026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037602026/11/12 11:50:58 INFO Received uploads request method=POST path=/37612026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period37622026/11/12 11:50:58 INFO Received complete upload request method=POST path=/37632026/11/12 11:50:58 INFO Received complete push request method=POST path=/37642026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037652026/11/12 11:50:58 INFO Completed upload id=25 objects=6 duration=487.375µs37662026/11/12 11:50:58 INFO Vacuumed table table=pending_closures37672026/11/12 11:50:58 INFO Completed push id=21 objects=17 duration=505.834µs37682026/11/12 11:50:58 INFO Vacuumed table table=pending_closures37692026/11/12 11:50:58 INFO Received complete push request method=POST path=/37702026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts37712026/11/12 11:50:58 INFO Received push request method=POST path=/37722026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts37732026/11/12 11:50:58 INFO Completed push id=6 objects=6 duration=579.541µs37742026/11/12 11:50:58 INFO Received complete push request method=POST path=/37752026/11/12 11:50:58 INFO Completed push id=19 objects=7 duration=617.375µs37762026/11/12 11:50:58 INFO Vacuumed table table=pending_objects37772026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads37782026/11/12 11:50:58 INFO Vacuumed table table=pending_objects37792026/11/12 11:50:58 INFO Received push request method=POST path=/37802026/11/12 11:50:58 INFO Received uploads request method=POST path=/37812026/11/12 11:50:58 INFO Received push request method=POST path=/37822026/11/12 11:50:58 INFO Vacuumed table table=closures37832026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads37842026/11/12 11:50:58 INFO Received complete push request method=POST path=/37852026/11/12 11:50:58 INFO Vacuumed table table=objects37862026/11/12 11:50:58 INFO Vacuumed table table=closures37872026/11/12 11:50:58 INFO Completed push id=11 objects=9 duration=421.5µs37882026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037892026/11/12 11:50:58 INFO Vacuumed table table=objects37902026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period37912026/11/12 11:50:58 INFO Aborted multipart uploads count=0 kept=037922026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037932026/11/12 11:50:58 WARN Force mode enabled - objects will be deleted immediately without grace period37942026/11/12 11:50:58 INFO Vacuumed table table=pending_closures37952026/11/12 11:50:58 INFO Vacuumed table table=commit_receipts37962026/11/12 11:50:58 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037972026/11/12 11:50:58 INFO Vacuumed table table=pending_objects37982026/11/12 11:50:58 INFO Vacuumed table table=pending_closures37992026/11/12 11:50:58 INFO Received push request method=POST path=/38002026/11/12 11:50:58 INFO Vacuumed table table=multipart_uploads38012026/11/12 11:50:58 INFO Vacuumed table table=closures38022026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts38032026/11/12 11:50:59 INFO Vacuumed table table=pending_objects38042026/11/12 11:50:59 INFO Vacuumed table table=objects38052026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads38062026/11/12 11:50:59 INFO Vacuumed table table=closures38072026/11/12 11:50:59 INFO Received uploads request method=POST path=/38082026/11/12 11:50:59 INFO Received complete push request method=POST path=/38092026/11/12 11:50:59 INFO Received push request method=POST path=/38102026/11/12 11:50:59 INFO Vacuumed table table=objects38112026/11/12 11:50:59 INFO Completed push id=15 objects=24 duration=766.084µs38122026/11/12 11:50:59 INFO Received push request method=POST path=/38132026/11/12 11:50:59 INFO Received uploads request method=POST path=/38142026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38152026/11/12 11:50:59 INFO Received uploads request method=POST path=/38162026/11/12 11:50:59 INFO Completed upload id=19 objects=2 duration=267.917µs38172026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38182026/11/12 11:50:59 INFO Received push request method=POST path=/38192026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38202026/11/12 11:50:59 INFO Completed upload id=2 objects=10 duration=427.042µs38212026/11/12 11:50:59 INFO Received complete push request method=POST path=/38222026/11/12 11:50:59 INFO Completed upload id=24 objects=7 duration=479µs38232026/11/12 11:50:59 INFO Received push request method=POST path=/38242026/11/12 11:50:59 INFO Completed push id=17 objects=22 duration=722.042µs38252026/11/12 11:50:59 INFO Received complete push request method=POST path=/38262026/11/12 11:50:59 INFO Received uploads request method=POST path=/38272026/11/12 11:50:59 INFO Completed push id=26 objects=3 duration=6.643083ms38282026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38292026/11/12 11:50:59 INFO Completed upload id=28 objects=8 duration=311.041µs38302026/11/12 11:50:59 INFO Received push request method=POST path=/38312026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38322026/11/12 11:50:59 INFO Received complete push request method=POST path=/38332026/11/12 11:50:59 INFO Completed upload id=29 objects=10 duration=176.25µs38342026/11/12 11:50:59 INFO Completed push id=19 objects=14 duration=497.208µs38352026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38362026/11/12 11:50:59 INFO Completed upload id=30 objects=20 duration=293.625µs38372026/11/12 11:50:59 INFO Received uploads request method=POST path=/38382026/11/12 11:50:59 INFO Received complete push request method=POST path=/38392026/11/12 11:50:59 INFO Completed push id=31 objects=11 duration=388.833µs38402026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38412026/11/12 11:50:59 INFO Completed upload id=32 objects=2 duration=200.916µs38422026/11/12 11:50:59 INFO Received complete push request method=POST path=/38432026/11/12 11:50:59 INFO Completed push id=33 objects=3 duration=343.083µs38442026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38452026/11/12 11:50:59 INFO Completed upload id=34 objects=3 duration=202.459µs38462026/11/12 11:50:59 INFO Received complete push request method=POST path=/38472026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=038482026/11/12 11:50:59 INFO Completed push id=29 objects=24 duration=6.172ms38492026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period38502026/11/12 11:50:59 INFO Received complete push request method=POST path=/38512026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038522026/11/12 11:50:59 INFO Completed push id=7 objects=27 duration=6.834542ms38532026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=038542026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period38552026/11/12 11:50:59 INFO Vacuumed table table=pending_closures38562026/11/12 11:50:59 INFO Received complete push request method=POST path=/38572026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=038582026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts38592026/11/12 11:50:59 INFO Completed push id=17 objects=6 duration=775.417µs38602026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38612026/11/12 11:50:59 INFO Vacuumed table table=pending_objects38622026/11/12 11:50:59 INFO Completed upload id=12 objects=26 duration=4.547875ms38632026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads38642026/11/12 11:50:59 INFO Vacuumed table table=closures38652026/11/12 11:50:59 INFO Received uploads request method=POST path=/38662026/11/12 11:50:59 INFO Vacuumed table table=pending_closures38672026/11/12 11:50:59 INFO Vacuumed table table=objects38682026/11/12 11:50:59 INFO Received complete push request method=POST path=/38692026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38702026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts38712026/11/12 11:50:59 INFO Completed push id=16 objects=8 duration=513.25µs38722026/11/12 11:50:59 INFO Completed upload id=20 objects=6 duration=407.958µs38732026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38742026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=038752026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period38762026/11/12 11:50:59 INFO Completed upload id=23 objects=16 duration=5.463208ms38772026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038782026/11/12 11:50:59 INFO Received uploads request method=POST path=/38792026/11/12 11:50:59 INFO Vacuumed table table=pending_closures38802026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=038812026/11/12 11:50:59 INFO Vacuumed table table=pending_objects38822026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts38832026/11/12 11:50:59 INFO Received complete upload request method=POST path=/38842026/11/12 11:50:59 INFO Completed upload id=21 objects=2 duration=300.291µs38852026/11/12 11:50:59 INFO Vacuumed table table=pending_objects38862026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads38872026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period38882026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads38892026/11/12 11:50:59 INFO Received uploads request method=POST path=/38902026/11/12 11:50:59 INFO Vacuumed table table=closures38912026/11/12 11:50:59 INFO Vacuumed table table=closures38922026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038932026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=038942026/11/12 11:50:59 INFO Vacuumed table table=pending_closures38952026/11/12 11:50:59 INFO Vacuumed table table=objects38962026/11/12 11:50:59 INFO Vacuumed table table=objects38972026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period38982026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts38992026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039002026/11/12 11:50:59 INFO Received complete upload request method=POST path=/39012026/11/12 11:50:59 INFO Vacuumed table table=pending_objects39022026/11/12 11:50:59 INFO Vacuumed table table=pending_closures39032026/11/12 11:50:59 INFO Completed upload id=19 objects=25 duration=5.648833ms39042026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads39052026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts39062026/11/12 11:50:59 INFO Vacuumed table table=closures39072026/11/12 11:50:59 INFO Vacuumed table table=pending_objects39082026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=039092026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads39102026/11/12 11:50:59 INFO Vacuumed table table=objects39112026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period39122026/11/12 11:50:59 INFO Vacuumed table table=closures39132026/11/12 11:50:59 INFO Received complete upload request method=POST path=/39142026/11/12 11:50:59 INFO Completed upload id=3 objects=9 duration=510.458µs39152026/11/12 11:50:59 INFO Vacuumed table table=objects39162026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=039172026/11/12 11:50:59 INFO Vacuumed table table=pending_closures39182026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts39192026/11/12 11:50:59 INFO Received uploads request method=POST path=/39202026/11/12 11:50:59 INFO Vacuumed table table=pending_objects39212026/11/12 11:50:59 INFO Received uploads request method=POST path=/39222026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads39232026/11/12 11:50:59 INFO Received push request method=POST path=/39242026/11/12 11:50:59 INFO Received complete push request method=POST path=/39252026/11/12 11:50:59 INFO Vacuumed table table=closures39262026/11/12 11:50:59 INFO Completed push id=3 objects=5 duration=544.375µs39272026/11/12 11:50:59 INFO Received complete push request method=POST path=/39282026/11/12 11:50:59 INFO Received complete push request method=POST path=/39292026/11/12 11:50:59 INFO Received complete push request method=POST path=/39302026/11/12 11:50:59 INFO Vacuumed table table=objects39312026/11/12 11:50:59 INFO Completed push id=24 objects=24 duration=1.216625ms39322026/11/12 11:50:59 INFO Received push request method=POST path=/39332026/11/12 11:50:59 INFO Completed push id=17 objects=22 duration=571.792µs39342026/11/12 11:50:59 INFO Completed push id=11 objects=6 duration=1.007125ms39352026/11/12 11:50:59 INFO Received complete push request method=POST path=/39362026/11/12 11:50:59 INFO Received push request method=POST path=/39372026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=039382026/11/12 11:50:59 INFO Received uploads request method=POST path=/39392026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period39402026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039412026/11/12 11:50:59 INFO Received complete push request method=POST path=/39422026/11/12 11:50:59 INFO Vacuumed table table=pending_closures39432026/11/12 11:50:59 INFO Received uploads request method=POST path=/39442026/11/12 11:50:59 INFO Completed push id=4 objects=7 duration=420.417µs39452026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts39462026/11/12 11:50:59 INFO Completed push id=3 objects=22 duration=48.345667ms39472026/11/12 11:50:59 INFO Received uploads request method=POST path=/39482026/11/12 11:50:59 INFO Received complete push request method=POST path=/39492026/11/12 11:50:59 INFO Received push request method=POST path=/39502026/11/12 11:50:59 INFO Vacuumed table table=pending_objects39512026/11/12 11:50:59 INFO Received uploads request method=POST path=/39522026/11/12 11:50:59 INFO Received push request method=POST path=/39532026/11/12 11:50:59 INFO Completed push id=5 objects=6 duration=929.75µs39542026/11/12 11:50:59 INFO Received push request method=POST path=/39552026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads39562026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=039572026/11/12 11:50:59 INFO Received push request method=POST path=/39582026/11/12 11:50:59 INFO Received uploads request method=POST path=/39592026/11/12 11:50:59 INFO Vacuumed table table=closures39602026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period39612026/11/12 11:50:59 INFO Received complete push request method=POST path=/39622026/11/12 11:50:59 INFO Vacuumed table table=objects39632026/11/12 11:50:59 INFO Completed push id=16 objects=4 duration=7.039625ms39642026/11/12 11:50:59 INFO Received complete push request method=POST path=/39652026/11/12 11:50:59 INFO Received uploads request method=POST path=/39662026/11/12 11:50:59 INFO Completed push id=18 objects=6 duration=402.958µs39672026/11/12 11:50:59 INFO Received uploads request method=POST path=/39682026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=039692026/11/12 11:50:59 INFO Received uploads request method=POST path=/39702026/11/12 11:50:59 INFO Received complete upload request method=POST path=/39712026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039722026/11/12 11:50:59 INFO Received complete push request method=POST path=/39732026/11/12 11:50:59 INFO Completed upload id=20 objects=5 duration=273.541µs39742026/11/12 11:50:59 INFO Received push request method=POST path=/39752026/11/12 11:50:59 INFO Vacuumed table table=pending_closures39762026/11/12 11:50:59 INFO Completed push id=4 objects=4 duration=597.625µs39772026/11/12 11:50:59 INFO Received uploads request method=POST path=/39782026/11/12 11:50:59 INFO Received uploads request method=POST path=/39792026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts39802026/11/12 11:50:59 INFO Vacuumed table table=pending_objects39812026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads39822026/11/12 11:50:59 INFO Received push request method=POST path=/39832026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=039842026/11/12 11:50:59 INFO Vacuumed table table=closures39852026/11/12 11:50:59 INFO Received push request method=POST path=/39862026/11/12 11:50:59 INFO Received push request method=POST path=/39872026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period39882026/11/12 11:50:59 INFO Vacuumed table table=objects39892026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039902026/11/12 11:50:59 INFO Received complete push request method=POST path=/39912026/11/12 11:50:59 INFO Received push request method=POST path=/39922026/11/12 11:50:59 INFO Received complete upload request method=POST path=/39932026/11/12 11:50:59 INFO Vacuumed table table=pending_closures39942026/11/12 11:50:59 INFO Completed push id=5 objects=3 duration=660.167µs39952026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts39962026/11/12 11:50:59 INFO Completed upload id=20 objects=3 duration=1.056666ms39972026/11/12 11:50:59 INFO Vacuumed table table=pending_objects39982026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=039992026/11/12 11:50:59 INFO Received complete push request method=POST path=/40002026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=040012026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads40022026/11/12 11:50:59 WARN Force mode enabled - objects will be deleted immediately without grace period40032026/11/12 11:50:59 INFO Received push request method=POST path=/40042026/11/12 11:50:59 INFO Completed push id=13 objects=12 duration=926.042µs40052026/11/12 11:50:59 INFO Vacuumed table table=closures40062026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040072026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=040082026/11/12 11:50:59 INFO Vacuumed table table=objects40092026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=4 objects-deleted-after-grace-period=0 objects-failed-to-delete=040102026/11/12 11:50:59 INFO Received complete upload request method=POST path=/40112026/11/12 11:50:59 INFO Vacuumed table table=pending_closures40122026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts40132026/11/12 11:50:59 INFO Completed upload id=24 objects=7 duration=6.956458ms40142026/11/12 11:50:59 INFO Vacuumed table table=pending_objects40152026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=040162026/11/12 11:50:59 INFO Received push request method=POST path=/40172026/11/12 11:50:59 INFO Vacuumed table table=multipart_uploads40182026/11/12 11:50:59 INFO Aborted multipart uploads count=0 kept=040192026/11/12 11:50:59 INFO Vacuumed table table=pending_closures40202026/11/12 11:50:59 INFO Vacuumed table table=closures40212026/11/12 11:50:59 INFO Vacuumed table table=commit_receipts40222026/11/12 11:50:59 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040232026/11/12 11:50:59 INFO Received complete upload request method=POST path=/40242026/11/12 11:50:59 INFO Vacuumed table table=pending_objects40252026/11/12 11:50:59 INFO Vacuumed table table=pending_closures40262026/11/12 11:50:59 INFO Vacuumed table table=objects40272026/11/12 11:50:59 INFO Completed upload id=2 objects=2 duration=388.166µs40282026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads40292026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts40302026/11/12 11:51:00 INFO Vacuumed table table=closures40312026/11/12 11:51:00 INFO Vacuumed table table=pending_objects40322026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=040332026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads40342026/11/12 11:51:00 INFO Vacuumed table table=pending_closures40352026/11/12 11:51:00 INFO Vacuumed table table=objects40362026/11/12 11:51:00 INFO Vacuumed table table=closures40372026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040382026/11/12 11:51:00 INFO Vacuumed table table=pending_closures40392026/11/12 11:51:00 INFO Vacuumed table table=objects40402026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts40412026/11/12 11:51:00 INFO Vacuumed table table=pending_objects40422026/11/12 11:51:00 INFO Received complete upload request method=POST path=/40432026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads40442026/11/12 11:51:00 INFO Received push request method=POST path=/40452026/11/12 11:51:00 INFO Received uploads request method=POST path=/40462026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts40472026/11/12 11:51:00 INFO Vacuumed table table=closures40482026/11/12 11:51:00 INFO Completed upload id=23 objects=7 duration=6.529042ms40492026/11/12 11:51:00 INFO Vacuumed table table=objects40502026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=040512026/11/12 11:51:00 INFO Received complete upload request method=POST path=/40522026/11/12 11:51:00 INFO Received complete upload request method=POST path=/40532026/11/12 11:51:00 INFO Received complete push request method=POST path=/40542026/11/12 11:51:00 INFO Completed upload id=26 objects=5 duration=664.917µs40552026/11/12 11:51:00 INFO Completed upload id=3 objects=25 duration=1.133125ms40562026/11/12 11:51:00 INFO Completed push id=6 objects=5 duration=1.164333ms40572026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period40582026/11/12 11:51:00 INFO Received push request method=POST path=/40592026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040602026/11/12 11:51:00 INFO Vacuumed table table=pending_closures40612026/11/12 11:51:00 INFO Vacuumed table table=pending_objects40622026/11/12 11:51:00 INFO Received push request method=POST path=/40632026/11/12 11:51:00 INFO Received complete push request method=POST path=/40642026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=040652026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts40662026/11/12 11:51:00 INFO Completed push id=27 objects=3 duration=8.1185ms40672026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads40682026/11/12 11:51:00 INFO Received push request method=POST path=/40692026/11/12 11:51:00 INFO Received push request method=POST path=/40702026/11/12 11:51:00 INFO Received complete upload request method=POST path=/40712026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period40722026/11/12 11:51:00 INFO Vacuumed table table=pending_objects40732026/11/12 11:51:00 INFO Completed upload id=28 objects=5 duration=7.276583ms40742026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads40752026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=040762026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=3 objects-failed-to-delete=040772026/11/12 11:51:00 INFO Received push request method=POST path=/40782026/11/12 11:51:00 INFO Vacuumed table table=closures40792026/11/12 11:51:00 INFO Vacuumed table table=closures40802026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period40812026/11/12 11:51:00 INFO Vacuumed table table=objects40822026/11/12 11:51:00 INFO Received complete push request method=POST path=/40832026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040842026/11/12 11:51:00 INFO Completed push id=29 objects=17 duration=536.875µs40852026/11/12 11:51:00 INFO Vacuumed table table=pending_closures40862026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts40872026/11/12 11:51:00 INFO Vacuumed table table=pending_closures40882026/11/12 11:51:00 INFO Received uploads request method=POST path=/40892026/11/12 11:51:00 INFO Vacuumed table table=objects40902026/11/12 11:51:00 INFO Vacuumed table table=pending_objects40912026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=040922026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads40932026/11/12 11:51:00 INFO Vacuumed table table=closures40942026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period40952026/11/12 11:51:00 INFO Vacuumed table table=objects40962026/11/12 11:51:00 INFO Received push request method=POST path=/40972026/11/12 11:51:00 INFO Received push request method=POST path=/40982026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040992026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41002026/11/12 11:51:00 INFO Received push request method=POST path=/41012026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041022026/11/12 11:51:00 INFO Received push request method=POST path=/41032026/11/12 11:51:00 INFO Vacuumed table table=pending_closures41042026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041052026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41062026/11/12 11:51:00 INFO Received complete push request method=POST path=/41072026/11/12 11:51:00 INFO Vacuumed table table=pending_closures41082026/11/12 11:51:00 INFO Received uploads request method=POST path=/41092026/11/12 11:51:00 INFO Completed push id=31 objects=14 duration=821.125µs41102026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41112026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41122026/11/12 11:51:00 INFO Received complete push request method=POST path=/41132026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41142026/11/12 11:51:00 INFO Received uploads request method=POST path=/41152026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41162026/11/12 11:51:00 INFO Completed push id=23 objects=28 duration=2.21ms41172026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41182026/11/12 11:51:00 INFO Vacuumed table table=closures41192026/11/12 11:51:00 INFO Received push request method=POST path=/41202026/11/12 11:51:00 INFO Vacuumed table table=closures41212026/11/12 11:51:00 INFO Received complete upload request method=POST path=/41222026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41232026/11/12 11:51:00 INFO Vacuumed table table=objects41242026/11/12 11:51:00 INFO Received uploads request method=POST path=/41252026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41262026/11/12 11:51:00 INFO Completed upload id=27 objects=8 duration=438.459µs41272026/11/12 11:51:00 INFO Received uploads request method=POST path=/41282026/11/12 11:51:00 INFO Received uploads request method=POST path=/41292026/11/12 11:51:00 INFO Received push request method=POST path=/41302026/11/12 11:51:00 INFO Vacuumed table table=objects41312026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041322026/11/12 11:51:00 INFO Vacuumed table table=closures41332026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041342026/11/12 11:51:00 INFO Vacuumed table table=pending_closures41352026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41362026/11/12 11:51:00 INFO Received uploads request method=POST path=/41372026/11/12 11:51:00 INFO Received push request method=POST path=/41382026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41392026/11/12 11:51:00 INFO Vacuumed table table=objects41402026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41412026/11/12 11:51:00 INFO Vacuumed table table=closures41422026/11/12 11:51:00 INFO Vacuumed table table=objects41432026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041442026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041452026/11/12 11:51:00 INFO Vacuumed table table=pending_closures41462026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41472026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41482026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41492026/11/12 11:51:00 INFO Received complete push request method=POST path=/41502026/11/12 11:51:00 INFO Received uploads request method=POST path=/41512026/11/12 11:51:00 INFO Vacuumed table table=closures41522026/11/12 11:51:00 INFO Received complete push request method=POST path=/41532026/11/12 11:51:00 INFO Vacuumed table table=objects41542026/11/12 11:51:00 INFO Completed push id=7 objects=7 duration=394.625µs41552026/11/12 11:51:00 INFO Completed push id=19 objects=6 duration=1.008916ms41562026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041572026/11/12 11:51:00 INFO Received complete push request method=POST path=/41582026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period41592026/11/12 11:51:00 INFO Received uploads request method=POST path=/41602026/11/12 11:51:00 INFO Received complete upload request method=POST path=/41612026/11/12 11:51:00 INFO Completed push id=6 objects=8 duration=1.055959ms41622026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041632026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041642026/11/12 11:51:00 INFO Vacuumed table table=pending_closures41652026/11/12 11:51:00 INFO Completed upload id=25 objects=16 duration=1.171625ms41662026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period41672026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41682026/11/12 11:51:00 INFO Received complete push request method=POST path=/41692026/11/12 11:51:00 INFO Received uploads request method=POST path=/41702026/11/12 11:51:00 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."41712026/11/12 11:51:00 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."41722026/11/12 11:51:00 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."41732026/11/12 11:51:00 INFO Completed push id=7 objects=15 duration=1.45475ms41742026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41752026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041762026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041772026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41782026/11/12 11:51:00 INFO Received uploads request method=POST path=/41792026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period41802026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period41812026/11/12 11:51:00 INFO Vacuumed table table=closures41822026/11/12 11:51:00 INFO Received push request method=POST path=/41832026/11/12 11:51:00 INFO Received uploads request method=POST path=/41842026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041852026/11/12 11:51:00 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."41862026/11/12 11:51:00 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."41872026/11/12 11:51:00 INFO Received complete upload request method=POST path=/41882026/11/12 11:51:00 INFO Received push request method=POST path=/41892026/11/12 11:51:00 INFO Vacuumed table table=objects41902026/11/12 11:51:00 INFO Vacuumed table table=pending_closures41912026/11/12 11:51:00 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."41922026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts41932026/11/12 11:51:00 INFO Completed upload id=7 objects=4 duration=376.25µs41942026/11/12 11:51:00 INFO Received push request method=POST path=/41952026/11/12 11:51:00 INFO Vacuumed table table=pending_objects41962026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads41972026/11/12 11:51:00 INFO Received push request method=POST path=/41982026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=041992026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042002026/11/12 11:51:00 INFO Vacuumed table table=pending_closures42012026/11/12 11:51:00 INFO Vacuumed table table=closures42022026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts42032026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042042026/11/12 11:51:00 INFO Vacuumed table table=objects42052026/11/12 11:51:00 INFO Vacuumed table table=pending_objects42062026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period42072026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads42082026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042092026/11/12 11:51:00 INFO Vacuumed table table=closures42102026/11/12 11:51:00 INFO Received push request method=POST path=/42112026/11/12 11:51:00 INFO Vacuumed table table=pending_closures42122026/11/12 11:51:00 INFO Vacuumed table table=objects42132026/11/12 11:51:00 INFO Received push request method=POST path=/42142026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts42152026/11/12 11:51:00 INFO Received push request method=POST path=/42162026/11/12 11:51:00 INFO Vacuumed table table=pending_objects42172026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads42182026/11/12 11:51:00 INFO Vacuumed table table=closures42192026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042202026/11/12 11:51:00 INFO Received uploads request method=POST path=/42212026/11/12 11:51:00 INFO Vacuumed table table=objects42222026/11/12 11:51:00 INFO Received complete upload request method=POST path=/42232026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042242026/11/12 11:51:00 INFO Received complete upload request method=POST path=/42252026/11/12 11:51:00 INFO Completed upload id=10 objects=6 duration=752.458µs42262026/11/12 11:51:00 INFO Vacuumed table table=pending_closures42272026/11/12 11:51:00 INFO Received uploads request method=POST path=/42282026/11/12 11:51:00 INFO Completed upload id=22 objects=5 duration=690.917µs42292026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts42302026/11/12 11:51:00 INFO Received push request method=POST path=/42312026/11/12 11:51:00 INFO Received complete upload request method=POST path=/42322026/11/12 11:51:00 INFO Received complete push request method=POST path=/42332026/11/12 11:51:00 INFO Received complete push request method=POST path=/42342026/11/12 11:51:00 INFO Completed push id=8 objects=6 duration=571.709µs42352026/11/12 11:51:00 INFO Completed upload id=9 objects=7 duration=10.269625ms42362026/11/12 11:51:00 INFO Vacuumed table table=pending_objects42372026/11/12 11:51:00 INFO Completed push id=28 objects=3 duration=10.269583ms42382026/11/12 11:51:00 INFO Received complete upload request method=POST path=/42392026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads42402026/11/12 11:51:00 INFO Completed upload id=7 objects=10 duration=452.916µs42412026/11/12 11:51:00 INFO Received complete push request method=POST path=/42422026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042432026/11/12 11:51:00 INFO Vacuumed table table=closures42442026/11/12 11:51:00 INFO Completed push id=29 objects=15 duration=678µs42452026/11/12 11:51:00 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."42462026/11/12 11:51:00 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."42472026/11/12 11:51:00 INFO Vacuumed table table=objects42482026/11/12 11:51:00 INFO Received complete push request method=POST path=/42492026/11/12 11:51:00 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."42502026/11/12 11:51:00 INFO Completed push id=30 objects=6 duration=427.875µs42512026/11/12 11:51:00 INFO Received push request method=POST path=/42522026/11/12 11:51:00 INFO Received complete upload request method=POST path=/42532026/11/12 11:51:00 INFO Completed upload id=31 objects=3 duration=242.25µs42542026/11/12 11:51:00 INFO Received uploads request method=POST path=/42552026/11/12 11:51:00 INFO Received uploads request method=POST path=/42562026/11/12 11:51:00 INFO Received complete push request method=POST path=/42572026/11/12 11:51:00 INFO Received complete upload request method=POST path=/42582026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042592026/11/12 11:51:00 INFO Completed push id=7 objects=7 duration=446.584µs42602026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042612026/11/12 11:51:00 INFO Completed upload id=18 objects=11 duration=637.25µs42622026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period42632026/11/12 11:51:00 INFO Received complete push request method=POST path=/42642026/11/12 11:51:00 INFO Received complete push request method=POST path=/42652026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042662026/11/12 11:51:00 INFO Received uploads request method=POST path=/42672026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042682026/11/12 11:51:00 INFO Completed push id=12 objects=6 duration=257.958µs42692026/11/12 11:51:00 INFO Completed push id=10 objects=2 duration=492.708µs42702026/11/12 11:51:00 INFO Vacuumed table table=pending_closures42712026/11/12 11:51:00 INFO Received complete push request method=POST path=/42722026/11/12 11:51:00 INFO Received push request method=POST path=/42732026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts42742026/11/12 11:51:00 INFO Completed push id=12 objects=7 duration=752.167µs42752026/11/12 11:51:00 INFO Vacuumed table table=pending_closures42762026/11/12 11:51:00 INFO Vacuumed table table=pending_objects42772026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042782026/11/12 11:51:00 INFO Aborted multipart uploads count=0 kept=042792026/11/12 11:51:00 INFO Vacuumed table table=commit_receipts42802026/11/12 11:51:00 INFO Vacuumed table table=multipart_uploads42812026/11/12 11:51:00 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=042822026/11/12 11:51:00 WARN Force mode enabled - objects will be deleted immediately without grace period42832026/11/12 11:51:00 INFO Vacuumed table table=closures42842026/11/12 11:51:00 INFO Vacuumed table table=objects42852026/11/12 11:51:00 INFO Vacuumed table table=pending_objects42862026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads42872026/11/12 11:51:01 INFO Received complete upload request method=POST path=/42882026/11/12 11:51:01 INFO Vacuumed table table=closures42892026/11/12 11:51:01 INFO Received complete upload request method=POST path=/42902026/11/12 11:51:01 INFO Completed upload id=12 objects=21 duration=11.210666ms42912026/11/12 11:51:01 INFO Vacuumed table table=objects42922026/11/12 11:51:01 INFO Vacuumed table table=pending_closures42932026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=042942026/11/12 11:51:01 INFO Received push request method=POST path=/42952026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts42962026/11/12 11:51:01 INFO Completed upload id=2 objects=26 duration=40.853833ms42972026/11/12 11:51:01 INFO Vacuumed table table=pending_closures42982026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts42992026/11/12 11:51:01 INFO Received push request method=POST path=/43002026/11/12 11:51:01 INFO Vacuumed table table=pending_objects43012026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads43022026/11/12 11:51:01 INFO Vacuumed table table=pending_objects43032026/11/12 11:51:01 INFO Vacuumed table table=closures43042026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads43052026/11/12 11:51:01 INFO Received complete push request method=POST path=/43062026/11/12 11:51:01 INFO Received push request method=POST path=/43072026/11/12 11:51:01 INFO Vacuumed table table=objects43082026/11/12 11:51:01 INFO Vacuumed table table=closures43092026/11/12 11:51:01 INFO Completed push id=13 objects=23 duration=735.083µs43102026/11/12 11:51:01 INFO Received push request method=POST path=/43112026/11/12 11:51:01 INFO Received complete push request method=POST path=/43122026/11/12 11:51:01 INFO Vacuumed table table=objects43132026/11/12 11:51:01 INFO Completed push id=9 objects=7 duration=2.076792ms43142026/11/12 11:51:01 INFO Received uploads request method=POST path=/43152026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=043162026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=1 objects-deleted-after-grace-period=0 objects-failed-to-delete=043172026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=043182026/11/12 11:51:01 INFO Vacuumed table table=pending_closures43192026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=043202026/11/12 11:51:01 INFO Received uploads request method=POST path=/43212026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=043222026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043232026/11/12 11:51:01 INFO Vacuumed table table=pending_closures43242026/11/12 11:51:01 INFO Vacuumed table table=pending_closures43252026/11/12 11:51:01 INFO Received uploads request method=POST path=/43262026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts43272026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts43282026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts43292026/11/12 11:51:01 INFO Vacuumed table table=pending_objects43302026/11/12 11:51:01 INFO Received uploads request method=POST path=/43312026/11/12 11:51:01 INFO Vacuumed table table=pending_objects43322026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads43332026/11/12 11:51:01 INFO Vacuumed table table=pending_objects43342026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads43352026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads43362026/11/12 11:51:01 INFO Vacuumed table table=closures43372026/11/12 11:51:01 INFO Received push request method=POST path=/43382026/11/12 11:51:01 INFO Vacuumed table table=closures43392026/11/12 11:51:01 INFO Vacuumed table table=objects43402026/11/12 11:51:01 INFO Vacuumed table table=objects43412026/11/12 11:51:01 INFO Received push request method=POST path=/43422026/11/12 11:51:01 INFO Received uploads request method=POST path=/43432026/11/12 11:51:01 INFO Received push request method=POST path=/43442026/11/12 11:51:01 INFO Received push request method=POST path=/43452026/11/12 11:51:01 INFO Received complete push request method=POST path=/43462026/11/12 11:51:01 INFO Received complete upload request method=POST path=/43472026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=043482026/11/12 11:51:01 INFO Vacuumed table table=closures43492026/11/12 11:51:01 INFO Completed push id=8 objects=6 duration=5.873583ms43502026/11/12 11:51:01 INFO Completed upload id=10 objects=7 duration=5.832292ms43512026/11/12 11:51:01 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."43522026/11/12 11:51:01 WARN Force mode enabled - objects will be deleted immediately without grace period43532026/11/12 11:51:01 INFO Vacuumed table table=objects43542026/11/12 11:51:01 INFO Received push request method=POST path=/43552026/11/12 11:51:01 INFO Received uploads request method=POST path=/43562026/11/12 11:51:01 INFO Received uploads request method=POST path=/43572026/11/12 11:51:01 INFO Received uploads request method=POST path=/43582026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043592026/11/12 11:51:01 INFO Received push request method=POST path=/43602026/11/12 11:51:01 INFO Received uploads request method=POST path=/43612026/11/12 11:51:01 INFO Vacuumed table table=pending_closures43622026/11/12 11:51:01 INFO Received uploads request method=POST path=/43632026/11/12 11:51:01 INFO Received push request method=POST path=/43642026/11/12 11:51:01 INFO Received complete upload request method=POST path=/43652026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts43662026/11/12 11:51:01 INFO Completed upload id=15 objects=4 duration=850.209µs43672026/11/12 11:51:01 INFO Received push request method=POST path=/43682026/11/12 11:51:01 INFO Received complete upload request method=POST path=/43692026/11/12 11:51:01 INFO Received push request method=POST path=/43702026/11/12 11:51:01 INFO Vacuumed table table=pending_objects43712026/11/12 11:51:01 INFO Completed upload id=18 objects=4 duration=334.542µs43722026/11/12 11:51:01 INFO Received complete push request method=POST path=/43732026/11/12 11:51:01 INFO Received uploads request method=POST path=/43742026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads43752026/11/12 11:51:01 INFO Received push request method=POST path=/43762026/11/12 11:51:01 INFO Vacuumed table table=closures43772026/11/12 11:51:01 INFO Completed push id=19 objects=14 duration=627.667µs43782026/11/12 11:51:01 INFO Received complete upload request method=POST path=/43792026/11/12 11:51:01 INFO Vacuumed table table=objects43802026/11/12 11:51:01 INFO Received push request method=POST path=/43812026/11/12 11:51:01 INFO Received complete push request method=POST path=/43822026/11/12 11:51:01 INFO Completed upload id=16 objects=3 duration=323.375µs43832026/11/12 11:51:01 INFO Received complete push request method=POST path=/43842026/11/12 11:51:01 INFO Completed push id=15 objects=7 duration=709.125µs43852026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=043862026/11/12 11:51:01 INFO Received push request method=POST path=/43872026/11/12 11:51:01 INFO Completed push id=13 objects=22 duration=708.25µs43882026/11/12 11:51:01 WARN Force mode enabled - objects will be deleted immediately without grace period43892026/11/12 11:51:01 INFO Received uploads request method=POST path=/43902026/11/12 11:51:01 INFO Received complete push request method=POST path=/43912026/11/12 11:51:01 INFO Received uploads request method=POST path=/43922026/11/12 11:51:01 INFO Received complete push request method=POST path=/43932026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=043942026/11/12 11:51:01 INFO Received uploads request method=POST path=/43952026/11/12 11:51:01 INFO Completed push id=21 objects=6 duration=387.292µs43962026/11/12 11:51:01 INFO Completed push id=15 objects=4 duration=509.375µs43972026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043982026/11/12 11:51:01 INFO Received uploads request method=POST path=/43992026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44002026/11/12 11:51:01 INFO Received push request method=POST path=/44012026/11/12 11:51:01 INFO Received push request method=POST path=/44022026/11/12 11:51:01 INFO Completed upload id=22 objects=7 duration=477.958µs44032026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44042026/11/12 11:51:01 INFO Received push request method=POST path=/44052026/11/12 11:51:01 INFO Received uploads request method=POST path=/44062026/11/12 11:51:01 INFO Completed upload id=22 objects=2 duration=430.875µs44072026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44082026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44092026/11/12 11:51:01 INFO Received push request method=POST path=/44102026/11/12 11:51:01 INFO Received complete push request method=POST path=/44112026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044122026/11/12 11:51:01 INFO Completed push id=24 objects=4 duration=388.917µs44132026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=044142026/11/12 11:51:01 INFO Received push request method=POST path=/44152026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44162026/11/12 11:51:01 INFO Received complete push request method=POST path=/44172026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44182026/11/12 11:51:01 INFO Vacuumed table table=pending_objects44192026/11/12 11:51:01 INFO Completed upload id=11 objects=7 duration=422.625µs44202026/11/12 11:51:01 INFO Received uploads request method=POST path=/44212026/11/12 11:51:01 INFO Completed push id=25 objects=9 duration=284.75µs44222026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads44232026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44242026/11/12 11:51:01 INFO Received uploads request method=POST path=/44252026/11/12 11:51:01 INFO Received uploads request method=POST path=/44262026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44272026/11/12 11:51:01 INFO Vacuumed table table=closures44282026/11/12 11:51:01 INFO Vacuumed table table=pending_objects44292026/11/12 11:51:01 INFO Completed upload id=26 objects=3 duration=190.708µs44302026/11/12 11:51:01 INFO Received uploads request method=POST path=/44312026/11/12 11:51:01 INFO Vacuumed table table=objects44322026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads44332026/11/12 11:51:01 INFO Vacuumed table table=closures44342026/11/12 11:51:01 INFO Received push request method=POST path=/44352026/11/12 11:51:01 INFO Vacuumed table table=objects44362026/11/12 11:51:01 INFO Received uploads request method=POST path=/44372026/11/12 11:51:01 INFO Received push request method=POST path=/44382026/11/12 11:51:01 INFO Received uploads request method=POST path=/44392026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44402026/11/12 11:51:01 INFO Received complete push request method=POST path=/44412026/11/12 11:51:01 INFO Completed upload id=18 objects=4 duration=935.042µs44422026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044432026/11/12 11:51:01 INFO Completed push id=19 objects=8 duration=1.207667ms44442026/11/12 11:51:01 INFO Received push request method=POST path=/44452026/11/12 11:51:01 WARN Force mode enabled - objects will be deleted immediately without grace period44462026/11/12 11:51:01 INFO Received complete push request method=POST path=/44472026/11/12 11:51:01 INFO Received uploads request method=POST path=/44482026/11/12 11:51:01 INFO Completed push id=17 objects=6 duration=465.041µs44492026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044502026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44512026/11/12 11:51:01 INFO Received push request method=POST path=/44522026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44532026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044542026/11/12 11:51:01 INFO Received push request method=POST path=/44552026/11/12 11:51:01 INFO Received push request method=POST path=/44562026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044572026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044582026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044592026/11/12 11:51:01 INFO Vacuumed table table=pending_objects44602026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44612026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44622026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044632026/11/12 11:51:01 INFO Completed upload id=27 objects=7 duration=381.25µs44642026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44652026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44662026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads44672026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44682026/11/12 11:51:01 INFO Vacuumed table table=pending_objects44692026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044702026/11/12 11:51:01 INFO Received complete upload request method=POST path=/44712026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads44722026/11/12 11:51:01 INFO Vacuumed table table=closures44732026/11/12 11:51:01 INFO Vacuumed table table=pending_objects44742026/11/12 11:51:01 INFO Completed upload id=28 objects=3 duration=606.75µs44752026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44762026/11/12 11:51:01 INFO Vacuumed table table=objects44772026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads44782026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44792026/11/12 11:51:01 INFO Vacuumed table table=closures44802026/11/12 11:51:01 INFO Vacuumed table table=pending_objects44812026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044822026/11/12 11:51:01 INFO Vacuumed table table=closures44832026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads44842026/11/12 11:51:01 INFO Vacuumed table table=objects44852026/11/12 11:51:01 INFO Vacuumed table table=objects44862026/11/12 11:51:01 INFO Vacuumed table table=closures44872026/11/12 11:51:01 WARN Force mode enabled - objects will be deleted immediately without grace period44882026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=044892026/11/12 11:51:01 INFO Received complete push request method=POST path=/44902026/11/12 11:51:01 INFO Vacuumed table table=objects44912026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044922026/11/12 11:51:01 INFO Received push request method=POST path=/44932026/11/12 11:51:01 WARN Force mode enabled - objects will be deleted immediately without grace period44942026/11/12 11:51:01 INFO Completed push id=14 objects=3 duration=425.083µs44952026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44962026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044972026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts44982026/11/12 11:51:01 INFO Vacuumed table table=pending_closures44992026/11/12 11:51:01 INFO Received push request method=POST path=/45002026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts45012026/11/12 11:51:01 INFO Received complete push request method=POST path=/45022026/11/12 11:51:01 INFO Vacuumed table table=pending_objects45032026/11/12 11:51:01 INFO Completed push id=29 objects=23 duration=541.042µs45042026/11/12 11:51:01 INFO Received complete upload request method=POST path=/45052026/11/12 11:51:01 INFO Vacuumed table table=pending_objects45062026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads45072026/11/12 11:51:01 INFO Completed upload id=20 objects=4 duration=6.141917ms45082026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads45092026/11/12 11:51:01 INFO Received push request method=POST path=/45102026/11/12 11:51:01 INFO Received complete push request method=POST path=/45112026/11/12 11:51:01 INFO Vacuumed table table=closures45122026/11/12 11:51:01 INFO Vacuumed table table=closures45132026/11/12 11:51:01 INFO Completed push id=30 objects=6 duration=565.875µs45142026/11/12 11:51:01 INFO Received uploads request method=POST path=/45152026/11/12 11:51:01 INFO Received push request method=POST path=/45162026/11/12 11:51:01 INFO Vacuumed table table=objects45172026/11/12 11:51:01 INFO Vacuumed table table=objects45182026/11/12 11:51:01 INFO Received push request method=POST path=/45192026/11/12 11:51:01 INFO Received push request method=POST path=/45202026/11/12 11:51:01 INFO Received uploads request method=POST path=/45212026/11/12 11:51:01 INFO Received push request method=POST path=/45222026/11/12 11:51:01 INFO Received uploads request method=POST path=/45232026/11/12 11:51:01 INFO Received push request method=POST path=/45242026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=045252026/11/12 11:51:01 INFO Received uploads request method=POST path=/45262026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045272026/11/12 11:51:01 INFO Vacuumed table table=pending_closures45282026/11/12 11:51:01 INFO Received uploads request method=POST path=/45292026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts45302026/11/12 11:51:01 INFO Received complete push request method=POST path=/45312026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=045322026/11/12 11:51:01 INFO Received push request method=POST path=/45332026/11/12 11:51:01 INFO Completed push id=9 objects=24 duration=395.125µs45342026/11/12 11:51:01 WARN Force mode enabled - objects will be deleted immediately without grace period45352026/11/12 11:51:01 INFO Vacuumed table table=pending_objects45362026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045372026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads45382026/11/12 11:51:01 INFO Vacuumed table table=pending_closures45392026/11/12 11:51:01 INFO Received uploads request method=POST path=/45402026/11/12 11:51:01 INFO Received uploads request method=POST path=/45412026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts45422026/11/12 11:51:01 INFO Vacuumed table table=closures45432026/11/12 11:51:01 INFO Received uploads request method=POST path=/45442026/11/12 11:51:01 INFO Vacuumed table table=objects45452026/11/12 11:51:01 INFO Vacuumed table table=pending_objects45462026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads45472026/11/12 11:51:01 INFO Received push request method=POST path=/45482026/11/12 11:51:01 INFO Vacuumed table table=closures45492026/11/12 11:51:01 INFO Received uploads request method=POST path=/45502026/11/12 11:51:01 INFO Received complete upload request method=POST path=/45512026/11/12 11:51:01 INFO Vacuumed table table=objects45522026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=045532026/11/12 11:51:01 INFO Received complete push request method=POST path=/45542026/11/12 11:51:01 INFO Completed upload id=10 objects=10 duration=356.584µs45552026/11/12 11:51:01 INFO Vacuumed table table=pending_closures45562026/11/12 11:51:01 INFO Received push request method=POST path=/45572026/11/12 11:51:01 INFO Completed push id=33 objects=3 duration=365.166µs45582026/11/12 11:51:01 INFO Vacuumed table table=commit_receipts45592026/11/12 11:51:01 INFO Received complete push request method=POST path=/45602026/11/12 11:51:01 INFO Completed push id=26 objects=14 duration=1.343875ms45612026/11/12 11:51:01 INFO Received complete push request method=POST path=/45622026/11/12 11:51:01 INFO Received uploads request method=POST path=/45632026/11/12 11:51:01 INFO Vacuumed table table=pending_objects45642026/11/12 11:51:01 INFO Received uploads request method=POST path=/45652026/11/12 11:51:01 INFO Received push request method=POST path=/45662026/11/12 11:51:01 INFO Completed push id=34 objects=6 duration=298.083µs45672026/11/12 11:51:01 INFO Received push request method=POST path=/45682026/11/12 11:51:01 INFO Vacuumed table table=multipart_uploads45692026/11/12 11:51:01 INFO Vacuumed table table=closures45702026/11/12 11:51:01 INFO Vacuumed table table=objects45712026/11/12 11:51:01 INFO Received complete push request method=POST path=/45722026/11/12 11:51:01 INFO Received uploads request method=POST path=/45732026/11/12 11:51:01 INFO Received push request method=POST path=/45742026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=045752026/11/12 11:51:01 INFO Received push request method=POST path=/45762026/11/12 11:51:01 INFO Received complete push request method=POST path=/45772026/11/12 11:51:01 INFO Completed push id=35 objects=8 duration=348.875µs45782026/11/12 11:51:01 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045792026/11/12 11:51:01 INFO Aborted multipart uploads count=0 kept=045802026/11/12 11:51:01 INFO Received uploads request method=POST path=/45812026/11/12 11:51:01 INFO Received uploads request method=POST path=/45822026/11/12 11:51:02 INFO Vacuumed table table=pending_closures45832026/11/12 11:51:02 INFO Completed push id=3 objects=21 duration=6.974625ms45842026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045852026/11/12 11:51:02 INFO Received complete upload request method=POST path=/45862026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=045872026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts45882026/11/12 11:51:02 INFO Vacuumed table table=pending_closures45892026/11/12 11:51:02 INFO Completed upload id=36 objects=9 duration=5.865542ms45902026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts45912026/11/12 11:51:02 INFO Vacuumed table table=pending_objects45922026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045932026/11/12 11:51:02 INFO Received uploads request method=POST path=/45942026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads45952026/11/12 11:51:02 INFO Vacuumed table table=pending_closures45962026/11/12 11:51:02 INFO Vacuumed table table=pending_objects45972026/11/12 11:51:02 INFO Received complete push request method=POST path=/45982026/11/12 11:51:02 INFO Received complete push request method=POST path=/45992026/11/12 11:51:02 INFO Vacuumed table table=closures46002026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046012026/11/12 11:51:02 INFO Received push request method=POST path=/46022026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46032026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46042026/11/12 11:51:02 INFO Completed push id=14 objects=3 duration=358.375µs46052026/11/12 11:51:02 INFO Completed push id=16 objects=5 duration=493.25µs46062026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period46072026/11/12 11:51:02 INFO Vacuumed table table=objects46082026/11/12 11:51:02 INFO Vacuumed table table=closures46092026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46102026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046112026/11/12 11:51:02 INFO Vacuumed table table=objects46122026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46132026/11/12 11:51:02 INFO Received uploads request method=POST path=/46142026/11/12 11:51:02 INFO Received push request method=POST path=/46152026/11/12 11:51:02 INFO Vacuumed table table=closures46162026/11/12 11:51:02 INFO Received uploads request method=POST path=/46172026/11/12 11:51:02 INFO Vacuumed table table=objects46182026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046192026/11/12 11:51:02 INFO Received push request method=POST path=/46202026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46212026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=046222026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46232026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46242026/11/12 11:51:02 INFO Received push request method=POST path=/46252026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46262026/11/12 11:51:02 INFO Received uploads request method=POST path=/46272026/11/12 11:51:02 INFO Received push request method=POST path=/46282026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46292026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46302026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046312026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46322026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46332026/11/12 11:51:02 INFO Vacuumed table table=closures46342026/11/12 11:51:02 INFO Received push request method=POST path=/46352026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period46362026/11/12 11:51:02 INFO Vacuumed table table=closures46372026/11/12 11:51:02 INFO Received complete push request method=POST path=/46382026/11/12 11:51:02 INFO Vacuumed table table=objects46392026/11/12 11:51:02 INFO Vacuumed table table=objects46402026/11/12 11:51:02 INFO Completed push id=15 objects=5 duration=5.814583ms46412026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046422026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046432026/11/12 11:51:02 INFO Received complete upload request method=POST path=/46442026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046452026/11/12 11:51:02 INFO Received uploads request method=POST path=/46462026/11/12 11:51:02 INFO Completed upload id=33 objects=5 duration=950.208µs46472026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46482026/11/12 11:51:02 INFO Received push request method=POST path=/46492026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46502026/11/12 11:51:02 INFO Received push request method=POST path=/46512026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46522026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46532026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46542026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46552026/11/12 11:51:02 INFO Vacuumed table table=closures46562026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46572026/11/12 11:51:02 INFO Received uploads request method=POST path=/46582026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46592026/11/12 11:51:02 INFO Vacuumed table table=objects46602026/11/12 11:51:02 INFO Vacuumed table table=closures46612026/11/12 11:51:02 INFO Received uploads request method=POST path=/46622026/11/12 11:51:02 INFO Vacuumed table table=objects46632026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046642026/11/12 11:51:02 INFO Received uploads request method=POST path=/46652026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period46662026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046672026/11/12 11:51:02 INFO Received push request method=POST path=/46682026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46692026/11/12 11:51:02 INFO Received push request method=POST path=/46702026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046712026/11/12 11:51:02 INFO Received complete push request method=POST path=/46722026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46732026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046742026/11/12 11:51:02 INFO Received uploads request method=POST path=/46752026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46762026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46772026/11/12 11:51:02 INFO Completed push id=27 objects=25 duration=6.3455ms46782026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46792026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46802026/11/12 11:51:02 INFO Received uploads request method=POST path=/46812026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046822026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046832026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46842026/11/12 11:51:02 INFO Vacuumed table table=closures46852026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46862026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=046872026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46882026/11/12 11:51:02 INFO Vacuumed table table=closures46892026/11/12 11:51:02 INFO Vacuumed table table=objects46902026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts46912026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period46922026/11/12 11:51:02 INFO Vacuumed table table=objects46932026/11/12 11:51:02 INFO Received complete push request method=POST path=/46942026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046952026/11/12 11:51:02 INFO Vacuumed table table=pending_objects46962026/11/12 11:51:02 INFO Completed push id=1 objects=11 duration=703.834µs46972026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads46982026/11/12 11:51:02 INFO Vacuumed table table=pending_closures46992026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts47002026/11/12 11:51:02 INFO Vacuumed table table=closures47012026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=047022026/11/12 11:51:02 INFO Received uploads request method=POST path=/47032026/11/12 11:51:02 INFO Vacuumed table table=objects47042026/11/12 11:51:02 INFO Vacuumed table table=pending_objects47052026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047062026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads47072026/11/12 11:51:02 INFO Vacuumed table table=pending_closures47082026/11/12 11:51:02 INFO Vacuumed table table=closures47092026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts47102026/11/12 11:51:02 INFO Vacuumed table table=objects47112026/11/12 11:51:02 INFO Vacuumed table table=pending_objects47122026/11/12 11:51:02 INFO Received complete push request method=POST path=/47132026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads47142026/11/12 11:51:02 INFO Completed push id=24 objects=5 duration=2.180542ms47152026/11/12 11:51:02 INFO Vacuumed table table=closures47162026/11/12 11:51:02 INFO Received uploads request method=POST path=/47172026/11/12 11:51:02 INFO Vacuumed table table=objects47182026/11/12 11:51:02 INFO Received uploads request method=POST path=/47192026/11/12 11:51:02 INFO Received uploads request method=POST path=/47202026/11/12 11:51:02 INFO Received push request method=POST path=/47212026/11/12 11:51:02 INFO Received uploads request method=POST path=/47222026/11/12 11:51:02 INFO Received push request method=POST path=/47232026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47242026/11/12 11:51:02 INFO Received uploads request method=POST path=/47252026/11/12 11:51:02 INFO Completed upload id=16 objects=3 duration=242.917µs47262026/11/12 11:51:02 INFO Received uploads request method=POST path=/47272026/11/12 11:51:02 INFO Received push request method=POST path=/47282026/11/12 11:51:02 INFO Received push request method=POST path=/47292026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=047302026/11/12 11:51:02 INFO Received complete push request method=POST path=/47312026/11/12 11:51:02 INFO Received complete push request method=POST path=/47322026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047332026/11/12 11:51:02 INFO Completed push id=18 objects=6 duration=1.098875ms47342026/11/12 11:51:02 INFO Received push request method=POST path=/47352026/11/12 11:51:02 INFO Vacuumed table table=pending_closures47362026/11/12 11:51:02 INFO Completed push id=14 objects=3 duration=6.137791ms47372026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts47382026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47392026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47402026/11/12 11:51:02 INFO Completed upload id=23 objects=9 duration=266.958µs47412026/11/12 11:51:02 INFO Completed upload id=14 objects=16 duration=5.436459ms47422026/11/12 11:51:02 INFO Vacuumed table table=pending_objects47432026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads47442026/11/12 11:51:02 INFO Vacuumed table table=closures47452026/11/12 11:51:02 INFO Vacuumed table table=objects47462026/11/12 11:51:02 INFO Received push request method=POST path=/47472026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=047482026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period47492026/11/12 11:51:02 INFO Received uploads request method=POST path=/47502026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047512026/11/12 11:51:02 INFO Vacuumed table table=pending_closures47522026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts47532026/11/12 11:51:02 INFO Received complete push request method=POST path=/47542026/11/12 11:51:02 INFO Vacuumed table table=pending_objects47552026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads47562026/11/12 11:51:02 INFO Completed push id=21 objects=9 duration=6.87775ms47572026/11/12 11:51:02 INFO Vacuumed table table=closures47582026/11/12 11:51:02 INFO Received push request method=POST path=/47592026/11/12 11:51:02 INFO Vacuumed table table=objects47602026/11/12 11:51:02 INFO Received uploads request method=POST path=/47612026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47622026/11/12 11:51:02 INFO Completed upload id=19 objects=2 duration=894.25µs47632026/11/12 11:51:02 INFO Received complete push request method=POST path=/47642026/11/12 11:51:02 INFO Received uploads request method=POST path=/47652026/11/12 11:51:02 INFO Received push request method=POST path=/47662026/11/12 11:51:02 INFO Completed push id=16 objects=26 duration=395.75µs47672026/11/12 11:51:02 INFO Received complete push request method=POST path=/47682026/11/12 11:51:02 INFO Received push request method=POST path=/47692026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=047702026/11/12 11:51:02 INFO Completed push id=33 objects=7 duration=6.791458ms47712026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period47722026/11/12 11:51:02 INFO Received complete push request method=POST path=/47732026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47742026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047752026/11/12 11:51:02 INFO Completed push id=21 objects=26 duration=562.5µs47762026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47772026/11/12 11:51:02 INFO Completed upload id=26 objects=3 duration=473.75µs47782026/11/12 11:51:02 INFO Vacuumed table table=pending_closures47792026/11/12 11:51:02 INFO Completed upload id=21 objects=25 duration=7.143708ms47802026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts47812026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=047822026/11/12 11:51:02 INFO Received uploads request method=POST path=/47832026/11/12 11:51:02 INFO Vacuumed table table=pending_objects47842026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period47852026/11/12 11:51:02 INFO Received complete upload request method=POST path=/47862026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads47872026/11/12 11:51:02 INFO Vacuumed table table=closures47882026/11/12 11:51:02 INFO Completed upload id=13 objects=8 duration=11.043459ms47892026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047902026/11/12 11:51:02 INFO Vacuumed table table=objects47912026/11/12 11:51:02 INFO Vacuumed table table=pending_closures47922026/11/12 11:51:02 INFO Received uploads request method=POST path=/47932026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts47942026/11/12 11:51:02 INFO Received complete push request method=POST path=/47952026/11/12 11:51:02 INFO Vacuumed table table=pending_objects47962026/11/12 11:51:02 INFO Received uploads request method=POST path=/47972026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads47982026/11/12 11:51:02 INFO Completed push id=27 objects=6 duration=1.080792ms47992026/11/12 11:51:02 INFO Vacuumed table table=closures48002026/11/12 11:51:02 INFO Received push request method=POST path=/48012026/11/12 11:51:02 INFO Vacuumed table table=objects48022026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48032026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48042026/11/12 11:51:02 INFO Completed upload id=15 objects=2 duration=592.042µs48052026/11/12 11:51:02 INFO Completed upload id=28 objects=17 duration=318.417µs48062026/11/12 11:51:02 INFO Received complete push request method=POST path=/48072026/11/12 11:51:02 INFO Received complete push request method=POST path=/48082026/11/12 11:51:02 INFO Completed push id=29 objects=2 duration=293.958µs48092026/11/12 11:51:02 INFO Received push request method=POST path=/48102026/11/12 11:51:02 INFO Completed push id=17 objects=11 duration=658.5µs48112026/11/12 11:51:02 INFO Received complete push request method=POST path=/48122026/11/12 11:51:02 INFO Completed push id=31 objects=6 duration=283.625µs48132026/11/12 11:51:02 INFO Received uploads request method=POST path=/48142026/11/12 11:51:02 INFO Received push request method=POST path=/48152026/11/12 11:51:02 INFO Received complete push request method=POST path=/48162026/11/12 11:51:02 INFO Completed push id=32 objects=9 duration=302.625µs48172026/11/12 11:51:02 INFO Received uploads request method=POST path=/48182026/11/12 11:51:02 INFO Received push request method=POST path=/48192026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48202026/11/12 11:51:02 INFO Completed upload id=26 objects=8 duration=325µs48212026/11/12 11:51:02 INFO Received complete push request method=POST path=/48222026/11/12 11:51:02 INFO Completed push id=28 objects=14 duration=509.417µs48232026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48242026/11/12 11:51:02 INFO Completed upload id=26 objects=6 duration=240.542µs48252026/11/12 11:51:02 INFO Received push request method=POST path=/48262026/11/12 11:51:02 INFO Received uploads request method=POST path=/48272026/11/12 11:51:02 INFO Received uploads request method=POST path=/48282026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48292026/11/12 11:51:02 INFO Completed upload id=29 objects=5 duration=224.167µs48302026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=048312026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period48322026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=048332026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048342026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period48352026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048362026/11/12 11:51:02 INFO Vacuumed table table=pending_closures48372026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48382026/11/12 11:51:02 INFO Vacuumed table table=pending_closures48392026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts48402026/11/12 11:51:02 INFO Completed upload id=33 objects=9 duration=263.875µs48412026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48422026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts48432026/11/12 11:51:02 INFO Completed upload id=13 objects=14 duration=6.388875ms48442026/11/12 11:51:02 INFO Vacuumed table table=pending_objects48452026/11/12 11:51:02 INFO Vacuumed table table=pending_objects48462026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads48472026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=048482026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=048492026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads48502026/11/12 11:51:02 INFO Vacuumed table table=closures48512026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period48522026/11/12 11:51:02 INFO Vacuumed table table=closures48532026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048542026/11/12 11:51:02 INFO Vacuumed table table=objects48552026/11/12 11:51:02 INFO Vacuumed table table=pending_closures48562026/11/12 11:51:02 INFO Vacuumed table table=objects48572026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts48582026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048592026/11/12 11:51:02 INFO Received uploads request method=POST path=/48602026/11/12 11:51:02 INFO Received push request method=POST path=/48612026/11/12 11:51:02 INFO Vacuumed table table=pending_objects48622026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48632026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads48642026/11/12 11:51:02 INFO Received complete push request method=POST path=/48652026/11/12 11:51:02 INFO Completed upload id=21 objects=9 duration=692.625µs48662026/11/12 11:51:02 INFO Vacuumed table table=closures48672026/11/12 11:51:02 INFO Received uploads request method=POST path=/48682026/11/12 11:51:02 INFO Vacuumed table table=objects48692026/11/12 11:51:02 INFO Completed push id=13 objects=15 duration=3.761708ms48702026/11/12 11:51:02 INFO Vacuumed table table=pending_closures48712026/11/12 11:51:02 INFO Vacuumed table table=commit_receipts48722026/11/12 11:51:02 INFO Received complete push request method=POST path=/48732026/11/12 11:51:02 INFO Completed push id=25 objects=10 duration=562.125µs48742026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=048752026/11/12 11:51:02 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."48762026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48772026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48782026/11/12 11:51:02 INFO Vacuumed table table=pending_objects48792026/11/12 11:51:02 INFO Completed upload id=31 objects=3 duration=864.333µs48802026/11/12 11:51:02 INFO Completed upload id=29 objects=5 duration=279.209µs48812026/11/12 11:51:02 INFO Vacuumed table table=multipart_uploads48822026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48832026/11/12 11:51:02 INFO Completed upload id=22 objects=2 duration=237.75µs48842026/11/12 11:51:02 INFO Vacuumed table table=closures48852026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48862026/11/12 11:51:02 INFO Completed upload id=30 objects=2 duration=301.083µs48872026/11/12 11:51:02 INFO Vacuumed table table=objects48882026/11/12 11:51:02 INFO Received complete upload request method=POST path=/48892026/11/12 11:51:02 INFO Aborted multipart uploads count=0 kept=048902026/11/12 11:51:02 INFO Completed upload id=12 objects=6 duration=394.542µs48912026/11/12 11:51:02 WARN Force mode enabled - objects will be deleted immediately without grace period48922026/11/12 11:51:02 INFO Received complete push request method=POST path=/48932026/11/12 11:51:02 INFO Received complete push request method=POST path=/48942026/11/12 11:51:02 INFO Received complete push request method=POST path=/48952026/11/12 11:51:02 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048962026/11/12 11:51:02 INFO Received complete push request method=POST path=/48972026/11/12 11:51:02 INFO Completed push id=31 objects=20 duration=317.209µs48982026/11/12 11:51:03 INFO Vacuumed table table=pending_closures48992026/11/12 11:51:03 INFO Completed push id=31 objects=6 duration=6.160708ms49002026/11/12 11:51:03 INFO Completed push id=17 objects=3 duration=6.210375ms49012026/11/12 11:51:03 INFO Completed push id=4 objects=6 duration=6.235458ms49022026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts49032026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49042026/11/12 11:51:03 INFO Vacuumed table table=pending_objects49052026/11/12 11:51:03 INFO Received uploads request method=POST path=/49062026/11/12 11:51:03 INFO Received uploads request method=POST path=/49072026/11/12 11:51:03 INFO Completed upload id=32 objects=5 duration=294.792µs49082026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads49092026/11/12 11:51:03 INFO Vacuumed table table=closures49102026/11/12 11:51:03 INFO Received push request method=POST path=/49112026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49122026/11/12 11:51:03 INFO Vacuumed table table=objects49132026/11/12 11:51:03 INFO Completed upload id=33 objects=3 duration=289.041µs49142026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49152026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=049162026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=049172026/11/12 11:51:03 INFO Completed upload id=18 objects=2 duration=790.041µs49182026/11/12 11:51:03 INFO Received complete push request method=POST path=/49192026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period49202026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period49212026/11/12 11:51:03 INFO Completed push id=5 objects=28 duration=524.792µs49222026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049232026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049242026/11/12 11:51:03 INFO Received complete push request method=POST path=/49252026/11/12 11:51:03 INFO Received push request method=POST path=/49262026/11/12 11:51:03 INFO Completed push id=23 objects=5 duration=455.166µs49272026/11/12 11:51:03 INFO Vacuumed table table=pending_closures49282026/11/12 11:51:03 INFO Received complete push request method=POST path=/49292026/11/12 11:51:03 INFO Completed push id=10 objects=2 duration=863.5µs49302026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts49312026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49322026/11/12 11:51:03 INFO Completed upload id=24 objects=3 duration=337.125µs49332026/11/12 11:51:03 INFO Vacuumed table table=pending_objects49342026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads49352026/11/12 11:51:03 INFO Vacuumed table table=pending_closures49362026/11/12 11:51:03 INFO Received complete push request method=POST path=/49372026/11/12 11:51:03 INFO Vacuumed table table=closures49382026/11/12 11:51:03 INFO Completed push id=25 objects=4 duration=253.708µs49392026/11/12 11:51:03 INFO Vacuumed table table=objects49402026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts49412026/11/12 11:51:03 INFO Received uploads request method=POST path=/49422026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=049432026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period49442026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049452026/11/12 11:51:03 INFO Vacuumed table table=pending_closures49462026/11/12 11:51:03 INFO Vacuumed table table=pending_objects49472026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads49482026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts49492026/11/12 11:51:03 INFO Vacuumed table table=closures49502026/11/12 11:51:03 INFO Vacuumed table table=pending_objects49512026/11/12 11:51:03 INFO Vacuumed table table=objects49522026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads49532026/11/12 11:51:03 INFO Received complete push request method=POST path=/49542026/11/12 11:51:03 INFO Vacuumed table table=closures49552026/11/12 11:51:03 INFO Vacuumed table table=objects49562026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49572026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49582026/11/12 11:51:03 INFO Completed push id=20 objects=3 duration=85.36025ms49592026/11/12 11:51:03 INFO Completed upload id=13 objects=7 duration=31.530834ms49602026/11/12 11:51:03 INFO Completed upload id=17 objects=5 duration=67.399084ms49612026/11/12 11:51:03 INFO Received complete push request method=POST path=/49622026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=049632026/11/12 11:51:03 INFO Completed push id=9 objects=9 duration=1.343125ms49642026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period49652026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49662026/11/12 11:51:03 INFO Completed upload id=20 objects=4 duration=254.084µs49672026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049682026/11/12 11:51:03 INFO Vacuumed table table=pending_closures49692026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts49702026/11/12 11:51:03 INFO Vacuumed table table=pending_objects49712026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads49722026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49732026/11/12 11:51:03 INFO Received push request method=POST path=/49742026/11/12 11:51:03 INFO Vacuumed table table=closures49752026/11/12 11:51:03 INFO Completed upload id=23 objects=7 duration=441.291µs49762026/11/12 11:51:03 INFO Received push request method=POST path=/49772026/11/12 11:51:03 INFO Vacuumed table table=objects49782026/11/12 11:51:03 INFO Received push request method=POST path=/49792026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49802026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49812026/11/12 11:51:03 INFO Completed upload id=22 objects=6 duration=204.584µs49822026/11/12 11:51:03 INFO Completed upload id=21 objects=8 duration=5.418167ms49832026/11/12 11:51:03 INFO Received complete push request method=POST path=/49842026/11/12 11:51:03 INFO Received uploads request method=POST path=/49852026/11/12 11:51:03 INFO Received complete push request method=POST path=/49862026/11/12 11:51:03 INFO Completed push id=19 objects=3 duration=6.672709ms49872026/11/12 11:51:03 INFO Completed push id=22 objects=6 duration=366.416µs49882026/11/12 11:51:03 INFO Received complete push request method=POST path=/49892026/11/12 11:51:03 INFO Completed push id=24 objects=8 duration=271.709µs49902026/11/12 11:51:03 INFO Received uploads request method=POST path=/49912026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49922026/11/12 11:51:03 INFO Completed upload id=25 objects=9 duration=187.834µs49932026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49942026/11/12 11:51:03 INFO Received push request method=POST path=/49952026/11/12 11:51:03 INFO Completed upload id=27 objects=3 duration=605.833µs49962026/11/12 11:51:03 INFO Received push request method=POST path=/49972026/11/12 11:51:03 INFO Received complete upload request method=POST path=/49982026/11/12 11:51:03 INFO Completed upload id=28 objects=6 duration=261.167µs49992026/11/12 11:51:03 INFO Received complete push request method=POST path=/50002026/11/12 11:51:03 INFO Received uploads request method=POST path=/50012026/11/12 11:51:03 INFO Completed push id=30 objects=4 duration=6.139792ms50022026/11/12 11:51:03 INFO Received complete push request method=POST path=/50032026/11/12 11:51:03 INFO Received uploads request method=POST path=/50042026/11/12 11:51:03 INFO Completed push id=31 objects=7 duration=4.288708ms50052026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50062026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50072026/11/12 11:51:03 INFO Completed upload id=32 objects=5 duration=431.125µs50082026/11/12 11:51:03 INFO Completed upload id=17 objects=25 duration=6.887792ms50092026/11/12 11:51:03 INFO Received uploads request method=POST path=/50102026/11/12 11:51:03 INFO Received push request method=POST path=/50112026/11/12 11:51:03 INFO Received uploads request method=POST path=/50122026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50132026/11/12 11:51:03 INFO Received uploads request method=POST path=/50142026/11/12 11:51:03 INFO Completed upload id=21 objects=2 duration=290.709µs50152026/11/12 11:51:03 INFO Received push request method=POST path=/50162026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=050172026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period50182026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050192026/11/12 11:51:03 INFO Vacuumed table table=pending_closures50202026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts50212026/11/12 11:51:03 INFO Vacuumed table table=pending_objects50222026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads50232026/11/12 11:51:03 INFO Vacuumed table table=closures50242026/11/12 11:51:03 INFO Received complete push request method=POST path=/50252026/11/12 11:51:03 INFO Vacuumed table table=objects50262026/11/12 11:51:03 INFO Completed push id=20 objects=4 duration=445.791µs50272026/11/12 11:51:03 INFO Received complete push request method=POST path=/50282026/11/12 11:51:03 INFO Completed push id=26 objects=23 duration=354.667µs50292026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50302026/11/12 11:51:03 INFO Completed upload id=22 objects=8 duration=583.667µs50312026/11/12 11:51:03 INFO Received complete push request method=POST path=/50322026/11/12 11:51:03 INFO Completed push id=1 objects=9 duration=616.583µs50332026/11/12 11:51:03 INFO Received complete push request method=POST path=/50342026/11/12 11:51:03 INFO Completed push id=23 objects=5 duration=479.875µs50352026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50362026/11/12 11:51:03 INFO Completed upload id=24 objects=8 duration=291.5µs50372026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50382026/11/12 11:51:03 INFO Completed upload id=24 objects=18 duration=431.5µs50392026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50402026/11/12 11:51:03 INFO Completed upload id=28 objects=5 duration=220.959µs50412026/11/12 11:51:03 INFO Received complete push request method=POST path=/50422026/11/12 11:51:03 INFO Completed push id=25 objects=2 duration=642.541µs50432026/11/12 11:51:03 INFO Received complete push request method=POST path=/50442026/11/12 11:51:03 INFO Completed push id=27 objects=4 duration=243.459µs50452026/11/12 11:51:03 INFO Received complete push request method=POST path=/50462026/11/12 11:51:03 INFO Completed push id=27 objects=15 duration=478.75µs50472026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50482026/11/12 11:51:03 INFO Completed upload id=30 objects=5 duration=460.083µs50492026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50502026/11/12 11:51:03 INFO Completed upload id=34 objects=24 duration=400.5µs50512026/11/12 11:51:03 INFO Received complete push request method=POST path=/50522026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=050532026/11/12 11:51:03 INFO Completed push id=7 objects=24 duration=6.857708ms50542026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period50552026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050562026/11/12 11:51:03 INFO Received uploads request method=POST path=/50572026/11/12 11:51:03 INFO Received complete push request method=POST path=/50582026/11/12 11:51:03 INFO Received uploads request method=POST path=/50592026/11/12 11:51:03 INFO Completed push id=31 objects=3 duration=452.041µs50602026/11/12 11:51:03 INFO Vacuumed table table=pending_closures50612026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts50622026/11/12 11:51:03 INFO Received complete push request method=POST path=/50632026/11/12 11:51:03 INFO Received uploads request method=POST path=/50642026/11/12 11:51:03 INFO Completed push id=28 objects=26 duration=737.666µs50652026/11/12 11:51:03 INFO Vacuumed table table=pending_objects50662026/11/12 11:51:03 INFO Vacuumed table table=multipart_uploads50672026/11/12 11:51:03 INFO Received complete push request method=POST path=/50682026/11/12 11:51:03 INFO Received push request method=POST path=/50692026/11/12 11:51:03 INFO Completed push id=30 objects=3 duration=312.792µs50702026/11/12 11:51:03 INFO Vacuumed table table=closures50712026/11/12 11:51:03 INFO Received uploads request method=POST path=/50722026/11/12 11:51:03 INFO Received complete push request method=POST path=/50732026/11/12 11:51:03 INFO Vacuumed table table=objects50742026/11/12 11:51:03 INFO Completed push id=32 objects=19 duration=289.916µs50752026/11/12 11:51:03 INFO Received complete push request method=POST path=/50762026/11/12 11:51:03 INFO Completed push id=13 objects=2 duration=293.958µs50772026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=050782026/11/12 11:51:03 INFO Received complete upload request method=POST path=/50792026/11/12 11:51:03 INFO Completed upload id=27 objects=13 duration=459.125µs50802026/11/12 11:51:03 WARN Force mode enabled - objects will be deleted immediately without grace period50812026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050822026/11/12 11:51:03 INFO Aborted multipart uploads count=0 kept=050832026/11/12 11:51:03 INFO Received complete push request method=POST path=/50842026/11/12 11:51:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050852026/11/12 11:51:03 INFO Vacuumed table table=pending_closures50862026/11/12 11:51:03 INFO Completed push id=16 objects=7 duration=6.558042ms50872026/11/12 11:51:03 INFO Vacuumed table table=pending_closures50882026/11/12 11:51:03 INFO Vacuumed table table=commit_receipts50892026/11/12 11:51:04 INFO Vacuumed table table=commit_receipts50902026/11/12 11:51:04 INFO Vacuumed table table=pending_objects50912026/11/12 11:51:04 INFO Vacuumed table table=multipart_uploads50922026/11/12 11:51:04 INFO Vacuumed table table=closures50932026/11/12 11:51:04 INFO Vacuumed table table=pending_objects50942026/11/12 11:51:04 INFO Vacuumed table table=objects50952026/11/12 11:51:04 INFO Vacuumed table table=multipart_uploads50962026/11/12 11:51:04 INFO Vacuumed table table=closures50972026/11/12 11:51:04 INFO Vacuumed table table=objects50982026/11/12 11:51:04 INFO Received uploads request method=POST path=/50992026/11/12 11:51:04 INFO Received push request method=POST path=/51002026/11/12 11:51:04 INFO Received complete push request method=POST path=/51012026/11/12 11:51:04 INFO Completed push id=32 objects=6 duration=919.75µs51022026/11/12 11:51:04 INFO Received push request method=POST path=/51032026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51042026/11/12 11:51:04 INFO Completed upload id=33 objects=7 duration=282.083µs51052026/11/12 11:51:04 INFO Received uploads request method=POST path=/51062026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51072026/11/12 11:51:04 INFO Completed upload id=34 objects=3 duration=281.75µs51082026/11/12 11:51:04 INFO Received uploads request method=POST path=/51092026/11/12 11:51:04 INFO Received complete push request method=POST path=/51102026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51112026/11/12 11:51:04 INFO Completed push id=35 objects=11 duration=228µs51122026/11/12 11:51:04 INFO Completed upload id=29 objects=4 duration=6.710708ms51132026/11/12 11:51:04 INFO Received complete push request method=POST path=/51142026/11/12 11:51:04 INFO Completed push id=28 objects=19 duration=1.231458ms51152026/11/12 11:51:04 INFO Received uploads request method=POST path=/51162026/11/12 11:51:04 INFO Aborted multipart uploads count=0 kept=051172026/11/12 11:51:04 WARN Force mode enabled - objects will be deleted immediately without grace period51182026/11/12 11:51:04 INFO Garbage collection completed failed-uploads-deleted=6 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=051192026/11/12 11:51:04 INFO Received uploads request method=POST path=/51202026/11/12 11:51:04 INFO Received complete push request method=POST path=/51212026/11/12 11:51:04 INFO Vacuumed table table=pending_closures51222026/11/12 11:51:04 INFO Vacuumed table table=commit_receipts51232026/11/12 11:51:04 INFO Completed push id=23 objects=6 duration=6.129916ms51242026/11/12 11:51:04 INFO Received complete push request method=POST path=/51252026/11/12 11:51:04 INFO Completed push id=24 objects=6 duration=280.417µs51262026/11/12 11:51:04 INFO Vacuumed table table=pending_objects51272026/11/12 11:51:04 INFO Vacuumed table table=multipart_uploads51282026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51292026/11/12 11:51:04 INFO Vacuumed table table=closures51302026/11/12 11:51:04 INFO Completed upload id=2 objects=7 duration=336.166µs51312026/11/12 11:51:04 INFO Vacuumed table table=objects51322026/11/12 11:51:04 INFO Received complete push request method=POST path=/51332026/11/12 11:51:04 INFO Completed push id=11 objects=6 duration=541.5µs51342026/11/12 11:51:04 INFO Received complete push request method=POST path=/51352026/11/12 11:51:04 INFO Completed push id=20 objects=13 duration=325µs51362026/11/12 11:51:04 INFO Received complete push request method=POST path=/51372026/11/12 11:51:04 INFO Received complete push request method=POST path=/51382026/11/12 11:51:04 INFO Received complete push request method=POST path=/51392026/11/12 11:51:04 INFO Completed push id=22 objects=4 duration=253.041µs51402026/11/12 11:51:04 INFO Completed push id=29 objects=10 duration=290.291µs51412026/11/12 11:51:04 INFO Completed push id=25 objects=7 duration=319.417µs51422026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51432026/11/12 11:51:04 INFO Completed upload id=30 objects=6 duration=284.958µs51442026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51452026/11/12 11:51:04 INFO Completed upload id=23 objects=7 duration=275.625µs51462026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51472026/11/12 11:51:04 INFO Completed upload id=31 objects=5 duration=384.834µs51482026/11/12 11:51:04 INFO Received complete push request method=POST path=/51492026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51502026/11/12 11:51:04 INFO Completed upload id=34 objects=3 duration=155.083µs51512026/11/12 11:51:04 INFO Completed push id=24 objects=5 duration=6.023625ms51522026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51532026/11/12 11:51:04 INFO Aborted multipart uploads count=0 kept=051542026/11/12 11:51:04 INFO Completed upload id=25 objects=2 duration=160.708µs51552026/11/12 11:51:04 WARN Force mode enabled - objects will be deleted immediately without grace period51562026/11/12 11:51:04 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=051572026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51582026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51592026/11/12 11:51:04 INFO Completed upload id=26 objects=20 duration=247.958µs51602026/11/12 11:51:04 INFO Completed upload id=8 objects=6 duration=278.833µs51612026/11/12 11:51:04 INFO Vacuumed table table=pending_closures51622026/11/12 11:51:04 INFO Vacuumed table table=commit_receipts51632026/11/12 11:51:04 INFO Vacuumed table table=pending_objects51642026/11/12 11:51:04 INFO Vacuumed table table=multipart_uploads51652026/11/12 11:51:04 INFO Vacuumed table table=closures51662026/11/12 11:51:04 INFO Vacuumed table table=objects51672026/11/12 11:51:04 INFO Received complete push request method=POST path=/51682026/11/12 11:51:04 INFO Completed push id=28 objects=7 duration=287.708µs51692026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51702026/11/12 11:51:04 INFO Completed upload id=26 objects=24 duration=333.625µs51712026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51722026/11/12 11:51:04 INFO Completed upload id=30 objects=6 duration=226.583µs51732026/11/12 11:51:04 INFO Received complete push request method=POST path=/51742026/11/12 11:51:04 INFO Completed push id=31 objects=5 duration=234.834µs51752026/11/12 11:51:04 INFO Received complete push request method=POST path=/51762026/11/12 11:51:04 INFO Completed push id=32 objects=26 duration=577.209µs51772026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51782026/11/12 11:51:04 INFO Completed upload id=33 objects=2 duration=228.958µs51792026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51802026/11/12 11:51:04 INFO Completed upload id=34 objects=5 duration=219.792µs51812026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51822026/11/12 11:51:04 INFO Completed upload id=35 objects=11 duration=205.5µs51832026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51842026/11/12 11:51:04 INFO Completed upload id=36 objects=3 duration=172.625µs51852026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51862026/11/12 11:51:04 INFO Completed upload id=27 objects=26 duration=607.209µs51872026/11/12 11:51:04 INFO Aborted multipart uploads count=0 kept=051882026/11/12 11:51:04 WARN Force mode enabled - objects will be deleted immediately without grace period51892026/11/12 11:51:04 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=051902026/11/12 11:51:04 INFO Received complete upload request method=POST path=/51912026/11/12 11:51:04 INFO Completed upload id=12 objects=9 duration=259.709µs51922026/11/12 11:51:04 INFO Vacuumed table table=pending_closures51932026/11/12 11:51:04 INFO Vacuumed table table=commit_receipts51942026/11/12 11:51:04 INFO Received complete push request method=POST path=/51952026/11/12 11:51:04 INFO Vacuumed table table=pending_objects51962026/11/12 11:51:04 INFO Vacuumed table table=multipart_uploads51972026/11/12 11:51:04 INFO Completed push id=28 objects=6 duration=233.542µs51982026/11/12 11:51:04 INFO Vacuumed table table=closures51992026/11/12 11:51:04 INFO Vacuumed table table=objects52002026/11/12 11:51:04 INFO Received complete push request method=POST path=/52012026/11/12 11:51:04 INFO Completed push id=29 objects=6 duration=257.458µs52022026/11/12 11:51:04 INFO Received complete upload request method=POST path=/52032026/11/12 11:51:04 INFO Completed upload id=30 objects=8 duration=418µs52042026/11/12 11:51:04 INFO Received complete upload request method=POST path=/52052026/11/12 11:51:04 INFO Completed upload id=31 objects=6 duration=824.916µs52062026/11/12 11:51:04 INFO Received complete upload request method=POST path=/52072026/11/12 11:51:04 INFO Completed upload id=32 objects=4 duration=298.291µs52082026/11/12 11:51:04 INFO Received complete upload request method=POST path=/52092026/11/12 11:51:04 INFO Completed upload id=33 objects=10 duration=753.708µs52102026/11/12 11:51:04 INFO Received complete upload request method=POST path=/52112026/11/12 11:51:04 INFO Completed upload id=34 objects=23 duration=1.354333ms52122026/11/12 11:51:05 INFO Received complete push request method=POST path=/52132026/11/12 11:51:05 INFO Completed push id=35 objects=6 duration=1.184083ms52142026/11/12 11:51:05 INFO Aborted multipart uploads count=0 kept=052152026/11/12 11:51:05 WARN Force mode enabled - objects will be deleted immediately without grace period52162026/11/12 11:51:05 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=052172026/11/12 11:51:05 INFO Received complete upload request method=POST path=/52182026/11/12 11:51:05 INFO Completed upload id=18 objects=22 duration=538.042µs52192026/11/12 11:51:05 INFO Vacuumed table table=pending_closures52202026/11/12 11:51:05 INFO Vacuumed table table=commit_receipts52212026/11/12 11:51:05 INFO Vacuumed table table=pending_objects52222026/11/12 11:51:05 INFO Vacuumed table table=multipart_uploads52232026/11/12 11:51:05 INFO Vacuumed table table=closures52242026/11/12 11:51:05 INFO Vacuumed table table=objects52252026/11/12 11:51:05 INFO Received complete upload request method=POST path=/52262026/11/12 11:51:05 INFO Completed upload id=21 objects=8 duration=288.833µs52272026/11/12 11:51:05 INFO Received complete upload request method=POST path=/52282026/11/12 11:51:05 INFO Completed upload id=22 objects=7 duration=302.375µs52292026/11/12 11:51:05 INFO Received complete push request method=POST path=/52302026/11/12 11:51:05 INFO Completed push id=24 objects=5 duration=284.917µs52312026/11/12 11:51:05 INFO Received complete upload request method=POST path=/52322026/11/12 11:51:05 INFO Completed upload id=25 objects=8 duration=218.959µs52332026/11/12 11:51:05 INFO Received complete push request method=POST path=/52342026/11/12 11:51:05 INFO Completed push id=26 objects=4 duration=268.709µs52352026/11/12 11:51:05 INFO Received complete push request method=POST path=/52362026/11/12 11:51:05 INFO Completed push id=30 objects=2 duration=226.875µs52372026/11/12 11:51:05 INFO Received complete push request method=POST path=/52382026/11/12 11:51:05 INFO Completed push id=32 objects=7 duration=370.25µs52392026/11/12 11:51:05 INFO Received complete upload request method=POST path=/52402026/11/12 11:51:05 INFO Completed upload id=33 objects=6 duration=224.375µs52412026/11/12 11:51:05 INFO Received complete upload request method=POST path=/52422026/11/12 11:51:05 INFO Completed upload id=34 objects=3 duration=184.417µs52432026/11/12 11:51:05 INFO Aborted multipart uploads count=0 kept=052442026/11/12 11:51:05 WARN Force mode enabled - objects will be deleted immediately without grace period52452026/11/12 11:51:05 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=052462026/11/12 11:51:05 INFO Vacuumed table table=pending_closures52472026/11/12 11:51:05 INFO Vacuumed table table=commit_receipts52482026/11/12 11:51:05 INFO Vacuumed table table=pending_objects52492026/11/12 11:51:05 INFO Vacuumed table table=multipart_uploads52502026/11/12 11:51:05 INFO Vacuumed table table=closures52512026/11/12 11:51:05 INFO Vacuumed table table=objects5252--- PASS: FuzzPushGC (0.00s)5253 --- PASS: FuzzPushGC/seed#3 (4.78s)5254 --- PASS: FuzzPushGC/seed#14 (6.30s)5255 --- PASS: FuzzPushGC/seed#5 (9.32s)5256 --- PASS: FuzzPushGC/seed#2 (9.43s)5257 --- PASS: FuzzPushGC/seed#1 (10.25s)5258 --- PASS: FuzzPushGC/seed#15 (10.96s)5259 --- PASS: FuzzPushGC/seed#4 (12.04s)5260 --- PASS: FuzzPushGC/seed#0 (12.92s)5261 --- PASS: FuzzPushGC/seed#6 (13.10s)5262 --- PASS: FuzzPushGC/seed#9 (13.90s)5263 --- PASS: FuzzPushGC/seed#7 (13.97s)5264 --- PASS: FuzzPushGC/seed#8 (14.10s)5265 --- PASS: FuzzPushGC/seed#13 (14.31s)5266 --- PASS: FuzzPushGC/seed#11 (14.57s)5267 --- PASS: FuzzPushGC/seed#12 (14.97s)5268 --- PASS: FuzzPushGC/seed#10 (15.14s)5269PASS5270{"timestamp":"2026-11-12T11:51:05.208582Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:53010","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(3)"}5271{"timestamp":"2026-11-12T11:51:05.208587Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:52715","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(2)"}5272{"timestamp":"2026-11-12T11:51:05.208981Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:53086","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(2)"}5273{"timestamp":"2026-11-12T11:51:05.208998Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:53100","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(2)"}5274{"timestamp":"2026-11-12T11:51:05.209199Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:53092","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(4)"}52752026-11-12 11:51:05.360 UTC [56706] LOG: received smart shutdown request52762026-11-12 11:51:05.361 UTC [56706] LOG: background worker "logical replication launcher" (PID 56716) exited with exit code 152772026-11-12 11:51:06.319 UTC [56711] LOG: checkpoint complete: wrote 3264 buffers (19.9%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 33 recycled; write=32.106 s, sync=0.831 s, total=33.138 s; sync files=43132, longest=0.001 s, average=0.001 s; distance=533263 kB, estimate=533263 kB; lsn=0/28071548, redo lsn=0/22050C0852782026-11-12 11:51:06.321 UTC [56711] LOG: shutting down52792026-11-12 11:51:06.321 UTC [56711] LOG: checkpoint starting: shutdown immediate52802026-11-12 11:51:06.833 UTC [56711] LOG: checkpoint complete: wrote 9075 buffers (55.4%), wrote 2 SLRU buffers; 0 WAL file(s) added, 0 removed, 6 recycled; write=0.463 s, sync=0.046 s, total=0.512 s; sync files=3066, longest=0.001 s, average=0.001 s; distance=98434 kB, estimate=489780 kB; lsn=0/280715C0, redo lsn=0/280715C052812026-11-12 11:51:06.840 UTC [56706] LOG: database system is shut down5282Running OIDC tests...5283=== RUN TestAudienceForIssuer5284=== PAUSE TestAudienceForIssuer5285=== RUN TestProviderClientGivesUpOnSilentIssuer5286=== PAUSE TestProviderClientGivesUpOnSilentIssuer5287=== RUN TestGlobMatch5288=== PAUSE TestGlobMatch5289=== RUN TestValidateToken_ValidToken5290=== PAUSE TestValidateToken_ValidToken5291=== RUN TestValidateToken_WrongAudience5292=== PAUSE TestValidateToken_WrongAudience5293=== RUN TestValidateToken_Expired5294=== PAUSE TestValidateToken_Expired5295=== RUN TestValidateToken_BoundClaimsMismatch5296=== PAUSE TestValidateToken_BoundClaimsMismatch5297=== RUN TestValidateToken_BoundSubjectMismatch5298=== PAUSE TestValidateToken_BoundSubjectMismatch5299=== RUN TestValidateToken_MultipleProviders5300=== PAUSE TestValidateToken_MultipleProviders5301=== RUN TestValidateToken_UnknownIssuerFetchesNoKeys5302=== PAUSE TestValidateToken_UnknownIssuerFetchesNoKeys5303=== RUN TestValidateToken_GoogleSchemelessIssuer5304=== PAUSE TestValidateToken_GoogleSchemelessIssuer5305=== RUN TestValidateToken_KubernetesServiceAccount5306=== PAUSE TestValidateToken_KubernetesServiceAccount5307=== RUN TestNewValidator_KubernetesRequiresCA5308=== PAUSE TestNewValidator_KubernetesRequiresCA5309=== RUN TestValidateToken_KubernetesIssuerFromOwnToken5310=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken5311=== RUN TestPins_ReservedForMatchingRule5312=== PAUSE TestPins_ReservedForMatchingRule5313=== RUN TestPins_TopLevelShorthand5314=== PAUSE TestPins_TopLevelShorthand5315=== RUN TestPins_ConfigValidation5316=== PAUSE TestPins_ConfigValidation5317=== RUN TestScopes_LegacyProviderDefaultsToWrite5318=== PAUSE TestScopes_LegacyProviderDefaultsToWrite5319=== RUN TestScopes_Rules5320=== PAUSE TestScopes_Rules5321=== RUN TestScopes_ConfigValidation5322=== PAUSE TestScopes_ConfigValidation5323=== CONT TestAudienceForIssuer5324=== CONT TestValidateToken_GoogleSchemelessIssuer5325=== CONT TestPins_ReservedForMatchingRule5326=== CONT TestValidateToken_Expired5327=== CONT TestProviderClientGivesUpOnSilentIssuer5328=== CONT TestNewValidator_KubernetesRequiresCA5329=== CONT TestValidateToken_KubernetesServiceAccount5330--- PASS: TestAudienceForIssuer (0.00s)5331=== CONT TestValidateToken_WrongAudience5332=== CONT TestValidateToken_ValidToken5333--- PASS: TestProviderClientGivesUpOnSilentIssuer (0.00s)5334=== CONT TestGlobMatch5335=== RUN TestGlobMatch/foo_foo5336=== PAUSE TestGlobMatch/foo_foo5337=== RUN TestGlobMatch/foo_bar5338=== PAUSE TestGlobMatch/foo_bar5339=== RUN TestGlobMatch/*_5340=== PAUSE TestGlobMatch/*_5341=== RUN TestGlobMatch/*_anything5342=== PAUSE TestGlobMatch/*_anything5343=== RUN TestGlobMatch/foo*_foo5344=== PAUSE TestGlobMatch/foo*_foo5345=== RUN TestGlobMatch/foo*_foobar5346=== PAUSE TestGlobMatch/foo*_foobar5347=== RUN TestGlobMatch/foo*_bar5348=== PAUSE TestGlobMatch/foo*_bar5349=== RUN TestGlobMatch/*bar_bar5350=== PAUSE TestGlobMatch/*bar_bar5351=== RUN TestGlobMatch/*bar_foobar5352=== PAUSE TestGlobMatch/*bar_foobar5353=== RUN TestGlobMatch/*bar_foo5354=== PAUSE TestGlobMatch/*bar_foo5355=== RUN TestGlobMatch/foo*bar_foobar5356=== PAUSE TestGlobMatch/foo*bar_foobar5357=== RUN TestGlobMatch/foo*bar_foo123bar5358=== PAUSE TestGlobMatch/foo*bar_foo123bar5359=== RUN TestGlobMatch/foo*bar_foobarbaz5360=== PAUSE TestGlobMatch/foo*bar_foobarbaz5361=== RUN TestGlobMatch/*/*_foo/bar5362=== PAUSE TestGlobMatch/*/*_foo/bar5363=== RUN TestGlobMatch/*/*_foo5364=== PAUSE TestGlobMatch/*/*_foo5365=== RUN TestGlobMatch/refs/heads/*_refs/heads/main5366=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main5367=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.05368=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.05369=== RUN TestGlobMatch/refs/*/main_refs/heads/main5370=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main5371=== RUN TestGlobMatch/fo?_foo5372=== PAUSE TestGlobMatch/fo?_foo5373=== RUN TestGlobMatch/fo?_fo5374=== PAUSE TestGlobMatch/fo?_fo5375=== RUN TestGlobMatch/fo?_fooo5376=== PAUSE TestGlobMatch/fo?_fooo5377=== RUN TestGlobMatch/?oo_foo5378=== PAUSE TestGlobMatch/?oo_foo5379=== RUN TestGlobMatch/?oo_boo5380=== PAUSE TestGlobMatch/?oo_boo5381=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5382=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5383=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5384=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5385=== CONT TestGlobMatch/foo_foo5386=== CONT TestValidateToken_MultipleProviders5387=== CONT TestGlobMatch/*/*_foo/bar5388=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5389=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5390=== CONT TestGlobMatch/?oo_boo5391=== CONT TestGlobMatch/?oo_foo5392=== CONT TestGlobMatch/fo?_fooo5393=== CONT TestGlobMatch/fo?_fo5394=== CONT TestGlobMatch/fo?_foo5395=== CONT TestGlobMatch/refs/*/main_refs/heads/main5396=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.05397=== CONT TestGlobMatch/refs/heads/*_refs/heads/main5398=== CONT TestGlobMatch/*/*_foo5399=== CONT TestGlobMatch/*bar_bar5400=== CONT TestGlobMatch/foo*bar_foobarbaz5401=== CONT TestGlobMatch/foo*bar_foo123bar5402=== CONT TestGlobMatch/foo*bar_foobar5403=== CONT TestGlobMatch/*bar_foo5404=== CONT TestGlobMatch/*bar_foobar5405=== CONT TestGlobMatch/foo*_foo5406=== CONT TestGlobMatch/foo*_bar5407=== CONT TestGlobMatch/foo*_foobar5408=== CONT TestGlobMatch/*_5409=== CONT TestGlobMatch/*_anything5410=== CONT TestGlobMatch/foo_bar5411--- PASS: TestGlobMatch (0.00s)5412 --- PASS: TestGlobMatch/foo_foo (0.00s)5413 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)5414 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)5415 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)5416 --- PASS: TestGlobMatch/?oo_boo (0.00s)5417 --- PASS: TestGlobMatch/?oo_foo (0.00s)5418 --- PASS: TestGlobMatch/fo?_fooo (0.00s)5419 --- PASS: TestGlobMatch/fo?_fo (0.00s)5420 --- PASS: TestGlobMatch/fo?_foo (0.00s)5421 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)5422 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)5423 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)5424 --- PASS: TestGlobMatch/*/*_foo (0.00s)5425 --- PASS: TestGlobMatch/*bar_bar (0.00s)5426 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)5427 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)5428 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)5429 --- PASS: TestGlobMatch/*bar_foo (0.00s)5430 --- PASS: TestGlobMatch/*bar_foobar (0.00s)5431 --- PASS: TestGlobMatch/foo*_foo (0.00s)5432 --- PASS: TestGlobMatch/foo*_bar (0.00s)5433 --- PASS: TestGlobMatch/foo*_foobar (0.00s)5434 --- PASS: TestGlobMatch/*_ (0.00s)5435 --- PASS: TestGlobMatch/*_anything (0.00s)5436 --- PASS: TestGlobMatch/foo_bar (0.00s)5437=== CONT TestValidateToken_UnknownIssuerFetchesNoKeys5438=== CONT TestPins_TopLevelShorthand54392026/11/12 11:51:08 INFO OIDC provider initialized name=known issuer=https://known.example5440=== CONT TestScopes_ConfigValidation5441=== CONT TestScopes_Rules5442--- PASS: TestScopes_ConfigValidation (0.00s)5443=== CONT TestScopes_LegacyProviderDefaultsToWrite5444=== CONT TestPins_ConfigValidation5445--- PASS: TestPins_ConfigValidation (0.00s)5446=== CONT TestValidateToken_BoundSubjectMismatch5447=== CONT TestValidateToken_BoundClaimsMismatch5448=== CONT TestValidateToken_KubernetesIssuerFromOwnToken54492026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53889/oidc5450--- PASS: TestPins_TopLevelShorthand (0.06s)54512026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53891/oidc5452--- PASS: TestScopes_Rules (0.07s)54532026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53895/oidc54542026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53897/oidc54552026/11/12 11:51:08 http: TLS handshake error from 127.0.0.1:53894: read tcp 127.0.0.1:53893->127.0.0.1:53894: use of closed network connection5456--- PASS: TestNewValidator_KubernetesRequiresCA (0.08s)5457--- PASS: TestValidateToken_UnknownIssuerFetchesNoKeys (0.07s)5458--- PASS: TestValidateToken_BoundClaimsMismatch (0.06s)5459--- PASS: TestValidateToken_WrongAudience (0.08s)54602026/11/12 11:51:08 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:539025461--- PASS: TestValidateToken_KubernetesServiceAccount (0.11s)54622026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53904/oidc5463--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.11s)54642026/11/12 11:51:08 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC12354652026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53906/oidc5466--- PASS: TestValidateToken_BoundSubjectMismatch (0.11s)5467--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.11s)54682026/11/12 11:51:08 INFO OIDC provider initialized name=google issuer=https://accounts.google.com5469--- PASS: TestValidateToken_GoogleSchemelessIssuer (0.14s)54702026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53912/oidc5471--- PASS: TestValidateToken_ValidToken (0.15s)54722026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53915/oidc5473--- PASS: TestValidateToken_Expired (0.18s)54742026/11/12 11:51:08 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:53914/oidc54752026/11/12 11:51:08 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:53917/oidc5476--- PASS: TestValidateToken_MultipleProviders (0.18s)54772026/11/12 11:51:08 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:53920/oidc5478--- PASS: TestPins_ReservedForMatchingRule (0.20s)5479PASS5480Running hook tests...5481=== RUN TestSendPathsEmpty5482=== PAUSE TestSendPathsEmpty5483=== RUN TestQueueEnqueueAndFetch5484=== PAUSE TestQueueEnqueueAndFetch5485=== RUN TestQueueDeduplication5486=== PAUSE TestQueueDeduplication5487=== RUN TestQueueRemove5488=== PAUSE TestQueueRemove5489=== RUN TestQueueFetchBatchLimit5490=== PAUSE TestQueueFetchBatchLimit5491=== RUN TestQueueRetryMovesToBack5492=== PAUSE TestQueueRetryMovesToBack5493=== RUN TestQueueFetchRemoveLifecycle5494=== PAUSE TestQueueFetchRemoveLifecycle5495=== RUN TestQueueConcurrentWriters5496=== PAUSE TestQueueConcurrentWriters5497=== RUN TestQueueRemoveLargeClosure5498=== PAUSE TestQueueRemoveLargeClosure5499=== RUN TestServerClientIntegration5500--- PASS: TestServerClientIntegration (0.00s)5501=== RUN TestServerQueueError55022026/11/12 11:51:09 ERROR Failed to queue paths error="permission denied" count=15503--- PASS: TestServerQueueError (0.00s)5504=== RUN TestGetListenerSocketActivation5505 server_test.go:147: systemd socket activation does not exist on darwin5506--- SKIP: TestGetListenerSocketActivation (0.00s)5507=== RUN TestServerStalledClientDoesNotBlockShutdown5508=== PAUSE TestServerStalledClientDoesNotBlockShutdown5509=== RUN TestServerBacksOffOnAcceptErrors5510=== PAUSE TestServerBacksOffOnAcceptErrors5511=== RUN TestDrainIsolatesPoisonPath5512=== PAUSE TestDrainIsolatesPoisonPath5513=== RUN TestRunNotBlockedByPoisonHead5514=== PAUSE TestRunNotBlockedByPoisonHead5515=== RUN TestDrainGivesUpWhenServerDown5516=== PAUSE TestDrainGivesUpWhenServerDown5517=== RUN TestFailedPathPrunedByLaterClosure5518=== PAUSE TestFailedPathPrunedByLaterClosure5519=== RUN TestWorkerUploadsAndRemoves5520=== PAUSE TestWorkerUploadsAndRemoves5521=== RUN TestWorkerSkipsGCdPaths5522=== PAUSE TestWorkerSkipsGCdPaths5523=== RUN TestWorkerPrunesClosureDeps5524=== PAUSE TestWorkerPrunesClosureDeps5525=== RUN TestDrainTimeout5526=== PAUSE TestDrainTimeout5527=== RUN TestWorkerRemoveFailureIsNotProgress5528=== PAUSE TestWorkerRemoveFailureIsNotProgress5529=== RUN TestWorkerKeepsPathItCannotStat5530=== PAUSE TestWorkerKeepsPathItCannotStat5531=== CONT TestSendPathsEmpty5532=== CONT TestQueueConcurrentWriters5533--- PASS: TestSendPathsEmpty (0.00s)5534=== CONT TestWorkerKeepsPathItCannotStat5535=== CONT TestWorkerRemoveFailureIsNotProgress5536=== CONT TestDrainTimeout5537=== CONT TestWorkerPrunesClosureDeps5538=== CONT TestWorkerSkipsGCdPaths5539=== CONT TestWorkerUploadsAndRemoves5540=== CONT TestFailedPathPrunedByLaterClosure5541=== CONT TestDrainGivesUpWhenServerDown5542=== CONT TestQueueRemove5543=== CONT TestQueueDeduplication5544=== CONT TestQueueFetchBatchLimit5545=== CONT TestQueueEnqueueAndFetch5546=== CONT TestQueueFetchRemoveLifecycle5547=== CONT TestServerBacksOffOnAcceptErrors5548=== CONT TestRunNotBlockedByPoisonHead5549=== CONT TestQueueRetryMovesToBack55502000/01/01 00:00:00 ERROR Accept failed error="too many open files"55512000/01/01 00:00:00 ERROR Accept failed error="too many open files"55522000/01/01 00:00:00 ERROR Accept failed error="too many open files"55532000/01/01 00:00:00 ERROR Accept failed error="too many open files"55542000/01/01 00:00:00 ERROR Accept failed error="too many open files"55552000/01/01 00:00:00 ERROR Accept failed error="too many open files"55562000/01/01 00:00:00 ERROR Accept failed error="too many open files"55572000/01/01 00:00:00 ERROR Accept failed error="too many open files"5558--- PASS: TestServerBacksOffOnAcceptErrors (0.00s)5559=== CONT TestDrainIsolatesPoisonPath5560=== CONT TestServerStalledClientDoesNotBlockShutdown5561=== CONT TestQueueRemoveLargeClosure55622026/11/12 11:51:09 WARN Cannot stat store path, will retry later path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerKeepsPathItCannotStat3110655234/002/locked/aaa error="stat /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerKeepsPathItCannotStat3110655234/002/locked/aaa: permission denied"55632026/11/12 11:51:09 INFO Upload queue status pending=255642026/11/12 11:51:09 INFO Upload queue status pending=255652026/11/12 11:51:09 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerSkipsGCdPaths13849781/002/nonexistent55662026/11/12 11:51:09 INFO Uploading batch count=155672026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=155682026/11/12 11:51:09 INFO Uploading batch count=25569--- PASS: TestQueueRetryMovesToBack (0.01s)55702026/11/12 11:51:09 INFO Uploading batch count=155712026/11/12 11:51:09 INFO Upload queue status pending=255722026/11/12 11:51:09 INFO Uploading batch count=15573--- PASS: TestQueueEnqueueAndFetch (0.01s)55742026/11/12 11:51:09 INFO Uploading batch count=15575--- PASS: TestQueueFetchBatchLimit (0.01s)55762026/11/12 11:51:09 INFO Uploading batch count=455772026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=455782026/11/12 11:51:09 INFO Uploading batch count=155792026/11/12 11:51:09 INFO Upload queue status pending=355802026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainIsolatesPoisonPath4198931118/002/bbb55812026/11/12 11:51:09 INFO Uploading batch count=155822026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=15583--- PASS: TestQueueFetchRemoveLifecycle (0.01s)55842026/11/12 11:51:09 WARN Cannot stat store path, will retry later path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerKeepsPathItCannotStat3110655234/002/locked/aaa error="stat /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerKeepsPathItCannotStat3110655234/002/locked/aaa: permission denied"55852026/11/12 11:51:09 INFO Uploading batch count=255862026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=255872026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainGivesUpWhenServerDown1890767400/002/a55882000/01/01 00:00:00 INFO Uploading batch count=255892000/01/01 00:00:00 ERROR Upload failed error="context deadline exceeded" count=25590--- PASS: TestQueueDeduplication (0.01s)55912000/01/01 00:00:00 ERROR Drain finished with paths left in queue remaining=455922026/11/12 11:51:09 WARN Cannot stat store path, will retry later path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerKeepsPathItCannotStat3110655234/002/locked/aaa error="stat /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerKeepsPathItCannotStat3110655234/002/locked/aaa: permission denied"55932026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainGivesUpWhenServerDown1890767400/002/b55942026/11/12 11:51:09 ERROR Drain finished with paths left in queue remaining=15595--- PASS: TestQueueRemove (0.02s)55962026/11/12 11:51:09 INFO Uploading batch count=155972026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=155982026/11/12 11:51:09 INFO Uploading batch count=255992026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=25600--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)56012026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainGivesUpWhenServerDown1890767400/002/c56022026/11/12 11:51:09 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerRemoveFailureIsNotProgress2357432727/002/nonexistent56032026/11/12 11:51:09 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=156042026/11/12 11:51:09 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerRemoveFailureIsNotProgress2357432727/002/nonexistent56052026/11/12 11:51:09 INFO Uploading batch count=156062026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=156072026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainGivesUpWhenServerDown1890767400/002/d56082026/11/12 11:51:09 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=156092026/11/12 11:51:09 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestWorkerRemoveFailureIsNotProgress2357432727/002/nonexistent56102026/11/12 11:51:09 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=156112026/11/12 11:51:09 INFO Uploading batch count=156122026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=156132026/11/12 11:51:09 INFO Uploading batch count=256142026/11/12 11:51:09 ERROR Upload failed error="upload failed" count=256152026/11/12 11:51:09 ERROR Drain finished with paths left in queue remaining=156162026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainGivesUpWhenServerDown1890767400/002/e56172026/11/12 11:51:09 ERROR Drain finished with paths left in queue remaining=156182026/11/12 11:51:09 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestDrainGivesUpWhenServerDown1890767400/002/f5619--- PASS: TestDrainTimeout (0.02s)56202026/11/12 11:51:09 ERROR Drain finished with paths left in queue remaining=105621--- PASS: TestWorkerKeepsPathItCannotStat (0.02s)5622--- PASS: TestWorkerRemoveFailureIsNotProgress (0.02s)5623--- PASS: TestDrainIsolatesPoisonPath (0.02s)5624--- PASS: TestDrainGivesUpWhenServerDown (0.02s)5625--- PASS: TestWorkerSkipsGCdPaths (0.03s)5626--- PASS: TestWorkerPrunesClosureDeps (0.03s)5627--- PASS: TestWorkerUploadsAndRemoves (0.03s)5628--- PASS: TestQueueRemoveLargeClosure (0.05s)5629--- PASS: TestQueueConcurrentWriters (0.06s)56302026/11/12 11:51:09 ERROR Failed to decode request error="read unix /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/hook3494128896/test.sock->: i/o timeout"56312026/11/12 11:51:09 ERROR Failed to write response error="write unix /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/hook3494128896/test.sock->: i/o timeout"5632--- PASS: TestServerStalledClientDoesNotBlockShutdown (0.20s)56332026/11/12 11:51:10 INFO Uploading batch count=156342026/11/12 11:51:10 INFO Uploading batch count=156352026/11/12 11:51:10 INFO Uploading batch count=156362026/11/12 11:51:10 ERROR Upload failed error="upload failed" count=156372026/11/12 11:51:10 INFO Uploading batch count=156382026/11/12 11:51:10 ERROR Upload failed error="upload failed" count=156392026/11/12 11:51:10 INFO Uploading batch count=156402026/11/12 11:51:10 ERROR Upload failed error="upload failed" count=156412026/11/12 11:51:10 INFO Uploading batch count=156422026/11/12 11:51:10 ERROR Upload failed error="upload failed" count=156432026/11/12 11:51:10 ERROR Drain finished with paths left in queue remaining=15644--- PASS: TestRunNotBlockedByPoisonHead (1.04s)5645PASS5646Running signing tests...5647=== RUN TestExternalSigner5648=== PAUSE TestExternalSigner5649=== RUN TestExternalSignerWrongPublicKey5650=== PAUSE TestExternalSignerWrongPublicKey5651=== RUN TestExternalSignerErrors5652=== PAUSE TestExternalSignerErrors5653=== RUN TestExternalSignerRestartsAfterCrash5654=== PAUSE TestExternalSignerRestartsAfterCrash5655=== RUN TestExternalSignerProgramErrorKeepsProcess5656=== PAUSE TestExternalSignerProgramErrorKeepsProcess5657=== RUN TestExternalSignerClose5658=== PAUSE TestExternalSignerClose5659=== RUN TestExternalSignerRejectsInvalidPublicKey5660=== PAUSE TestExternalSignerRejectsInvalidPublicKey5661=== RUN TestExternalSignerCancellation5662=== PAUSE TestExternalSignerCancellation5663=== RUN TestGenerateFingerprint5664=== PAUSE TestGenerateFingerprint5665=== RUN TestParseSigningKey5666=== PAUSE TestParseSigningKey5667=== RUN TestSign5668=== PAUSE TestSign5669=== RUN TestSignBatch5670=== PAUSE TestSignBatch5671=== RUN TestNilKeyPublicKey5672=== PAUSE TestNilKeyPublicKey5673=== RUN TestSignErrors5674=== PAUSE TestSignErrors5675=== CONT TestExternalSigner5676=== CONT TestExternalSignerCancellation5677=== CONT TestExternalSignerProgramErrorKeepsProcess5678=== CONT TestExternalSignerErrors5679=== RUN TestExternalSignerErrors/exit_at_startup5680=== CONT TestSignBatch5681=== CONT TestSignErrors5682=== CONT TestNilKeyPublicKey5683--- PASS: TestNilKeyPublicKey (0.00s)5684=== CONT TestParseSigningKey5685=== RUN TestParseSigningKey/valid_32-byte_key5686=== CONT TestSign5687=== CONT TestGenerateFingerprint5688=== RUN TestGenerateFingerprint/basic_with_references5689=== CONT TestExternalSignerRejectsInvalidPublicKey5690=== RUN TestExternalSignerRejectsInvalidPublicKey/#005691=== CONT TestExternalSignerRestartsAfterCrash5692=== PAUSE TestExternalSignerRejectsInvalidPublicKey/#005693=== RUN TestExternalSignerRejectsInvalidPublicKey/no-colon5694=== PAUSE TestExternalSignerRejectsInvalidPublicKey/no-colon5695=== RUN TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5696=== PAUSE TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5697=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5698=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5699=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5700=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5701=== CONT TestExternalSignerRejectsInvalidPublicKey/#005702=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5703=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5704=== CONT TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5705=== CONT TestExternalSignerRejectsInvalidPublicKey/no-colon5706--- PASS: TestExternalSignerRejectsInvalidPublicKey (0.00s)5707 --- PASS: TestExternalSignerRejectsInvalidPublicKey/#00 (0.00s)5708 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:YQ== (0.00s)5709 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:invalid! (0.00s)5710 --- PASS: TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= (0.00s)5711 --- PASS: TestExternalSignerRejectsInvalidPublicKey/no-colon (0.00s)5712=== CONT TestExternalSignerClose5713=== CONT TestExternalSignerWrongPublicKey5714=== PAUSE TestExternalSignerErrors/exit_at_startup5715=== PAUSE TestParseSigningKey/valid_32-byte_key5716=== PAUSE TestGenerateFingerprint/basic_with_references5717=== RUN TestParseSigningKey/valid_32-byte_key_with_different_name5718=== PAUSE TestParseSigningKey/valid_32-byte_key_with_different_name5719=== RUN TestParseSigningKey/no_colon5720=== PAUSE TestParseSigningKey/no_colon5721=== RUN TestParseSigningKey/empty_name5722=== PAUSE TestParseSigningKey/empty_name5723=== RUN TestParseSigningKey/invalid_base645724=== PAUSE TestParseSigningKey/invalid_base645725=== RUN TestParseSigningKey/wrong_length5726=== RUN TestGenerateFingerprint/no_references5727=== PAUSE TestGenerateFingerprint/no_references5728=== RUN TestGenerateFingerprint/unsorted_references_get_sorted5729=== PAUSE TestGenerateFingerprint/unsorted_references_get_sorted5730=== RUN TestGenerateFingerprint/invalid_nar_hash_prefix5731=== RUN TestExternalSignerErrors/exit_on_request5732=== PAUSE TestParseSigningKey/wrong_length5733=== CONT TestParseSigningKey/valid_32-byte_key5734=== CONT TestParseSigningKey/invalid_base645735=== PAUSE TestGenerateFingerprint/invalid_nar_hash_prefix5736=== PAUSE TestExternalSignerErrors/exit_on_request5737=== CONT TestParseSigningKey/valid_32-byte_key_with_different_name5738=== CONT TestParseSigningKey/empty_name5739=== CONT TestParseSigningKey/wrong_length5740=== CONT TestParseSigningKey/no_colon5741=== RUN TestExternalSignerErrors/null5742=== RUN TestGenerateFingerprint/invalid_nar_hash_length5743=== PAUSE TestGenerateFingerprint/invalid_nar_hash_length5744=== PAUSE TestExternalSignerErrors/null5745=== RUN TestGenerateFingerprint/invalid_store_path_prefix5746=== RUN TestExternalSignerErrors/null_signatures5747=== PAUSE TestGenerateFingerprint/invalid_store_path_prefix5748=== RUN TestGenerateFingerprint/invalid_reference_prefix5749=== PAUSE TestExternalSignerErrors/null_signatures5750=== PAUSE TestGenerateFingerprint/invalid_reference_prefix5751=== RUN TestExternalSignerErrors/too_few_signatures5752=== PAUSE TestExternalSignerErrors/too_few_signatures5753=== RUN TestExternalSignerErrors/unrequested_key5754=== CONT TestGenerateFingerprint/invalid_nar_hash_prefix5755=== CONT TestGenerateFingerprint/invalid_nar_hash_length5756=== CONT TestGenerateFingerprint/no_references5757=== PAUSE TestExternalSignerErrors/unrequested_key5758=== RUN TestExternalSignerErrors/wrong_signature_name5759=== CONT TestGenerateFingerprint/invalid_reference_prefix5760=== PAUSE TestExternalSignerErrors/wrong_signature_name5761=== CONT TestGenerateFingerprint/unsorted_references_get_sorted5762=== CONT TestGenerateFingerprint/invalid_store_path_prefix5763=== CONT TestGenerateFingerprint/basic_with_references5764--- PASS: TestGenerateFingerprint (0.00s)5765 --- PASS: TestGenerateFingerprint/invalid_nar_hash_prefix (0.00s)5766 --- PASS: TestGenerateFingerprint/invalid_nar_hash_length (0.00s)5767 --- PASS: TestGenerateFingerprint/no_references (0.00s)5768 --- PASS: TestGenerateFingerprint/invalid_reference_prefix (0.00s)5769 --- PASS: TestGenerateFingerprint/unsorted_references_get_sorted (0.00s)5770 --- PASS: TestGenerateFingerprint/invalid_store_path_prefix (0.00s)5771 --- PASS: TestGenerateFingerprint/basic_with_references (0.00s)5772=== RUN TestExternalSignerErrors/invalid_JSON5773=== PAUSE TestExternalSignerErrors/invalid_JSON5774=== RUN TestExternalSignerErrors/wrong_id5775=== PAUSE TestExternalSignerErrors/wrong_id5776=== RUN TestExternalSignerErrors/wrong_signatures_shape5777=== PAUSE TestExternalSignerErrors/wrong_signatures_shape5778=== RUN TestExternalSignerErrors/missing_signature_name5779=== PAUSE TestExternalSignerErrors/missing_signature_name5780=== RUN TestExternalSignerErrors/invalid_signature_base645781=== PAUSE TestExternalSignerErrors/invalid_signature_base645782=== RUN TestExternalSignerErrors/program_error5783=== PAUSE TestExternalSignerErrors/program_error5784=== RUN TestExternalSignerErrors/missing_signatures5785=== PAUSE TestExternalSignerErrors/missing_signatures5786=== RUN TestExternalSignerErrors/wrong_signature_length5787=== PAUSE TestExternalSignerErrors/wrong_signature_length5788=== RUN TestExternalSignerErrors/wrong_shape5789=== PAUSE TestExternalSignerErrors/wrong_shape5790=== CONT TestExternalSignerErrors/exit_at_startup5791=== CONT TestExternalSignerErrors/wrong_id5792=== CONT TestExternalSignerErrors/too_few_signatures5793=== CONT TestExternalSignerErrors/program_error5794=== CONT TestExternalSignerErrors/invalid_signature_base645795=== CONT TestExternalSignerErrors/wrong_signature_length5796=== CONT TestExternalSignerErrors/null5797=== CONT TestExternalSignerErrors/null_signatures5798=== RUN TestSignErrors/nil_key5799=== PAUSE TestSignErrors/nil_key5800=== RUN TestSignErrors/nil_narinfo5801=== PAUSE TestSignErrors/nil_narinfo5802=== RUN TestSignErrors/invalid_narinfo5803=== PAUSE TestSignErrors/invalid_narinfo5804=== RUN TestSignErrors/canceled5805=== PAUSE TestSignErrors/canceled5806=== CONT TestSignErrors/nil_key5807=== CONT TestExternalSignerErrors/wrong_shape5808=== CONT TestExternalSignerErrors/invalid_JSON5809=== CONT TestExternalSignerErrors/exit_on_request5810=== CONT TestExternalSignerErrors/missing_signatures5811--- PASS: TestSign (0.00s)5812=== CONT TestSignErrors/canceled5813=== CONT TestSignErrors/invalid_narinfo5814=== CONT TestSignErrors/nil_narinfo5815--- PASS: TestSignErrors (0.00s)5816 --- PASS: TestSignErrors/nil_key (0.00s)5817 --- PASS: TestSignErrors/canceled (0.00s)5818 --- PASS: TestSignErrors/invalid_narinfo (0.00s)5819 --- PASS: TestSignErrors/nil_narinfo (0.00s)5820=== CONT TestExternalSignerErrors/missing_signature_name5821=== CONT TestExternalSignerErrors/unrequested_key5822=== CONT TestExternalSignerErrors/wrong_signatures_shape5823=== CONT TestExternalSignerErrors/wrong_signature_name5824--- PASS: TestParseSigningKey (0.00s)5825 --- PASS: TestParseSigningKey/invalid_base64 (0.00s)5826 --- PASS: TestParseSigningKey/empty_name (0.00s)5827 --- PASS: TestParseSigningKey/wrong_length (0.00s)5828 --- PASS: TestParseSigningKey/no_colon (0.00s)5829 --- PASS: TestParseSigningKey/valid_32-byte_key (0.00s)5830 --- PASS: TestParseSigningKey/valid_32-byte_key_with_different_name (0.00s)5831--- PASS: TestSignBatch (0.01s)5832--- PASS: TestExternalSigner (0.11s)5833--- PASS: TestExternalSignerCancellation (0.20s)5834--- PASS: TestExternalSignerClose (0.25s)5835--- PASS: TestExternalSignerProgramErrorKeepsProcess (0.33s)5836--- PASS: TestExternalSignerRestartsAfterCrash (0.42s)5837/private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestExternalSignerRestartsAfterCrash2099988629/001/sign program: line 7: /private/var/tb/1/scratch/a2f8a8cfe8d40a6c/build/TestExternalSignerRestartsAfterCrash2099988629/001/sign program.starts: No such file or directory5838--- PASS: TestExternalSignerWrongPublicKey (0.48s)5839--- PASS: TestExternalSignerErrors (0.00s)5840 --- PASS: TestExternalSignerErrors/invalid_JSON (0.55s)5841 --- PASS: TestExternalSignerErrors/wrong_shape (0.63s)5842 --- PASS: TestExternalSignerErrors/missing_signature_name (0.70s)5843 --- PASS: TestExternalSignerErrors/wrong_signatures_shape (0.78s)5844 --- PASS: TestExternalSignerErrors/exit_at_startup (0.86s)5845 --- PASS: TestExternalSignerErrors/wrong_signature_name (0.93s)5846 --- PASS: TestExternalSignerErrors/unrequested_key (1.00s)5847 --- PASS: TestExternalSignerErrors/null (1.11s)5848 --- PASS: TestExternalSignerErrors/exit_on_request (1.16s)5849 --- PASS: TestExternalSignerErrors/program_error (1.23s)5850 --- PASS: TestExternalSignerErrors/wrong_id (1.31s)5851 --- PASS: TestExternalSignerErrors/null_signatures (1.38s)5852 --- PASS: TestExternalSignerErrors/invalid_signature_base64 (1.46s)5853 --- PASS: TestExternalSignerErrors/too_few_signatures (1.54s)5854 --- PASS: TestExternalSignerErrors/missing_signatures (1.61s)5855 --- PASS: TestExternalSignerErrors/wrong_signature_length (1.69s)5856PASS5857Running OpenBao signer tests...5858=== RUN TestSign5859=== PAUSE TestSign5860=== RUN TestSignErrors5861=== PAUSE TestSignErrors5862=== RUN TestServe5863=== PAUSE TestServe5864=== RUN TestServeRejectsGarbage5865=== PAUSE TestServeRejectsGarbage5866=== CONT TestSign5867=== CONT TestSignErrors5868=== CONT TestServe5869=== CONT TestServeRejectsGarbage5870=== RUN TestSignErrors/http_error5871=== PAUSE TestSignErrors/http_error5872=== RUN TestSignErrors/invalid_json5873=== PAUSE TestSignErrors/invalid_json5874=== RUN TestSignErrors/no_prefix5875--- PASS: TestServeRejectsGarbage (0.00s)5876=== PAUSE TestSignErrors/no_prefix5877=== RUN TestSignErrors/invalid_base645878=== PAUSE TestSignErrors/invalid_base645879=== CONT TestSignErrors/http_error5880=== CONT TestSignErrors/no_prefix5881=== CONT TestSignErrors/invalid_base645882=== CONT TestSignErrors/invalid_json5883--- PASS: TestServe (0.00s)5884--- PASS: TestSignErrors (0.00s)5885 --- PASS: TestSignErrors/invalid_json (0.00s)5886 --- PASS: TestSignErrors/no_prefix (0.00s)5887 --- PASS: TestSignErrors/http_error (0.00s)5888 --- PASS: TestSignErrors/invalid_base64 (0.00s)5889--- PASS: TestSign (0.00s)5890PASS