niks3-go-unit-tests
checks.aarch64-darwin.go-unit-tests
· build #483
· raw
1tribuchet: building on mac022Running client tests...3=== RUN TestDoServerRequestAttachesToken4=== PAUSE TestDoServerRequestAttachesToken5=== RUN TestUploadBuildLog_FileBodyReplayedOnRetry6=== PAUSE TestUploadBuildLog_FileBodyReplayedOnRetry7=== RUN TestRegisterUploadedObjectReusesConnections8=== PAUSE TestRegisterUploadedObjectReusesConnections9=== RUN TestRunGarbageCollection_FinishedOnAnotherReplica10=== PAUSE TestRunGarbageCollection_FinishedOnAnotherReplica11=== RUN TestRunGarbageCollection_NotFoundAfterLocalRun12=== PAUSE TestRunGarbageCollection_NotFoundAfterLocalRun13=== RUN TestCaseHackSuffix14=== PAUSE TestCaseHackSuffix15=== RUN TestFilterOversizedClosures16=== PAUSE TestFilterOversizedClosures17=== RUN TestUploadMultipart_PartsInParallel18=== PAUSE TestUploadMultipart_PartsInParallel19=== RUN TestUploadMultipart_ReturnsAfterDroppedBody20=== PAUSE TestUploadMultipart_ReturnsAfterDroppedBody21=== RUN TestPartSizeForNAR22=== PAUSE TestPartSizeForNAR23=== RUN TestDumpPathCaseHackMatchesNix24--- PASS: TestDumpPathCaseHackMatchesNix (0.04s)25=== RUN TestDumpPathCaseHackCollision26--- PASS: TestDumpPathCaseHackCollision (0.00s)27=== RUN TestDumpPathMatchesNix28=== PAUSE TestDumpPathMatchesNix29=== RUN TestDumpPathSingleFile30=== PAUSE TestDumpPathSingleFile31=== RUN TestDumpPathWriterError32=== PAUSE TestDumpPathWriterError33=== RUN TestEncodeNixBase3234=== PAUSE TestEncodeNixBase3235=== RUN TestEncodeNixBase32WithRealHash36=== PAUSE TestEncodeNixBase32WithRealHash37=== RUN TestConvertHashToNix3238=== PAUSE TestConvertHashToNix3239=== RUN TestGetStorePathHash40=== PAUSE TestGetStorePathHash41=== RUN TestPathInfoHashCompatibility42=== PAUSE TestPathInfoHashCompatibility43=== RUN TestParsePathInfoJSON44=== PAUSE TestParsePathInfoJSON45=== RUN TestParsePathInfoJSONMultiplePaths46=== PAUSE TestParsePathInfoJSONMultiplePaths47=== RUN TestPathInfoCACompatibility48=== PAUSE TestPathInfoCACompatibility49=== RUN TestRateLimiterFeedback50=== PAUSE TestRateLimiterFeedback51=== RUN TestRateLimiterFeedback_400DoesNotCountAsSuccess52=== PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess53=== RUN TestRegisterUploadedObject_BoundedAgainstSilentServer54=== PAUSE TestRegisterUploadedObject_BoundedAgainstSilentServer55=== RUN TestRegisterUploadedObject_OutlivesPush56=== PAUSE TestRegisterUploadedObject_OutlivesPush57=== RUN TestResolveStorePath58=== PAUSE TestResolveStorePath59=== RUN TestDoWithRetry_BodyReplayedViaGetBody60=== PAUSE TestDoWithRetry_BodyReplayedViaGetBody61=== RUN TestRetryTimeoutOutlastsMaxRetries62=== PAUSE TestRetryTimeoutOutlastsMaxRetries63=== RUN TestDoWithRetry_FinalResponseBodyReadable64=== PAUSE TestDoWithRetry_FinalResponseBodyReadable65=== RUN TestShellSplit66=== PAUSE TestShellSplit67=== RUN TestShellSplitErrors68=== PAUSE TestShellSplitErrors69=== RUN TestStreamPushReportsEveryPath70=== PAUSE TestStreamPushReportsEveryPath71=== RUN TestStreamPushBatchesUnderLoad72=== PAUSE TestStreamPushBatchesUnderLoad73=== RUN TestStreamPushIsolatesFailures74=== PAUSE TestStreamPushIsolatesFailures75=== RUN TestStreamPushGivesUpOnDeadServer76=== PAUSE TestStreamPushGivesUpOnDeadServer77=== RUN TestStreamPushRequestLine78=== PAUSE TestStreamPushRequestLine79=== RUN TestStreamPushReportsSignatures80=== PAUSE TestStreamPushReportsSignatures81=== RUN TestStreamPushReportsSkippedPaths82=== PAUSE TestStreamPushReportsSkippedPaths83=== RUN TestClientSignaturesByStorePath84=== PAUSE TestClientSignaturesByStorePath85=== RUN TestStreamPushStopsWhenCanceled86=== PAUSE TestStreamPushStopsWhenCanceled87=== RUN TestSetClientTLS88=== PAUSE TestSetClientTLS89=== RUN TestSetClientTLSDoesNotMutateDefaultTransport90=== PAUSE TestSetClientTLSDoesNotMutateDefaultTransport91=== RUN TestSetClientTLSErrors92=== PAUSE TestSetClientTLSErrors93=== RUN TestStaticToken94=== PAUSE TestStaticToken95=== RUN TestFileTokenReadsAndCaches96=== PAUSE TestFileTokenReadsAndCaches97=== RUN TestFileTokenMissing98=== PAUSE TestFileTokenMissing99=== RUN TestFileTokenEmpty100=== PAUSE TestFileTokenEmpty101=== RUN TestScriptTokenNoExpiryRerunsEveryCall102=== PAUSE TestScriptTokenNoExpiryRerunsEveryCall103=== RUN TestScriptTokenCachesUntilRefresh104=== PAUSE TestScriptTokenCachesUntilRefresh105=== RUN TestScriptTokenEmptyToken106=== PAUSE TestScriptTokenEmptyToken107=== RUN TestScriptTokenBadJSON108=== PAUSE TestScriptTokenBadJSON109=== RUN TestScriptTokenScriptFails110=== PAUSE TestScriptTokenScriptFails111=== RUN TestScriptTokenEmptyCommand112=== PAUSE TestScriptTokenEmptyCommand113=== CONT TestDoServerRequestAttachesToken114=== CONT TestRetryTimeoutOutlastsMaxRetries115=== CONT TestEncodeNixBase32WithRealHash116--- PASS: TestEncodeNixBase32WithRealHash (0.00s)117=== CONT TestStreamPushGivesUpOnDeadServer118=== CONT TestSetClientTLS119=== CONT TestScriptTokenEmptyCommand120--- PASS: TestScriptTokenEmptyCommand (0.00s)121=== CONT TestScriptTokenBadJSON122=== CONT TestScriptTokenEmptyToken123=== CONT TestScriptTokenCachesUntilRefresh124=== CONT TestScriptTokenNoExpiryRerunsEveryCall125=== CONT TestFileTokenEmpty126=== CONT TestFileTokenMissing127=== CONT TestFileTokenReadsAndCaches1282026/11/11 22:34:42 ERROR Upload failed error="connection refused" count=201292026/11/11 22:34:42 ERROR Server seems unavailable, giving up on batch untried=17130=== CONT TestStaticToken131--- PASS: TestStaticToken (0.00s)132=== CONT TestDoWithRetry_BodyReplayedViaGetBody133=== CONT TestSetClientTLSErrors134--- PASS: TestFileTokenEmpty (0.00s)135=== CONT TestResolveStorePath136--- PASS: TestStreamPushGivesUpOnDeadServer (0.00s)137=== CONT TestRegisterUploadedObject_OutlivesPush138--- PASS: TestFileTokenMissing (0.00s)139=== CONT TestRegisterUploadedObject_BoundedAgainstSilentServer140=== CONT TestSetClientTLSDoesNotMutateDefaultTransport141--- PASS: TestFileTokenReadsAndCaches (0.00s)142=== CONT TestStreamPushStopsWhenCanceled143=== CONT TestClientSignaturesByStorePath144--- PASS: TestClientSignaturesByStorePath (0.00s)145=== CONT TestStreamPushReportsSkippedPaths146=== CONT TestStreamPushReportsSignatures147=== CONT TestStreamPushRequestLine148=== CONT TestStreamPushReportsEveryPath149=== CONT TestStreamPushIsolatesFailures150=== CONT TestStreamPushBatchesUnderLoad151=== CONT TestScriptTokenScriptFails152=== CONT TestRateLimiterFeedback153=== CONT TestRateLimiterFeedback_400DoesNotCountAsSuccess154--- PASS: TestStreamPushStopsWhenCanceled (0.00s)155=== CONT TestEncodeNixBase32156=== RUN TestEncodeNixBase32/test_string_hash1572026/11/11 22:34:42 WARN Rate limiter enabled after throttle name=server-test rate=51582026/11/11 22:34:42 WARN Rate limiter enabled after throttle name=server-test rate=51592026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:55100160=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=false161=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=false162=== RUN TestStreamPushBatchesUnderLoad/oneAtATime=true163=== PAUSE TestStreamPushBatchesUnderLoad/oneAtATime=true164--- PASS: TestStreamPushReportsEveryPath (0.00s)165=== CONT TestDumpPathSingleFile166=== RUN TestSetClientTLSErrors/missing_cert_file167=== CONT TestDumpPathWriterError168=== PAUSE TestSetClientTLSErrors/missing_cert_file169=== RUN TestSetClientTLSErrors/missing_key_file170=== PAUSE TestSetClientTLSErrors/missing_key_file171=== RUN TestSetClientTLSErrors/missing_ca_file172=== PAUSE TestSetClientTLSErrors/missing_ca_file173=== RUN TestSetClientTLSErrors/invalid_ca_file174=== PAUSE TestSetClientTLSErrors/invalid_ca_file175=== CONT TestUploadMultipart_PartsInParallel176=== CONT TestUploadMultipart_ReturnsAfterDroppedBody177=== RUN TestRateLimiterFeedback/429_enables_limiter178=== PAUSE TestRateLimiterFeedback/429_enables_limiter179=== RUN TestRateLimiterFeedback/503_enables_limiter180=== PAUSE TestRateLimiterFeedback/503_enables_limiter181=== RUN TestRateLimiterFeedback/200_does_not_enable_limiter1822026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:550961832026/11/11 22:34:42 ERROR Upload failed error="bad path" count=3184=== CONT TestPartSizeForNAR185=== CONT TestParsePathInfoJSON186=== CONT TestPathInfoCACompatibility187=== RUN TestPathInfoCACompatibility/null_ca_field188=== PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter189--- PASS: TestResolveStorePath (0.00s)190=== CONT TestDumpPathMatchesNix191--- PASS: TestStreamPushReportsSkippedPaths (0.00s)192--- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.00s)193--- PASS: TestStreamPushIsolatesFailures (0.00s)194=== RUN TestPartSizeForNAR/zero_stays_at_minimum195=== RUN TestParsePathInfoJSON/Nix_format196=== PAUSE TestPartSizeForNAR/zero_stays_at_minimum197=== RUN TestPartSizeForNAR/small_stays_at_minimum198=== PAUSE TestPartSizeForNAR/small_stays_at_minimum199=== RUN TestPartSizeForNAR/80_GiB_fits_at_minimum200=== PAUSE TestPathInfoCACompatibility/null_ca_field201=== RUN TestPathInfoCACompatibility/old_string_format_-_text202=== PAUSE TestPathInfoCACompatibility/old_string_format_-_text203=== RUN TestPathInfoCACompatibility/old_string_format_-_fixed_recursive2042026/11/11 22:34:42 WARN Rate limiter backed off name=server-test rate=52052026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=2 backoff=0s status=503 url=http://127.0.0.1:55100206=== PAUSE TestEncodeNixBase32/test_string_hash207=== RUN TestEncodeNixBase32/empty_input208=== PAUSE TestEncodeNixBase32/empty_input209=== PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum210=== RUN TestPartSizeForNAR/115_GiB_needs_larger_parts211=== PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts212=== RUN TestPartSizeForNAR/1_TiB213=== PAUSE TestPartSizeForNAR/1_TiB214=== RUN TestPartSizeForNAR/5_TiB_S3_max_object215=== PAUSE TestPartSizeForNAR/5_TiB_S3_max_object216=== RUN TestPartSizeForNAR/capped_at_5_GiB217=== PAUSE TestPartSizeForNAR/capped_at_5_GiB218=== CONT TestShellSplit219=== CONT TestGetStorePathHash220=== RUN TestGetStorePathHash/valid_store_path221=== PAUSE TestGetStorePathHash/valid_store_path222=== RUN TestGetStorePathHash/basename_without_hyphen_should_error2232026/11/11 22:34:42 ERROR Upload failed error=boom count=1224=== RUN TestRateLimiterFeedback/400_does_not_enable_limiter225=== PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter226--- PASS: TestScriptTokenScriptFails (0.01s)227--- PASS: TestShellSplit (0.00s)2282026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:55096229=== CONT TestParsePathInfoJSONMultiplePaths2302026/11/11 22:34:42 ERROR Upload failed error=boom count=1231=== RUN TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths232=== PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive233=== PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths234=== RUN TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths235=== PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths236=== CONT TestCaseHackSuffix237=== PAUSE TestGetStorePathHash/basename_without_hyphen_should_error238=== CONT TestDoWithRetry_FinalResponseBodyReadable239=== RUN TestPathInfoCACompatibility/new_structured_format_-_text240=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_text241=== CONT TestShellSplitErrors242=== CONT TestRegisterUploadedObjectReusesConnections243=== PAUSE TestParsePathInfoJSON/Nix_format244=== CONT TestRunGarbageCollection_FinishedOnAnotherReplica245=== CONT TestPathInfoHashCompatibility246=== RUN TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)247=== CONT TestRunGarbageCollection_NotFoundAfterLocalRun248--- PASS: TestStreamPushReportsSignatures (0.01s)249=== CONT TestFilterOversizedClosures250=== RUN TestFilterOversizedClosures/no_limit_keeps_everything251=== RUN TestGetStorePathHash/hash_with_invalid_characters_should_error252=== PAUSE TestFilterOversizedClosures/no_limit_keeps_everything253=== RUN TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped254=== PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped255=== RUN TestFilterOversizedClosures/all_closures_skipped256=== PAUSE TestFilterOversizedClosures/all_closures_skipped257=== PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error258=== RUN TestGetStorePathHash/hash_with_wrong_length_should_error259=== PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error260=== CONT TestConvertHashToNix32261=== RUN TestConvertHashToNix32/SRI_format_to_Nix32262=== PAUSE TestConvertHashToNix32/SRI_format_to_Nix32263=== RUN TestConvertHashToNix32/already_Nix32_format264=== PAUSE TestConvertHashToNix32/already_Nix32_format265=== RUN TestConvertHashToNix32/invalid_format266=== PAUSE TestConvertHashToNix32/invalid_format267=== RUN TestParsePathInfoJSON/Lix_format268=== PAUSE TestParsePathInfoJSON/Lix_format269=== RUN TestParsePathInfoJSON/empty_input270=== PAUSE TestParsePathInfoJSON/empty_input271=== RUN TestParsePathInfoJSON/whitespace_only272=== PAUSE TestParsePathInfoJSON/whitespace_only273=== RUN TestParsePathInfoJSON/invalid_JSON274=== PAUSE TestParsePathInfoJSON/invalid_JSON275=== CONT TestUploadBuildLog_FileBodyReplayedOnRetry276=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)277=== RUN TestPathInfoHashCompatibility/old_string_format_with_colon278=== PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon279=== RUN TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI280=== PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI281=== RUN TestPathInfoHashCompatibility/new_structured_format_with_sha512282=== PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512283=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=true284--- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.01s)285--- PASS: TestRegisterUploadedObject_OutlivesPush (0.01s)286--- PASS: TestShellSplitErrors (0.00s)287--- PASS: TestDoServerRequestAttachesToken (0.01s)288=== CONT TestSetClientTLSErrors/missing_cert_file289=== RUN TestPathInfoCACompatibility/new_structured_format_-_nar_method290=== PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method291=== CONT TestSetClientTLSErrors/missing_key_file292=== CONT TestStreamPushBatchesUnderLoad/oneAtATime=false293=== CONT TestSetClientTLSErrors/invalid_ca_file294=== CONT TestEncodeNixBase32/test_string_hash295=== CONT TestSetClientTLSErrors/missing_ca_file296--- PASS: TestStreamPushBatchesUnderLoad (0.00s)297 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=true (0.00s)298 --- PASS: TestStreamPushBatchesUnderLoad/oneAtATime=false (0.00s)299=== CONT TestEncodeNixBase32/empty_input300--- PASS: TestEncodeNixBase32 (0.01s)301 --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)302 --- PASS: TestEncodeNixBase32/empty_input (0.00s)303=== CONT TestPartSizeForNAR/1_TiB304=== CONT TestPartSizeForNAR/115_GiB_needs_larger_parts305=== CONT TestPartSizeForNAR/80_GiB_fits_at_minimum306=== CONT TestPartSizeForNAR/small_stays_at_minimum307=== CONT TestPartSizeForNAR/capped_at_5_GiB308=== CONT TestRateLimiterFeedback/429_enables_limiter309=== CONT TestPartSizeForNAR/zero_stays_at_minimum310=== CONT TestRateLimiterFeedback/400_does_not_enable_limiter311=== CONT TestPartSizeForNAR/5_TiB_S3_max_object312--- PASS: TestPartSizeForNAR (0.00s)313 --- PASS: TestPartSizeForNAR/1_TiB (0.00s)314 --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)315 --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)316 --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)317 --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)318 --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)319 --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)320=== CONT TestRateLimiterFeedback/200_does_not_enable_limiter321=== CONT TestRateLimiterFeedback/503_enables_limiter3222026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=1ms status=502 url=http://127.0.0.1:550963232026/11/11 22:34:42 WARN Rate limiter enabled after throttle name=server-test rate=53242026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:55112325--- PASS: TestUploadMultipart_ReturnsAfterDroppedBody (0.01s)326=== CONT TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths327=== CONT TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths328--- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)329 --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)330 --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)331=== CONT TestFilterOversizedClosures/no_limit_keeps_everything332=== CONT TestGetStorePathHash/valid_store_path333=== CONT TestConvertHashToNix32/SRI_format_to_Nix32334=== CONT TestFilterOversizedClosures/all_closures_skipped3352026/11/11 22:34:42 WARN Rate limiter backed off name=server-test rate=53362026/11/11 22:34:42 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50337=== CONT TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped3382026/11/11 22:34:42 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000339--- PASS: TestFilterOversizedClosures (0.00s)340 --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)341 --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)342 --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)343=== CONT TestParsePathInfoJSON/Nix_format344=== CONT TestConvertHashToNix32/already_Nix32_format345=== CONT TestGetStorePathHash/hash_with_invalid_characters_should_error346--- PASS: TestDoWithRetry_FinalResponseBodyReadable (0.00s)347=== CONT TestGetStorePathHash/hash_with_wrong_length_should_error348=== CONT TestGetStorePathHash/basename_without_hyphen_should_error349=== CONT TestConvertHashToNix32/invalid_format350--- PASS: TestGetStorePathHash (0.00s)351 --- PASS: TestGetStorePathHash/valid_store_path (0.00s)352 --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)353 --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)354 --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)355--- PASS: TestConvertHashToNix32 (0.00s)356 --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)357 --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)358 --- PASS: TestConvertHashToNix32/invalid_format (0.00s)359=== CONT TestParsePathInfoJSON/empty_input360=== CONT TestParsePathInfoJSON/invalid_JSON361=== CONT TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)362=== CONT TestParsePathInfoJSON/whitespace_only363=== CONT TestPathInfoHashCompatibility/new_structured_format_with_sha512364=== CONT TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI365=== CONT TestParsePathInfoJSON/Lix_format366=== CONT TestPathInfoHashCompatibility/old_string_format_with_colon367=== CONT TestPathInfoCACompatibility/null_ca_field368=== CONT TestPathInfoCACompatibility/new_structured_format_-_nar_method369=== CONT TestPathInfoCACompatibility/old_string_format_-_fixed_recursive370=== CONT TestPathInfoCACompatibility/old_string_format_-_text371=== CONT TestPathInfoCACompatibility/new_structured_format_-_text372--- PASS: TestParsePathInfoJSON (0.01s)373 --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)374 --- PASS: TestParsePathInfoJSON/empty_input (0.00s)375 --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)376 --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)377 --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)378--- PASS: TestPathInfoHashCompatibility (0.00s)379 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)380 --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)381 --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)382 --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)383--- PASS: TestPathInfoCACompatibility (0.01s)384 --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)385 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)386 --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)387 --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)388 --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)389--- PASS: TestScriptTokenBadJSON (0.01s)390--- PASS: TestScriptTokenEmptyToken (0.01s)3912026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=2 backoff=1ms status=502 url=http://127.0.0.1:55096392=== RUN TestSetClientTLS/rejects_connection_without_client_cert393=== PAUSE TestSetClientTLS/rejects_connection_without_client_cert394=== RUN TestSetClientTLS/succeeds_with_client_cert_and_CA395=== PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA396=== RUN TestSetClientTLS/preserves_debug_logging_transport397=== PAUSE TestSetClientTLS/preserves_debug_logging_transport398=== CONT TestSetClientTLS/rejects_connection_without_client_cert399--- PASS: TestSetClientTLSErrors (0.00s)400 --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)401 --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)402 --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)403 --- PASS: TestSetClientTLSErrors/missing_ca_file (0.00s)404=== CONT TestSetClientTLS/preserves_debug_logging_transport405=== CONT TestSetClientTLS/succeeds_with_client_cert_and_CA4062026/11/11 22:34:42 INFO Garbage collection started4072026/11/11 22:34:42 WARN Rate limiter enabled after throttle name=s3-test rate=54082026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:551644092026/11/11 22:34:42 INFO Garbage collection started4102026/11/11 22:34:42 WARN Rate limiter enabled after throttle name=server-test rate=54112026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=503 url=http://127.0.0.1:551804122026/11/11 22:34:42 WARN Rate limiter enabled after throttle name=server-test rate=54132026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=1 backoff=0s status=429 url=http://127.0.0.1:551284142026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=3 backoff=1ms status=502 url=http://127.0.0.1:550964152026/11/11 22:34:42 WARN Rate limiter backed off name=server-test rate=54162026/11/11 22:34:42 WARN Rate limiter backed off name=server-test rate=5417--- PASS: TestRateLimiterFeedback (0.01s)418 --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.01s)419 --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.01s)420 --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.01s)421 --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.01s)4222026/11/11 22:34:42 INFO Garbage collection progress phase=running_on_another_replica failed_uploads_deleted=0 old_closures_deleted=0 objects_marked=0 objects_deleted=0 objects_failed=0423--- PASS: TestRunGarbageCollection_NotFoundAfterLocalRun (0.01s)424--- PASS: TestUploadBuildLog_FileBodyReplayedOnRetry (0.01s)4252026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=4 backoff=1ms status=502 url=http://127.0.0.1:550964262026/11/11 22:34:42 WARN Garbage collection finished on another replica. Its statistics are not available here427--- PASS: TestRunGarbageCollection_FinishedOnAnotherReplica (0.01s)428--- PASS: TestStreamPushRequestLine (0.02s)4292026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=5 backoff=1ms status=502 url=http://127.0.0.1:550964302026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=6 backoff=1ms status=502 url=http://127.0.0.1:550964312026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=7 backoff=1ms status=502 url=http://127.0.0.1:550964322026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=8 backoff=1ms status=502 url=http://127.0.0.1:550964332026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=9 backoff=1ms status=502 url=http://127.0.0.1:550964342026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=10 backoff=1ms status=502 url=http://127.0.0.1:55096435--- PASS: TestRegisterUploadedObjectReusesConnections (0.03s)4362026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=11 backoff=1ms status=502 url=http://127.0.0.1:550964372026/11/11 22:34:42 http: TLS handshake error from 127.0.0.1:55178: remote error: tls: bad certificate438--- PASS: TestSetClientTLS (0.02s)439 --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.01s)440 --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.01s)441 --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.02s)4422026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=12 backoff=1ms status=502 url=http://127.0.0.1:550964432026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=13 backoff=1ms status=502 url=http://127.0.0.1:550964442026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=14 backoff=1ms status=502 url=http://127.0.0.1:550964452026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=15 backoff=1ms status=502 url=http://127.0.0.1:55096446--- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.05s)447--- PASS: TestScriptTokenCachesUntilRefresh (0.05s)4482026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=16 backoff=1ms status=502 url=http://127.0.0.1:550964492026/11/11 22:34:42 WARN Request returned retryable status, retrying attempt=17 backoff=1ms status=502 url=http://127.0.0.1:55096450--- PASS: TestRetryTimeoutOutlastsMaxRetries (0.05s)451--- PASS: TestDumpPathWriterError (0.05s)452--- PASS: TestCaseHackSuffix (0.06s)453--- PASS: TestDumpPathSingleFile (0.07s)454--- PASS: TestDumpPathMatchesNix (0.08s)4552026/11/11 22:34:42 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:55102/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:55102/api/uploads/complete4562026/11/11 22:34:42 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4572026/11/11 22:34:42 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:55102/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:55102/api/uploads/complete4582026/11/11 22:34:42 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"4592026/11/11 22:34:42 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://127.0.0.1:55102/api/uploads/complete\": context deadline exceeded" url=http://127.0.0.1:55102/api/uploads/complete4602026/11/11 22:34:42 WARN Failed to register uploaded object key=abc.narinfo error="sending request: context canceled during retry: context deadline exceeded"461--- PASS: TestRegisterUploadedObject_BoundedAgainstSilentServer (0.11s)462--- PASS: TestUploadMultipart_PartsInParallel (0.62s)463--- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)464PASS465Running server tests...466The files belonging to this database system will be owned by user "_tribuchetbld7".467This user must also own the server process.468469The database cluster will be initialized with locale "C".470The default database encoding has accordingly been set to "SQL_ASCII".471The default text search configuration will be set to "english".472473Data page checksums are enabled.474475creating directory /private/var/tb/7/scratch/bbb413e2ef876c00/build/postgres2766368495/data ... ok476creating subdirectories ... ok477selecting dynamic shared memory implementation ... posix478selecting default "max_connections" ... 100479selecting default "shared_buffers" ... 128MB480selecting default time zone ... UTC481creating configuration files ... ok482running bootstrap script ... ok483performing post-bootstrap initialization ... ok484syncing data to disk ... ok485486initdb: warning: enabling "trust" authentication for local connections487initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.488489Success. You can now start the database server using:490491 pg_ctl -D /private/var/tb/7/scratch/bbb413e2ef876c00/build/postgres2766368495/data -l logfile start492493/private/var/tb/7/scratch/bbb413e2ef876c00/build/postgres2766368495:5432 - no response4942026-11-11 22:34:44.657 UTC [65917] LOG: starting PostgreSQL 18.6 on aarch64-apple-darwin25.6.0, compiled by clang version 21.1.8, 64-bit4952026-11-11 22:34:44.657 UTC [65917] LOG: listening on Unix socket "/private/var/tb/7/scratch/bbb413e2ef876c00/build/postgres2766368495/.s.PGSQL.5432"4962026-11-11 22:34:44.659 UTC [65924] LOG: database system was shut down at 2026-11-11 22:34:44 UTC4972026-11-11 22:34:44.660 UTC [65917] LOG: database system is ready to accept connections498/private/var/tb/7/scratch/bbb413e2ef876c00/build/postgres2766368495:5432 - accepting connections499{"timestamp":"2026-11-11T22:34:44.876233Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"45708712-86ad-4b5c-97cc-b96d1f275239","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"GET","uri":"/health/ready","status_code":503,"suppressed_errors":0,"duration_ms":0,"result":"server_error","target":"rustfs::server::http","filename":"rustfs/src/server/layer.rs","line_number":502,"threadName":"rustfs-worker","threadId":"ThreadId(7)"}500=== RUN TestAbortSucceeded501=== PAUSE TestAbortSucceeded502=== RUN TestService_AuthMiddleware503=== PAUSE TestService_AuthMiddleware504=== RUN TestService_AuthMiddleware_MTLSProxyHeader505=== PAUSE TestService_AuthMiddleware_MTLSProxyHeader506=== RUN TestService_AuthMiddleware_MTLSBoundSubjects507=== PAUSE TestService_AuthMiddleware_MTLSBoundSubjects508=== RUN TestService_ReadAuthMiddleware509=== PAUSE TestService_ReadAuthMiddleware510=== RUN TestService_AuthMiddleware_OIDC511=== PAUSE TestService_AuthMiddleware_OIDC512=== RUN TestService_RequireScope_OIDC513=== PAUSE TestService_RequireScope_OIDC514=== RUN TestService_ReadScope_PublicByDefault515=== PAUSE TestService_ReadScope_PublicByDefault516=== RUN TestCacheConfigHandler517=== PAUSE TestCacheConfigHandler518=== RUN TestCacheStatsHandler519=== PAUSE TestCacheStatsHandler520=== RUN TestClientCADerivations521=== PAUSE TestClientCADerivations522=== RUN TestClientErrorHandling523=== PAUSE TestClientErrorHandling524=== RUN TestClientIntegration525=== PAUSE TestClientIntegration526=== RUN TestClientMultipleUploads527=== PAUSE TestClientMultipleUploads528=== RUN TestClientWithDependencies529=== PAUSE TestClientWithDependencies530=== RUN TestClientSharedPathCommittedMidPush531=== PAUSE TestClientSharedPathCommittedMidPush532=== RUN TestPinProtectsFromGC533=== PAUSE TestPinProtectsFromGC534=== RUN TestClientPushesUseOnePush535=== PAUSE TestClientPushesUseOnePush536=== RUN TestClientFallsBackToClosures537=== PAUSE TestClientFallsBackToClosures538=== RUN TestDeleteClosuresRacingPins539=== PAUSE TestDeleteClosuresRacingPins540=== RUN TestConcurrentCommitsSharingObjectsDoNotDeadlock541=== PAUSE TestConcurrentCommitsSharingObjectsDoNotDeadlock542=== RUN TestResolveDBConnectionString543=== PAUSE TestResolveDBConnectionString544=== RUN TestConnectWaitsForAPeerMigration545=== PAUSE TestConnectWaitsForAPeerMigration546=== RUN TestLeadElectsOneAndHandsOver547=== PAUSE TestLeadElectsOneAndHandsOver548=== RUN TestLeadIncumbentWinsAfterRestart5492026/11/11 22:34:45 INFO lead: acquired remote=192.0.2.1:1234 generation=15502026/11/11 22:34:45 INFO lead: released remote=192.0.2.1:1234 generation=15512026/11/11 22:34:45 INFO lead: acquired remote=192.0.2.1:1234 generation=25522026/11/11 22:34:46 INFO lead: released remote=192.0.2.1:1234 generation=2553--- PASS: TestLeadIncumbentWinsAfterRestart (1.87s)554=== RUN TestLeadUnannouncedStandbyYieldsToIncumbent555=== PAUSE TestLeadUnannouncedStandbyYieldsToIncumbent556=== RUN TestLeadIncumbentAnnouncesAtOnce557=== PAUSE TestLeadIncumbentAnnouncesAtOnce558=== RUN TestLeadGenerationGrowsWithEveryGrant559=== PAUSE TestLeadGenerationGrowsWithEveryGrant560=== RUN TestLeadEndsOnShutdown561=== PAUSE TestLeadEndsOnShutdown562=== RUN TestLeadEndsWhenItsConnectionHangs5632026/11/11 22:34:47 INFO lead: acquired remote=192.0.2.1:1234 generation=15642026-11-11 22:34:48.407 UTC [65960] FATAL: terminating connection due to administrator command5652026/11/11 22:34:48 INFO lead: acquired remote=192.0.2.1:1234 generation=25662026/11/11 22:34:49 WARN lead: lock connection lost error="timeout: context deadline exceeded"5672026/11/11 22:34:49 INFO lead: released remote=192.0.2.1:1234 generation=15682026/11/11 22:34:49 INFO lead: released remote=192.0.2.1:1234 generation=2569--- PASS: TestLeadEndsWhenItsConnectionHangs (2.96s)570=== RUN TestGCAdvisoryLockBlocksConcurrentRun571=== PAUSE TestGCAdvisoryLockBlocksConcurrentRun572=== RUN TestGCBugBareHashReferences573=== PAUSE TestGCBugBareHashReferences574=== RUN TestGCMetrics575=== PAUSE TestGCMetrics576=== RUN TestPushDedupSurvivesConcurrentGC577=== PAUSE TestPushDedupSurvivesConcurrentGC578=== RUN TestDeduplicatedObjectsRecordedAsPending579=== PAUSE TestDeduplicatedObjectsRecordedAsPending580=== RUN TestGCSweepSkipsPendingObjects581=== PAUSE TestGCSweepSkipsPendingObjects582=== RUN TestTombstonedObjectOfferedWithoutWaiting583=== PAUSE TestTombstonedObjectOfferedWithoutWaiting584=== RUN TestGCSweepDeliversEachKeyOnce585=== PAUSE TestGCSweepDeliversEachKeyOnce586=== RUN TestCreatePendingClosureVerifyS3FailureReleasesConnection587=== PAUSE TestCreatePendingClosureVerifyS3FailureReleasesConnection588=== RUN TestForceGCDuringPushOffersSweptObject589=== PAUSE TestForceGCDuringPushOffersSweptObject590=== RUN TestFailedS3DeleteKeepsTombstone591=== PAUSE TestFailedS3DeleteKeepsTombstone592=== RUN TestSweepSkipsRowsLockedByPush593=== PAUSE TestSweepSkipsRowsLockedByPush594=== RUN TestRegisterCompletedObjectNeedsPendingRow595=== PAUSE TestRegisterCompletedObjectNeedsPendingRow596=== RUN TestGetExistingObjectsLocksRows597=== PAUSE TestGetExistingObjectsLocksRows598=== RUN TestSweepRechecksPendingAfterLocking599=== PAUSE TestSweepRechecksPendingAfterLocking600=== RUN TestPushWaitsForSweepHoldingRow601=== PAUSE TestPushWaitsForSweepHoldingRow602=== RUN TestCommitRacingPendingCleanupKeepsObjects603=== PAUSE TestCommitRacingPendingCleanupKeepsObjects604=== RUN TestGCEndsOnShutdown605=== PAUSE TestGCEndsOnShutdown606=== RUN TestGCTaskStore_StartNew607=== PAUSE TestGCTaskStore_StartNew608=== RUN TestGCTaskStore_DeduplicateSameParams609=== PAUSE TestGCTaskStore_DeduplicateSameParams610=== RUN TestGCTaskStore_ConflictDifferentParams611=== PAUSE TestGCTaskStore_ConflictDifferentParams612=== RUN TestGCTaskStore_GetEmpty613=== PAUSE TestGCTaskStore_GetEmpty614=== RUN TestGCTaskStore_GetReturnsLatest615=== PAUSE TestGCTaskStore_GetReturnsLatest616=== RUN TestGCTaskStore_CompletedAllowsNewTask617=== PAUSE TestGCTaskStore_CompletedAllowsNewTask618=== RUN TestGCTaskStore_PhaseUpdates619=== PAUSE TestGCTaskStore_PhaseUpdates620=== RUN TestGCTaskStore_Fail621=== PAUSE TestGCTaskStore_Fail622=== RUN TestGracefulShutdownDrainsInflight623=== PAUSE TestGracefulShutdownDrainsInflight624=== RUN TestService_healthCheckHandler625=== PAUSE TestService_healthCheckHandler626=== RUN TestService_readinessHandler627=== PAUSE TestService_readinessHandler628=== RUN TestGenerateLandingPage629=== PAUSE TestGenerateLandingPage630=== RUN TestEnsureAbortUploadsRule631=== PAUSE TestEnsureAbortUploadsRule632=== RUN TestCacheConfigHandlerMaxNarSize633=== PAUSE TestCacheConfigHandlerMaxNarSize634=== RUN TestCreatePendingClosureRejectsOversizedNAR635=== PAUSE TestCreatePendingClosureRejectsOversizedNAR636=== RUN TestNARDeduplicationMetadataUploadBug637=== PAUSE TestNARDeduplicationMetadataUploadBug638=== RUN TestMetricsInventory639=== PAUSE TestMetricsInventory640=== RUN TestMetricsCommit641=== PAUSE TestMetricsCommit642=== RUN TestService_NativeMTLS643=== PAUSE TestService_NativeMTLS644=== RUN TestServerTLSConfig645=== PAUSE TestServerTLSConfig646=== RUN TestMultipartCleanup647=== PAUSE TestMultipartCleanup648=== RUN TestMultipartUploadAbortedWhenCancelledBeforeRecorded649=== PAUSE TestMultipartUploadAbortedWhenCancelledBeforeRecorded650=== RUN TestPendingCleanupUsesOneCutoff651=== PAUSE TestPendingCleanupUsesOneCutoff652=== RUN TestObjectStatsTrigger653=== PAUSE TestObjectStatsTrigger654=== RUN TestObjectStatsUpdatedOncePerCommit655=== PAUSE TestObjectStatsUpdatedOncePerCommit656=== RUN TestOrphanedObjectsGC657=== PAUSE TestOrphanedObjectsGC658=== RUN TestOrphanedObjectsGCStressTest659=== PAUSE TestOrphanedObjectsGCStressTest660=== RUN TestCreatePin_ReservedPins661=== PAUSE TestCreatePin_ReservedPins662=== RUN TestPresentReportsOnlyClosureRoots663=== PAUSE TestPresentReportsOnlyClosureRoots664=== RUN TestPresentRefreshesOnlyStaleClosures665=== PAUSE TestPresentRefreshesOnlyStaleClosures666=== RUN TestPresentNotReportedWhileGCDeletesClosure667=== PAUSE TestPresentNotReportedWhileGCDeletesClosure668=== RUN TestParseSingleRange669=== PAUSE TestParseSingleRange670=== RUN TestProxyHeadersOnlyTrustedOnSocket6712026/11/11 22:34:49 INFO Starting HTTP server address=proxy.sock6722026/11/11 22:34:49 INFO Starting HTTP server address=127.0.0.1:552186732026/11/11 22:34:49 WARN mTLS auth: subject not in bound subjects subject="CN=someone"6742026/11/11 22:34:49 INFO Shutdown signal received, draining in-flight requests timeout=10s675--- PASS: TestProxyHeadersOnlyTrustedOnSocket (0.17s)676=== RUN TestIsValidCachePath677=== PAUSE TestIsValidCachePath678=== RUN TestReadProxyNarinfo679=== PAUSE TestReadProxyNarinfo680=== RUN TestReadProxyNarinfoAlreadyDecompressed681=== PAUSE TestReadProxyNarinfoAlreadyDecompressed682=== RUN TestReadProxyContentNegotiation683=== PAUSE TestReadProxyContentNegotiation684=== RUN TestReadProxyNarStreaming685=== PAUSE TestReadProxyNarStreaming686=== RUN TestReadProxy404687=== PAUSE TestReadProxy404688=== RUN TestReadProxyInvalidPath689=== PAUSE TestReadProxyInvalidPath690=== RUN TestReadProxyHead691=== PAUSE TestReadProxyHead692=== RUN TestReadProxyOutlastsServerWriteTimeout693=== PAUSE TestReadProxyOutlastsServerWriteTimeout694=== RUN TestReadProxyConditionalGet695=== PAUSE TestReadProxyConditionalGet696=== RUN TestReadProxyRootRedirectsToIndexHTML697=== PAUSE TestReadProxyRootRedirectsToIndexHTML698=== RUN TestReadProxyDisabled699=== PAUSE TestReadProxyDisabled700=== RUN TestReadRedirectNar701=== PAUSE TestReadRedirectNar702=== RUN TestReadRedirectKeepsNarinfoProxied703=== PAUSE TestReadRedirectKeepsNarinfoProxied704=== RUN TestReadProxyRangeRequest705=== PAUSE TestReadProxyRangeRequest706=== RUN TestReadRedirectUsesPublicS3URL707=== PAUSE TestReadRedirectUsesPublicS3URL708=== RUN TestPush_OverlappingRootsStoreOneRowPerKey709=== PAUSE TestPush_OverlappingRootsStoreOneRowPerKey710=== RUN TestPush_CompleteCommitsEveryRoot711=== PAUSE TestPush_CompleteCommitsEveryRoot712=== RUN TestPush_RepeatedRootCommitsOnce713=== PAUSE TestPush_RepeatedRootCommitsOnce714=== RUN TestPush_CompleteWaitsForCleanupOfThePush715=== PAUSE TestPush_CompleteWaitsForCleanupOfThePush716=== RUN TestPush_RootsAreLockedInByteOrder717=== PAUSE TestPush_RootsAreLockedInByteOrder718=== RUN TestPush_SkippedKeySurvivesGCBeforeCommit719=== PAUSE TestPush_SkippedKeySurvivesGCBeforeCommit720=== RUN TestPush_RejectsBadRequests721=== PAUSE TestPush_RejectsBadRequests722=== RUN TestPush_SignsNarinfosOfItsPendingObjects723=== PAUSE TestPush_SignsNarinfosOfItsPendingObjects724=== RUN TestSharedNarBothUploadsComplete725=== PAUSE TestSharedNarBothUploadsComplete726=== RUN TestCompleteMultipartUpload_ErrorButObjectExists727=== PAUSE TestCompleteMultipartUpload_ErrorButObjectExists728=== RUN TestCompletedNarNotReofferedAcrossClosures729=== PAUSE TestCompletedNarNotReofferedAcrossClosures730=== RUN TestPresignedUploadRegisteredBeforeCommit731=== PAUSE TestPresignedUploadRegisteredBeforeCommit732=== RUN TestService_Rustfstest733=== PAUSE TestService_Rustfstest734=== RUN TestParseSize735=== PAUSE TestParseSize736=== RUN TestSkippedUploadsHandler737=== PAUSE TestSkippedUploadsHandler738=== RUN TestSystemdListenerNotActivated739--- PASS: TestSystemdListenerNotActivated (0.00s)740=== RUN TestWatchdogBeatsWhenHealthy741--- PASS: TestWatchdogBeatsWhenHealthy (0.03s)742=== RUN TestWatchdogSkipsWhenUnhealthy7432026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7442026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7452026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7462026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7472026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7482026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7492026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7502026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7512026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"7522026/11/11 22:34:50 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"753--- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)754=== RUN TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle755=== PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle756=== RUN TestProxyWriteTimeout757=== PAUSE TestProxyWriteTimeout758=== RUN TestPendingClosureWriteTimeout759=== PAUSE TestPendingClosureWriteTimeout760=== RUN TestIsValidUploadKey761=== PAUSE TestIsValidUploadKey762=== RUN TestUploadHandlersRejectInvalidKeys763=== PAUSE TestUploadHandlersRejectInvalidKeys764=== RUN TestUploadHandlersRejectOversizedBody765=== PAUSE TestUploadHandlersRejectOversizedBody766=== RUN TestService_cleanupPendingClosuresHandler767=== PAUSE TestService_cleanupPendingClosuresHandler768=== RUN TestService_createPendingClosureHandler769=== PAUSE TestService_createPendingClosureHandler770=== RUN TestService_verifyS3Integrity771=== PAUSE TestService_verifyS3Integrity772=== RUN TestService_verifyS3ReuploadsStaleNarinfo773=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo774=== RUN TestCompleteMultipartUnregistered775=== PAUSE TestCompleteMultipartUnregistered776=== RUN TestCreatePendingClosure_SmallNARUsesSimplePUT777=== PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT778=== CONT TestReadRedirectKeepsNarinfoProxied779=== CONT TestGCEndsOnShutdown780=== CONT TestService_verifyS3Integrity781=== CONT TestAbortSucceeded782--- PASS: TestAbortSucceeded (0.00s)783=== CONT TestGCTaskStore_StartNew784=== CONT TestCommitRacingPendingCleanupKeepsObjects785=== CONT TestReadProxyHead786--- PASS: TestGCTaskStore_StartNew (0.00s)787=== CONT TestReadRedirectNar788=== CONT TestReadProxyDisabled789=== CONT TestService_Rustfstest790=== CONT TestReadProxyRootRedirectsToIndexHTML791=== CONT TestCreatePendingClosure_SmallNARUsesSimplePUT792=== CONT TestReadProxyConditionalGet793=== CONT TestCompleteMultipartUnregistered794=== CONT TestService_verifyS3ReuploadsStaleNarinfo795=== CONT TestReadProxyOutlastsServerWriteTimeout796=== CONT TestReadProxyInvalidPath797=== CONT TestReadProxy404798=== CONT TestReadProxyNarStreaming799=== CONT TestReadProxyContentNegotiation800=== CONT TestReadProxyNarinfoAlreadyDecompressed801=== CONT TestReadProxyNarinfo802=== CONT TestIsValidCachePath803=== RUN TestIsValidCachePath/narinfo804=== CONT TestParseSingleRange805=== CONT TestLeadElectsOneAndHandsOver806=== RUN TestGCEndsOnShutdown/before_the_run807=== CONT TestPushWaitsForSweepHoldingRow808=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed809=== PAUSE TestIsValidCachePath/narinfo810=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed811=== PAUSE TestGCEndsOnShutdown/before_the_run812=== RUN TestIsValidCachePath/narinfo_all_nix_base32_chars813=== RUN TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed814=== PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars815=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed816=== RUN TestIsValidCachePath/nar_zst817=== PAUSE TestIsValidCachePath/nar_zst818=== RUN TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete819=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost820=== PAUSE TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete821=== RUN TestIsValidCachePath/nar_xz822=== PAUSE TestIsValidCachePath/nar_xz823=== RUN TestIsValidCachePath/nar_bz2824=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost825=== RUN TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed826=== RUN TestParseSingleRange/none827=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed828=== RUN TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed829=== PAUSE TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed830=== PAUSE TestParseSingleRange/none831=== CONT TestPresentNotReportedWhileGCDeletesClosure832=== PAUSE TestIsValidCachePath/nar_bz2833=== RUN TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark834=== PAUSE TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark835=== CONT TestPresentRefreshesOnlyStaleClosures836=== RUN TestParseSingleRange/unknown_unit837=== PAUSE TestParseSingleRange/unknown_unit838=== RUN TestParseSingleRange/multi-range_ignored839=== RUN TestPresentNotReportedWhileGCDeletesClosure/stale840=== PAUSE TestParseSingleRange/multi-range_ignored841=== RUN TestParseSingleRange/malformed_no_dash842=== RUN TestIsValidCachePath/nar_uncompressed843=== PAUSE TestParseSingleRange/malformed_no_dash844=== RUN TestParseSingleRange/malformed_both_empty845=== PAUSE TestIsValidCachePath/nar_uncompressed846=== PAUSE TestParseSingleRange/malformed_both_empty847=== RUN TestParseSingleRange/malformed_end_before_start848=== PAUSE TestParseSingleRange/malformed_end_before_start849=== RUN TestParseSingleRange/closed850=== PAUSE TestParseSingleRange/closed851=== RUN TestParseSingleRange/open-ended852=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/stale853=== RUN TestIsValidCachePath/ls854=== PAUSE TestIsValidCachePath/ls855=== PAUSE TestParseSingleRange/open-ended856=== RUN TestPresentNotReportedWhileGCDeletesClosure/fresh857=== RUN TestParseSingleRange/end_clamped_to_size858=== RUN TestIsValidCachePath/log859=== PAUSE TestIsValidCachePath/log860=== PAUSE TestParseSingleRange/end_clamped_to_size861=== RUN TestParseSingleRange/suffix862=== PAUSE TestPresentNotReportedWhileGCDeletesClosure/fresh863=== RUN TestIsValidCachePath/realisation864=== PAUSE TestIsValidCachePath/realisation865=== RUN TestIsValidCachePath/nix-cache-info866=== PAUSE TestIsValidCachePath/nix-cache-info867=== RUN TestIsValidCachePath/index.html868=== PAUSE TestIsValidCachePath/index.html869=== RUN TestIsValidCachePath/traversal_parent870=== PAUSE TestIsValidCachePath/traversal_parent871=== PAUSE TestParseSingleRange/suffix872=== RUN TestParseSingleRange/suffix_exceeds_size873=== PAUSE TestParseSingleRange/suffix_exceeds_size874=== RUN TestParseSingleRange/single_byte875=== PAUSE TestParseSingleRange/single_byte876=== RUN TestParseSingleRange/start_past_EOF877=== PAUSE TestParseSingleRange/start_past_EOF878=== RUN TestParseSingleRange/start_far_past_EOF879=== PAUSE TestParseSingleRange/start_far_past_EOF880=== CONT TestPresentReportsOnlyClosureRoots881=== CONT TestCreatePin_ReservedPins882=== RUN TestIsValidCachePath/traversal_in_middle883=== PAUSE TestIsValidCachePath/traversal_in_middle884=== RUN TestIsValidCachePath/invalid_char_e885=== PAUSE TestIsValidCachePath/invalid_char_e886=== RUN TestIsValidCachePath/invalid_char_u887=== PAUSE TestIsValidCachePath/invalid_char_u888=== RUN TestIsValidCachePath/random_path889=== PAUSE TestIsValidCachePath/random_path890=== RUN TestIsValidCachePath/empty891=== PAUSE TestIsValidCachePath/empty892=== RUN TestIsValidCachePath/leading_slash893=== PAUSE TestIsValidCachePath/leading_slash894=== RUN TestIsValidCachePath/wrong_extension895=== PAUSE TestIsValidCachePath/wrong_extension896=== RUN TestIsValidCachePath/short_hash897=== PAUSE TestIsValidCachePath/short_hash898=== CONT TestOrphanedObjectsGCStressTest8992026/11/11 22:34:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55220/oidc900--- PASS: TestReadProxyHead (1.30s)901=== CONT TestSweepRechecksPendingAfterLocking902--- PASS: TestReadRedirectNar (1.52s)903=== CONT TestGetExistingObjectsLocksRows9042026/11/11 22:34:51 INFO Received uploads request method=POST path=/api/pending_closures905--- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (1.71s)906=== CONT TestOrphanedObjectsGC9072026/11/11 22:34:52 INFO Received uploads request method=POST path=/api/pending_closures908--- PASS: TestReadRedirectKeepsNarinfoProxied (2.01s)909=== CONT TestRegisterCompletedObjectNeedsPendingRow9102026/11/11 22:34:52 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9112026/11/11 22:34:52 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst912--- PASS: TestCompleteMultipartUnregistered (2.12s)913=== CONT TestObjectStatsUpdatedOncePerCommit914--- PASS: TestService_Rustfstest (2.26s)915=== CONT TestSweepSkipsRowsLockedByPush916--- PASS: TestPushWaitsForSweepHoldingRow (2.33s)917=== CONT TestObjectStatsTrigger9182026/11/11 22:34:52 INFO Aborted multipart uploads count=0 kept=09192026/11/11 22:34:52 WARN Force mode enabled - objects will be deleted immediately without grace period9202026/11/11 22:34:52 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=09212026/11/11 22:34:52 INFO Vacuumed table table=pending_closures9222026/11/11 22:34:52 INFO Vacuumed table table=pending_objects9232026/11/11 22:34:52 INFO Vacuumed table table=multipart_uploads9242026/11/11 22:34:52 INFO Vacuumed table table=closures9252026/11/11 22:34:52 INFO Vacuumed table table=objects9262026/11/11 22:34:52 INFO lead: acquired remote=192.0.2.1:1234 generation=1927--- PASS: TestCommitRacingPendingCleanupKeepsObjects (2.65s)928=== CONT TestClientErrorHandling929=== RUN TestClientErrorHandling/InvalidStorePath930=== PAUSE TestClientErrorHandling/InvalidStorePath931=== RUN TestClientErrorHandling/InvalidAuthToken932=== PAUSE TestClientErrorHandling/InvalidAuthToken933=== RUN TestClientErrorHandling/ServerNotAvailable934=== PAUSE TestClientErrorHandling/ServerNotAvailable935=== CONT TestPendingCleanupUsesOneCutoff936--- PASS: TestReadProxyInvalidPath (2.79s)937=== CONT TestMultipartUploadAbortedWhenCancelledBeforeRecorded938--- PASS: TestReadProxyNarStreaming (3.03s)939=== CONT TestFailedS3DeleteKeepsTombstone940--- PASS: TestPresentRefreshesOnlyStaleClosures (3.19s)941=== CONT TestMultipartCleanup942--- PASS: TestPresentReportsOnlyClosureRoots (3.37s)943=== CONT TestForceGCDuringPushOffersSweptObject944=== RUN TestForceGCDuringPushOffersSweptObject/before_pending_rows945=== PAUSE TestForceGCDuringPushOffersSweptObject/before_pending_rows946=== RUN TestForceGCDuringPushOffersSweptObject/after_presence_check947=== PAUSE TestForceGCDuringPushOffersSweptObject/after_presence_check948=== CONT TestServerTLSConfig949=== RUN TestServerTLSConfig/no_client_CA950=== PAUSE TestServerTLSConfig/no_client_CA951=== RUN TestServerTLSConfig/missing_CA_file952=== PAUSE TestServerTLSConfig/missing_CA_file953=== RUN TestServerTLSConfig/not_a_PEM_file954=== PAUSE TestServerTLSConfig/not_a_PEM_file955=== CONT TestCreatePendingClosureVerifyS3FailureReleasesConnection956--- PASS: TestReadProxyDisabled (3.51s)957=== CONT TestService_NativeMTLS958--- PASS: TestReadProxyConditionalGet (3.73s)959=== CONT TestGCSweepDeliversEachKeyOnce9602026/11/11 22:34:54 INFO Received uploads request method=POST path=/api/pending_closures9612026/11/11 22:34:54 INFO lead: released remote=192.0.2.1:1234 generation=19622026/11/11 22:34:54 INFO lead: acquired remote=192.0.2.1:1234 generation=2963--- PASS: TestReadProxyNarinfoAlreadyDecompressed (4.39s)964=== CONT TestTombstonedObjectOfferedWithoutWaiting9652026/11/11 22:34:54 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux9662026/11/11 22:34:54 WARN Refused reserved pin name=worker-x86_64-linux9672026/11/11 22:34:54 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux9682026/11/11 22:34:54 INFO Received create pin request method=POST path=/api/pins/my-app9692026/11/11 22:34:54 INFO Received create pin request method=POST path=/api/pins/worker-x86_64-linux970--- PASS: TestCreatePin_ReservedPins (4.62s)971=== CONT TestGCSweepSkipsPendingObjects9722026/11/11 22:34:55 ERROR Failed to decode narinfo key=3hcdxyjf9yiq7qf3i4548drb6sjmwa1v.narinfo limit=16777216 error=<nil>973--- PASS: TestReadProxyNarinfo (4.93s)974=== CONT TestDeduplicatedObjectsRecordedAsPending9752026/11/11 22:34:55 INFO lead: released remote=192.0.2.1:1234 generation=2976--- PASS: TestLeadElectsOneAndHandsOver (5.05s)977=== CONT TestMetricsCommit978--- PASS: TestReadProxyRootRedirectsToIndexHTML (5.10s)979=== CONT TestPushDedupSurvivesConcurrentGC9802026/11/11 22:34:55 INFO Received complete multipart upload request method=POST path=/api/multipart/complete9812026/11/11 22:34:55 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=OWUzMWQyMGYtZTA0MC00YWQ2LTg3OTctMWVmNWM1N2I3ZWUzLjRmYjc1ZGVkLTlhMGQtNGQwYi1hYjVkLWVkODM0YmEyYzhmZHgxNzk0NDM2NDk0MDkwNzcxMDAw parts=109822026/11/11 22:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete9832026/11/11 22:34:55 INFO Completed upload id=1 objects=2 duration=13.057417ms9842026/11/11 22:34:55 INFO Received uploads request method=POST path=/api/pending_closures9852026/11/11 22:34:55 INFO Received uploads request method=POST path=/api/pending_closures9862026/11/11 22:34:55 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo9872026/11/11 22:34:55 WARN Found objects in DB but missing from S3, will re-upload count=1988--- PASS: TestService_verifyS3Integrity (5.26s)989=== CONT TestMetricsInventory990--- PASS: TestReadProxyContentNegotiation (5.46s)991=== CONT TestGCMetrics9922026/11/11 22:34:56 INFO Aborted multipart uploads count=0 kept=09932026/11/11 22:34:56 WARN Force mode enabled - objects will be deleted immediately without grace period9942026/11/11 22:34:56 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=09952026/11/11 22:34:56 INFO Vacuumed table table=pending_closures996--- PASS: TestReadProxy404 (6.40s)997=== CONT TestNARDeduplicationMetadataUploadBug9982026/11/11 22:34:56 INFO Vacuumed table table=pending_objects9992026/11/11 22:34:56 INFO Vacuumed table table=multipart_uploads10002026/11/11 22:34:56 INFO Vacuumed table table=closures10012026/11/11 22:34:56 INFO Vacuumed table table=objects1002--- PASS: TestSweepRechecksPendingAfterLocking (5.15s)1003=== CONT TestConnectWaitsForAPeerMigration1004--- PASS: TestGetExistingObjectsLocksRows (4.99s)1005=== CONT TestCreatePendingClosureRejectsOversizedNAR10062026/11/11 22:34:56 INFO Received uploads request method=POST path=/api/pending_closures1007--- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)1008=== CONT TestClientCADerivations1009--- PASS: TestRegisterCompletedObjectNeedsPendingRow (5.19s)1010=== CONT TestCacheConfigHandlerMaxNarSize1011--- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)1012=== CONT TestCacheStatsHandler1013--- PASS: TestObjectStatsUpdatedOncePerCommit (5.83s)1014=== CONT TestEnsureAbortUploadsRule10152026/11/11 22:34:58 INFO Aborted multipart uploads count=0 kept=010162026/11/11 22:34:58 WARN Force mode enabled - objects will be deleted immediately without grace period10172026/11/11 22:34:58 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=010182026/11/11 22:34:58 INFO Vacuumed table table=pending_closures10192026/11/11 22:34:58 INFO Vacuumed table table=pending_objects10202026/11/11 22:34:58 INFO Vacuumed table table=multipart_uploads10212026/11/11 22:34:58 INFO Vacuumed table table=closures10222026/11/11 22:34:58 INFO Vacuumed table table=objects10232026/11/11 22:34:58 INFO Aborted multipart uploads count=0 kept=010242026/11/11 22:34:58 WARN Force mode enabled - objects will be deleted immediately without grace period1025--- PASS: TestObjectStatsTrigger (6.36s)1026=== CONT TestResolveDBConnectionString1027=== RUN TestResolveDBConnectionString/flag_wins1028=== PAUSE TestResolveDBConnectionString/flag_wins1029=== RUN TestResolveDBConnectionString/file_when_flag_empty1030=== PAUSE TestResolveDBConnectionString/file_when_flag_empty1031=== RUN TestResolveDBConnectionString/missing_file_is_an_error1032=== PAUSE TestResolveDBConnectionString/missing_file_is_an_error1033=== RUN TestResolveDBConnectionString/PGHOST_allows_empty1034=== PAUSE TestResolveDBConnectionString/PGHOST_allows_empty1035=== RUN TestResolveDBConnectionString/nothing_configured1036=== PAUSE TestResolveDBConnectionString/nothing_configured1037=== CONT TestCacheConfigHandler1038=== RUN TestCacheConfigHandler/full_config,_no_issuer1039=== PAUSE TestCacheConfigHandler/full_config,_no_issuer1040=== RUN TestCacheConfigHandler/no_cache_url_configured1041=== PAUSE TestCacheConfigHandler/no_cache_url_configured1042=== RUN TestCacheConfigHandler/no_signing_keys1043=== PAUSE TestCacheConfigHandler/no_signing_keys1044=== RUN TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1045=== PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1046=== CONT TestGenerateLandingPage1047--- PASS: TestGenerateLandingPage (0.01s)1048=== CONT TestConcurrentCommitsSharingObjectsDoNotDeadlock10492026/11/11 22:34:59 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=010502026/11/11 22:34:59 INFO Vacuumed table table=pending_closures10512026/11/11 22:34:59 INFO Vacuumed table table=pending_objects10522026/11/11 22:34:59 INFO Vacuumed table table=multipart_uploads10532026/11/11 22:34:59 INFO Vacuumed table table=closures10542026/11/11 22:34:59 INFO Vacuumed table table=objects1055--- PASS: TestSweepSkipsRowsLockedByPush (6.67s)1056=== CONT TestService_readinessHandler10572026/11/11 22:34:59 INFO Received uploads request method=POST path=/api/pending_closures1058=== NAME TestOrphanedObjectsGC1059 orphaned_objects_gc_test.go:287: GC Test Summary:1060 orphaned_objects_gc_test.go:288: - Kept: 2 objects from closure A1061 orphaned_objects_gc_test.go:289: - Deleted: 2 objects from closure B1062 orphaned_objects_gc_test.go:290: - Deleted: 6 orphaned chain objects (X1->X2->X3)1063 orphaned_objects_gc_test.go:291: - Deleted: 2 orphaned single objects (Y)1064 orphaned_objects_gc_test.go:292: - Total deleted: 10 objects1065--- PASS: TestOrphanedObjectsGC (7.50s)1066=== CONT TestDeleteClosuresRacingPins10672026/11/11 22:34:59 INFO Received uploads request method=POST path=/api/pending_closures10682026/11/11 22:34:59 INFO Received cleanup request method=DELETE path=/api/pending_closures10692026/11/11 22:34:59 INFO Received uploads request method=POST path=/api/pending_closures1070--- PASS: TestMultipartUploadAbortedWhenCancelledBeforeRecorded (6.96s)1071=== CONT TestService_healthCheckHandler1072--- PASS: TestReadProxyOutlastsServerWriteTimeout (9.83s)1073=== CONT TestGCBugBareHashReferences10742026/11/11 22:35:00 INFO Received uploads request method=POST path=/api/pending_closures10752026/11/11 22:35:00 INFO Aborted multipart uploads count=0 kept=010762026/11/11 22:35:00 INFO Received uploads request method=POST path=/api/pending_closures10772026/11/11 22:35:00 WARN Force mode enabled - objects will be deleted immediately without grace period10782026/11/11 22:35:00 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."10792026/11/11 22:35:00 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."1080--- PASS: TestFailedS3DeleteKeepsTombstone (7.24s)1081=== CONT TestGCAdvisoryLockBlocksConcurrentRun10822026/11/11 22:35:00 INFO Received cleanup request method=DELETE path=/api/pending_closures10832026/11/11 22:35:00 WARN Failed to abort upload, keeping its closure key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst error="Get \"http://127.0.0.1:1/bucket38/?location=\": dial tcp 127.0.0.1:1: connect: connection refused" code=""10842026/11/11 22:35:00 INFO Aborted multipart uploads count=0 kept=110852026/11/11 22:35:00 INFO Received cleanup request method=DELETE path=/api/pending_closures10862026/11/11 22:35:00 INFO Aborted multipart uploads count=1 kept=01087--- PASS: TestMultipartCleanup (7.34s)1088=== CONT TestLeadEndsOnShutdown10892026/11/11 22:35:00 INFO Received uploads request method=POST path=/api/pending_closures1090--- PASS: TestCreatePendingClosureVerifyS3FailureReleasesConnection (7.44s)1091=== CONT TestLeadGenerationGrowsWithEveryGrant10922026/11/11 22:35:01 WARN mTLS auth: subject not in bound subjects subject="CN=reader"10932026/11/11 22:35:01 WARN mTLS auth: subject not in bound subjects subject="CN=reader"1094--- PASS: TestService_NativeMTLS (7.40s)1095=== CONT TestGracefulShutdownDrainsInflight10962026/11/11 22:35:01 INFO Starting HTTP server address=127.0.0.1:5530410972026/11/11 22:35:01 INFO Shutdown signal received, draining in-flight requests timeout=10s1098--- PASS: TestGracefulShutdownDrainsInflight (0.08s)1099=== CONT TestLeadIncumbentAnnouncesAtOnce11002026/11/11 22:35:01 INFO Aborted multipart uploads count=0 kept=011012026/11/11 22:35:01 WARN Force mode enabled - objects will be deleted immediately without grace period11022026/11/11 22:35:01 INFO Received uploads request method=POST path=/api/pending_closures1103--- PASS: TestTombstonedObjectOfferedWithoutWaiting (7.42s)1104=== CONT TestGCTaskStore_Fail1105--- PASS: TestGCTaskStore_Fail (0.00s)1106=== CONT TestLeadUnannouncedStandbyYieldsToIncumbent11072026/11/11 22:35:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=011082026/11/11 22:35:02 INFO Vacuumed table table=pending_closures11092026/11/11 22:35:02 INFO Vacuumed table table=pending_objects11102026/11/11 22:35:02 INFO Vacuumed table table=multipart_uploads11112026/11/11 22:35:02 INFO Vacuumed table table=closures11122026/11/11 22:35:02 INFO Received uploads request method=POST path=/api/pending_closures11132026/11/11 22:35:02 INFO Vacuumed table table=objects1114--- PASS: TestGCSweepDeliversEachKeyOnce (8.49s)1115=== CONT TestGCTaskStore_PhaseUpdates1116--- PASS: TestGCTaskStore_PhaseUpdates (0.00s)1117=== CONT TestGCTaskStore_GetEmpty1118--- PASS: TestGCTaskStore_GetEmpty (0.00s)1119=== CONT TestGCTaskStore_ConflictDifferentParams1120--- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)1121=== CONT TestGCTaskStore_CompletedAllowsNewTask1122--- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)1123=== CONT TestGCTaskStore_DeduplicateSameParams1124--- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)1125=== CONT TestGCTaskStore_GetReturnsLatest1126--- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)1127=== CONT TestService_ReadAuthMiddleware11282026/11/11 22:35:02 INFO Aborted multipart uploads count=0 kept=011292026/11/11 22:35:02 WARN Force mode enabled - objects will be deleted immediately without grace period11302026/11/11 22:35:02 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011312026/11/11 22:35:02 INFO Vacuumed table table=pending_closures11322026/11/11 22:35:02 INFO Vacuumed table table=pending_objects11332026/11/11 22:35:02 INFO Vacuumed table table=multipart_uploads11342026/11/11 22:35:02 INFO Vacuumed table table=closures11352026/11/11 22:35:02 INFO Vacuumed table table=objects1136--- PASS: TestGCSweepSkipsPendingObjects (7.82s)1137=== CONT TestPush_SkippedKeySurvivesGCBeforeCommit11382026/11/11 22:35:02 INFO Received uploads request method=POST path=/api/pending_closures1139--- PASS: TestDeduplicatedObjectsRecordedAsPending (7.68s)1140=== CONT TestService_RequireScope_OIDC11412026/11/11 22:35:02 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55310/oidc11422026/11/11 22:35:03 INFO Received push request method=POST path=/api/pushes11432026/11/11 22:35:03 INFO Received complete push request method=POST path=/api/pushes/1/complete11442026/11/11 22:35:03 INFO Completed push id=1 objects=4 duration=33.089166ms11452026/11/11 22:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete11462026/11/11 22:35:03 INFO Completed upload id=2 objects=2 duration=1.381166ms1147--- PASS: TestMetricsCommit (7.99s)1148=== CONT TestPresignedUploadRegisteredBeforeCommit11492026/11/11 22:35:03 INFO Received uploads request method=POST path=/api/pending_closures11502026/11/11 22:35:03 INFO Aborted multipart uploads count=0 kept=01151--- PASS: TestMetricsInventory (8.35s)1152=== CONT TestService_AuthMiddleware_OIDC11532026/11/11 22:35:03 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011542026/11/11 22:35:03 INFO Vacuumed table table=pending_closures11552026/11/11 22:35:03 INFO Vacuumed table table=pending_objects11562026/11/11 22:35:03 INFO Vacuumed table table=multipart_uploads11572026/11/11 22:35:03 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55316/oidc11582026/11/11 22:35:03 INFO Vacuumed table table=closures11592026/11/11 22:35:03 INFO Vacuumed table table=objects11602026/11/11 22:35:03 INFO Aborted multipart uploads count=0 kept=011612026/11/11 22:35:04 WARN Force mode enabled - objects will be deleted immediately without grace period11622026/11/11 22:35:04 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011632026/11/11 22:35:04 INFO Vacuumed table table=pending_closures11642026/11/11 22:35:04 INFO Vacuumed table table=pending_objects11652026/11/11 22:35:04 INFO Vacuumed table table=multipart_uploads11662026/11/11 22:35:04 INFO Vacuumed table table=closures11672026/11/11 22:35:04 INFO Vacuumed table table=objects1168--- PASS: TestPushDedupSurvivesConcurrentGC (8.72s)1169=== CONT TestCompletedNarNotReofferedAcrossClosures11702026/11/11 22:35:04 INFO Aborted multipart uploads count=0 kept=011712026/11/11 22:35:04 WARN Force mode enabled - objects will be deleted immediately without grace period11722026/11/11 22:35:04 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=011732026/11/11 22:35:04 INFO Vacuumed table table=pending_closures11742026/11/11 22:35:04 INFO Vacuumed table table=pending_objects11752026/11/11 22:35:04 INFO Vacuumed table table=multipart_uploads11762026/11/11 22:35:04 INFO Vacuumed table table=closures11772026/11/11 22:35:04 INFO Vacuumed table table=objects1178--- PASS: TestGCMetrics (8.44s)1179=== CONT TestPush_CompleteCommitsEveryRoot1180=== NAME TestNARDeduplicationMetadataUploadBug1181 metadata_upload_test.go:48: First store path: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestNARDeduplicationMetadataUploadBug438155249/001/store/ii0r90dqmxxkh8k455lffgzj0zmq33y2-file1.txt11822026/11/11 22:35:04 INFO Received push request method=POST path=/api/pushes11832026/11/11 22:35:04 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)11842026/11/11 22:35:04 INFO Uploading ii0r90dqmxxkh8k455lffgzj0zmq33y2-file1.txt (160B)11852026/11/11 22:35:04 WARN Failed to register uploaded object key=ii0r90dqmxxkh8k455lffgzj0zmq33y2.ls error="server returned 404: 404 page not found\n"11862026/11/11 22:35:04 WARN Failed to register uploaded object key=nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst error="server returned 404: 404 page not found\n"11872026/11/11 22:35:04 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign11882026/11/11 22:35:04 INFO Signed narinfos id=1 count=111892026/11/11 22:35:04 INFO Uploading 1 narinfos11902026/11/11 22:35:04 INFO Received complete push request method=POST path=/api/pushes/1/complete11912026/11/11 22:35:04 WARN Failed to register uploaded object key=ii0r90dqmxxkh8k455lffgzj0zmq33y2.narinfo error="server returned 404: 404 page not found\n"11922026/11/11 22:35:04 INFO Completed push id=1 objects=3 duration=38.016125ms11932026/11/11 22:35:04 INFO Upload complete. (221ms)1194 metadata_upload_test.go:54: Retrieved narinfo from S3:1195 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestNARDeduplicationMetadataUploadBug438155249/001/store/ii0r90dqmxxkh8k455lffgzj0zmq33y2-file1.txt1196 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1197 Compression: zstd1198 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1199 NarSize: 1601200 References: 1201 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1202 metadata_upload_test.go:55: Retrieved .ls file from S3 (compressed size: 77 bytes)1203 metadata_upload_test.go:55: Decompressed .ls content (64 bytes):1204 {"version":1,"root":{"type":"regular","size":44,"narOffset":96}}1205--- PASS: TestCacheStatsHandler (7.56s)1206=== CONT TestCompleteMultipartUpload_ErrorButObjectExists1207=== NAME TestNARDeduplicationMetadataUploadBug1208 metadata_upload_test.go:64: Second store path (same content): /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestNARDeduplicationMetadataUploadBug438155249/001/store/zkrhpbr65xfl9blp63p4wz496xwz1p02-file2.txt1209=== NAME TestClientCADerivations1210 client_ca_test.go:136: Built CA derivation: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientCADerivations2660433726/001/store/47lkp678d6kaq1sj78plnc4jwspgziyn-ca-test1211 client_ca_test.go:139: Found 1 dependencies (including self)12122026/11/11 22:35:05 INFO Received push request method=POST path=/api/pushes12132026/11/11 22:35:05 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)12142026/11/11 22:35:05 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign12152026/11/11 22:35:05 INFO Signed narinfos id=2 count=112162026/11/11 22:35:05 WARN Failed to register uploaded object key=zkrhpbr65xfl9blp63p4wz496xwz1p02.ls error="server returned 404: 404 page not found\n"12172026/11/11 22:35:05 INFO Uploading 1 narinfos12182026/11/11 22:35:05 INFO Received complete push request method=POST path=/api/pushes/2/complete12192026/11/11 22:35:05 WARN Failed to register uploaded object key=zkrhpbr65xfl9blp63p4wz496xwz1p02.narinfo error="server returned 404: 404 page not found\n"12202026/11/11 22:35:05 INFO Completed push id=2 objects=3 duration=1.053916ms12212026/11/11 22:35:05 INFO Upload complete. (143ms)1222=== NAME TestNARDeduplicationMetadataUploadBug1223 metadata_upload_test.go:76: Retrieved narinfo from S3:1224 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestNARDeduplicationMetadataUploadBug438155249/001/store/zkrhpbr65xfl9blp63p4wz496xwz1p02-file2.txt1225 URL: nar/1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf.nar.zst1226 Compression: zstd1227 NarHash: sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1228 NarSize: 1601229 References: 1230 CA: fixed:r:sha256:1byf36hhc5sn8lvwqfkjh3ybgn76slmx8naakslrypxs6mna71rf1231 metadata_upload_test.go:77: Retrieved .ls file from S3 (compressed size: 62 bytes)1232 metadata_upload_test.go:77: Decompressed .ls content (49 bytes):1233 {"version":1,"root":{"type":"regular","size":44}}12342026/11/11 22:35:05 INFO Installed lifecycle rule aborting incomplete NAR uploads bucket=bucket52 days=21235--- PASS: TestEnsureAbortUploadsRule (7.10s)1236=== CONT TestClientFallsBackToClosures12372026/11/11 22:35:05 INFO Received push request method=POST path=/api/pushes12382026/11/11 22:35:05 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)12392026/11/11 22:35:05 INFO Uploading 47lkp678d6kaq1sj78plnc4jwspgziyn-ca-test (144B)1240--- PASS: TestNARDeduplicationMetadataUploadBug (8.71s)1241=== CONT TestSharedNarBothUploadsComplete12422026/11/11 22:35:05 WARN Failed to register uploaded object key=47lkp678d6kaq1sj78plnc4jwspgziyn.ls error="server returned 404: 404 page not found\n"12432026/11/11 22:35:05 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"12442026/11/11 22:35:05 WARN Failed to register uploaded object key=log/vwrak99iksyf51g4drzdvkdz2p9yk882-ca-test.drv error="server returned 404: 404 page not found\n"12452026/11/11 22:35:05 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign12462026/11/11 22:35:05 INFO Signed narinfos id=1 count=112472026/11/11 22:35:05 INFO Uploading 1 narinfos12482026/11/11 22:35:05 INFO Received complete push request method=POST path=/api/pushes/1/complete12492026/11/11 22:35:05 WARN Failed to register uploaded object key=47lkp678d6kaq1sj78plnc4jwspgziyn.narinfo error="server returned 404: 404 page not found\n"12502026/11/11 22:35:05 WARN readiness check failed error="closed pool"1251--- PASS: TestService_readinessHandler (6.29s)1252=== CONT TestClientPushesUseOnePush12532026/11/11 22:35:05 INFO Completed push id=1 objects=4 duration=20.623208ms12542026/11/11 22:35:05 INFO Upload complete. (305ms)1255=== NAME TestClientCADerivations1256 client_ca_test.go:180: Narinfo contains CA field: StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientCADerivations2660433726/001/store/47lkp678d6kaq1sj78plnc4jwspgziyn-ca-test1257 URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst1258 Compression: zstd1259 NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1260 NarSize: 1441261 References: 1262 Deriver: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientCADerivations2660433726/001/store/vwrak99iksyf51g4drzdvkdz2p9yk882-ca-test.drv1263 CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n1264 client_ca_test.go:185: Checking for realisation files in S3...1265 client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations1266 client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache1267--- PASS: TestConnectWaitsForAPeerMigration (8.90s)1268=== CONT TestPush_SignsNarinfosOfItsPendingObjects1269=== NAME TestClientCADerivations1270 client_ca_test.go:258: nix copy output: error: binary cache 's3://bucket49?endpoint=http://localhost:55203®ion=eu-west-1' is for Nix stores with prefix '/nix/store', not '/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientCADerivations2660433726/001/store'1271 client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 112722026/11/11 22:35:05 INFO Aborted multipart uploads count=1 kept=01273--- PASS: TestClientCADerivations (8.94s)1274=== CONT TestPinProtectsFromGC12752026/11/11 22:35:05 INFO Received cleanup request method=DELETE path=/api/pending_closures12762026/11/11 22:35:05 INFO Aborted multipart uploads count=1 kept=01277--- PASS: TestPendingCleanupUsesOneCutoff (12.83s)1278=== CONT TestPush_RejectsBadRequests1279--- PASS: TestService_healthCheckHandler (6.28s)1280=== CONT TestClientSharedPathCommittedMidPush1281--- PASS: TestGCBugBareHashReferences (6.72s)1282=== CONT TestClientWithDependencies12832026/11/11 22:35:06 ERROR failed to check GC advisory lock error="query pg_locks: failed to connect to `user=_tribuchetbld7 database=niks3`: /nonexistent/.s.PGSQL.5432 (/nonexistent): dial error: dial unix /nonexistent/.s.PGSQL.5432: connect: no such file or directory"1284--- PASS: TestGCAdvisoryLockBlocksConcurrentRun (6.31s)1285=== CONT TestPush_CompleteWaitsForCleanupOfThePush1286=== NAME TestOrphanedObjectsGCStressTest1287 orphaned_objects_gc_test.go:422: Created 10 active closures, 5 to-delete closures, 20 orphaned chains1288--- PASS: TestConcurrentCommitsSharingObjectsDoNotDeadlock (7.89s)1289=== CONT TestClientIntegration1290=== NAME TestOrphanedObjectsGCStressTest1291 orphaned_objects_gc_test.go:440: Marked 210 objects for deletion12922026/11/11 22:35:07 INFO lead: acquired remote=192.0.2.1:1234 generation=112932026/11/11 22:35:07 INFO lead: acquired remote=192.0.2.1:1234 generation=112942026/11/11 22:35:07 INFO lead: acquired remote=192.0.2.1:1234 generation=112952026/11/11 22:35:07 INFO lead: released remote=192.0.2.1:1234 generation=11296--- PASS: TestLeadIncumbentAnnouncesAtOnce (6.52s)1297=== CONT TestService_AuthMiddleware_MTLSProxyHeader12982026/11/11 22:35:08 INFO lead: acquired remote=192.0.2.1:1234 generation=112992026/11/11 22:35:08 INFO lead: released remote=192.0.2.1:1234 generation=11300--- PASS: TestLeadEndsOnShutdown (7.38s)1301=== CONT TestClientMultipleUploads1302--- PASS: TestService_ReadAuthMiddleware (5.94s)1303=== CONT TestService_AuthMiddleware_MTLSBoundSubjects13042026/11/11 22:35:08 INFO lead: released remote=192.0.2.1:1234 generation=113052026/11/11 22:35:08 INFO lead: acquired remote=192.0.2.1:1234 generation=213062026/11/11 22:35:08 INFO Received push request method=POST path=/api/pushes13072026/11/11 22:35:08 INFO Received complete push request method=POST path=/api/pushes/1/complete13082026/11/11 22:35:08 INFO Completed push id=1 objects=4 duration=32.677708ms13092026/11/11 22:35:08 INFO Received push request method=POST path=/api/pushes13102026/11/11 22:35:08 INFO Aborted multipart uploads count=0 kept=013112026/11/11 22:35:09 WARN Force mode enabled - objects will be deleted immediately without grace period13122026/11/11 22:35:09 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=2 objects-failed-to-delete=013132026/11/11 22:35:09 INFO Vacuumed table table=pending_closures13142026/11/11 22:35:09 INFO Vacuumed table table=pending_objects1315=== RUN TestService_RequireScope_OIDC/builder_may_write1316=== PAUSE TestService_RequireScope_OIDC/builder_may_write1317=== RUN TestService_RequireScope_OIDC/builder_may_not_admin1318=== PAUSE TestService_RequireScope_OIDC/builder_may_not_admin1319=== RUN TestService_RequireScope_OIDC/ops_may_admin1320=== PAUSE TestService_RequireScope_OIDC/ops_may_admin1321=== RUN TestService_RequireScope_OIDC/ops_may_not_write1322=== PAUSE TestService_RequireScope_OIDC/ops_may_not_write1323=== RUN TestService_RequireScope_OIDC/reader_may_not_write1324=== PAUSE TestService_RequireScope_OIDC/reader_may_not_write1325=== RUN TestService_RequireScope_OIDC/static_token_may_admin1326=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin1327=== RUN TestService_RequireScope_OIDC/static_token_may_write1328=== PAUSE TestService_RequireScope_OIDC/static_token_may_write1329=== RUN TestService_RequireScope_OIDC/reader_may_read1330=== PAUSE TestService_RequireScope_OIDC/reader_may_read1331=== RUN TestService_RequireScope_OIDC/writer_implies_read1332=== PAUSE TestService_RequireScope_OIDC/writer_implies_read1333=== RUN TestService_RequireScope_OIDC/anonymous_may_not_read1334=== PAUSE TestService_RequireScope_OIDC/anonymous_may_not_read1335=== RUN TestService_RequireScope_OIDC/reader_may_read_with_netrc1336=== PAUSE TestService_RequireScope_OIDC/reader_may_read_with_netrc1337=== RUN TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1338=== PAUSE TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1339=== RUN TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1340=== PAUSE TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read1341=== RUN TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1342=== PAUSE TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1343=== CONT TestPush_RepeatedRootCommitsOnce13442026/11/11 22:35:09 INFO Vacuumed table table=multipart_uploads13452026/11/11 22:35:09 INFO Vacuumed table table=closures13462026/11/11 22:35:09 INFO Vacuumed table table=objects13472026/11/11 22:35:09 INFO Received complete push request method=POST path=/api/pushes/2/complete13482026/11/11 22:35:09 INFO Completed push id=2 objects=4 duration=9.206708ms1349--- PASS: TestPush_SkippedKeySurvivesGCBeforeCommit (6.48s)1350=== CONT TestService_AuthMiddleware13512026/11/11 22:35:09 INFO lead: released remote=192.0.2.1:1234 generation=113522026/11/11 22:35:09 INFO lead: acquired remote=192.0.2.1:1234 generation=213532026/11/11 22:35:09 INFO lead: given back to the incumbent remote=192.0.2.1:1234 generation=213542026/11/11 22:35:09 INFO lead: acquired remote=192.0.2.1:1234 generation=313552026/11/11 22:35:09 INFO Received uploads request method=POST path=/api/pending_closures13562026/11/11 22:35:09 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst13572026/11/11 22:35:09 INFO Received uploads request method=POST path=/api/pending_closures1358--- PASS: TestPresignedUploadRegisteredBeforeCommit (6.23s)1359=== CONT TestService_ReadScope_PublicByDefault13602026/11/11 22:35:09 INFO lead: released remote=192.0.2.1:1234 generation=213612026/11/11 22:35:09 INFO lead: acquired remote=192.0.2.1:1234 generation=313622026/11/11 22:35:09 INFO lead: released remote=192.0.2.1:1234 generation=31363--- PASS: TestLeadGenerationGrowsWithEveryGrant (8.49s)1364=== CONT TestIsValidUploadKey1365=== RUN TestIsValidUploadKey/narinfo1366=== PAUSE TestIsValidUploadKey/narinfo1367=== RUN TestIsValidUploadKey/nar_zst1368=== PAUSE TestIsValidUploadKey/nar_zst1369=== RUN TestIsValidUploadKey/nar_xz1370=== PAUSE TestIsValidUploadKey/nar_xz1371=== RUN TestIsValidUploadKey/nar_plain1372=== PAUSE TestIsValidUploadKey/nar_plain1373=== RUN TestIsValidUploadKey/listing1374=== PAUSE TestIsValidUploadKey/listing1375=== RUN TestIsValidUploadKey/build_log1376=== PAUSE TestIsValidUploadKey/build_log1377=== RUN TestIsValidUploadKey/build_log_home-manager_file1378=== PAUSE TestIsValidUploadKey/build_log_home-manager_file1379=== RUN TestIsValidUploadKey/build_log_plus_in_name1380=== PAUSE TestIsValidUploadKey/build_log_plus_in_name1381=== RUN TestIsValidUploadKey/build_log_question_mark1382=== PAUSE TestIsValidUploadKey/build_log_question_mark1383=== RUN TestIsValidUploadKey/build_log_equals1384=== PAUSE TestIsValidUploadKey/build_log_equals1385=== RUN TestIsValidUploadKey/realisation1386=== PAUSE TestIsValidUploadKey/realisation1387=== RUN TestIsValidUploadKey/realisation_plus_in_output1388=== PAUSE TestIsValidUploadKey/realisation_plus_in_output1389=== RUN TestIsValidUploadKey/nix-cache-info1390=== PAUSE TestIsValidUploadKey/nix-cache-info1391=== RUN TestIsValidUploadKey/index.html1392=== PAUSE TestIsValidUploadKey/index.html1393=== RUN TestIsValidUploadKey/narinfo_key,_nar_type1394=== PAUSE TestIsValidUploadKey/narinfo_key,_nar_type1395=== RUN TestIsValidUploadKey/nar_key,_narinfo_type1396=== PAUSE TestIsValidUploadKey/nar_key,_narinfo_type1397=== RUN TestIsValidUploadKey/listing_key,_narinfo_type1398=== PAUSE TestIsValidUploadKey/listing_key,_narinfo_type1399=== RUN TestIsValidUploadKey/traversal1400=== PAUSE TestIsValidUploadKey/traversal1401=== RUN TestIsValidUploadKey/traversal_nar1402=== PAUSE TestIsValidUploadKey/traversal_nar1403=== RUN TestIsValidUploadKey/absolute1404=== PAUSE TestIsValidUploadKey/absolute1405=== RUN TestIsValidUploadKey/empty_key1406=== PAUSE TestIsValidUploadKey/empty_key1407=== RUN TestIsValidUploadKey/unknown_type1408=== PAUSE TestIsValidUploadKey/unknown_type1409=== CONT TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle1410=== RUN TestService_AuthMiddleware_OIDC/valid_OIDC_token1411=== PAUSE TestService_AuthMiddleware_OIDC/valid_OIDC_token1412=== RUN TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1413=== PAUSE TestService_AuthMiddleware_OIDC/OIDC_token_with_wrong_org_rejected1414=== RUN TestService_AuthMiddleware_OIDC/malformed_token_rejected1415=== PAUSE TestService_AuthMiddleware_OIDC/malformed_token_rejected1416=== RUN TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1417=== PAUSE TestService_AuthMiddleware_OIDC/static_token_still_works_with_OIDC_configured1418=== CONT TestService_createPendingClosureHandler14192026/11/11 22:35:10 INFO Received uploads request method=POST path=/api/pending_closures14202026/11/11 22:35:10 INFO Received push request method=POST path=/api/pushes14212026/11/11 22:35:10 INFO Received complete push request method=POST path=/api/pushes/1/complete14222026/11/11 22:35:10 INFO Completed push id=1 objects=6 duration=64.356708ms1423--- PASS: TestPush_CompleteCommitsEveryRoot (6.60s)1424=== CONT TestPendingClosureWriteTimeout1425=== RUN TestPendingClosureWriteTimeout/empty1426=== PAUSE TestPendingClosureWriteTimeout/empty1427=== RUN TestPendingClosureWriteTimeout/400_objects1428=== PAUSE TestPendingClosureWriteTimeout/400_objects1429=== RUN TestPendingClosureWriteTimeout/670k_objects1430=== PAUSE TestPendingClosureWriteTimeout/670k_objects1431=== RUN TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1432=== PAUSE TestPendingClosureWriteTimeout/handler_extends_the_server's_deadline1433=== CONT TestService_cleanupPendingClosuresHandler14342026/11/11 22:35:10 INFO Received uploads request method=POST path=/api/pending_closures1435--- PASS: TestDeleteClosuresRacingPins (11.48s)1436=== CONT TestProxyWriteTimeout1437=== RUN TestProxyWriteTimeout/narinfo1438=== PAUSE TestProxyWriteTimeout/narinfo1439=== RUN TestProxyWriteTimeout/1_GiB_nar1440=== PAUSE TestProxyWriteTimeout/1_GiB_nar1441=== RUN TestProxyWriteTimeout/10_GiB_nar1442=== PAUSE TestProxyWriteTimeout/10_GiB_nar1443=== RUN TestProxyWriteTimeout/unknown_size1444=== PAUSE TestProxyWriteTimeout/unknown_size1445=== CONT TestUploadHandlersRejectOversizedBody1446=== RUN TestUploadHandlersRejectOversizedBody/create_pending_closure1447=== PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure1448=== RUN TestUploadHandlersRejectOversizedBody/complete_multipart1449=== PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart1450=== RUN TestUploadHandlersRejectOversizedBody/request_more_parts1451=== PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts1452=== CONT TestUploadHandlersRejectInvalidKeys1453=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1454=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info1455=== RUN TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal1456=== PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal1457=== RUN TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1458=== PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key1459=== RUN TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1460=== PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key1461=== CONT TestReadRedirectUsesPublicS3URL14622026/11/11 22:35:11 INFO lead: released remote=192.0.2.1:1234 generation=31463--- PASS: TestLeadUnannouncedStandbyYieldsToIncumbent (9.12s)1464=== CONT TestPush_OverlappingRootsStoreOneRowPerKey14652026/11/11 22:35:11 INFO Received complete multipart upload request method=POST path=/api/multipart/complete14662026/11/11 22:35:11 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=OWUzMWQyMGYtZTA0MC00YWQ2LTg3OTctMWVmNWM1N2I3ZWUzLjM2ODA0MzNmLWEyYjctNDczMy1iNGQ4LWM0NTY4ZmNiNjE2ZngxNzk0NDM2NTEwOTAyNTc1MDAw14672026/11/11 22:35:11 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=OWUzMWQyMGYtZTA0MC00YWQ2LTg3OTctMWVmNWM1N2I3ZWUzLjM2ODA0MzNmLWEyYjctNDczMy1iNGQ4LWM0NTY4ZmNiNjE2ZngxNzk0NDM2NTEwOTAyNTc1MDAw parts=11468--- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (6.28s)1469=== CONT TestSkippedUploadsHandler14702026/11/11 22:35:11 INFO Client skipped oversized paths paths=3 nar_bytes=50000000001471--- PASS: TestSkippedUploadsHandler (0.01s)1472=== CONT TestReadProxyRangeRequest14732026/11/11 22:35:11 INFO Received uploads request method=POST path=/api/pending_closures14742026/11/11 22:35:11 INFO Received uploads request method=POST path=/api/pending_closures14752026/11/11 22:35:12 INFO Received uploads request method=POST path=/api/pending_closures14762026/11/11 22:35:12 INFO Received uploads request method=POST path=/api/pending_closures14772026/11/11 22:35:12 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)14782026/11/11 22:35:12 INFO Uploading 85iv3h985bz3mghhlxkx4f69yp9l8vx6-shared-dep (136B)14792026/11/11 22:35:12 INFO Uploading r8nfi0jawkcbq9i97n01wrxsfzhchvkf-a (256B)14802026/11/11 22:35:12 WARN Failed to register uploaded object key=85iv3h985bz3mghhlxkx4f69yp9l8vx6.ls error="server returned 404: 404 page not found\n"14812026/11/11 22:35:12 WARN Failed to register uploaded object key=nar/07xkyly2l0par6mlypa6ykipmnvmh34ia1rqx1bs79zjlld518qc.nar.zst error="server returned 404: 404 page not found\n"14822026/11/11 22:35:12 WARN Failed to register uploaded object key=vy9chpjzyfi6r2a02p0iqcb8snalixbf.ls error="server returned 404: 404 page not found\n"14832026/11/11 22:35:12 WARN Failed to register uploaded object key=r8nfi0jawkcbq9i97n01wrxsfzhchvkf.ls error="server returned 404: 404 page not found\n"14842026/11/11 22:35:12 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"14852026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign14862026/11/11 22:35:12 INFO Signed narinfos id=1 count=214872026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign14882026/11/11 22:35:12 INFO Signed narinfos id=2 count=214892026/11/11 22:35:12 INFO Uploading 4 narinfos14902026/11/11 22:35:12 INFO Received complete multipart upload request method=POST path=/api/multipart/complete14912026/11/11 22:35:12 WARN Failed to register uploaded object key=r8nfi0jawkcbq9i97n01wrxsfzhchvkf.narinfo error="server returned 404: 404 page not found\n"14922026/11/11 22:35:12 WARN Failed to register uploaded object key=85iv3h985bz3mghhlxkx4f69yp9l8vx6.narinfo error="server returned 404: 404 page not found\n"14932026/11/11 22:35:12 WARN Failed to register uploaded object key=vy9chpjzyfi6r2a02p0iqcb8snalixbf.narinfo error="server returned 404: 404 page not found\n"14942026/11/11 22:35:12 INFO Received push request method=POST path=/api/pushes14952026/11/11 22:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete14962026/11/11 22:35:12 WARN Failed to register uploaded object key=85iv3h985bz3mghhlxkx4f69yp9l8vx6.narinfo error="server returned 404: 404 page not found\n"14972026/11/11 22:35:12 INFO Completed upload id=1 objects=6 duration=58.931791ms14982026/11/11 22:35:12 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=OWUzMWQyMGYtZTA0MC00YWQ2LTg3OTctMWVmNWM1N2I3ZWUzLmQwMmVlNzIyLTUxZTEtNGM1NS1iZWNhLTllNzJlMmQyNzJkMngxNzk0NDM2NTEwMTEwMzc4MDAw parts=1214992026/11/11 22:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete15002026/11/11 22:35:12 INFO Received uploads request method=POST path=/api/pending_closures15012026/11/11 22:35:12 INFO Completed upload id=2 objects=6 duration=1.329958ms1502--- PASS: TestCompletedNarNotReofferedAcrossClosures (8.63s)1503=== CONT TestParseSize1504--- PASS: TestParseSize (0.00s)1505=== CONT TestPush_RootsAreLockedInByteOrder15062026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15072026/11/11 22:35:12 INFO Upload complete. (582ms)15082026/11/11 22:35:12 INFO Signed narinfos id=1 count=11509=== NAME TestClientFallsBackToClosures1510 client_pushes_test.go:112: Retrieved narinfo from S3:1511 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientFallsBackToClosures2472910097/001/store/85iv3h985bz3mghhlxkx4f69yp9l8vx6-shared-dep1512 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1513 Compression: zstd1514 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821515 NarSize: 1361516 References: 1517 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n15182026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1519 client_pushes_test.go:112: Retrieved narinfo from S3:1520 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientFallsBackToClosures2472910097/001/store/r8nfi0jawkcbq9i97n01wrxsfzhchvkf-a1521 URL: nar/07xkyly2l0par6mlypa6ykipmnvmh34ia1rqx1bs79zjlld518qc.nar.zst1522 Compression: zstd1523 NarHash: sha256:07xkyly2l0par6mlypa6ykipmnvmh34ia1rqx1bs79zjlld518qc1524 NarSize: 2561525 References: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientFallsBackToClosures2472910097/001/store/85iv3h985bz3mghhlxkx4f69yp9l8vx6-shared-dep1526 CA: text:sha256:1s9y1bgljmgvpppjqwz37j7igili9jvjb3hbg7bp5jdbv3ibhhh815272026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15282026/11/11 22:35:12 ERROR Failed to sign narinfos signer="index 1" error="signing key cannot be nil"15292026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign1530 client_pushes_test.go:112: Retrieved narinfo from S3:1531 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientFallsBackToClosures2472910097/001/store/vy9chpjzyfi6r2a02p0iqcb8snalixbf-b15322026/11/11 22:35:12 ERROR Failed to sign narinfos signer=niks3-test-1 error="signer failed"1533 URL: nar/07xkyly2l0par6mlypa6ykipmnvmh34ia1rqx1bs79zjlld518qc.nar.zst1534 Compression: zstd1535 NarHash: sha256:07xkyly2l0par6mlypa6ykipmnvmh34ia1rqx1bs79zjlld518qc1536 NarSize: 2561537 References: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientFallsBackToClosures2472910097/001/store/85iv3h985bz3mghhlxkx4f69yp9l8vx6-shared-dep1538 CA: text:sha256:1s9y1bgljmgvpppjqwz37j7igili9jvjb3hbg7bp5jdbv3ibhhh815392026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15402026/11/11 22:35:12 ERROR Signer returned unexpected signature count signer=niks3-test-1 got=0 want=115412026/11/11 22:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15422026/11/11 22:35:12 ERROR Signer returned unexpected object key signer=niks3-test-1 object_key=unexpected.narinfo1543--- PASS: TestPush_SignsNarinfosOfItsPendingObjects (7.14s)1544=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_other_NAR_pushed1545--- PASS: TestClientFallsBackToClosures (7.61s)1546=== CONT TestService_verifyS3ReuploadsStaleNarinfo/lost,_same_NAR_pushed15472026/11/11 22:35:13 INFO Received push request method=POST path=/api/pushes15482026/11/11 22:35:13 INFO Uploading 2 paths to 127.0.0.1 (1 already cached)15492026/11/11 22:35:13 INFO Uploading x8aicrji6r11pl1nrayxclxq8zasi755-b (256B)15502026/11/11 22:35:13 INFO Uploading lgymnr0kxnykiacy6mh8rf0gyaqwf9n4-shared-dep (136B)1551=== RUN TestPush_RejectsBadRequests/no_roots1552=== PAUSE TestPush_RejectsBadRequests/no_roots1553=== RUN TestPush_RejectsBadRequests/no_objects1554=== PAUSE TestPush_RejectsBadRequests/no_objects1555=== RUN TestPush_RejectsBadRequests/bad_root1556=== PAUSE TestPush_RejectsBadRequests/bad_root1557=== RUN TestPush_RejectsBadRequests/root_not_in_objects1558=== PAUSE TestPush_RejectsBadRequests/root_not_in_objects1559=== CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost,_second_pushed15602026/11/11 22:35:13 WARN Failed to register uploaded object key=lgymnr0kxnykiacy6mh8rf0gyaqwf9n4.ls error="server returned 404: 404 page not found\n"15612026/11/11 22:35:13 WARN Failed to register uploaded object key=mp9j2inhnzh1smyhchxlxxifxk72hjxq.ls error="server returned 404: 404 page not found\n"15622026/11/11 22:35:13 WARN Failed to register uploaded object key=nar/1a0s3wk9h0jp81kc03a15zq5k3zmcdwydgpc426jf0gmgqa0sk5v.nar.zst error="server returned 404: 404 page not found\n"15632026/11/11 22:35:13 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign15642026/11/11 22:35:13 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"15652026/11/11 22:35:13 WARN Failed to register uploaded object key=x8aicrji6r11pl1nrayxclxq8zasi755.ls error="server returned 404: 404 page not found\n"15662026/11/11 22:35:13 INFO Signed narinfos id=1 count=315672026/11/11 22:35:13 INFO Uploading 3 narinfos15682026/11/11 22:35:13 WARN Failed to register uploaded object key=lgymnr0kxnykiacy6mh8rf0gyaqwf9n4.narinfo error="server returned 404: 404 page not found\n"15692026/11/11 22:35:13 WARN Failed to register uploaded object key=x8aicrji6r11pl1nrayxclxq8zasi755.narinfo error="server returned 404: 404 page not found\n"15702026/11/11 22:35:13 INFO Received complete push request method=POST path=/api/pushes/1/complete15712026/11/11 22:35:13 WARN Failed to register uploaded object key=mp9j2inhnzh1smyhchxlxxifxk72hjxq.narinfo error="server returned 404: 404 page not found\n"15722026/11/11 22:35:13 INFO Completed push id=1 objects=8 duration=27.794416ms15732026/11/11 22:35:13 INFO Upload complete. (417ms)1574=== NAME TestClientPushesUseOnePush1575 client_pushes_test.go:97: Retrieved narinfo from S3:1576 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientPushesUseOnePush482666758/001/store/lgymnr0kxnykiacy6mh8rf0gyaqwf9n4-shared-dep1577 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1578 Compression: zstd1579 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821580 NarSize: 1361581 References: 1582 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1583 client_pushes_test.go:97: Retrieved narinfo from S3:1584 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientPushesUseOnePush482666758/001/store/mp9j2inhnzh1smyhchxlxxifxk72hjxq-a1585 URL: nar/1a0s3wk9h0jp81kc03a15zq5k3zmcdwydgpc426jf0gmgqa0sk5v.nar.zst1586 Compression: zstd1587 NarHash: sha256:1a0s3wk9h0jp81kc03a15zq5k3zmcdwydgpc426jf0gmgqa0sk5v1588 NarSize: 2561589 References: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientPushesUseOnePush482666758/001/store/lgymnr0kxnykiacy6mh8rf0gyaqwf9n4-shared-dep1590 CA: text:sha256:1g993mz5di6m464rww31sm39z449c8qgq1in72ccqq9pyqnya7x01591 client_pushes_test.go:97: Retrieved narinfo from S3:1592 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientPushesUseOnePush482666758/001/store/x8aicrji6r11pl1nrayxclxq8zasi755-b1593 URL: nar/1a0s3wk9h0jp81kc03a15zq5k3zmcdwydgpc426jf0gmgqa0sk5v.nar.zst1594 Compression: zstd1595 NarHash: sha256:1a0s3wk9h0jp81kc03a15zq5k3zmcdwydgpc426jf0gmgqa0sk5v1596 NarSize: 2561597 References: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientPushesUseOnePush482666758/001/store/lgymnr0kxnykiacy6mh8rf0gyaqwf9n4-shared-dep1598 CA: text:sha256:1g993mz5di6m464rww31sm39z449c8qgq1in72ccqq9pyqnya7x01599=== NAME TestPinProtectsFromGC1600 client_integration_test.go:778: Pinned store path: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestPinProtectsFromGC809138777/001/store/q563nlh894jfphgznz89964vffrprdg7-pinned-file.txt1601 client_integration_test.go:779: Unpinned store path: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestPinProtectsFromGC809138777/001/store/r6bhlfb8pw5b1mj60yhj1gj0y9f2gl51-unpinned-file.txt1602--- PASS: TestClientPushesUseOnePush (8.22s)16032026/11/11 22:35:13 INFO Received push request method=POST path=/api/pushes1604=== CONT TestService_verifyS3ReuploadsStaleNarinfo/first_of_two_lost16052026/11/11 22:35:13 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16062026/11/11 22:35:13 INFO Uploading q563nlh894jfphgznz89964vffrprdg7-pinned-file.txt (128B)16072026/11/11 22:35:13 WARN Failed to register uploaded object key=q563nlh894jfphgznz89964vffrprdg7.ls error="server returned 404: 404 page not found\n"16082026/11/11 22:35:13 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign16092026/11/11 22:35:13 WARN Failed to register uploaded object key=nar/0qmhsg42pqsz7x6hh02j8gznnac3yi3qpjhrqbwvz88i194jbb5s.nar.zst error="server returned 404: 404 page not found\n"16102026/11/11 22:35:13 INFO Signed narinfos id=1 count=116112026/11/11 22:35:13 INFO Uploading 1 narinfos16122026/11/11 22:35:13 INFO Received complete push request method=POST path=/api/pushes/1/complete16132026/11/11 22:35:13 WARN Failed to register uploaded object key=q563nlh894jfphgznz89964vffrprdg7.narinfo error="server returned 404: 404 page not found\n"16142026/11/11 22:35:13 INFO Completed push id=1 objects=3 duration=29.68375ms16152026/11/11 22:35:13 INFO Upload complete. (359ms)16162026/11/11 22:35:14 INFO Received push request method=POST path=/api/pushes16172026/11/11 22:35:14 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16182026/11/11 22:35:14 INFO Uploading r6bhlfb8pw5b1mj60yhj1gj0y9f2gl51-unpinned-file.txt (128B)16192026/11/11 22:35:14 INFO Received complete multipart upload request method=POST path=/api/multipart/complete16202026/11/11 22:35:14 WARN Failed to register uploaded object key=r6bhlfb8pw5b1mj60yhj1gj0y9f2gl51.ls error="server returned 404: 404 page not found\n"16212026/11/11 22:35:14 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign16222026/11/11 22:35:14 WARN Failed to register uploaded object key=nar/0gh0wdnr6gmk4r5sfzzh12isnl14rgmkrwy1ws41hpsrlndclg5h.nar.zst error="server returned 404: 404 page not found\n"16232026/11/11 22:35:14 INFO Signed narinfos id=2 count=116242026/11/11 22:35:14 INFO Uploading 1 narinfos16252026/11/11 22:35:14 INFO Received complete push request method=POST path=/api/pushes/2/complete16262026/11/11 22:35:14 WARN Failed to register uploaded object key=r6bhlfb8pw5b1mj60yhj1gj0y9f2gl51.narinfo error="server returned 404: 404 page not found\n"16272026/11/11 22:35:14 INFO Completed push id=2 objects=3 duration=1.033459ms16282026/11/11 22:35:14 INFO Upload complete. (202ms)16292026/11/11 22:35:14 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=OWUzMWQyMGYtZTA0MC00YWQ2LTg3OTctMWVmNWM1N2I3ZWUzLmM2NTdmNjRhLTc0OWUtNDlhYi1iZDljLTA1ZGM3Y2RlNGM5NngxNzk0NDM2NTExNjg5MjA4MDAw parts=1216302026/11/11 22:35:14 INFO Starting cleanup of old closures method=DELETE path=/api/closures16312026/11/11 22:35:14 INFO Garbage collection started16322026/11/11 22:35:14 INFO Aborted multipart uploads count=0 kept=016332026/11/11 22:35:14 WARN Force mode enabled - objects will be deleted immediately without grace period16342026/11/11 22:35:14 INFO Received push request method=POST path=/api/pushes16352026/11/11 22:35:14 INFO Received push request method=POST path=/api/pushes16362026/11/11 22:35:14 INFO Uploading 2 paths to 127.0.0.1 (0 already cached)16372026/11/11 22:35:14 INFO Uploading 95bxfqllrviplzajlg5d0mhjq6szd9z2-top (264B)16382026/11/11 22:35:14 INFO Uploading aiamqkhrk165n61s9pg9zay960izyhy7-shared-dep (136B)1639=== NAME TestClientIntegration1640 client_integration_test.go:291: Created store path: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientIntegration1984346703/002/store/6n968k8ffza060fd9hny2g2y77frkdpj-test-file.txt16412026/11/11 22:35:14 WARN Failed to register uploaded object key=nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst error="server returned 404: 404 page not found\n"16422026/11/11 22:35:14 WARN Failed to register uploaded object key=95bxfqllrviplzajlg5d0mhjq6szd9z2.ls error="server returned 404: 404 page not found\n"16432026/11/11 22:35:14 WARN Failed to register uploaded object key=aiamqkhrk165n61s9pg9zay960izyhy7.ls error="server returned 404: 404 page not found\n"16442026/11/11 22:35:14 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign16452026/11/11 22:35:14 WARN Failed to register uploaded object key=nar/1ymxkrbw6aza4327qyc4f5rl770rjp7xyn43qh0wjqhvvn801xz7.nar.zst error="server returned 404: 404 page not found\n"16462026/11/11 22:35:14 INFO Signed narinfos id=1 count=216472026/11/11 22:35:14 INFO Uploading 2 narinfos16482026/11/11 22:35:14 WARN Failed to register uploaded object key=aiamqkhrk165n61s9pg9zay960izyhy7.narinfo error="server returned 404: 404 page not found\n"16492026/11/11 22:35:14 INFO Received push request method=POST path=/api/pushes16502026/11/11 22:35:14 INFO Received complete push request method=POST path=/api/pushes/1/complete16512026/11/11 22:35:14 WARN Failed to register uploaded object key=95bxfqllrviplzajlg5d0mhjq6szd9z2.narinfo error="server returned 404: 404 page not found\n"16522026/11/11 22:35:14 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)16532026/11/11 22:35:14 INFO Uploading 6n968k8ffza060fd9hny2g2y77frkdpj-test-file.txt (152B)16542026/11/11 22:35:14 INFO Completed push id=1 objects=6 duration=60.118459ms16552026/11/11 22:35:14 INFO Upload complete. (441ms)1656=== NAME TestClientSharedPathCommittedMidPush1657 client_integration_test.go:727: Retrieved narinfo from S3:1658 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientSharedPathCommittedMidPush3874525851/001/store/aiamqkhrk165n61s9pg9zay960izyhy7-shared-dep1659 URL: nar/1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y82.nar.zst1660 Compression: zstd1661 NarHash: sha256:1vnl0g6w4zgpfz06rb321mfd3jqsrs120jcl8dg2dxn014875y821662 NarSize: 1361663 References: 1664 CA: text:sha256:08nxw05k7b0pzzy0f3swvnw4ldxdbclkdnklpidwmrxdhvfrmv7n1665 client_integration_test.go:727: Retrieved narinfo from S3:1666 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientSharedPathCommittedMidPush3874525851/001/store/95bxfqllrviplzajlg5d0mhjq6szd9z2-top1667 URL: nar/1ymxkrbw6aza4327qyc4f5rl770rjp7xyn43qh0wjqhvvn801xz7.nar.zst1668 Compression: zstd1669 NarHash: sha256:1ymxkrbw6aza4327qyc4f5rl770rjp7xyn43qh0wjqhvvn801xz71670 NarSize: 2641671 References: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientSharedPathCommittedMidPush3874525851/001/store/aiamqkhrk165n61s9pg9zay960izyhy7-shared-dep1672 CA: text:sha256:0gwv90l9dvjqz53chqal4dxrynqcrhbrx75jyldgvz5fxjn4x5gf16732026/11/11 22:35:14 WARN Failed to register uploaded object key=6n968k8ffza060fd9hny2g2y77frkdpj.ls error="server returned 404: 404 page not found\n"16742026/11/11 22:35:14 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=016752026/11/11 22:35:14 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign16762026/11/11 22:35:14 WARN Failed to register uploaded object key=nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst error="server returned 404: 404 page not found\n"16772026/11/11 22:35:14 INFO Signed narinfos id=1 count=116782026/11/11 22:35:14 INFO Uploading 1 narinfos16792026/11/11 22:35:15 INFO Vacuumed table table=pending_closures16802026/11/11 22:35:15 INFO Received complete push request method=POST path=/api/pushes/1/complete16812026/11/11 22:35:15 WARN Failed to register uploaded object key=6n968k8ffza060fd9hny2g2y77frkdpj.narinfo error="server returned 404: 404 page not found\n"16822026-11-11 22:35:15.015 UTC [66329] ERROR: Push does not exist: id=116832026-11-11 22:35:15.015 UTC [66329] CONTEXT: PL/pgSQL function commit_push(bigint) line 11 at RAISE16842026-11-11 22:35:15.015 UTC [66329] STATEMENT: SELECT commit_push($1)1685--- PASS: TestPush_CompleteWaitsForCleanupOfThePush (8.20s)1686=== CONT TestService_verifyS3ReuploadsStaleNarinfo/intact,_other_NAR_pushed16872026/11/11 22:35:15 INFO Completed push id=1 objects=3 duration=34.295375ms16882026/11/11 22:35:15 INFO Upload complete. (416ms)1689--- PASS: TestClientSharedPathCommittedMidPush (8.79s)1690=== CONT TestGCEndsOnShutdown/before_the_run16912026/11/11 22:35:15 INFO Vacuumed table table=pending_objects16922026/11/11 22:35:15 INFO Vacuumed table table=multipart_uploads16932026/11/11 22:35:15 INFO Vacuumed table table=closures16942026/11/11 22:35:15 INFO All 1 paths already cached1695=== NAME TestClientIntegration1696 client_integration_test.go:317: Retrieved narinfo from S3:1697 StorePath: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientIntegration1984346703/002/store/6n968k8ffza060fd9hny2g2y77frkdpj-test-file.txt1698 URL: nar/11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk1.nar.zst1699 Compression: zstd1700 NarHash: sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11701 NarSize: 1521702 References: 1703 CA: fixed:r:sha256:11l1b7hsy9g9pz8i2rcn4n128l6pyr2yf58d49r12hr5caw9dzk11704 client_integration_test.go:318: Retrieved .ls file from S3 (compressed size: 77 bytes)1705 client_integration_test.go:318: Decompressed .ls content (64 bytes):1706 {"version":1,"root":{"type":"regular","size":39,"narOffset":96}}17072026/11/11 22:35:15 INFO Vacuumed table table=objects1708--- PASS: TestService_AuthMiddleware_MTLSProxyHeader (7.72s)1709=== CONT TestGCEndsOnShutdown/blocked_on_a_row_lock_in_the_mark17102026/11/11 22:35:15 INFO Received push request method=POST path=/api/pushes17112026/11/11 22:35:15 INFO Object in database but missing from S3 key=6n968k8ffza060fd9hny2g2y77frkdpj.ls17122026/11/11 22:35:15 WARN Found objects in DB but missing from S3, will re-upload count=117132026/11/11 22:35:15 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)17142026/11/11 22:35:15 INFO Received complete push request method=POST path=/api/pushes/2/complete17152026/11/11 22:35:15 WARN Failed to register uploaded object key=6n968k8ffza060fd9hny2g2y77frkdpj.ls error="server returned 404: 404 page not found\n"17162026/11/11 22:35:15 INFO Completed push id=2 objects=3 duration=773.292µs17172026/11/11 22:35:15 INFO Upload complete. (206ms)1718=== NAME TestClientIntegration1719 client_integration_test.go:335: Retrieved .ls file from S3 (compressed size: 62 bytes)1720 client_integration_test.go:335: Decompressed .ls content (49 bytes):1721 {"version":1,"root":{"type":"regular","size":39}}1722=== NAME TestClientWithDependencies1723 client_integration_test.go:660: Built derivation: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientWithDependencies3533860956/001/store/bdckn06kg9bq398wxr9ngr1li4j0wbj5-test-script1724 client_integration_test.go:662: Found 1 dependencies (including self)17252026/11/11 22:35:16 INFO Received push request method=POST path=/api/pushes17262026/11/11 22:35:16 INFO Uploading 0 paths to 127.0.0.1 (1 already cached)17272026/11/11 22:35:16 INFO Received push request method=POST path=/api/pushes17282026/11/11 22:35:16 INFO Received complete push request method=POST path=/api/pushes/3/complete17292026/11/11 22:35:16 WARN Failed to register uploaded object key=6n968k8ffza060fd9hny2g2y77frkdpj.ls error="server returned 404: 404 page not found\n"17302026/11/11 22:35:16 INFO Completed push id=3 objects=3 duration=735.792µs17312026/11/11 22:35:16 INFO Upload complete. (186ms)17322026/11/11 22:35:16 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)17332026/11/11 22:35:16 INFO Uploading bdckn06kg9bq398wxr9ngr1li4j0wbj5-test-script (136B)1734=== NAME TestClientIntegration1735 client_integration_test.go:352: Retrieved .ls file from S3 (compressed size: 62 bytes)1736 client_integration_test.go:352: Decompressed .ls content (49 bytes):1737 {"version":1,"root":{"type":"regular","size":39}}1738 client_integration_test.go:363: Testing garbage collection...17392026/11/11 22:35:16 INFO Starting cleanup of old closures method=DELETE path=/api/closures17402026/11/11 22:35:16 INFO Garbage collection started17412026/11/11 22:35:16 INFO Aborted multipart uploads count=0 kept=017422026/11/11 22:35:16 WARN Failed to register uploaded object key=bdckn06kg9bq398wxr9ngr1li4j0wbj5.ls error="server returned 404: 404 page not found\n"17432026/11/11 22:35:16 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=017442026/11/11 22:35:16 INFO Received create pin request method=POST path=/api/pins/myapp17452026/11/11 22:35:16 WARN Force mode enabled - objects will be deleted immediately without grace period17462026/11/11 22:35:16 WARN Failed to register uploaded object key=nar/1s7yghixzpinyqm7g59kyn3sav81pmnsdi5v63m6x4r2vacy907j.nar.zst error="server returned 404: 404 page not found\n"17472026/11/11 22:35:16 WARN Failed to register uploaded object key=log/xpsdg1va5y1k3s7xa7bnap3w4gzvsr68-test-script.drv error="server returned 404: 404 page not found\n"17482026/11/11 22:35:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign17492026/11/11 22:35:16 INFO Signed narinfos id=1 count=117502026/11/11 22:35:16 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"17512026/11/11 22:35:16 WARN mTLS auth: bound subjects configured but subject DN unavailable17522026/11/11 22:35:16 INFO Uploading 1 narinfos17532026/11/11 22:35:16 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"1754--- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (7.97s)1755=== CONT TestGCEndsOnShutdown/blocked_in_the_sweep's_S3_delete17562026/11/11 22:35:16 INFO Created/updated pin name=myapp store_path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestPinProtectsFromGC809138777/001/store/q563nlh894jfphgznz89964vffrprdg7-pinned-file.txt narinfo_key=q563nlh894jfphgznz89964vffrprdg7.narinfo17572026/11/11 22:35:16 INFO Starting cleanup of old closures method=DELETE path=/api/closures17582026/11/11 22:35:16 INFO Garbage collection started17592026/11/11 22:35:16 INFO Aborted multipart uploads count=0 kept=017602026/11/11 22:35:16 WARN Force mode enabled - objects will be deleted immediately without grace period17612026/11/11 22:35:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=017622026/11/11 22:35:16 INFO Vacuumed table table=pending_closures17632026/11/11 22:35:16 INFO Vacuumed table table=pending_objects17642026/11/11 22:35:16 INFO Vacuumed table table=multipart_uploads17652026/11/11 22:35:16 INFO Vacuumed table table=closures17662026/11/11 22:35:16 INFO Received complete push request method=POST path=/api/pushes/1/complete17672026/11/11 22:35:16 WARN Failed to register uploaded object key=bdckn06kg9bq398wxr9ngr1li4j0wbj5.narinfo error="server returned 404: 404 page not found\n"17682026/11/11 22:35:16 INFO Vacuumed table table=objects17692026/11/11 22:35:16 INFO Completed push id=1 objects=4 duration=51.62425ms17702026/11/11 22:35:16 INFO Upload complete. (450ms)1771=== NAME TestClientWithDependencies1772 client_integration_test.go:664: Skipping nix copy test - isolated store (/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientWithDependencies3533860956/001/store) requires matching store prefix17732026/11/11 22:35:16 INFO Received complete multipart upload request method=POST path=/api/multipart/complete1774=== NAME TestClientMultipleUploads1775 client_integration_test.go:405: Created store path 0: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientMultipleUploads1338289038/001/store/80h6ly9ym5gfrcn0pln4qgzjz2ady61j-test-file-0.txt17762026/11/11 22:35:16 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0100000000000000000000.nar.zst upload_id=OWUzMWQyMGYtZTA0MC00YWQ2LTg3OTctMWVmNWM1N2I3ZWUzLmQ0OWU3ZjU2LWQ0YWEtNDI3MC1hNWFkLWVhNTQwNWNmNTJjZXgxNzk0NDM2NTExNzU3NjA2MDAw parts=121777--- PASS: TestSharedNarBothUploadsComplete (11.42s)1778=== CONT TestPresentNotReportedWhileGCDeletesClosure/stale1779=== CONT TestPresentNotReportedWhileGCDeletesClosure/fresh1780--- PASS: TestClientWithDependencies (9.99s)17812026/11/11 22:35:16 INFO Received push request method=POST path=/api/pushes1782=== NAME TestClientMultipleUploads1783 client_integration_test.go:405: Created store path 1: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientMultipleUploads1338289038/001/store/nka5idjw8f4920n77had17adfgj19lx4-test-file-1.txt17842026/11/11 22:35:16 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=017852026/11/11 22:35:17 INFO Vacuumed table table=pending_closures17862026/11/11 22:35:17 INFO Received complete push request method=POST path=/api/pushes/1/complete17872026/11/11 22:35:17 INFO Vacuumed table table=pending_objects17882026/11/11 22:35:17 INFO Vacuumed table table=multipart_uploads17892026/11/11 22:35:17 INFO Completed push id=1 objects=4 duration=37.387792ms1790--- PASS: TestPush_RepeatedRootCommitsOnce (8.03s)1791=== CONT TestParseSingleRange/none1792=== CONT TestParseSingleRange/end_clamped_to_size1793=== CONT TestParseSingleRange/malformed_both_empty1794=== CONT TestParseSingleRange/open-ended1795=== CONT TestParseSingleRange/closed1796=== CONT TestParseSingleRange/malformed_end_before_start1797=== CONT TestParseSingleRange/single_byte1798=== CONT TestParseSingleRange/start_far_past_EOF1799=== CONT TestParseSingleRange/start_past_EOF1800=== CONT TestParseSingleRange/suffix_exceeds_size1801=== CONT TestParseSingleRange/suffix1802=== CONT TestParseSingleRange/multi-range_ignored1803=== CONT TestParseSingleRange/malformed_no_dash1804=== CONT TestParseSingleRange/unknown_unit1805=== CONT TestIsValidCachePath/narinfo1806=== CONT TestIsValidCachePath/index.html1807=== CONT TestIsValidCachePath/short_hash1808--- PASS: TestParseSingleRange (0.01s)1809 --- PASS: TestParseSingleRange/none (0.00s)1810 --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)1811 --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)1812 --- PASS: TestParseSingleRange/open-ended (0.00s)1813 --- PASS: TestParseSingleRange/closed (0.00s)1814 --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)1815 --- PASS: TestParseSingleRange/single_byte (0.00s)1816 --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)1817 --- PASS: TestParseSingleRange/start_past_EOF (0.00s)1818 --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)1819 --- PASS: TestParseSingleRange/suffix (0.00s)1820 --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)1821 --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)1822 --- PASS: TestParseSingleRange/unknown_unit (0.00s)1823=== CONT TestIsValidCachePath/wrong_extension1824=== CONT TestIsValidCachePath/leading_slash1825=== CONT TestIsValidCachePath/empty1826=== CONT TestIsValidCachePath/random_path1827=== CONT TestIsValidCachePath/invalid_char_u1828=== CONT TestIsValidCachePath/invalid_char_e1829=== CONT TestIsValidCachePath/traversal_in_middle1830=== CONT TestIsValidCachePath/traversal_parent1831=== CONT TestIsValidCachePath/nar_uncompressed1832=== CONT TestIsValidCachePath/nix-cache-info1833=== CONT TestIsValidCachePath/realisation1834=== CONT TestIsValidCachePath/log1835=== CONT TestIsValidCachePath/ls1836=== CONT TestIsValidCachePath/nar_xz1837=== CONT TestIsValidCachePath/nar_zst1838=== CONT TestIsValidCachePath/narinfo_all_nix_base32_chars1839=== CONT TestIsValidCachePath/nar_bz21840--- PASS: TestIsValidCachePath (0.01s)1841 --- PASS: TestIsValidCachePath/narinfo (0.00s)1842 --- PASS: TestIsValidCachePath/index.html (0.00s)1843 --- PASS: TestIsValidCachePath/short_hash (0.00s)1844 --- PASS: TestIsValidCachePath/wrong_extension (0.00s)1845 --- PASS: TestIsValidCachePath/leading_slash (0.00s)1846 --- PASS: TestIsValidCachePath/empty (0.00s)1847 --- PASS: TestIsValidCachePath/random_path (0.00s)1848 --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)1849 --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)1850 --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)1851 --- PASS: TestIsValidCachePath/traversal_parent (0.00s)1852 --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)1853 --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)1854 --- PASS: TestIsValidCachePath/realisation (0.00s)1855 --- PASS: TestIsValidCachePath/log (0.00s)1856 --- PASS: TestIsValidCachePath/ls (0.00s)1857 --- PASS: TestIsValidCachePath/nar_xz (0.00s)1858 --- PASS: TestIsValidCachePath/nar_zst (0.00s)1859 --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)1860 --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)1861=== CONT TestClientErrorHandling/InvalidStorePath18622026/11/11 22:35:17 INFO Vacuumed table table=closures1863=== NAME TestClientMultipleUploads1864 client_integration_test.go:405: Created store path 2: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestClientMultipleUploads1338289038/001/store/5idnnkhzxi796nkfb4r3fyrjyilfck15-test-file-2.txt18652026/11/11 22:35:17 INFO Vacuumed table table=objects18662026/11/11 22:35:17 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"1867--- PASS: TestService_AuthMiddleware (8.13s)1868=== CONT TestClientErrorHandling/ServerNotAvailable18692026/11/11 22:35:17 INFO Received push request method=POST path=/api/pushes18702026/11/11 22:35:17 INFO Uploading 3 paths to 127.0.0.1 (0 already cached)18712026/11/11 22:35:17 INFO Uploading nka5idjw8f4920n77had17adfgj19lx4-test-file-1.txt (160B)18722026/11/11 22:35:17 INFO Uploading 80h6ly9ym5gfrcn0pln4qgzjz2ady61j-test-file-0.txt (160B)18732026/11/11 22:35:17 INFO Uploading 5idnnkhzxi796nkfb4r3fyrjyilfck15-test-file-2.txt (160B)18742026/11/11 22:35:17 WARN Failed to register uploaded object key=5idnnkhzxi796nkfb4r3fyrjyilfck15.ls error="server returned 404: 404 page not found\n"18752026/11/11 22:35:17 WARN Failed to register uploaded object key=nka5idjw8f4920n77had17adfgj19lx4.ls error="server returned 404: 404 page not found\n"18762026/11/11 22:35:17 WARN Failed to register uploaded object key=80h6ly9ym5gfrcn0pln4qgzjz2ady61j.ls error="server returned 404: 404 page not found\n"18772026/11/11 22:35:17 WARN Failed to register uploaded object key=nar/0ahq3izw3h0b0c08p3xdfclh758fwxnp85ccvflasb4vnfsv50ri.nar.zst error="server returned 404: 404 page not found\n"18782026/11/11 22:35:17 WARN Failed to register uploaded object key=nar/13p9pqi0ga6fx2apcwls9hjnv7nmf740ggpn5zvfzdsp5vz2bbg4.nar.zst error="server returned 404: 404 page not found\n"18792026/11/11 22:35:17 WARN Failed to register uploaded object key=nar/1823g6vx4q5zqvr73m7lkq1wpk40fin7bsc792di430yk7sg4lka.nar.zst error="server returned 404: 404 page not found\n"18802026/11/11 22:35:17 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign18812026/11/11 22:35:17 INFO Signed narinfos id=1 count=318822026/11/11 22:35:17 INFO Uploading 3 narinfos18832026/11/11 22:35:17 WARN Failed to register uploaded object key=5idnnkhzxi796nkfb4r3fyrjyilfck15.narinfo error="server returned 404: 404 page not found\n"18842026/11/11 22:35:17 WARN Failed to register uploaded object key=80h6ly9ym5gfrcn0pln4qgzjz2ady61j.narinfo error="server returned 404: 404 page not found\n"18852026/11/11 22:35:17 INFO Received complete push request method=POST path=/api/pushes/1/complete18862026/11/11 22:35:17 WARN Failed to register uploaded object key=nka5idjw8f4920n77had17adfgj19lx4.narinfo error="server returned 404: 404 page not found\n"18872026/11/11 22:35:17 INFO Completed push id=1 objects=9 duration=77.768584ms18882026/11/11 22:35:17 INFO Upload complete. (457ms)1889=== NAME TestClientMultipleUploads1890 client_integration_test.go:416: Uploaded 3 paths in 499.047875ms18912026/11/11 22:35:17 INFO Received uploads request method=POST path=/api/pending_closures18922026/11/11 22:35:17 WARN Request failed, retrying attempt=1 backoff=100ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp 127.0.0.1:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1893--- PASS: TestClientMultipleUploads (9.66s)1894=== CONT TestClientErrorHandling/InvalidAuthToken18952026/11/11 22:35:17 WARN Request failed, retrying attempt=2 backoff=210.881314ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp 127.0.0.1:19999: connect: connection refused" url=http://localhost:19999/api/objects/present18962026/11/11 22:35:18 WARN Request failed, retrying attempt=3 backoff=383.337327ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp 127.0.0.1:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1897--- PASS: TestService_ReadScope_PublicByDefault (8.52s)1898=== CONT TestForceGCDuringPushOffersSweptObject/before_pending_rows18992026/11/11 22:35:18 INFO Received complete multipart upload request method=POST path=/api/multipart/complete19002026/11/11 22:35:18 INFO Garbage collection progress phase="" failed_uploads_deleted=0 old_closures_deleted=1 objects_marked=3 objects_deleted=3 objects_failed=01901=== NAME TestClientIntegration1902 client_integration_test.go:370: Objects in database after GC:1903 client_integration_test.go:370: Successfully deleted all objects with GC --force1904=== NAME TestPinProtectsFromGC1905 client_integration_test.go:887: Pin successfully protected closure from garbage collection1906--- PASS: TestClientIntegration (11.52s)1907=== CONT TestServerTLSConfig/no_client_CA19082026/11/11 22:35:18 WARN Request failed, retrying attempt=4 backoff=771.754929ms error="Post \"http://localhost:19999/api/objects/present\": dial tcp 127.0.0.1:19999: connect: connection refused" url=http://localhost:19999/api/objects/present1909=== CONT TestForceGCDuringPushOffersSweptObject/after_presence_check19102026/11/11 22:35:18 INFO Received uploads request method=POST path=/api/pending_closures19112026/11/11 22:35:18 INFO Received uploads request method=POST path=/api/pending_closures19122026/11/11 22:35:18 INFO Received uploads request method=POST path=/api/pending_closures1913--- PASS: TestPinProtectsFromGC (12.79s)1914=== CONT TestServerTLSConfig/not_a_PEM_file1915=== CONT TestServerTLSConfig/missing_CA_file1916--- PASS: TestServerTLSConfig (0.00s)1917 --- PASS: TestServerTLSConfig/no_client_CA (0.00s)1918 --- PASS: TestServerTLSConfig/not_a_PEM_file (0.03s)1919 --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)1920=== CONT TestResolveDBConnectionString/flag_wins1921=== CONT TestResolveDBConnectionString/PGHOST_allows_empty1922=== CONT TestResolveDBConnectionString/nothing_configured1923=== CONT TestResolveDBConnectionString/missing_file_is_an_error1924=== CONT TestResolveDBConnectionString/file_when_flag_empty1925=== CONT TestCacheConfigHandler/full_config,_no_issuer1926=== CONT TestCacheConfigHandler/no_signing_keys1927=== CONT TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator1928=== CONT TestCacheConfigHandler/no_cache_url_configured1929--- PASS: TestCacheConfigHandler (0.00s)1930 --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)1931 --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)1932 --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)1933 --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)1934=== CONT TestService_RequireScope_OIDC/builder_may_write1935=== CONT TestService_RequireScope_OIDC/reader_may_read1936=== CONT TestService_RequireScope_OIDC/empty_netrc_password_may_not_read1937=== CONT TestService_RequireScope_OIDC/wrong_netrc_password_may_not_read19382026/11/11 22:35:18 WARN Authentication failed token_preview=wrong token_length=5 oidc_error="no provider could verify the token (signature or issuer mismatch)" oidc_provider="" tried_providers=[test]1939--- PASS: TestResolveDBConnectionString (0.07s)1940 --- PASS: TestResolveDBConnectionString/flag_wins (0.00s)1941 --- PASS: TestResolveDBConnectionString/PGHOST_allows_empty (0.00s)1942 --- PASS: TestResolveDBConnectionString/nothing_configured (0.00s)1943 --- PASS: TestResolveDBConnectionString/missing_file_is_an_error (0.00s)1944 --- PASS: TestResolveDBConnectionString/file_when_flag_empty (0.00s)1945=== CONT TestService_RequireScope_OIDC/static_token_may_admin_with_netrc1946=== CONT TestService_RequireScope_OIDC/reader_may_read_with_netrc1947=== CONT TestService_RequireScope_OIDC/anonymous_may_not_read1948=== CONT TestService_RequireScope_OIDC/writer_implies_read1949=== CONT TestService_RequireScope_OIDC/reader_may_not_write1950=== CONT TestService_RequireScope_OIDC/static_token_may_write1951=== CONT TestService_RequireScope_OIDC/static_token_may_admin1952=== CONT TestService_RequireScope_OIDC/ops_may_admin1953=== CONT TestService_RequireScope_OIDC/ops_may_not_write1954=== CONT TestService_RequireScope_OIDC/builder_may_not_admin1955=== CONT TestIsValidUploadKey/narinfo1956=== CONT TestIsValidUploadKey/realisation_plus_in_output1957=== CONT TestIsValidUploadKey/unknown_type1958=== CONT TestIsValidUploadKey/empty_key1959=== CONT TestIsValidUploadKey/absolute1960=== CONT TestIsValidUploadKey/traversal_nar1961=== CONT TestIsValidUploadKey/traversal1962=== CONT TestIsValidUploadKey/listing_key,_narinfo_type1963=== CONT TestIsValidUploadKey/nar_key,_narinfo_type1964=== CONT TestIsValidUploadKey/narinfo_key,_nar_type1965=== CONT TestIsValidUploadKey/index.html1966=== CONT TestIsValidUploadKey/nix-cache-info1967=== CONT TestIsValidUploadKey/build_log_home-manager_file1968=== CONT TestIsValidUploadKey/realisation1969=== CONT TestIsValidUploadKey/build_log_equals1970=== CONT TestIsValidUploadKey/build_log_question_mark1971=== CONT TestIsValidUploadKey/build_log_plus_in_name1972=== CONT TestIsValidUploadKey/nar_plain1973=== CONT TestIsValidUploadKey/build_log1974=== CONT TestIsValidUploadKey/listing1975=== CONT TestIsValidUploadKey/nar_xz1976=== CONT TestIsValidUploadKey/nar_zst1977--- PASS: TestIsValidUploadKey (0.01s)1978 --- PASS: TestIsValidUploadKey/narinfo (0.00s)1979 --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)1980 --- PASS: TestIsValidUploadKey/unknown_type (0.00s)1981 --- PASS: TestIsValidUploadKey/empty_key (0.00s)1982 --- PASS: TestIsValidUploadKey/absolute (0.00s)1983 --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)1984 --- PASS: TestIsValidUploadKey/traversal (0.00s)1985 --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)1986 --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)1987 --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)1988 --- PASS: TestIsValidUploadKey/index.html (0.00s)1989 --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)1990 --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)1991 --- PASS: TestIsValidUploadKey/realisation (0.00s)1992 --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)1993 --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)1994 --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)1995 --- PASS: TestIsValidUploadKey/nar_plain (0.00s)1996 --- PASS: TestIsValidUploadKey/build_log (0.00s)1997 --- PASS: TestIsValidUploadKey/listing (0.00s)1998 --- PASS: TestIsValidUploadKey/nar_xz (0.00s)1999 --- PASS: TestIsValidUploadKey/nar_zst (0.00s)2000=== CONT TestService_AuthMiddleware_OIDC/valid_OIDC_token
loading 653 hidden lines…
26542026/11/11 22:35:35 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."26552026/11/11 22:35:35 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."26562026/11/11 22:35:35 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."26572026/11/11 22:35:35 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."26582026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:aaaaaaaa!out.doi error="Access Denied."26592026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."26602026/11/11 22:35:35 INFO Vacuumed table table=closures26612026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026622026/11/11 22:35:35 INFO Completed push id=5 objects=3 duration=1.142209ms26632026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=026642026/11/11 22:35:35 INFO Received complete upload request method=POST path=/26652026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."26662026/11/11 22:35:35 INFO Received complete push request method=POST path=/26672026/11/11 22:35:35 INFO Vacuumed table table=objects26682026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."26692026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."26702026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."26712026/11/11 22:35:35 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."26722026/11/11 22:35:35 INFO Completed upload id=7 objects=4 duration=409.625µs26732026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026742026/11/11 22:35:35 INFO Received push request method=POST path=/26752026/11/11 22:35:35 INFO Received push request method=POST path=/26762026/11/11 22:35:35 INFO Received push request method=POST path=/26772026/11/11 22:35:35 INFO Received uploads request method=POST path=/26782026/11/11 22:35:35 INFO Received complete push request method=POST path=/26792026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=026802026/11/11 22:35:35 INFO Completed push id=8 objects=6 duration=601.916µs26812026/11/11 22:35:35 INFO Completed push id=1 objects=24 duration=31.919958ms26822026/11/11 22:35:35 INFO Vacuumed table table=pending_closures26832026/11/11 22:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period26842026/11/11 22:35:35 INFO Vacuumed table table=pending_closures26852026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=026862026/11/11 22:35:35 INFO Received push request method=POST path=/26872026/11/11 22:35:35 INFO Received complete upload request method=POST path=/26882026/11/11 22:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period26892026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026902026/11/11 22:35:35 INFO Received uploads request method=POST path=/26912026/11/11 22:35:35 INFO Completed upload id=17 objects=5 duration=267.667µs26922026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=026932026/11/11 22:35:35 INFO Vacuumed table table=pending_closures26942026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=026952026/11/11 22:35:35 INFO Received push request method=POST path=/26962026/11/11 22:35:35 INFO Vacuumed table table=pending_objects26972026/11/11 22:35:35 INFO Vacuumed table table=pending_objects26982026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=16 objects-failed-to-delete=026992026/11/11 22:35:35 INFO Received push request method=POST path=/27002026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27012026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27022026/11/11 22:35:35 INFO Vacuumed table table=pending_objects27032026/11/11 22:35:35 INFO Vacuumed table table=closures27042026/11/11 22:35:35 INFO Vacuumed table table=pending_closures27052026/11/11 22:35:35 INFO Vacuumed table table=closures27062026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27072026/11/11 22:35:35 INFO Vacuumed table table=objects27082026/11/11 22:35:35 INFO Vacuumed table table=objects27092026/11/11 22:35:35 INFO Vacuumed table table=pending_closures27102026/11/11 22:35:35 INFO Vacuumed table table=pending_objects27112026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27122026/11/11 22:35:35 INFO Vacuumed table table=closures27132026/11/11 22:35:35 INFO Vacuumed table table=closures27142026/11/11 22:35:35 INFO Received uploads request method=POST path=/27152026/11/11 22:35:35 INFO Vacuumed table table=objects27162026/11/11 22:35:35 INFO Received complete upload request method=POST path=/27172026/11/11 22:35:35 INFO Received complete push request method=POST path=/27182026/11/11 22:35:35 INFO Completed upload id=9 objects=7 duration=943.958µs27192026/11/11 22:35:35 INFO Completed push id=19 objects=3 duration=420.917µs27202026/11/11 22:35:35 INFO Vacuumed table table=objects27212026/11/11 22:35:35 INFO Received push request method=POST path=/27222026/11/11 22:35:35 INFO Vacuumed table table=pending_objects27232026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27242026/11/11 22:35:35 INFO Received push request method=POST path=/27252026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=027262026/11/11 22:35:35 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."27272026/11/11 22:35:35 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."27282026/11/11 22:35:35 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."27292026/11/11 22:35:35 INFO Vacuumed table table=closures27302026/11/11 22:35:35 INFO Received push request method=POST path=/27312026/11/11 22:35:35 INFO Received uploads request method=POST path=/27322026/11/11 22:35:35 INFO Received uploads request method=POST path=/27332026/11/11 22:35:35 INFO Received complete upload request method=POST path=/27342026/11/11 22:35:35 INFO Received push request method=POST path=/27352026/11/11 22:35:35 INFO Completed upload id=10 objects=17 duration=344.709µs27362026/11/11 22:35:35 INFO Received push request method=POST path=/27372026/11/11 22:35:35 INFO Vacuumed table table=objects27382026/11/11 22:35:35 INFO Received complete push request method=POST path=/27392026/11/11 22:35:35 INFO Received uploads request method=POST path=/27402026/11/11 22:35:35 INFO Completed push id=10 objects=2 duration=571.5µs27412026/11/11 22:35:35 INFO Received push request method=POST path=/27422026/11/11 22:35:35 INFO Received push request method=POST path=/27432026/11/11 22:35:35 INFO Received complete push request method=POST path=/27442026/11/11 22:35:35 INFO Received push request method=POST path=/27452026/11/11 22:35:35 INFO Completed push id=6 objects=5 duration=1.509ms27462026/11/11 22:35:35 INFO Received push request method=POST path=/27472026/11/11 22:35:35 INFO Received complete push request method=POST path=/27482026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=027492026/11/11 22:35:35 INFO Received push request method=POST path=/27502026/11/11 22:35:35 INFO Completed push id=14 objects=6 duration=477.709µs27512026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=027522026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=027532026/11/11 22:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period27542026/11/11 22:35:35 INFO Received push request method=POST path=/27552026/11/11 22:35:35 INFO Received uploads request method=POST path=/27562026/11/11 22:35:35 INFO Vacuumed table table=pending_closures27572026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027582026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=027592026/11/11 22:35:35 INFO Received complete upload request method=POST path=/27602026/11/11 22:35:35 INFO Received push request method=POST path=/27612026/11/11 22:35:35 INFO Received push request method=POST path=/27622026/11/11 22:35:35 INFO Vacuumed table table=pending_closures27632026/11/11 22:35:35 INFO Vacuumed table table=pending_objects27642026/11/11 22:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period27652026/11/11 22:35:35 INFO Vacuumed table table=pending_objects27662026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27672026/11/11 22:35:35 INFO Completed upload id=12 objects=21 duration=6.037125ms27682026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27692026/11/11 22:35:35 INFO Vacuumed table table=closures27702026/11/11 22:35:35 INFO Received uploads request method=POST path=/27712026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=027722026/11/11 22:35:35 INFO Received complete push request method=POST path=/27732026/11/11 22:35:35 INFO Vacuumed table table=closures27742026/11/11 22:35:35 INFO Received push request method=POST path=/27752026/11/11 22:35:35 INFO Vacuumed table table=objects27762026/11/11 22:35:35 INFO Vacuumed table table=objects27772026/11/11 22:35:35 INFO Completed push id=20 objects=4 duration=463.834µs27782026/11/11 22:35:35 INFO Received uploads request method=POST path=/27792026/11/11 22:35:35 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=1 objects-deleted-after-grace-period=0 objects-failed-to-delete=027802026/11/11 22:35:35 INFO Received push request method=POST path=/27812026/11/11 22:35:35 INFO Received push request method=POST path=/27822026/11/11 22:35:35 INFO Vacuumed table table=pending_closures27832026/11/11 22:35:35 INFO Received push request method=POST path=/27842026/11/11 22:35:35 INFO Vacuumed table table=pending_objects27852026/11/11 22:35:35 INFO Received uploads request method=POST path=/27862026/11/11 22:35:35 INFO Vacuumed table table=multipart_uploads27872026/11/11 22:35:35 INFO Received uploads request method=POST path=/27882026/11/11 22:35:35 INFO Vacuumed table table=closures27892026/11/11 22:35:35 INFO Received uploads request method=POST path=/27902026/11/11 22:35:35 INFO Vacuumed table table=objects27912026/11/11 22:35:35 INFO Aborted multipart uploads count=0 kept=027922026/11/11 22:35:35 INFO Received complete push request method=POST path=/27932026/11/11 22:35:35 WARN Force mode enabled - objects will be deleted immediately without grace period27942026/11/11 22:35:35 INFO Received push request method=POST path=/27952026/11/11 22:35:36 INFO Received push request method=POST path=/27962026/11/11 22:35:36 INFO Completed push id=13 objects=23 duration=434.75µs27972026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=027982026/11/11 22:35:36 INFO Received uploads request method=POST path=/27992026/11/11 22:35:36 INFO Received uploads request method=POST path=/28002026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28012026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028022026/11/11 22:35:36 INFO Received uploads request method=POST path=/28032026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=028042026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28052026/11/11 22:35:36 INFO Received complete push request method=POST path=/28062026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28072026/11/11 22:35:36 INFO Completed push id=12 objects=2 duration=5.987083ms28082026/11/11 22:35:36 INFO Vacuumed table table=closures28092026/11/11 22:35:36 INFO Received uploads request method=POST path=/28102026/11/11 22:35:36 INFO Vacuumed table table=objects28112026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28122026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28132026/11/11 22:35:36 INFO Completed upload id=5 objects=7 duration=926µs28142026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28152026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028162026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28172026/11/11 22:35:36 INFO Received uploads request method=POST path=/28182026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028192026/11/11 22:35:36 INFO Vacuumed table table=closures28202026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28212026/11/11 22:35:36 INFO Vacuumed table table=objects28222026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028232026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28242026/11/11 22:35:36 INFO Received push request method=POST path=/28252026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028262026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28272026/11/11 22:35:36 INFO Vacuumed table table=closures28282026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28292026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28302026/11/11 22:35:36 INFO Vacuumed table table=objects28312026/11/11 22:35:36 INFO Completed upload id=22 objects=8 duration=225.375µs28322026/11/11 22:35:36 INFO Received uploads request method=POST path=/28332026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28342026/11/11 22:35:36 INFO Received push request method=POST path=/28352026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28362026/11/11 22:35:36 INFO Received complete push request method=POST path=/28372026/11/11 22:35:36 INFO Received uploads request method=POST path=/28382026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28392026/11/11 22:35:36 INFO Completed push id=23 objects=5 duration=286.459µs28402026/11/11 22:35:36 INFO Completed upload id=6 objects=9 duration=392.041µs28412026/11/11 22:35:36 INFO Vacuumed table table=closures28422026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28432026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28442026/11/11 22:35:36 INFO Vacuumed table table=objects28452026/11/11 22:35:36 INFO Received uploads request method=POST path=/28462026/11/11 22:35:36 INFO Completed upload id=24 objects=8 duration=553.834µs28472026/11/11 22:35:36 INFO Completed upload id=15 objects=4 duration=6.670125ms28482026/11/11 22:35:36 INFO Received push request method=POST path=/28492026/11/11 22:35:36 INFO Received push request method=POST path=/28502026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28512026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28522026/11/11 22:35:36 INFO Received uploads request method=POST path=/28532026/11/11 22:35:36 INFO Completed upload id=28 objects=5 duration=533.416µs28542026/11/11 22:35:36 INFO Completed upload id=3 objects=5 duration=390.625µs28552026/11/11 22:35:36 INFO Received uploads request method=POST path=/28562026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028572026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028582026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28592026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28602026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028612026/11/11 22:35:36 INFO Completed upload id=16 objects=3 duration=285.917µs28622026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28632026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028642026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=028652026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28662026/11/11 22:35:36 INFO Vacuumed table table=closures28672026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028682026/11/11 22:35:36 INFO Vacuumed table table=objects28692026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28702026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28712026/11/11 22:35:36 INFO Received complete push request method=POST path=/28722026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28732026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28742026/11/11 22:35:36 INFO Completed push id=22 objects=3 duration=854.208µs28752026/11/11 22:35:36 INFO Received push request method=POST path=/28762026/11/11 22:35:36 INFO Vacuumed table table=closures28772026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028782026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28792026/11/11 22:35:36 INFO Vacuumed table table=objects28802026/11/11 22:35:36 WARN Force mode enabled - objects will be deleted immediately without grace period28812026/11/11 22:35:36 INFO Completed upload id=30 objects=5 duration=321.625µs28822026/11/11 22:35:36 INFO Vacuumed table table=pending_objects28832026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads28842026/11/11 22:35:36 INFO Vacuumed table table=closures28852026/11/11 22:35:36 INFO Vacuumed table table=objects28862026/11/11 22:35:36 INFO Received uploads request method=POST path=/28872026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028882026/11/11 22:35:36 WARN Force mode enabled - objects will be deleted immediately without grace period28892026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=028902026/11/11 22:35:36 INFO Received uploads request method=POST path=/28912026/11/11 22:35:36 INFO Received complete upload request method=POST path=/28922026/11/11 22:35:36 INFO Completed upload id=18 objects=4 duration=743.25µs28932026/11/11 22:35:36 INFO Received complete push request method=POST path=/28942026/11/11 22:35:36 INFO Completed push id=17 objects=6 duration=614.541µs28952026/11/11 22:35:36 INFO Vacuumed table table=pending_closures28962026/11/11 22:35:36 INFO Received complete push request method=POST path=/28972026/11/11 22:35:36 INFO Received push request method=POST path=/28982026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=028992026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029002026/11/11 22:35:36 INFO Vacuumed table table=pending_closures29012026/11/11 22:35:36 INFO Vacuumed table table=pending_objects29022026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads29032026/11/11 22:35:36 INFO Completed push id=3 objects=5 duration=40.263541ms29042026/11/11 22:35:36 INFO Received complete push request method=POST path=/29052026/11/11 22:35:36 INFO Vacuumed table table=closures29062026/11/11 22:35:36 INFO Vacuumed table table=pending_objects29072026/11/11 22:35:36 INFO Received complete push request method=POST path=/29082026/11/11 22:35:36 INFO Completed push id=31 objects=3 duration=441.334µs29092026/11/11 22:35:36 INFO Vacuumed table table=objects29102026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads29112026/11/11 22:35:36 INFO Completed push id=2 objects=10 duration=1.691041ms29122026/11/11 22:35:36 INFO Vacuumed table table=closures29132026/11/11 22:35:36 INFO Vacuumed table table=objects29142026/11/11 22:35:36 INFO Received push request method=POST path=/29152026/11/11 22:35:36 INFO Received push request method=POST path=/29162026/11/11 22:35:36 INFO Received complete push request method=POST path=/29172026/11/11 22:35:36 INFO Completed push id=8 objects=7 duration=533.958µs29182026/11/11 22:35:36 INFO Received uploads request method=POST path=/29192026/11/11 22:35:36 INFO Received push request method=POST path=/29202026/11/11 22:35:36 INFO Received complete push request method=POST path=/29212026/11/11 22:35:36 INFO Received push request method=POST path=/29222026/11/11 22:35:36 INFO Completed push id=9 objects=4 duration=890.334µs29232026/11/11 22:35:36 INFO Received push request method=POST path=/29242026/11/11 22:35:36 INFO Received push request method=POST path=/29252026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=029262026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029272026/11/11 22:35:36 INFO Vacuumed table table=pending_closures29282026/11/11 22:35:36 INFO Vacuumed table table=pending_objects29292026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads29302026/11/11 22:35:36 INFO Vacuumed table table=closures29312026/11/11 22:35:36 INFO Vacuumed table table=objects29322026/11/11 22:35:36 INFO Received push request method=POST path=/29332026/11/11 22:35:36 INFO Received uploads request method=POST path=/29342026/11/11 22:35:36 INFO Received push request method=POST path=/29352026/11/11 22:35:36 INFO Received complete push request method=POST path=/29362026/11/11 22:35:36 INFO Completed push id=26 objects=14 duration=988µs29372026/11/11 22:35:36 INFO Received push request method=POST path=/29382026/11/11 22:35:36 INFO Received uploads request method=POST path=/29392026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=029402026/11/11 22:35:36 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=029412026/11/11 22:35:36 INFO Vacuumed table table=pending_closures29422026/11/11 22:35:36 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."29432026/11/11 22:35:36 INFO Vacuumed table table=pending_objects29442026/11/11 22:35:36 INFO Received uploads request method=POST path=/29452026/11/11 22:35:36 INFO Vacuumed table table=multipart_uploads29462026/11/11 22:35:36 INFO Received uploads request method=POST path=/29472026/11/11 22:35:36 INFO Vacuumed table table=closures29482026/11/11 22:35:36 INFO Vacuumed table table=objects29492026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=029502026/11/11 22:35:36 INFO Received complete upload request method=POST path=/29512026/11/11 22:35:36 INFO Received complete upload request method=POST path=/29522026/11/11 22:35:36 INFO Received push request method=POST path=/29532026/11/11 22:35:36 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."29542026/11/11 22:35:36 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."29552026/11/11 22:35:36 INFO Completed upload id=9 objects=16 duration=466.666µs29562026/11/11 22:35:36 INFO Completed upload id=6 objects=24 duration=846.834µs29572026/11/11 22:35:36 INFO Received complete push request method=POST path=/29582026/11/11 22:35:36 INFO Received push request method=POST path=/29592026/11/11 22:35:36 INFO Received push request method=POST path=/29602026/11/11 22:35:36 INFO Completed push id=32 objects=6 duration=461.25µs29612026/11/11 22:35:36 INFO Received push request method=POST path=/29622026/11/11 22:35:36 INFO Aborted multipart uploads count=0 kept=029632026/11/11 22:35:36 INFO Received push request method=POST path=/29642026/11/11 22:35:36 INFO Received push request method=POST path=/29652026/11/11 22:35:36 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."29662026/11/11 22:35:37 INFO Received complete upload request method=POST path=/29672026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period29682026/11/11 22:35:37 INFO Received complete push request method=POST path=/29692026/11/11 22:35:37 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."29702026/11/11 22:35:37 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."29712026/11/11 22:35:37 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."29722026/11/11 22:35:37 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."29732026/11/11 22:35:37 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."29742026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."29752026/11/11 22:35:37 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."29762026/11/11 22:35:37 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."29772026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."29782026/11/11 22:35:37 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."29792026/11/11 22:35:37 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."29802026/11/11 22:35:37 INFO Completed upload id=33 objects=7 duration=326.916µs29812026/11/11 22:35:37 INFO Completed push id=10 objects=3 duration=531.625µs29822026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=3 objects-failed-to-delete=029832026/11/11 22:35:37 INFO Received push request method=POST path=/29842026/11/11 22:35:37 INFO Received complete upload request method=POST path=/29852026/11/11 22:35:37 INFO Received push request method=POST path=/29862026/11/11 22:35:37 INFO Vacuumed table table=pending_closures29872026/11/11 22:35:37 INFO Received uploads request method=POST path=/29882026/11/11 22:35:37 INFO Received uploads request method=POST path=/29892026/11/11 22:35:37 INFO Received complete upload request method=POST path=/29902026/11/11 22:35:37 INFO Vacuumed table table=pending_objects29912026/11/11 22:35:37 INFO Completed upload id=34 objects=3 duration=327.042µs29922026/11/11 22:35:37 INFO Received push request method=POST path=/29932026/11/11 22:35:37 INFO Received push request method=POST path=/29942026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads29952026/11/11 22:35:37 INFO Received uploads request method=POST path=/29962026/11/11 22:35:37 INFO Vacuumed table table=closures29972026/11/11 22:35:37 INFO Completed upload id=1 objects=15 duration=30.79275ms29982026/11/11 22:35:37 INFO Received complete push request method=POST path=/29992026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030002026/11/11 22:35:37 INFO Received push request method=POST path=/30012026/11/11 22:35:37 INFO Vacuumed table table=objects30022026/11/11 22:35:37 INFO Received uploads request method=POST path=/30032026/11/11 22:35:37 INFO Completed push id=35 objects=11 duration=504.5µs30042026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period30052026/11/11 22:35:37 INFO Received push request method=POST path=/30062026/11/11 22:35:37 INFO Received complete upload request method=POST path=/30072026/11/11 22:35:37 INFO Received complete push request method=POST path=/30082026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030092026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030102026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030112026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030122026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030132026/11/11 22:35:37 INFO Received complete push request method=POST path=/30142026/11/11 22:35:37 INFO Completed upload id=21 objects=7 duration=726.792µs30152026/11/11 22:35:37 INFO Completed push id=8 objects=6 duration=529.5µs30162026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period30172026/11/11 22:35:37 INFO Vacuumed table table=pending_closures30182026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=030192026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030202026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=6 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030212026/11/11 22:35:37 INFO Completed push id=27 objects=25 duration=1.115292ms30222026/11/11 22:35:37 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."30232026/11/11 22:35:37 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."30242026/11/11 22:35:37 INFO Vacuumed table table=pending_objects30252026/11/11 22:35:37 INFO Received push request method=POST path=/30262026/11/11 22:35:37 INFO Vacuumed table table=pending_closures30272026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030282026/11/11 22:35:37 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."30292026/11/11 22:35:37 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."30302026/11/11 22:35:37 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."30312026/11/11 22:35:37 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."30322026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."30332026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads30342026/11/11 22:35:37 INFO Vacuumed table table=pending_objects30352026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=030362026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030372026/11/11 22:35:37 INFO Vacuumed table table=closures30382026/11/11 22:35:37 INFO Vacuumed table table=pending_closures30392026/11/11 22:35:37 INFO Received uploads request method=POST path=/30402026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads30412026/11/11 22:35:37 INFO Vacuumed table table=pending_closures30422026/11/11 22:35:37 INFO Vacuumed table table=objects30432026/11/11 22:35:37 INFO Vacuumed table table=pending_closures30442026/11/11 22:35:37 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."30452026/11/11 22:35:37 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."30462026/11/11 22:35:37 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."30472026/11/11 22:35:37 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."30482026/11/11 22:35:37 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."30492026/11/11 22:35:37 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."30502026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."30512026/11/11 22:35:37 INFO Received uploads request method=POST path=/30522026/11/11 22:35:37 INFO Vacuumed table table=pending_objects30532026/11/11 22:35:37 INFO Vacuumed table table=closures30542026/11/11 22:35:37 INFO Vacuumed table table=pending_objects30552026/11/11 22:35:37 INFO Received uploads request method=POST path=/30562026/11/11 22:35:37 INFO Received push request method=POST path=/30572026/11/11 22:35:37 INFO Received complete upload request method=POST path=/30582026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads30592026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads30602026/11/11 22:35:37 INFO Vacuumed table table=objects30612026/11/11 22:35:37 INFO Received uploads request method=POST path=/30622026/11/11 22:35:37 INFO Vacuumed table table=closures30632026/11/11 22:35:37 INFO Completed upload id=27 objects=4 duration=266.916µs30642026/11/11 22:35:37 INFO Received push request method=POST path=/30652026/11/11 22:35:37 INFO Vacuumed table table=closures30662026/11/11 22:35:37 INFO Vacuumed table table=objects30672026/11/11 22:35:37 INFO Vacuumed table table=objects30682026/11/11 22:35:37 INFO Received push request method=POST path=/30692026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030702026/11/11 22:35:37 INFO Received complete push request method=POST path=/30712026/11/11 22:35:37 INFO Vacuumed table table=pending_objects30722026/11/11 22:35:37 INFO Received push request method=POST path=/30732026/11/11 22:35:37 INFO Received complete upload request method=POST path=/30742026/11/11 22:35:37 INFO Received complete upload request method=POST path=/30752026/11/11 22:35:37 INFO Completed push id=13 objects=11 duration=708.708µs30762026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads30772026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."30782026/11/11 22:35:37 INFO Received complete push request method=POST path=/30792026/11/11 22:35:37 INFO Completed upload id=9 objects=3 duration=618.625µs30802026/11/11 22:35:37 INFO Received uploads request method=POST path=/30812026/11/11 22:35:37 INFO Completed upload id=10 objects=2 duration=11.415667ms30822026/11/11 22:35:37 INFO Vacuumed table table=closures30832026/11/11 22:35:37 INFO Received complete push request method=POST path=/30842026/11/11 22:35:37 INFO Completed push id=24 objects=5 duration=1.127167ms30852026/11/11 22:35:37 INFO Received push request method=POST path=/30862026/11/11 22:35:37 INFO Vacuumed table table=objects30872026/11/11 22:35:37 INFO Completed push id=6 objects=26 duration=6.800167ms30882026/11/11 22:35:37 INFO Received uploads request method=POST path=/30892026/11/11 22:35:37 INFO Received push request method=POST path=/30902026/11/11 22:35:37 INFO Received uploads request method=POST path=/30912026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030922026/11/11 22:35:37 INFO Received uploads request method=POST path=/30932026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=030942026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030952026/11/11 22:35:37 INFO Vacuumed table table=pending_closures30962026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030972026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period30982026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=030992026/11/11 22:35:37 INFO Received push request method=POST path=/31002026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031012026/11/11 22:35:37 INFO Vacuumed table table=pending_objects31022026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031032026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period31042026/11/11 22:35:37 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."31052026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."31062026/11/11 22:35:37 INFO Received uploads request method=POST path=/31072026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads31082026/11/11 22:35:37 INFO Vacuumed table table=pending_closures31092026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031102026/11/11 22:35:37 INFO Received uploads request method=POST path=/31112026/11/11 22:35:37 INFO Vacuumed table table=pending_closures31122026/11/11 22:35:37 INFO Vacuumed table table=pending_objects31132026/11/11 22:35:37 INFO Received uploads request method=POST path=/31142026/11/11 22:35:37 INFO Vacuumed table table=closures31152026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads31162026/11/11 22:35:37 INFO Vacuumed table table=pending_objects31172026/11/11 22:35:37 INFO Received complete push request method=POST path=/31182026/11/11 22:35:37 INFO Vacuumed table table=objects31192026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads31202026/11/11 22:35:37 INFO Vacuumed table table=closures31212026/11/11 22:35:37 INFO Vacuumed table table=closures31222026/11/11 22:35:37 INFO Completed push id=12 objects=3 duration=6.208458ms31232026/11/11 22:35:37 INFO Vacuumed table table=objects31242026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31252026/11/11 22:35:37 INFO Vacuumed table table=objects31262026/11/11 22:35:37 INFO Received push request method=POST path=/31272026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31282026/11/11 22:35:37 INFO Received uploads request method=POST path=/31292026/11/11 22:35:37 INFO Received uploads request method=POST path=/31302026/11/11 22:35:37 INFO Completed upload id=17 objects=6 duration=1.545583ms31312026/11/11 22:35:37 INFO Completed upload id=4 objects=7 duration=734.917µs31322026/11/11 22:35:37 INFO Received uploads request method=POST path=/31332026/11/11 22:35:37 INFO Received uploads request method=POST path=/31342026/11/11 22:35:37 INFO Received push request method=POST path=/31352026/11/11 22:35:37 INFO Received push request method=POST path=/31362026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031372026/11/11 22:35:37 INFO Received uploads request method=POST path=/31382026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period31392026/11/11 22:35:37 INFO Received push request method=POST path=/31402026/11/11 22:35:37 INFO Received push request method=POST path=/31412026/11/11 22:35:37 INFO Received uploads request method=POST path=/31422026/11/11 22:35:37 INFO Received uploads request method=POST path=/31432026/11/11 22:35:37 INFO Received push request method=POST path=/31442026/11/11 22:35:37 INFO Received uploads request method=POST path=/31452026/11/11 22:35:37 INFO Received push request method=POST path=/31462026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031472026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31482026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period31492026/11/11 22:35:37 INFO Completed upload id=15 objects=9 duration=6.354292ms31502026/11/11 22:35:37 INFO Received complete push request method=POST path=/31512026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031522026/11/11 22:35:37 INFO Completed push id=16 objects=14 duration=707.25µs31532026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031542026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period31552026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031562026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31572026/11/11 22:35:37 INFO Vacuumed table table=pending_closures31582026/11/11 22:35:37 INFO Completed upload id=16 objects=23 duration=326.958µs31592026/11/11 22:35:37 INFO Vacuumed table table=pending_objects31602026/11/11 22:35:37 INFO Vacuumed table table=pending_closures31612026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads31622026/11/11 22:35:37 INFO Received push request method=POST path=/31632026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31642026/11/11 22:35:37 INFO Vacuumed table table=closures31652026/11/11 22:35:37 INFO Completed upload id=15 objects=6 duration=474.75µs31662026/11/11 22:35:37 INFO Vacuumed table table=objects31672026/11/11 22:35:37 INFO Received complete push request method=POST path=/31682026/11/11 22:35:37 INFO Vacuumed table table=pending_objects31692026/11/11 22:35:37 INFO Received uploads request method=POST path=/31702026/11/11 22:35:37 INFO Completed push id=21 objects=26 duration=479.25µs31712026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031722026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads31732026/11/11 22:35:37 INFO Received push request method=POST path=/31742026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=031752026/11/11 22:35:37 INFO Received complete push request method=POST path=/31762026/11/11 22:35:37 INFO Vacuumed table table=pending_closures31772026/11/11 22:35:37 INFO Completed push id=21 objects=17 duration=625.084µs31782026/11/11 22:35:37 INFO Vacuumed table table=pending_objects31792026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads31802026/11/11 22:35:37 INFO Received complete push request method=POST path=/31812026/11/11 22:35:37 INFO Vacuumed table table=closures31822026/11/11 22:35:37 INFO Vacuumed table table=closures31832026/11/11 22:35:37 INFO Completed push id=19 objects=7 duration=9.89725ms31842026/11/11 22:35:37 INFO Vacuumed table table=objects31852026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31862026/11/11 22:35:37 INFO Received push request method=POST path=/31872026/11/11 22:35:37 INFO Completed upload id=17 objects=7 duration=264.5µs31882026/11/11 22:35:37 INFO Received push request method=POST path=/31892026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031902026/11/11 22:35:37 INFO Vacuumed table table=objects31912026/11/11 22:35:37 INFO Received uploads request method=POST path=/31922026/11/11 22:35:37 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.ls error="Access Denied."31932026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."31942026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=031952026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31962026/11/11 22:35:37 INFO Received complete upload request method=POST path=/31972026/11/11 22:35:37 INFO Received uploads request method=POST path=/31982026/11/11 22:35:37 INFO Completed upload id=28 objects=17 duration=555.541µs31992026/11/11 22:35:37 INFO Completed upload id=25 objects=6 duration=726.375µs32002026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period32012026/11/11 22:35:37 INFO Received uploads request method=POST path=/32022026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032032026/11/11 22:35:37 INFO Vacuumed table table=pending_closures32042026/11/11 22:35:37 INFO Received complete push request method=POST path=/32052026/11/11 22:35:37 INFO Received uploads request method=POST path=/32062026/11/11 22:35:37 INFO Vacuumed table table=pending_objects32072026/11/11 22:35:37 INFO Received push request method=POST path=/32082026/11/11 22:35:37 INFO Completed push id=29 objects=2 duration=483.917µs32092026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads32102026/11/11 22:35:37 INFO Received uploads request method=POST path=/32112026/11/11 22:35:37 INFO Received uploads request method=POST path=/32122026/11/11 22:35:37 INFO Received complete push request method=POST path=/32132026/11/11 22:35:37 INFO Vacuumed table table=closures32142026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=032152026/11/11 22:35:37 INFO Completed push id=31 objects=6 duration=348.458µs32162026/11/11 22:35:37 INFO Received complete push request method=POST path=/32172026/11/11 22:35:37 INFO Received complete push request method=POST path=/32182026/11/11 22:35:37 INFO Vacuumed table table=objects32192026/11/11 22:35:37 INFO Completed push id=11 objects=8 duration=9.955416ms32202026/11/11 22:35:37 INFO Completed push id=11 objects=9 duration=9.944916ms32212026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period32222026/11/11 22:35:37 INFO Received complete push request method=POST path=/32232026/11/11 22:35:37 INFO Received uploads request method=POST path=/32242026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=032252026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."32262026/11/11 22:35:37 INFO Received complete upload request method=POST path=/32272026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=4 objects-failed-to-delete=032282026/11/11 22:35:37 INFO Completed push id=32 objects=9 duration=370.25µs32292026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032302026/11/11 22:35:37 INFO Received complete upload request method=POST path=/32312026/11/11 22:35:37 INFO Vacuumed table table=pending_closures32322026/11/11 22:35:37 INFO Vacuumed table table=pending_closures32332026/11/11 22:35:37 INFO Completed upload id=14 objects=6 duration=493.25µs32342026/11/11 22:35:37 INFO Received push request method=POST path=/32352026/11/11 22:35:37 INFO Vacuumed table table=pending_objects32362026/11/11 22:35:37 INFO Vacuumed table table=pending_objects32372026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=032382026/11/11 22:35:37 INFO Completed upload id=3 objects=6 duration=37.968625ms32392026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads32402026/11/11 22:35:37 INFO Received complete push request method=POST path=/32412026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads32422026/11/11 22:35:37 INFO Vacuumed table table=closures32432026/11/11 22:35:37 INFO Completed push id=15 objects=24 duration=832.959µs32442026/11/11 22:35:37 INFO Vacuumed table table=pending_closures32452026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=032462026/11/11 22:35:37 INFO Vacuumed table table=closures32472026/11/11 22:35:37 INFO Vacuumed table table=objects32482026/11/11 22:35:37 INFO Vacuumed table table=objects32492026/11/11 22:35:37 INFO Received complete upload request method=POST path=/32502026/11/11 22:35:37 INFO Vacuumed table table=pending_objects32512026/11/11 22:35:37 ERROR failed to remove object object=aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.narinfo error="Access Denied."32522026/11/11 22:35:37 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."32532026/11/11 22:35:37 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.narinfo error="Access Denied."32542026/11/11 22:35:37 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."32552026/11/11 22:35:37 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."32562026/11/11 22:35:37 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."32572026/11/11 22:35:37 INFO Vacuumed table table=multipart_uploads32582026/11/11 22:35:37 INFO Completed upload id=19 objects=2 duration=427.791µs32592026/11/11 22:35:37 INFO Received complete upload request method=POST path=/32602026/11/11 22:35:37 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."32612026/11/11 22:35:37 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."32622026/11/11 22:35:37 ERROR failed to remove object object=nar/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.nar.zst error="Access Denied."32632026/11/11 22:35:37 ERROR failed to remove object object=nar/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.nar.zst error="Access Denied."32642026/11/11 22:35:37 INFO Completed upload id=10 objects=6 duration=1.236666ms32652026/11/11 22:35:37 INFO Received complete upload request method=POST path=/32662026/11/11 22:35:37 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."32672026/11/11 22:35:37 INFO Aborted multipart uploads count=0 kept=032682026/11/11 22:35:37 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."32692026/11/11 22:35:37 INFO Completed upload id=24 objects=7 duration=292.792µs32702026/11/11 22:35:37 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."32712026/11/11 22:35:37 WARN Force mode enabled - objects will be deleted immediately without grace period32722026/11/11 22:35:37 INFO Received complete upload request method=POST path=/32732026/11/11 22:35:37 INFO Received complete push request method=POST path=/32742026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."32752026/11/11 22:35:37 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032762026/11/11 22:35:37 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."32772026/11/11 22:35:38 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."32782026/11/11 22:35:37 INFO Completed upload id=33 objects=9 duration=326.375µs32792026/11/11 22:35:37 INFO Completed push id=26 objects=3 duration=340.292µs32802026/11/11 22:35:37 INFO Vacuumed table table=pending_closures32812026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=032822026/11/11 22:35:38 INFO Vacuumed table table=pending_objects32832026/11/11 22:35:38 INFO Received complete upload request method=POST path=/32842026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=032852026/11/11 22:35:38 INFO Completed upload id=28 objects=8 duration=351.583µs32862026/11/11 22:35:38 INFO Vacuumed table table=closures32872026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads32882026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period32892026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=16 objects-failed-to-delete=032902026/11/11 22:35:38 INFO Received complete upload request method=POST path=/32912026/11/11 22:35:38 INFO Received complete upload request method=POST path=/32922026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=032932026/11/11 22:35:38 INFO Completed upload id=29 objects=10 duration=301.041µs32942026/11/11 22:35:38 INFO Vacuumed table table=pending_closures32952026/11/11 22:35:38 INFO Completed upload id=7 objects=3 duration=6.922708ms32962026/11/11 22:35:38 INFO Vacuumed table table=closures32972026/11/11 22:35:38 INFO Received complete upload request method=POST path=/32982026/11/11 22:35:38 INFO Vacuumed table table=pending_objects32992026/11/11 22:35:38 INFO Vacuumed table table=objects33002026/11/11 22:35:38 INFO Vacuumed table table=objects33012026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33022026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33032026/11/11 22:35:38 INFO Completed upload id=30 objects=20 duration=5.835875ms33042026/11/11 22:35:38 INFO Received complete upload request method=POST path=/33052026/11/11 22:35:38 INFO Completed upload id=12 objects=26 duration=1.110375ms33062026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=033072026/11/11 22:35:38 INFO Received complete push request method=POST path=/33082026/11/11 22:35:38 INFO Vacuumed table table=closures33092026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33102026/11/11 22:35:38 INFO Completed push id=31 objects=11 duration=11.298458ms33112026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033122026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=033132026/11/11 22:35:38 INFO Received uploads request method=POST path=/33142026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33152026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33162026/11/11 22:35:38 INFO Received complete upload request method=POST path=/33172026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period33182026/11/11 22:35:38 INFO Received complete push request method=POST path=/33192026/11/11 22:35:38 INFO Vacuumed table table=closures33202026/11/11 22:35:38 INFO Received complete push request method=POST path=/33212026/11/11 22:35:38 INFO Completed upload id=32 objects=2 duration=362.584µs33222026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33232026/11/11 22:35:38 INFO Vacuumed table table=objects33242026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033252026/11/11 22:35:38 INFO Completed push id=16 objects=8 duration=435.917µs33262026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33272026/11/11 22:35:38 INFO Vacuumed table table=objects33282026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33292026/11/11 22:35:38 INFO Received complete push request method=POST path=/33302026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=033312026/11/11 22:35:38 INFO Vacuumed table table=closures33322026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33332026/11/11 22:35:38 INFO Completed push id=33 objects=3 duration=224.584µs33342026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period33352026/11/11 22:35:38 INFO Vacuumed table table=objects33362026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33372026/11/11 22:35:38 INFO Completed push id=1 objects=6 duration=33.794375ms33382026/11/11 22:35:38 INFO Vacuumed table table=closures33392026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033402026/11/11 22:35:38 INFO Received complete upload request method=POST path=/33412026/11/11 22:35:38 INFO Received complete push request method=POST path=/33422026/11/11 22:35:38 INFO Completed push id=18 objects=23 duration=517.291µs33432026/11/11 22:35:38 INFO Completed upload id=34 objects=3 duration=555.959µs33442026/11/11 22:35:38 INFO Vacuumed table table=objects33452026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33462026/11/11 22:35:38 INFO Received uploads request method=POST path=/33472026/11/11 22:35:38 INFO Received uploads request method=POST path=/33482026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=033492026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33502026/11/11 22:35:38 INFO Received uploads request method=POST path=/33512026/11/11 22:35:38 INFO Received push request method=POST path=/33522026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period33532026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33542026/11/11 22:35:38 INFO Vacuumed table table=closures33552026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033562026/11/11 22:35:38 INFO Vacuumed table table=objects33572026/11/11 22:35:38 INFO Received uploads request method=POST path=/33582026/11/11 22:35:38 INFO Received complete push request method=POST path=/33592026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33602026/11/11 22:35:38 INFO Completed push id=13 objects=6 duration=4.617458ms33612026/11/11 22:35:38 INFO Received push request method=POST path=/33622026/11/11 22:35:38 INFO Received push request method=POST path=/33632026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33642026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33652026/11/11 22:35:38 INFO Vacuumed table table=closures33662026/11/11 22:35:38 INFO Vacuumed table table=objects33672026/11/11 22:35:38 INFO Received complete push request method=POST path=/33682026/11/11 22:35:38 INFO Completed push id=11 objects=9 duration=599.333µs33692026/11/11 22:35:38 INFO Received push request method=POST path=/33702026/11/11 22:35:38 INFO Received push request method=POST path=/33712026/11/11 22:35:38 INFO Received uploads request method=POST path=/33722026/11/11 22:35:38 INFO Received complete push request method=POST path=/33732026/11/11 22:35:38 INFO Completed push id=11 objects=6 duration=1.450333ms33742026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=033752026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period33762026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=033772026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33782026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33792026/11/11 22:35:38 INFO Received complete upload request method=POST path=/33802026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33812026/11/11 22:35:38 INFO Completed upload id=19 objects=25 duration=960.833µs33822026/11/11 22:35:38 INFO Vacuumed table table=closures33832026/11/11 22:35:38 INFO Vacuumed table table=objects33842026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=033852026/11/11 22:35:38 INFO Received uploads request method=POST path=/33862026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period33872026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=033882026/11/11 22:35:38 INFO Vacuumed table table=pending_closures33892026/11/11 22:35:38 INFO Vacuumed table table=pending_objects33902026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads33912026/11/11 22:35:38 INFO Received push request method=POST path=/33922026/11/11 22:35:38 INFO Vacuumed table table=closures33932026/11/11 22:35:38 INFO Received complete upload request method=POST path=/33942026/11/11 22:35:38 INFO Vacuumed table table=objects33952026/11/11 22:35:38 INFO Completed upload id=23 objects=15 duration=1.192209ms33962026/11/11 22:35:38 INFO Received complete push request method=POST path=/33972026/11/11 22:35:38 INFO Received push request method=POST path=/33982026/11/11 22:35:38 INFO Completed push id=18 objects=6 duration=440.625µs33992026/11/11 22:35:38 INFO Received uploads request method=POST path=/34002026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034012026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034022026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34032026/11/11 22:35:38 INFO Received uploads request method=POST path=/34042026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34052026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads34062026/11/11 22:35:38 INFO Vacuumed table table=closures34072026/11/11 22:35:38 INFO Received push request method=POST path=/34082026/11/11 22:35:38 INFO Vacuumed table table=objects34092026/11/11 22:35:38 INFO Received complete upload request method=POST path=/34102026/11/11 22:35:38 INFO Completed upload id=19 objects=6 duration=392.625µs34112026/11/11 22:35:38 INFO Received push request method=POST path=/34122026/11/11 22:35:38 INFO Received complete upload request method=POST path=/34132026/11/11 22:35:38 INFO Received complete push request method=POST path=/34142026/11/11 22:35:38 INFO Completed upload id=20 objects=3 duration=1.632667ms34152026/11/11 22:35:38 INFO Completed push id=17 objects=22 duration=1.031042ms34162026/11/11 22:35:38 INFO Received uploads request method=POST path=/34172026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034182026/11/11 22:35:38 INFO Received push request method=POST path=/34192026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034202026/11/11 22:35:38 INFO Received complete push request method=POST path=/34212026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34222026/11/11 22:35:38 INFO Completed push id=16 objects=4 duration=801.417µs34232026/11/11 22:35:38 INFO Received complete upload request method=POST path=/34242026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34252026/11/11 22:35:38 INFO Completed upload id=24 objects=7 duration=589.834µs34262026/11/11 22:35:38 INFO Received uploads request method=POST path=/34272026/11/11 22:35:38 INFO Received complete push request method=POST path=/34282026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads34292026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034302026/11/11 22:35:38 INFO Received complete upload request method=POST path=/34312026/11/11 22:35:38 INFO Completed push id=2 objects=4 duration=559.958µs34322026/11/11 22:35:38 INFO Vacuumed table table=closures34332026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034342026/11/11 22:35:38 INFO Completed upload id=20 objects=5 duration=201.375µs34352026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034362026/11/11 22:35:38 INFO Received complete upload request method=POST path=/34372026/11/11 22:35:38 INFO Vacuumed table table=objects34382026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34392026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034402026/11/11 22:35:38 INFO Received uploads request method=POST path=/34412026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34422026/11/11 22:35:38 INFO Completed upload id=11 objects=6 duration=774.291µs34432026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034442026/11/11 22:35:38 INFO Received push request method=POST path=/34452026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads34462026/11/11 22:35:38 INFO Received complete upload request method=POST path=/34472026/11/11 22:35:38 INFO Received uploads request method=POST path=/34482026/11/11 22:35:38 INFO Completed upload id=22 objects=7 duration=359µs34492026/11/11 22:35:38 INFO Vacuumed table table=closures34502026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period34512026/11/11 22:35:38 INFO Received push request method=POST path=/34522026/11/11 22:35:38 INFO Vacuumed table table=objects34532026/11/11 22:35:38 INFO Received complete push request method=POST path=/34542026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034552026/11/11 22:35:38 INFO Received uploads request method=POST path=/34562026/11/11 22:35:38 INFO Received complete push request method=POST path=/34572026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34582026/11/11 22:35:38 INFO Received uploads request method=POST path=/34592026/11/11 22:35:38 INFO Received push request method=POST path=/34602026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34612026/11/11 22:35:38 INFO Completed push id=24 objects=9 duration=1.014708ms34622026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34632026/11/11 22:35:38 INFO Received push request method=POST path=/34642026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads34652026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034662026/11/11 22:35:38 INFO Completed push id=3 objects=22 duration=18.226292ms34672026/11/11 22:35:38 INFO Received push request method=POST path=/34682026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034692026/11/11 22:35:38 INFO Vacuumed table table=closures34702026/11/11 22:35:38 INFO Received complete push request method=POST path=/34712026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period34722026/11/11 22:35:38 INFO Received complete push request method=POST path=/34732026/11/11 22:35:38 INFO Received push request method=POST path=/34742026/11/11 22:35:38 INFO Received push request method=POST path=/34752026/11/11 22:35:38 INFO Vacuumed table table=objects34762026/11/11 22:35:38 INFO Completed push id=17 objects=6 duration=643.041µs34772026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period34782026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034792026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34802026/11/11 22:35:38 INFO Completed push id=9 objects=5 duration=490.125µs34812026/11/11 22:35:38 INFO Received push request method=POST path=/34822026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34832026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads34842026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034852026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=034862026/11/11 22:35:38 INFO Received uploads request method=POST path=/34872026/11/11 22:35:38 INFO Received push request method=POST path=/34882026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34892026/11/11 22:35:38 WARN Force mode enabled - objects will be deleted immediately without grace period34902026/11/11 22:35:38 INFO Received complete push request method=POST path=/34912026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=034922026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34932026/11/11 22:35:38 INFO Received complete push request method=POST path=/34942026/11/11 22:35:38 INFO Completed push id=2 objects=7 duration=1.007958ms34952026/11/11 22:35:38 INFO Vacuumed table table=pending_objects34962026/11/11 22:35:38 INFO Completed push id=21 objects=3 duration=418.708µs34972026/11/11 22:35:38 INFO Vacuumed table table=pending_closures34982026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads34992026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads35002026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=035012026/11/11 22:35:38 INFO Vacuumed table table=closures35022026/11/11 22:35:38 INFO Vacuumed table table=closures35032026/11/11 22:35:38 INFO Vacuumed table table=closures35042026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035052026/11/11 22:35:38 INFO Received uploads request method=POST path=/35062026/11/11 22:35:38 INFO Vacuumed table table=pending_objects35072026/11/11 22:35:38 INFO Vacuumed table table=objects35082026/11/11 22:35:38 INFO Vacuumed table table=objects35092026/11/11 22:35:38 INFO Vacuumed table table=multipart_uploads35102026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=035112026/11/11 22:35:38 INFO Vacuumed table table=closures35122026/11/11 22:35:38 INFO Aborted multipart uploads count=0 kept=035132026/11/11 22:35:38 INFO Vacuumed table table=objects35142026/11/11 22:35:38 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=3 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035152026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035162026/11/11 22:35:39 INFO Vacuumed table table=pending_closures35172026/11/11 22:35:39 INFO Vacuumed table table=pending_closures35182026/11/11 22:35:39 INFO Vacuumed table table=pending_closures35192026/11/11 22:35:39 INFO Vacuumed table table=objects35202026/11/11 22:35:39 INFO Vacuumed table table=pending_objects35212026/11/11 22:35:39 INFO Received push request method=POST path=/35222026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads35232026/11/11 22:35:39 INFO Vacuumed table table=pending_objects35242026/11/11 22:35:39 INFO Vacuumed table table=closures35252026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads35262026/11/11 22:35:39 INFO Vacuumed table table=objects35272026/11/11 22:35:39 INFO Received push request method=POST path=/35282026/11/11 22:35:39 INFO Vacuumed table table=pending_objects35292026/11/11 22:35:39 INFO Vacuumed table table=closures35302026/11/11 22:35:39 INFO Received push request method=POST path=/35312026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads35322026/11/11 22:35:39 INFO Vacuumed table table=objects35332026/11/11 22:35:39 INFO Received push request method=POST path=/35342026/11/11 22:35:39 INFO Received complete upload request method=POST path=/35352026/11/11 22:35:39 INFO Vacuumed table table=closures35362026/11/11 22:35:39 INFO Received push request method=POST path=/35372026/11/11 22:35:39 INFO Received push request method=POST path=/35382026/11/11 22:35:39 INFO Received uploads request method=POST path=/35392026/11/11 22:35:39 INFO Vacuumed table table=objects35402026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=035412026/11/11 22:35:39 INFO Received push request method=POST path=/35422026/11/11 22:35:39 INFO Received complete push request method=POST path=/35432026/11/11 22:35:39 INFO Completed upload id=1 objects=9 duration=29.483583ms35442026/11/11 22:35:39 INFO Received push request method=POST path=/35452026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period35462026/11/11 22:35:39 INFO Received complete push request method=POST path=/35472026/11/11 22:35:39 INFO Received complete upload request method=POST path=/35482026/11/11 22:35:39 INFO Completed push id=23 objects=28 duration=920.834µs35492026/11/11 22:35:39 INFO Received push request method=POST path=/35502026/11/11 22:35:39 INFO Received complete push request method=POST path=/35512026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035522026/11/11 22:35:39 INFO Completed upload id=2 objects=2 duration=406.666µs35532026/11/11 22:35:39 INFO Completed push id=30 objects=4 duration=755.416µs35542026/11/11 22:35:39 INFO Received uploads request method=POST path=/35552026/11/11 22:35:39 INFO Vacuumed table table=pending_closures35562026/11/11 22:35:39 INFO Completed push id=6 objects=7 duration=1.959875ms35572026/11/11 22:35:39 INFO Received uploads request method=POST path=/35582026/11/11 22:35:39 INFO Received uploads request method=POST path=/35592026/11/11 22:35:39 INFO Received complete upload request method=POST path=/35602026/11/11 22:35:39 INFO Received complete push request method=POST path=/35612026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=035622026/11/11 22:35:39 INFO Received uploads request method=POST path=/35632026/11/11 22:35:39 INFO Vacuumed table table=pending_objects35642026/11/11 22:35:39 INFO Completed upload id=27 objects=8 duration=308.709µs35652026/11/11 22:35:39 INFO Received push request method=POST path=/35662026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period35672026/11/11 22:35:39 INFO Completed push id=5 objects=9 duration=6.21025ms35682026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads35692026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035702026/11/11 22:35:39 INFO Received push request method=POST path=/35712026/11/11 22:35:39 INFO Received push request method=POST path=/35722026/11/11 22:35:39 INFO Received push request method=POST path=/35732026/11/11 22:35:39 INFO Vacuumed table table=closures35742026/11/11 22:35:39 INFO Received push request method=POST path=/35752026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=035762026/11/11 22:35:39 INFO Vacuumed table table=objects35772026/11/11 22:35:39 INFO Received complete push request method=POST path=/35782026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=035792026/11/11 22:35:39 INFO Completed push id=4 objects=7 duration=876.041µs35802026/11/11 22:35:39 INFO Received complete push request method=POST path=/35812026/11/11 22:35:39 INFO Vacuumed table table=pending_closures35822026/11/11 22:35:39 INFO Received uploads request method=POST path=/35832026/11/11 22:35:39 INFO Received push request method=POST path=/35842026/11/11 22:35:39 INFO Received complete push request method=POST path=/35852026/11/11 22:35:39 INFO Vacuumed table table=pending_closures35862026/11/11 22:35:39 INFO Received push request method=POST path=/35872026/11/11 22:35:39 INFO Received uploads request method=POST path=/35882026/11/11 22:35:39 INFO Completed push id=6 objects=5 duration=423.625µs35892026/11/11 22:35:39 INFO Completed push id=32 objects=7 duration=301.667µs35902026/11/11 22:35:39 INFO Received uploads request method=POST path=/35912026/11/11 22:35:39 INFO Received uploads request method=POST path=/35922026/11/11 22:35:39 INFO Received push request method=POST path=/35932026/11/11 22:35:39 INFO Received push request method=POST path=/35942026/11/11 22:35:39 INFO Received complete push request method=POST path=/35952026/11/11 22:35:39 INFO Vacuumed table table=pending_objects35962026/11/11 22:35:39 INFO Received uploads request method=POST path=/35972026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=035982026/11/11 22:35:39 INFO Received push request method=POST path=/35992026/11/11 22:35:39 INFO Received complete push request method=POST path=/36002026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36012026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36022026/11/11 22:35:39 INFO Completed push id=26 objects=4 duration=363.167µs36032026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36042026/11/11 22:35:39 INFO Vacuumed table table=closures36052026/11/11 22:35:39 INFO Completed push id=31 objects=14 duration=891.917µs36062026/11/11 22:35:39 INFO Received push request method=POST path=/36072026/11/11 22:35:39 INFO Vacuumed table table=closures36082026/11/11 22:35:39 INFO Received push request method=POST path=/36092026/11/11 22:35:39 INFO Received complete upload request method=POST path=/36102026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period36112026/11/11 22:35:39 INFO Vacuumed table table=objects36122026/11/11 22:35:39 INFO Completed upload id=28 objects=13 duration=481.125µs36132026/11/11 22:35:39 INFO Vacuumed table table=objects36142026/11/11 22:35:39 INFO Received uploads request method=POST path=/36152026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036162026/11/11 22:35:39 INFO Received uploads request method=POST path=/36172026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036182026/11/11 22:35:39 INFO Received uploads request method=POST path=/36192026/11/11 22:35:39 INFO Received complete push request method=POST path=/36202026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period36212026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036222026/11/11 22:35:39 INFO Completed push id=29 objects=3 duration=316.125µs36232026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036242026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36252026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36262026/11/11 22:35:39 INFO Received complete upload request method=POST path=/36272026/11/11 22:35:39 INFO Received push request method=POST path=/36282026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36292026/11/11 22:35:39 INFO Completed upload id=31 objects=2 duration=424.166µs36302026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36312026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36322026/11/11 22:35:39 INFO Received push request method=POST path=/36332026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036342026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36352026/11/11 22:35:39 INFO Received complete push request method=POST path=/36362026/11/11 22:35:39 INFO Vacuumed table table=closures36372026/11/11 22:35:39 INFO Received push request method=POST path=/36382026/11/11 22:35:39 INFO Completed push id=33 objects=6 duration=275.542µs36392026/11/11 22:35:39 INFO Vacuumed table table=objects36402026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036412026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036422026/11/11 22:35:39 INFO Received complete upload request method=POST path=/36432026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36442026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period36452026/11/11 22:35:39 INFO Completed upload id=25 objects=16 duration=6.230416ms36462026/11/11 22:35:39 INFO Vacuumed table table=closures36472026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36482026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036492026/11/11 22:35:39 INFO Vacuumed table table=objects36502026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036512026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36522026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period36532026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036542026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36552026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36562026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036572026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36582026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36592026/11/11 22:35:39 INFO Vacuumed table table=closures36602026/11/11 22:35:39 INFO Vacuumed table table=closures36612026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period36622026/11/11 22:35:39 INFO Vacuumed table table=objects36632026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036642026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36652026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36662026/11/11 22:35:39 INFO Received push request method=POST path=/36672026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36682026/11/11 22:35:39 INFO Vacuumed table table=objects36692026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36702026/11/11 22:35:39 INFO Vacuumed table table=closures36712026/11/11 22:35:39 INFO Received push request method=POST path=/36722026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36732026/11/11 22:35:39 INFO Vacuumed table table=objects36742026/11/11 22:35:39 INFO Vacuumed table table=closures36752026/11/11 22:35:39 INFO Received uploads request method=POST path=/36762026/11/11 22:35:39 INFO Vacuumed table table=objects36772026/11/11 22:35:39 INFO Received uploads request method=POST path=/36782026/11/11 22:35:39 INFO Received complete upload request method=POST path=/36792026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=036802026/11/11 22:35:39 INFO Completed upload id=22 objects=5 duration=608.5µs36812026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period36822026/11/11 22:35:39 INFO Received complete push request method=POST path=/36832026/11/11 22:35:39 INFO Received complete push request method=POST path=/36842026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=036852026/11/11 22:35:39 INFO Completed push id=28 objects=3 duration=432.25µs36862026/11/11 22:35:39 INFO Vacuumed table table=pending_closures36872026/11/11 22:35:39 INFO Received complete push request method=POST path=/36882026/11/11 22:35:39 INFO Completed push id=29 objects=15 duration=250.291µs36892026/11/11 22:35:39 INFO Vacuumed table table=pending_objects36902026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads36912026/11/11 22:35:39 INFO Received complete push request method=POST path=/36922026/11/11 22:35:39 INFO Completed push id=1 objects=7 duration=38.960875ms36932026/11/11 22:35:39 INFO Vacuumed table table=closures36942026/11/11 22:35:39 INFO Completed push id=30 objects=6 duration=293.708µs36952026/11/11 22:35:39 INFO Received uploads request method=POST path=/36962026/11/11 22:35:39 INFO Vacuumed table table=objects36972026/11/11 22:35:39 INFO Received complete upload request method=POST path=/36982026/11/11 22:35:39 INFO Received push request method=POST path=/36992026/11/11 22:35:39 INFO Completed upload id=31 objects=3 duration=288.667µs37002026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=037012026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=037022026/11/11 22:35:39 WARN Force mode enabled - objects will be deleted immediately without grace period37032026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037042026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037052026/11/11 22:35:39 INFO Vacuumed table table=pending_closures37062026/11/11 22:35:39 INFO Vacuumed table table=pending_objects37072026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads37082026/11/11 22:35:39 INFO Vacuumed table table=closures37092026/11/11 22:35:39 INFO Vacuumed table table=objects37102026/11/11 22:35:39 INFO Received push request method=POST path=/37112026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=037122026/11/11 22:35:39 INFO Vacuumed table table=pending_closures37132026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037142026/11/11 22:35:39 INFO Received complete push request method=POST path=/37152026/11/11 22:35:39 INFO Vacuumed table table=pending_closures37162026/11/11 22:35:39 INFO Vacuumed table table=pending_objects37172026/11/11 22:35:39 INFO Completed push id=11 objects=11 duration=10.901667ms37182026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads37192026/11/11 22:35:39 INFO Vacuumed table table=closures37202026/11/11 22:35:39 INFO Vacuumed table table=objects37212026/11/11 22:35:39 INFO Vacuumed table table=pending_objects37222026/11/11 22:35:39 INFO Received push request method=POST path=/37232026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads37242026/11/11 22:35:39 INFO Received uploads request method=POST path=/37252026/11/11 22:35:39 INFO Vacuumed table table=closures37262026/11/11 22:35:39 INFO Aborted multipart uploads count=0 kept=037272026/11/11 22:35:39 INFO Vacuumed table table=objects37282026/11/11 22:35:39 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=037292026/11/11 22:35:39 INFO Vacuumed table table=pending_closures37302026/11/11 22:35:39 INFO Vacuumed table table=pending_objects37312026/11/11 22:35:39 INFO Received complete push request method=POST path=/37322026/11/11 22:35:39 INFO Vacuumed table table=multipart_uploads37332026/11/11 22:35:39 INFO Vacuumed table table=closures37342026/11/11 22:35:39 INFO Completed push id=7 objects=7 duration=10.299ms37352026/11/11 22:35:39 INFO Vacuumed table table=objects37362026/11/11 22:35:39 INFO Received complete push request method=POST path=/37372026/11/11 22:35:39 INFO Completed push id=12 objects=6 duration=404.209µs37382026/11/11 22:35:39 INFO Received complete upload request method=POST path=/37392026/11/11 22:35:39 INFO Completed upload id=7 objects=10 duration=990.709µs37402026/11/11 22:35:40 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."37412026/11/11 22:35:40 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.narinfo error="Access Denied."37422026/11/11 22:35:40 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."37432026/11/11 22:35:40 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.narinfo error="Access Denied."37442026/11/11 22:35:40 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."37452026/11/11 22:35:40 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.narinfo error="Access Denied."37462026/11/11 22:35:40 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."37472026/11/11 22:35:40 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."37482026/11/11 22:35:40 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."37492026/11/11 22:35:40 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."37502026/11/11 22:35:40 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."37512026/11/11 22:35:40 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."37522026/11/11 22:35:40 ERROR failed to remove object object=nar/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.nar.zst error="Access Denied."37532026/11/11 22:35:40 ERROR failed to remove object object=nar/dddddddddddddddddddddddddddddddddddddddddddddddddddd.nar.zst error="Access Denied."37542026/11/11 22:35:40 ERROR failed to remove object object=nar/ffffffffffffffffffffffffffffffffffffffffffffffffffff.nar.zst error="Access Denied."37552026/11/11 22:35:40 INFO Received complete push request method=POST path=/37562026/11/11 22:35:40 INFO Received complete push request method=POST path=/37572026/11/11 22:35:40 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."37582026/11/11 22:35:40 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."37592026/11/11 22:35:40 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."37602026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."37612026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."37622026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."37632026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."37642026/11/11 22:35:40 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."37652026/11/11 22:35:40 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.narinfo error="Access Denied."37662026/11/11 22:35:40 ERROR failed to remove object object=nar/cccccccccccccccccccccccccccccccccccccccccccccccccccc.nar.zst error="Access Denied."37672026/11/11 22:35:40 INFO Completed push id=7 objects=7 duration=883.708µs37682026/11/11 22:35:40 INFO Completed push id=9 objects=7 duration=2.781458ms37692026/11/11 22:35:40 INFO Received uploads request method=POST path=/37702026/11/11 22:35:40 INFO Received uploads request method=POST path=/37712026/11/11 22:35:40 INFO Received complete push request method=POST path=/37722026/11/11 22:35:40 INFO Received push request method=POST path=/37732026/11/11 22:35:40 INFO Received uploads request method=POST path=/37742026/11/11 22:35:40 INFO Received push request method=POST path=/37752026/11/11 22:35:40 INFO Received push request method=POST path=/37762026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=037772026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period37782026/11/11 22:35:40 INFO Completed push id=3 objects=8 duration=30.055583ms37792026/11/11 22:35:40 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."37802026/11/11 22:35:40 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."37812026/11/11 22:35:40 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."37822026/11/11 22:35:40 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."37832026/11/11 22:35:40 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."37842026/11/11 22:35:40 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."37852026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."37862026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."37872026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."37882026/11/11 22:35:40 INFO Received complete upload request method=POST path=/37892026/11/11 22:35:40 INFO Received push request method=POST path=/37902026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=037912026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period37922026/11/11 22:35:40 INFO Completed upload id=2 objects=10 duration=691.375µs37932026/11/11 22:35:40 INFO Received complete push request method=POST path=/37942026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=9 objects-failed-to-delete=037952026/11/11 22:35:40 INFO Completed push id=4 objects=7 duration=495.5µs37962026/11/11 22:35:40 INFO Received push request method=POST path=/37972026/11/11 22:35:40 INFO Received uploads request method=POST path=/37982026/11/11 22:35:40 INFO Vacuumed table table=pending_closures37992026/11/11 22:35:40 INFO Received uploads request method=POST path=/38002026/11/11 22:35:40 INFO Received push request method=POST path=/38012026/11/11 22:35:40 INFO Vacuumed table table=pending_objects38022026/11/11 22:35:40 INFO Vacuumed table table=multipart_uploads38032026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=038042026/11/11 22:35:40 INFO Vacuumed table table=closures38052026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period38062026/11/11 22:35:40 INFO Vacuumed table table=objects38072026/11/11 22:35:40 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."38082026/11/11 22:35:40 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.ls error="Access Denied."38092026/11/11 22:35:40 ERROR failed to remove object object=gggggggggggggggggggggggggggggggg.narinfo error="Access Denied."38102026/11/11 22:35:40 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ls error="Access Denied."38112026/11/11 22:35:40 ERROR failed to remove object object=hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.narinfo error="Access Denied."38122026/11/11 22:35:40 ERROR failed to remove object object=nar/gggggggggggggggggggggggggggggggggggggggggggggggggggg.nar.zst error="Access Denied."38132026/11/11 22:35:40 ERROR failed to remove object object=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh.nar.zst error="Access Denied."38142026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."38152026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:dddddddd!out.doi error="Access Denied."38162026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:gggggggg!out.doi error="Access Denied."38172026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."38182026/11/11 22:35:40 INFO Received push request method=POST path=/38192026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38202026/11/11 22:35:40 INFO Completed upload id=10 objects=7 duration=674.75µs38212026/11/11 22:35:40 INFO Received complete push request method=POST path=/38222026/11/11 22:35:40 INFO Received push request method=POST path=/38232026/11/11 22:35:40 INFO Completed push id=8 objects=2 duration=501.708µs38242026/11/11 22:35:40 INFO Received uploads request method=POST path=/38252026/11/11 22:35:40 INFO Received uploads request method=POST path=/38262026/11/11 22:35:40 INFO Received uploads request method=POST path=/38272026/11/11 22:35:40 INFO Received complete push request method=POST path=/38282026/11/11 22:35:40 INFO Received push request method=POST path=/38292026/11/11 22:35:40 INFO Completed push id=4 objects=6 duration=781.833µs38302026/11/11 22:35:40 INFO Received uploads request method=POST path=/38312026/11/11 22:35:40 INFO Received uploads request method=POST path=/38322026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38332026/11/11 22:35:40 INFO Received uploads request method=POST path=/38342026/11/11 22:35:40 INFO Completed upload id=18 objects=4 duration=542.917µs38352026/11/11 22:35:40 INFO Received push request method=POST path=/38362026/11/11 22:35:40 INFO Received complete push request method=POST path=/38372026/11/11 22:35:40 INFO Completed push id=13 objects=22 duration=364.541µs38382026/11/11 22:35:40 INFO Received complete push request method=POST path=/38392026/11/11 22:35:40 INFO Completed push id=21 objects=6 duration=367.25µs38402026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38412026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38422026/11/11 22:35:40 INFO Completed upload id=18 objects=11 duration=336.041µs38432026/11/11 22:35:40 INFO Completed upload id=22 objects=7 duration=218.834µs38442026/11/11 22:35:40 INFO Received uploads request method=POST path=/38452026/11/11 22:35:40 INFO Received complete push request method=POST path=/38462026/11/11 22:35:40 INFO Completed push id=24 objects=4 duration=275.75µs38472026/11/11 22:35:40 INFO Received push request method=POST path=/38482026/11/11 22:35:40 INFO Received complete push request method=POST path=/38492026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38502026/11/11 22:35:40 INFO Completed push id=25 objects=9 duration=422.958µs38512026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=038522026/11/11 22:35:40 INFO Completed upload id=4 objects=14 duration=1.178208ms38532026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period38542026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38552026/11/11 22:35:40 INFO Completed upload id=26 objects=3 duration=177.833µs38562026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=038572026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period38582026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038592026/11/11 22:35:40 INFO Vacuumed table table=pending_closures38602026/11/11 22:35:40 INFO Received complete push request method=POST path=/38612026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38622026/11/11 22:35:40 INFO Completed push id=2 objects=25 duration=933.917µs38632026/11/11 22:35:40 INFO Completed upload id=9 objects=2 duration=827.125µs38642026/11/11 22:35:40 INFO Vacuumed table table=pending_objects38652026/11/11 22:35:40 INFO Received complete push request method=POST path=/38662026/11/11 22:35:40 INFO Vacuumed table table=multipart_uploads38672026/11/11 22:35:40 INFO Vacuumed table table=closures38682026/11/11 22:35:40 INFO Completed push id=3 objects=5 duration=6.250917ms38692026/11/11 22:35:40 INFO Received complete push request method=POST path=/38702026/11/11 22:35:40 INFO Vacuumed table table=objects38712026/11/11 22:35:40 INFO Received push request method=POST path=/38722026/11/11 22:35:40 INFO Completed push id=8 objects=3 duration=714.792µs38732026/11/11 22:35:40 INFO Received push request method=POST path=/38742026/11/11 22:35:40 INFO Received push request method=POST path=/38752026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=038762026/11/11 22:35:40 INFO Received push request method=POST path=/38772026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038782026/11/11 22:35:40 INFO Received uploads request method=POST path=/38792026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=038802026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=038812026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38822026/11/11 22:35:40 INFO Completed upload id=13 objects=10 duration=279.792µs38832026/11/11 22:35:40 INFO Vacuumed table table=pending_closures38842026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=038852026/11/11 22:35:40 INFO Vacuumed table table=pending_closures38862026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period38872026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38882026/11/11 22:35:40 INFO Vacuumed table table=pending_objects38892026/11/11 22:35:40 INFO Vacuumed table table=multipart_uploads38902026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38912026/11/11 22:35:40 INFO Completed upload id=27 objects=7 duration=5.903292ms38922026/11/11 22:35:40 INFO Vacuumed table table=closures38932026/11/11 22:35:40 INFO Received complete push request method=POST path=/38942026/11/11 22:35:40 INFO Completed upload id=11 objects=7 duration=353.125µs38952026/11/11 22:35:40 INFO Received complete upload request method=POST path=/38962026/11/11 22:35:40 INFO Vacuumed table table=objects38972026/11/11 22:35:40 INFO Completed upload id=28 objects=3 duration=440.333µs38982026/11/11 22:35:40 INFO Vacuumed table table=pending_objects38992026/11/11 22:35:40 INFO Completed push id=15 objects=24 duration=1.466209ms39002026/11/11 22:35:40 INFO Received uploads request method=POST path=/39012026/11/11 22:35:40 INFO Vacuumed table table=multipart_uploads39022026/11/11 22:35:40 INFO Received uploads request method=POST path=/39032026/11/11 22:35:40 INFO Received uploads request method=POST path=/39042026/11/11 22:35:40 INFO Received uploads request method=POST path=/39052026/11/11 22:35:40 INFO Received complete push request method=POST path=/39062026/11/11 22:35:40 INFO Received uploads request method=POST path=/39072026/11/11 22:35:40 INFO Completed push id=4 objects=4 duration=685.417µs39082026/11/11 22:35:40 INFO Vacuumed table table=closures39092026/11/11 22:35:40 INFO Received push request method=POST path=/39102026/11/11 22:35:40 INFO Received complete push request method=POST path=/39112026/11/11 22:35:40 INFO Received complete push request method=POST path=/39122026/11/11 22:35:40 INFO Completed push id=5 objects=3 duration=735µs39132026/11/11 22:35:40 INFO Completed push id=29 objects=23 duration=266.958µs39142026/11/11 22:35:40 INFO Vacuumed table table=objects39152026/11/11 22:35:40 INFO Received complete push request method=POST path=/39162026/11/11 22:35:40 INFO Completed push id=30 objects=6 duration=436.834µs39172026/11/11 22:35:40 INFO Received complete push request method=POST path=/39182026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=039192026/11/11 22:35:40 INFO Received push request method=POST path=/39202026/11/11 22:35:40 INFO Received complete upload request method=POST path=/39212026/11/11 22:35:40 INFO Completed push id=5 objects=8 duration=1.941583ms39222026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=4 objects-deleted-after-grace-period=0 objects-failed-to-delete=039232026/11/11 22:35:40 INFO Completed upload id=6 objects=6 duration=369.041µs39242026/11/11 22:35:40 ERROR failed to remove object object=realisations/sha256:cccccccc!out.doi error="Access Denied."39252026/11/11 22:35:40 INFO Received push request method=POST path=/39262026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=039272026/11/11 22:35:40 INFO Received push request method=POST path=/39282026/11/11 22:35:40 INFO Received uploads request method=POST path=/39292026/11/11 22:35:40 INFO Received uploads request method=POST path=/39302026/11/11 22:35:40 WARN Force mode enabled - objects will be deleted immediately without grace period39312026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=039322026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039332026/11/11 22:35:40 INFO Aborted multipart uploads count=0 kept=039342026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039352026/11/11 22:35:40 INFO Vacuumed table table=pending_closures39362026/11/11 22:35:40 INFO Vacuumed table table=pending_closures39372026/11/11 22:35:40 INFO Vacuumed table table=pending_closures39382026/11/11 22:35:40 INFO Vacuumed table table=pending_objects39392026/11/11 22:35:40 INFO Vacuumed table table=pending_objects39402026/11/11 22:35:40 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039412026/11/11 22:35:40 INFO Vacuumed table table=multipart_uploads39422026/11/11 22:35:40 INFO Vacuumed table table=multipart_uploads39432026/11/11 22:35:40 INFO Vacuumed table table=closures39442026/11/11 22:35:40 INFO Vacuumed table table=pending_closures39452026/11/11 22:35:40 INFO Vacuumed table table=closures39462026/11/11 22:35:40 INFO Vacuumed table table=objects39472026/11/11 22:35:41 INFO Vacuumed table table=objects39482026/11/11 22:35:41 INFO Vacuumed table table=pending_objects39492026/11/11 22:35:41 INFO Received complete push request method=POST path=/39502026/11/11 22:35:41 INFO Received push request method=POST path=/39512026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads39522026/11/11 22:35:41 INFO Vacuumed table table=pending_objects39532026/11/11 22:35:41 INFO Completed push id=33 objects=3 duration=262.292µs39542026/11/11 22:35:41 INFO Received uploads request method=POST path=/39552026/11/11 22:35:41 INFO Received uploads request method=POST path=/39562026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads39572026/11/11 22:35:41 INFO Vacuumed table table=closures39582026/11/11 22:35:41 INFO Received uploads request method=POST path=/39592026/11/11 22:35:41 INFO Received complete push request method=POST path=/39602026/11/11 22:35:41 INFO Completed push id=34 objects=6 duration=280.792µs39612026/11/11 22:35:41 INFO Vacuumed table table=objects39622026/11/11 22:35:41 INFO Received complete push request method=POST path=/39632026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=039642026/11/11 22:35:41 INFO Received push request method=POST path=/39652026/11/11 22:35:41 INFO Received complete push request method=POST path=/39662026/11/11 22:35:41 INFO Completed push id=15 objects=4 duration=321.708µs39672026/11/11 22:35:41 INFO Completed push id=35 objects=8 duration=271.791µs39682026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period39692026/11/11 22:35:41 INFO Vacuumed table table=closures39702026/11/11 22:35:41 INFO Received complete upload request method=POST path=/39712026/11/11 22:35:41 INFO Received complete push request method=POST path=/39722026/11/11 22:35:41 INFO Received push request method=POST path=/39732026/11/11 22:35:41 INFO Completed upload id=8 objects=3 duration=806.917µs39742026/11/11 22:35:41 INFO Completed push id=4 objects=4 duration=6.862792ms39752026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039762026/11/11 22:35:41 INFO Vacuumed table table=pending_closures39772026/11/11 22:35:41 INFO Received complete upload request method=POST path=/39782026/11/11 22:35:41 INFO Received uploads request method=POST path=/39792026/11/11 22:35:41 INFO Completed upload id=36 objects=9 duration=506.291µs39802026/11/11 22:35:41 INFO Vacuumed table table=objects39812026/11/11 22:35:41 INFO Received uploads request method=POST path=/39822026/11/11 22:35:41 INFO Vacuumed table table=pending_objects39832026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=039842026/11/11 22:35:41 INFO Received push request method=POST path=/39852026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads39862026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period39872026/11/11 22:35:41 INFO Vacuumed table table=closures39882026/11/11 22:35:41 INFO Received complete push request method=POST path=/39892026/11/11 22:35:41 INFO Completed push id=6 objects=6 duration=468.291µs39902026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=039912026/11/11 22:35:41 INFO Vacuumed table table=objects39922026/11/11 22:35:41 INFO Received push request method=POST path=/39932026/11/11 22:35:41 INFO Received uploads request method=POST path=/39942026/11/11 22:35:41 INFO Received push request method=POST path=/39952026/11/11 22:35:41 INFO Received push request method=POST path=/39962026/11/11 22:35:41 INFO Vacuumed table table=pending_closures39972026/11/11 22:35:41 INFO Received uploads request method=POST path=/39982026/11/11 22:35:41 INFO Received uploads request method=POST path=/39992026/11/11 22:35:41 INFO Received uploads request method=POST path=/40002026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040012026/11/11 22:35:41 INFO Vacuumed table table=pending_objects40022026/11/11 22:35:41 INFO Received uploads request method=POST path=/40032026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period40042026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads40052026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040062026/11/11 22:35:41 INFO Received complete push request method=POST path=/40072026/11/11 22:35:41 INFO Vacuumed table table=closures40082026/11/11 22:35:41 INFO Vacuumed table table=pending_closures40092026/11/11 22:35:41 INFO Completed push id=13 objects=12 duration=999.542µs40102026/11/11 22:35:41 INFO Vacuumed table table=objects40112026/11/11 22:35:41 INFO Vacuumed table table=pending_objects40122026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads40132026/11/11 22:35:41 INFO Received complete push request method=POST path=/40142026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040152026/11/11 22:35:41 INFO Vacuumed table table=closures40162026/11/11 22:35:41 INFO Completed push id=6 objects=6 duration=617.75µs40172026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=040182026/11/11 22:35:41 INFO Vacuumed table table=objects40192026/11/11 22:35:41 INFO Received push request method=POST path=/40202026/11/11 22:35:41 INFO Vacuumed table table=pending_closures40212026/11/11 22:35:41 INFO Received complete push request method=POST path=/40222026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040232026/11/11 22:35:41 INFO Vacuumed table table=pending_objects40242026/11/11 22:35:41 INFO Completed push id=10 objects=15 duration=464.666µs40252026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period40262026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads40272026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040282026/11/11 22:35:41 INFO Vacuumed table table=closures40292026/11/11 22:35:41 INFO Vacuumed table table=pending_closures40302026/11/11 22:35:41 INFO Vacuumed table table=objects40312026/11/11 22:35:41 INFO Vacuumed table table=pending_objects40322026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040332026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads40342026/11/11 22:35:41 INFO Received push request method=POST path=/40352026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period40362026/11/11 22:35:41 INFO Vacuumed table table=closures40372026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=040382026/11/11 22:35:41 INFO Vacuumed table table=objects40392026/11/11 22:35:41 INFO Received push request method=POST path=/40402026/11/11 22:35:41 INFO Vacuumed table table=pending_closures40412026/11/11 22:35:41 INFO Vacuumed table table=pending_objects40422026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads40432026/11/11 22:35:41 INFO Vacuumed table table=closures40442026/11/11 22:35:41 INFO Vacuumed table table=objects40452026/11/11 22:35:41 INFO Received push request method=POST path=/40462026/11/11 22:35:41 INFO Received complete push request method=POST path=/40472026/11/11 22:35:41 INFO Completed push id=14 objects=3 duration=389.917µs40482026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=11 objects-failed-to-delete=040492026/11/11 22:35:41 INFO Vacuumed table table=pending_closures40502026/11/11 22:35:41 INFO Received uploads request method=POST path=/40512026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40522026/11/11 22:35:41 INFO Completed upload id=20 objects=4 duration=287.75µs40532026/11/11 22:35:41 INFO Vacuumed table table=pending_objects40542026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040552026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads40562026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period40572026/11/11 22:35:41 INFO Vacuumed table table=closures40582026/11/11 22:35:41 INFO Vacuumed table table=objects40592026/11/11 22:35:41 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."40602026/11/11 22:35:41 INFO Received complete push request method=POST path=/40612026/11/11 22:35:41 INFO Received push request method=POST path=/40622026/11/11 22:35:41 INFO Completed push id=1 objects=11 duration=562.041µs40632026/11/11 22:35:41 INFO Received push request method=POST path=/40642026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40652026/11/11 22:35:41 INFO Completed upload id=10 objects=6 duration=847.792µs40662026/11/11 22:35:41 INFO Received push request method=POST path=/40672026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40682026/11/11 22:35:41 INFO Received complete push request method=POST path=/40692026/11/11 22:35:41 INFO Completed push id=8 objects=6 duration=531.792µs40702026/11/11 22:35:41 INFO Completed upload id=14 objects=8 duration=6.034209ms40712026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40722026/11/11 22:35:41 INFO Completed upload id=10 objects=23 duration=610.125µs40732026/11/11 22:35:41 INFO Received complete push request method=POST path=/40742026/11/11 22:35:41 INFO Received uploads request method=POST path=/40752026/11/11 22:35:41 INFO Received uploads request method=POST path=/40762026/11/11 22:35:41 INFO Completed push id=14 objects=4 duration=862.375µs40772026/11/11 22:35:41 INFO Received complete push request method=POST path=/40782026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040792026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period40802026/11/11 22:35:41 INFO Completed push id=7 objects=27 duration=6.799125ms40812026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40822026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40832026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=040842026/11/11 22:35:41 INFO Received push request method=POST path=/40852026/11/11 22:35:41 INFO Completed upload id=16 objects=3 duration=291.291µs40862026/11/11 22:35:41 INFO Completed upload id=23 objects=16 duration=701.291µs40872026/11/11 22:35:41 INFO Received uploads request method=POST path=/40882026/11/11 22:35:41 INFO Received complete push request method=POST path=/40892026/11/11 22:35:41 INFO Received push request method=POST path=/40902026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040912026/11/11 22:35:41 INFO Completed push id=12 objects=7 duration=473.291µs40922026/11/11 22:35:41 INFO Received push request method=POST path=/40932026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period40942026/11/11 22:35:41 INFO Vacuumed table table=pending_closures40952026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040962026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=040972026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=040982026/11/11 22:35:41 INFO Received complete upload request method=POST path=/40992026/11/11 22:35:41 INFO Vacuumed table table=pending_closures41002026/11/11 22:35:41 INFO Completed upload id=11 objects=6 duration=487.875µs41012026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period41022026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=6 objects-failed-to-delete=041032026/11/11 22:35:41 INFO Vacuumed table table=pending_objects41042026/11/11 22:35:41 INFO Vacuumed table table=pending_objects41052026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041062026/11/11 22:35:41 INFO Received push request method=POST path=/41072026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads41082026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads41092026/11/11 22:35:41 INFO Vacuumed table table=pending_closures41102026/11/11 22:35:41 INFO Vacuumed table table=closures41112026/11/11 22:35:41 INFO Vacuumed table table=closures41122026/11/11 22:35:41 INFO Vacuumed table table=pending_closures41132026/11/11 22:35:41 INFO Vacuumed table table=objects41142026/11/11 22:35:41 INFO Vacuumed table table=objects41152026/11/11 22:35:41 INFO Vacuumed table table=pending_objects41162026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads41172026/11/11 22:35:41 INFO Vacuumed table table=closures41182026/11/11 22:35:41 INFO Vacuumed table table=pending_objects41192026/11/11 22:35:41 INFO Received uploads request method=POST path=/41202026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads41212026/11/11 22:35:41 INFO Received uploads request method=POST path=/41222026/11/11 22:35:41 INFO Vacuumed table table=objects41232026/11/11 22:35:41 INFO Received complete push request method=POST path=/41242026/11/11 22:35:41 INFO Vacuumed table table=closures41252026/11/11 22:35:41 INFO Received complete push request method=POST path=/41262026/11/11 22:35:41 INFO Completed push id=16 objects=5 duration=378.041µs41272026/11/11 22:35:41 INFO Vacuumed table table=objects41282026/11/11 22:35:41 INFO Completed push id=19 objects=6 duration=1.244542ms41292026/11/11 22:35:41 INFO Received uploads request method=POST path=/41302026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=041312026/11/11 22:35:41 INFO Received uploads request method=POST path=/41322026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=041332026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=041342026/11/11 22:35:41 INFO Vacuumed table table=pending_closures41352026/11/11 22:35:41 INFO Received complete upload request method=POST path=/41362026/11/11 22:35:41 INFO Vacuumed table table=pending_objects41372026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period41382026/11/11 22:35:41 INFO Received uploads request method=POST path=/41392026/11/11 22:35:41 INFO Completed upload id=3 objects=9 duration=311.459µs41402026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads41412026/11/11 22:35:41 INFO Vacuumed table table=closures41422026/11/11 22:35:41 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."41432026/11/11 22:35:41 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."41442026/11/11 22:35:41 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."41452026/11/11 22:35:41 INFO Received uploads request method=POST path=/41462026/11/11 22:35:41 INFO Received complete push request method=POST path=/41472026/11/11 22:35:41 INFO Vacuumed table table=objects41482026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=041492026/11/11 22:35:41 INFO Completed push id=12 objects=15 duration=566.708µs41502026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period41512026/11/11 22:35:41 INFO Received uploads request method=POST path=/41522026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=041532026/11/11 22:35:41 INFO Received push request method=POST path=/41542026/11/11 22:35:41 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041552026/11/11 22:35:41 ERROR failed to remove object object=dddddddddddddddddddddddddddddddd.ls error="Access Denied."41562026/11/11 22:35:41 ERROR failed to remove object object=realisations/sha256:bbbbbbbb!out.doi error="Access Denied."41572026/11/11 22:35:41 ERROR failed to remove object object=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb.ls error="Access Denied."41582026/11/11 22:35:41 INFO Vacuumed table table=pending_closures41592026/11/11 22:35:41 INFO Received push request method=POST path=/41602026/11/11 22:35:41 INFO Vacuumed table table=pending_objects41612026/11/11 22:35:41 INFO Received uploads request method=POST path=/41622026/11/11 22:35:41 INFO Vacuumed table table=multipart_uploads41632026/11/11 22:35:41 INFO Received uploads request method=POST path=/41642026/11/11 22:35:41 INFO Received push request method=POST path=/41652026/11/11 22:35:41 INFO Vacuumed table table=closures41662026/11/11 22:35:41 INFO Aborted multipart uploads count=0 kept=041672026/11/11 22:35:41 INFO Vacuumed table table=objects41682026/11/11 22:35:41 INFO Received complete upload request method=POST path=/41692026/11/11 22:35:41 WARN Force mode enabled - objects will be deleted immediately without grace period41702026/11/11 22:35:42 INFO Received uploads request method=POST path=/41712026/11/11 22:35:42 INFO Completed upload id=16 objects=17 duration=770.041µs41722026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041732026/11/11 22:35:42 INFO Received uploads request method=POST path=/41742026/11/11 22:35:42 INFO Received uploads request method=POST path=/41752026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=041762026/11/11 22:35:42 INFO Received push request method=POST path=/41772026/11/11 22:35:42 INFO Received complete push request method=POST path=/41782026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period41792026/11/11 22:35:42 INFO Vacuumed table table=pending_closures41802026/11/11 22:35:42 INFO Received complete upload request method=POST path=/41812026/11/11 22:35:42 INFO Completed push id=5 objects=6 duration=600.417µs41822026/11/11 22:35:42 INFO Completed upload id=15 objects=6 duration=207.791µs41832026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=041842026/11/11 22:35:42 INFO Vacuumed table table=pending_objects41852026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=041862026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads41872026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041882026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period41892026/11/11 22:35:42 INFO Received push request method=POST path=/41902026/11/11 22:35:42 INFO Vacuumed table table=closures41912026/11/11 22:35:42 INFO Vacuumed table table=pending_closures41922026/11/11 22:35:42 INFO Vacuumed table table=objects41932026/11/11 22:35:42 INFO Vacuumed table table=pending_objects41942026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads41952026/11/11 22:35:42 INFO Vacuumed table table=closures41962026/11/11 22:35:42 INFO Vacuumed table table=objects41972026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=041982026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=041992026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42002026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42012026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42022026/11/11 22:35:42 INFO Vacuumed table table=closures42032026/11/11 22:35:42 INFO Vacuumed table table=objects42042026/11/11 22:35:42 INFO Received push request method=POST path=/42052026/11/11 22:35:42 INFO Received push request method=POST path=/42062026/11/11 22:35:42 INFO Received uploads request method=POST path=/42072026/11/11 22:35:42 INFO Received push request method=POST path=/42082026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042092026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042102026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42112026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42122026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42132026/11/11 22:35:42 INFO Vacuumed table table=closures42142026/11/11 22:35:42 INFO Vacuumed table table=objects42152026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042162026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period42172026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042182026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42192026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42202026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42212026/11/11 22:35:42 INFO Vacuumed table table=closures42222026/11/11 22:35:42 INFO Vacuumed table table=objects42232026/11/11 22:35:42 INFO Received complete upload request method=POST path=/42242026/11/11 22:35:42 INFO Received complete push request method=POST path=/42252026/11/11 22:35:42 INFO Completed upload id=19 objects=2 duration=1.223917ms42262026/11/11 22:35:42 INFO Completed push id=16 objects=16 duration=1.378791ms42272026/11/11 22:35:42 INFO Received uploads request method=POST path=/42282026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042292026/11/11 22:35:42 INFO Received complete push request method=POST path=/42302026/11/11 22:35:42 INFO Received complete push request method=POST path=/42312026/11/11 22:35:42 INFO Completed push id=33 objects=7 duration=494.542µs42322026/11/11 22:35:42 INFO Completed push id=19 objects=8 duration=9.333458ms42332026/11/11 22:35:42 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."42342026/11/11 22:35:42 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."42352026/11/11 22:35:42 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."42362026/11/11 22:35:42 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."42372026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."42382026/11/11 22:35:42 INFO Received complete upload request method=POST path=/42392026/11/11 22:35:42 INFO Received uploads request method=POST path=/42402026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."42412026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."42422026/11/11 22:35:42 INFO Completed upload id=26 objects=3 duration=267.834µs42432026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042442026/11/11 22:35:42 INFO Received complete push request method=POST path=/42452026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042462026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042472026/11/11 22:35:42 INFO Received uploads request method=POST path=/42482026/11/11 22:35:42 INFO Completed push id=4 objects=6 duration=484.292µs42492026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42502026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period42512026/11/11 22:35:42 INFO Received complete push request method=POST path=/42522026/11/11 22:35:42 INFO Received complete push request method=POST path=/42532026/11/11 22:35:42 INFO Received uploads request method=POST path=/42542026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42552026/11/11 22:35:42 INFO Completed push id=13 objects=15 duration=6.302833ms42562026/11/11 22:35:42 INFO Completed push id=16 objects=27 duration=6.261167ms42572026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042582026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42592026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42602026/11/11 22:35:42 INFO Received push request method=POST path=/42612026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042622026/11/11 22:35:42 INFO Received uploads request method=POST path=/42632026/11/11 22:35:42 INFO Received uploads request method=POST path=/42642026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42652026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."42662026/11/11 22:35:42 INFO Received push request method=POST path=/42672026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42682026/11/11 22:35:42 INFO Received push request method=POST path=/42692026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042702026/11/11 22:35:42 INFO Vacuumed table table=closures42712026/11/11 22:35:42 INFO Vacuumed table table=closures42722026/11/11 22:35:42 INFO Received uploads request method=POST path=/42732026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period42742026/11/11 22:35:42 INFO Vacuumed table table=objects42752026/11/11 22:35:42 INFO Vacuumed table table=objects42762026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042772026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42782026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042792026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42802026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period42812026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42822026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=042832026/11/11 22:35:42 INFO Vacuumed table table=closures42842026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period42852026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=042862026/11/11 22:35:42 INFO Vacuumed table table=objects42872026/11/11 22:35:42 INFO Vacuumed table table=pending_closures42882026/11/11 22:35:42 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."42892026/11/11 22:35:42 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.ls error="Access Denied."42902026/11/11 22:35:42 ERROR failed to remove object object=iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.narinfo error="Access Denied."42912026/11/11 22:35:42 ERROR failed to remove object object=nar/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii.nar.zst error="Access Denied."42922026/11/11 22:35:42 INFO Received uploads request method=POST path=/42932026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."42942026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:hhhhhhhh!out.doi error="Access Denied."42952026/11/11 22:35:42 ERROR failed to remove object object=realisations/sha256:iiiiiiii!out.doi error="Access Denied."42962026/11/11 22:35:42 INFO Vacuumed table table=pending_objects42972026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads42982026/11/11 22:35:42 INFO Vacuumed table table=closures42992026/11/11 22:35:42 INFO Vacuumed table table=objects43002026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043012026/11/11 22:35:42 INFO Received complete upload request method=POST path=/43022026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period43032026/11/11 22:35:42 INFO Completed upload id=21 objects=3 duration=448.042µs43042026/11/11 22:35:42 INFO Received push request method=POST path=/43052026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043062026/11/11 22:35:42 INFO Vacuumed table table=pending_closures43072026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043082026/11/11 22:35:42 INFO Received uploads request method=POST path=/43092026/11/11 22:35:42 INFO Vacuumed table table=pending_objects43102026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period43112026/11/11 22:35:42 INFO Received complete push request method=POST path=/43122026/11/11 22:35:42 INFO Received uploads request method=POST path=/43132026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads43142026/11/11 22:35:42 INFO Completed push id=18 objects=10 duration=561.208µs43152026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=7 objects-failed-to-delete=043162026/11/11 22:35:42 INFO Received uploads request method=POST path=/43172026/11/11 22:35:42 INFO Vacuumed table table=closures43182026/11/11 22:35:42 INFO Vacuumed table table=objects43192026/11/11 22:35:42 INFO Received push request method=POST path=/43202026/11/11 22:35:42 INFO Received complete push request method=POST path=/43212026/11/11 22:35:42 INFO Vacuumed table table=pending_closures43222026/11/11 22:35:42 INFO Completed push id=15 objects=7 duration=756.916µs43232026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043242026/11/11 22:35:42 INFO Received uploads request method=POST path=/43252026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043262026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period43272026/11/11 22:35:42 INFO Received uploads request method=POST path=/43282026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period43292026/11/11 22:35:42 INFO Vacuumed table table=pending_objects43302026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=5 old-closures-deleted=2 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043312026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043322026/11/11 22:35:42 INFO Received uploads request method=POST path=/43332026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads43342026/11/11 22:35:42 INFO Vacuumed table table=pending_closures43352026/11/11 22:35:42 INFO Vacuumed table table=closures43362026/11/11 22:35:42 INFO Vacuumed table table=pending_objects43372026/11/11 22:35:42 INFO Vacuumed table table=objects43382026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads43392026/11/11 22:35:42 INFO Received push request method=POST path=/43402026/11/11 22:35:42 INFO Vacuumed table table=closures43412026/11/11 22:35:42 INFO Received complete push request method=POST path=/43422026/11/11 22:35:42 INFO Received complete upload request method=POST path=/43432026/11/11 22:35:42 INFO Vacuumed table table=objects43442026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043452026/11/11 22:35:42 INFO Completed push id=7 objects=15 duration=835.375µs43462026/11/11 22:35:42 INFO Completed upload id=22 objects=2 duration=292.667µs43472026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period43482026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043492026/11/11 22:35:42 INFO Vacuumed table table=pending_closures43502026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043512026/11/11 22:35:42 INFO Received push request method=POST path=/43522026/11/11 22:35:42 INFO Vacuumed table table=pending_objects43532026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads43542026/11/11 22:35:42 INFO Vacuumed table table=pending_closures43552026/11/11 22:35:42 INFO Vacuumed table table=closures43562026/11/11 22:35:42 INFO Received complete push request method=POST path=/43572026/11/11 22:35:42 INFO Vacuumed table table=objects43582026/11/11 22:35:42 INFO Completed push id=20 objects=3 duration=362.125µs43592026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=043602026/11/11 22:35:42 INFO Received push request method=POST path=/43612026/11/11 22:35:42 INFO Received push request method=POST path=/43622026/11/11 22:35:42 INFO Vacuumed table table=pending_closures43632026/11/11 22:35:42 INFO Received push request method=POST path=/43642026/11/11 22:35:42 INFO Vacuumed table table=pending_objects43652026/11/11 22:35:42 INFO Vacuumed table table=pending_objects43662026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads43672026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads43682026/11/11 22:35:42 INFO Received push request method=POST path=/43692026/11/11 22:35:42 INFO Received complete push request method=POST path=/43702026/11/11 22:35:42 INFO Vacuumed table table=closures43712026/11/11 22:35:42 INFO Received push request method=POST path=/43722026/11/11 22:35:42 INFO Completed push id=22 objects=3 duration=734.75µs43732026/11/11 22:35:42 INFO Vacuumed table table=objects43742026/11/11 22:35:42 INFO Vacuumed table table=closures43752026/11/11 22:35:42 INFO Received uploads request method=POST path=/43762026/11/11 22:35:42 INFO Received complete upload request method=POST path=/43772026/11/11 22:35:42 INFO Received uploads request method=POST path=/43782026/11/11 22:35:42 INFO Completed upload id=22 objects=6 duration=291.458µs43792026/11/11 22:35:42 INFO Received push request method=POST path=/43802026/11/11 22:35:42 INFO Received push request method=POST path=/43812026/11/11 22:35:42 INFO Received uploads request method=POST path=/43822026/11/11 22:35:42 INFO Received complete push request method=POST path=/43832026/11/11 22:35:42 INFO Received push request method=POST path=/43842026/11/11 22:35:42 INFO Completed push id=24 objects=3 duration=312.958µs43852026/11/11 22:35:42 INFO Received uploads request method=POST path=/43862026/11/11 22:35:42 INFO Vacuumed table table=objects43872026/11/11 22:35:42 INFO Received push request method=POST path=/43882026/11/11 22:35:42 INFO Received push request method=POST path=/43892026/11/11 22:35:42 INFO Received push request method=POST path=/43902026/11/11 22:35:42 INFO Received push request method=POST path=/43912026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043922026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=043932026/11/11 22:35:42 INFO Received push request method=POST path=/43942026/11/11 22:35:42 INFO Received uploads request method=POST path=/43952026/11/11 22:35:42 WARN Force mode enabled - objects will be deleted immediately without grace period43962026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043972026/11/11 22:35:42 INFO Received uploads request method=POST path=/43982026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=043992026/11/11 22:35:42 INFO Received complete upload request method=POST path=/44002026/11/11 22:35:42 INFO Vacuumed table table=pending_closures44012026/11/11 22:35:42 INFO Received uploads request method=POST path=/44022026/11/11 22:35:42 INFO Received push request method=POST path=/44032026/11/11 22:35:42 INFO Completed upload id=17 objects=25 duration=1.228417ms44042026/11/11 22:35:42 INFO Received uploads request method=POST path=/44052026/11/11 22:35:42 INFO Received push request method=POST path=/44062026/11/11 22:35:42 INFO Received push request method=POST path=/44072026/11/11 22:35:42 INFO Received uploads request method=POST path=/44082026/11/11 22:35:42 INFO Vacuumed table table=pending_closures44092026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=044102026/11/11 22:35:42 INFO Vacuumed table table=pending_objects44112026/11/11 22:35:42 INFO Received complete upload request method=POST path=/44122026/11/11 22:35:42 INFO Completed upload id=21 objects=2 duration=278.084µs44132026/11/11 22:35:42 INFO Vacuumed table table=multipart_uploads44142026/11/11 22:35:42 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044152026/11/11 22:35:42 INFO Vacuumed table table=closures44162026/11/11 22:35:42 INFO Vacuumed table table=pending_objects44172026/11/11 22:35:42 INFO Received push request method=POST path=/44182026/11/11 22:35:42 INFO Aborted multipart uploads count=0 kept=044192026/11/11 22:35:42 INFO Vacuumed table table=objects44202026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44212026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44222026/11/11 22:35:43 WARN Force mode enabled - objects will be deleted immediately without grace period44232026/11/11 22:35:43 INFO Vacuumed table table=closures44242026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044252026/11/11 22:35:43 INFO Vacuumed table table=objects44262026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44272026/11/11 22:35:43 INFO Received push request method=POST path=/44282026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44292026/11/11 22:35:43 INFO Received push request method=POST path=/44302026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44312026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=044322026/11/11 22:35:43 INFO Vacuumed table table=closures44332026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44342026/11/11 22:35:43 INFO Vacuumed table table=objects44352026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=2 objects-failed-to-delete=044362026/11/11 22:35:43 INFO Received uploads request method=POST path=/44372026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44382026/11/11 22:35:43 INFO Received uploads request method=POST path=/44392026/11/11 22:35:43 INFO Vacuumed table table=closures44402026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44412026/11/11 22:35:43 INFO Vacuumed table table=objects44422026/11/11 22:35:43 INFO Received push request method=POST path=/44432026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=044442026/11/11 22:35:43 WARN Force mode enabled - objects will be deleted immediately without grace period44452026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44462026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44472026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044482026/11/11 22:35:43 INFO Vacuumed table table=closures44492026/11/11 22:35:43 INFO Received uploads request method=POST path=/44502026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44512026/11/11 22:35:43 INFO Vacuumed table table=objects44522026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44532026/11/11 22:35:43 INFO Received uploads request method=POST path=/44542026/11/11 22:35:43 INFO Received uploads request method=POST path=/44552026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44562026/11/11 22:35:43 INFO Vacuumed table table=closures44572026/11/11 22:35:43 INFO Vacuumed table table=objects44582026/11/11 22:35:43 INFO Received complete upload request method=POST path=/44592026/11/11 22:35:43 INFO Received uploads request method=POST path=/44602026/11/11 22:35:43 INFO Completed upload id=26 objects=2 duration=762.916µs44612026/11/11 22:35:43 INFO Received uploads request method=POST path=/44622026/11/11 22:35:43 INFO Received complete upload request method=POST path=/44632026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=044642026/11/11 22:35:43 INFO Completed upload id=23 objects=18 duration=688.834µs44652026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044662026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=044672026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044682026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44692026/11/11 22:35:43 INFO Received uploads request method=POST path=/44702026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44712026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44722026/11/11 22:35:43 INFO Vacuumed table table=closures44732026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=044742026/11/11 22:35:43 INFO Received push request method=POST path=/44752026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44762026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44772026/11/11 22:35:43 INFO Vacuumed table table=objects44782026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44792026/11/11 22:35:43 INFO Received complete upload request method=POST path=/44802026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44812026/11/11 22:35:43 INFO Completed upload id=22 objects=22 duration=470.875µs44822026/11/11 22:35:43 INFO Vacuumed table table=closures44832026/11/11 22:35:43 INFO Received push request method=POST path=/44842026/11/11 22:35:43 INFO Vacuumed table table=objects44852026/11/11 22:35:43 INFO Received complete push request method=POST path=/44862026/11/11 22:35:43 INFO Vacuumed table table=pending_objects44872026/11/11 22:35:43 INFO Received complete push request method=POST path=/44882026/11/11 22:35:43 INFO Completed push id=9 objects=9 duration=1.486959ms44892026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=044902026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads44912026/11/11 22:35:43 INFO Completed push id=26 objects=5 duration=525.459µs44922026/11/11 22:35:43 WARN Force mode enabled - objects will be deleted immediately without grace period44932026/11/11 22:35:43 INFO Vacuumed table table=closures44942026/11/11 22:35:43 INFO Received complete upload request method=POST path=/44952026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=044962026/11/11 22:35:43 INFO Vacuumed table table=objects44972026/11/11 22:35:43 INFO Completed upload id=24 objects=14 duration=263µs44982026/11/11 22:35:43 INFO Vacuumed table table=pending_closures44992026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=8 objects-deleted-after-grace-period=8 objects-failed-to-delete=045002026/11/11 22:35:43 INFO Vacuumed table table=pending_objects45012026/11/11 22:35:43 INFO Received complete push request method=POST path=/45022026/11/11 22:35:43 INFO Received push request method=POST path=/45032026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads45042026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45052026/11/11 22:35:43 INFO Completed push id=19 objects=3 duration=562.292µs45062026/11/11 22:35:43 INFO Vacuumed table table=closures45072026/11/11 22:35:43 INFO Vacuumed table table=pending_closures45082026/11/11 22:35:43 INFO Completed upload id=33 objects=5 duration=1.122209ms45092026/11/11 22:35:43 INFO Received uploads request method=POST path=/45102026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=045112026/11/11 22:35:43 INFO Vacuumed table table=objects45122026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45132026/11/11 22:35:43 ERROR failed to remove object object=cccccccccccccccccccccccccccccccc.ls error="Access Denied."45142026/11/11 22:35:43 ERROR failed to remove object object=ffffffffffffffffffffffffffffffff.ls error="Access Denied."45152026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45162026/11/11 22:35:43 INFO Completed upload id=21 objects=8 duration=357.333µs45172026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45182026/11/11 22:35:43 INFO Received uploads request method=POST path=/45192026/11/11 22:35:43 ERROR failed to remove object object=realisations/sha256:ffffffff!out.doi error="Access Denied."45202026/11/11 22:35:43 INFO Vacuumed table table=pending_objects45212026/11/11 22:35:43 INFO Completed upload id=14 objects=16 duration=6.973792ms45222026/11/11 22:35:43 INFO Completed upload id=15 objects=3 duration=6.958708ms45232026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads45242026/11/11 22:35:43 INFO Received push request method=POST path=/45252026/11/11 22:35:43 INFO Received complete push request method=POST path=/45262026/11/11 22:35:43 INFO Vacuumed table table=closures45272026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45282026/11/11 22:35:43 INFO Received push request method=POST path=/45292026/11/11 22:35:43 INFO Completed upload id=25 objects=4 duration=286.334µs45302026/11/11 22:35:43 INFO Completed push id=22 objects=6 duration=322.333µs45312026/11/11 22:35:43 INFO Received push request method=POST path=/45322026/11/11 22:35:43 INFO Vacuumed table table=objects45332026/11/11 22:35:43 INFO Received complete push request method=POST path=/45342026/11/11 22:35:43 INFO Received complete push request method=POST path=/45352026/11/11 22:35:43 INFO Received push request method=POST path=/45362026/11/11 22:35:43 INFO Completed push id=28 objects=11 duration=4.215208ms45372026/11/11 22:35:43 INFO Completed push id=24 objects=8 duration=4.222583ms45382026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45392026/11/11 22:35:43 INFO Received complete push request method=POST path=/45402026/11/11 22:35:43 INFO Completed upload id=25 objects=9 duration=246.583µs45412026/11/11 22:35:43 INFO Completed push id=20 objects=8 duration=239.875µs45422026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45432026/11/11 22:35:43 INFO Completed upload id=27 objects=3 duration=255.709µs45442026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=045452026/11/11 22:35:43 INFO Received uploads request method=POST path=/45462026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045472026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45482026/11/11 22:35:43 INFO Vacuumed table table=pending_closures45492026/11/11 22:35:43 INFO Received push request method=POST path=/45502026/11/11 22:35:43 INFO Vacuumed table table=pending_objects45512026/11/11 22:35:43 INFO Completed upload id=28 objects=6 duration=8.98975ms45522026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads45532026/11/11 22:35:43 INFO Vacuumed table table=closures45542026/11/11 22:35:43 INFO Received complete push request method=POST path=/45552026/11/11 22:35:43 INFO Completed push id=30 objects=4 duration=267.125µs45562026/11/11 22:35:43 INFO Vacuumed table table=objects45572026/11/11 22:35:43 INFO Received complete push request method=POST path=/45582026/11/11 22:35:43 INFO Received complete push request method=POST path=/45592026/11/11 22:35:43 INFO Completed push id=27 objects=11 duration=504.125µs45602026/11/11 22:35:43 INFO Completed push id=31 objects=7 duration=14.108666ms45612026/11/11 22:35:43 INFO Received push request method=POST path=/45622026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45632026/11/11 22:35:43 INFO Completed upload id=29 objects=26 duration=641.083µs45642026/11/11 22:35:43 INFO Received complete push request method=POST path=/45652026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45662026/11/11 22:35:43 INFO Completed push id=19 objects=14 duration=489.625µs45672026/11/11 22:35:43 INFO Completed upload id=32 objects=5 duration=268.167µs45682026/11/11 22:35:43 INFO Received complete push request method=POST path=/45692026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=045702026/11/11 22:35:43 INFO Received complete push request method=POST path=/45712026/11/11 22:35:43 INFO Received complete push request method=POST path=/45722026/11/11 22:35:43 INFO Completed push id=30 objects=8 duration=241.416µs45732026/11/11 22:35:43 INFO Completed push id=8 objects=6 duration=876.459µs45742026/11/11 22:35:43 INFO Completed push id=7 objects=24 duration=6.406834ms45752026/11/11 22:35:43 WARN Force mode enabled - objects will be deleted immediately without grace period45762026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45772026/11/11 22:35:43 INFO Completed upload id=31 objects=5 duration=222.625µs45782026/11/11 22:35:43 INFO Received push request method=POST path=/45792026/11/11 22:35:43 INFO Received uploads request method=POST path=/45802026/11/11 22:35:43 INFO Received complete push request method=POST path=/45812026/11/11 22:35:43 INFO Received uploads request method=POST path=/45822026/11/11 22:35:43 INFO Completed push id=32 objects=3 duration=303.666µs45832026/11/11 22:35:43 INFO Received uploads request method=POST path=/45842026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=045852026/11/11 22:35:43 WARN Force mode enabled - objects will be deleted immediately without grace period45862026/11/11 22:35:43 INFO Received push request method=POST path=/45872026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045882026/11/11 22:35:43 INFO Received uploads request method=POST path=/45892026/11/11 22:35:43 INFO Received complete push request method=POST path=/45902026/11/11 22:35:43 INFO Completed push id=13 objects=2 duration=230µs45912026/11/11 22:35:43 INFO Received complete upload request method=POST path=/45922026/11/11 22:35:43 INFO Completed upload id=27 objects=13 duration=392µs45932026/11/11 22:35:43 INFO Vacuumed table table=pending_closures45942026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=045952026/11/11 22:35:43 INFO Received complete push request method=POST path=/45962026/11/11 22:35:43 INFO Vacuumed table table=pending_objects45972026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=045982026/11/11 22:35:43 INFO Completed push id=17 objects=11 duration=397.916µs45992026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads46002026/11/11 22:35:43 INFO Vacuumed table table=pending_closures46012026/11/11 22:35:43 INFO Vacuumed table table=closures46022026/11/11 22:35:43 INFO Vacuumed table table=pending_objects46032026/11/11 22:35:43 INFO Vacuumed table table=objects46042026/11/11 22:35:43 INFO Received push request method=POST path=/46052026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads46062026/11/11 22:35:43 INFO Vacuumed table table=closures46072026/11/11 22:35:43 INFO Vacuumed table table=objects46082026/11/11 22:35:43 INFO Received complete push request method=POST path=/46092026/11/11 22:35:43 INFO Received push request method=POST path=/46102026/11/11 22:35:43 INFO Completed push id=16 objects=7 duration=476.917µs46112026/11/11 22:35:43 INFO Received uploads request method=POST path=/46122026/11/11 22:35:43 INFO Received push request method=POST path=/46132026/11/11 22:35:43 INFO Received complete upload request method=POST path=/46142026/11/11 22:35:43 INFO Completed upload id=26 objects=6 duration=305.875µs46152026/11/11 22:35:43 INFO Received push request method=POST path=/46162026/11/11 22:35:43 INFO Received uploads request method=POST path=/46172026/11/11 22:35:43 INFO Received uploads request method=POST path=/46182026/11/11 22:35:43 INFO Received complete upload request method=POST path=/46192026/11/11 22:35:43 INFO Completed upload id=29 objects=5 duration=283.334µs46202026/11/11 22:35:43 INFO Received uploads request method=POST path=/46212026/11/11 22:35:43 INFO Aborted multipart uploads count=0 kept=046222026/11/11 22:35:43 INFO Received complete upload request method=POST path=/46232026/11/11 22:35:43 WARN Force mode enabled - objects will be deleted immediately without grace period46242026/11/11 22:35:43 INFO Completed upload id=29 objects=4 duration=6.355959ms46252026/11/11 22:35:43 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046262026/11/11 22:35:43 INFO Vacuumed table table=pending_closures46272026/11/11 22:35:43 INFO Received uploads request method=POST path=/46282026/11/11 22:35:43 INFO Vacuumed table table=pending_objects46292026/11/11 22:35:43 INFO Received uploads request method=POST path=/46302026/11/11 22:35:43 INFO Vacuumed table table=multipart_uploads46312026/11/11 22:35:43 INFO Received complete push request method=POST path=/46322026/11/11 22:35:43 INFO Vacuumed table table=closures46332026/11/11 22:35:44 INFO Vacuumed table table=objects46342026/11/11 22:35:44 INFO Completed push id=29 objects=24 duration=6.192ms46352026/11/11 22:35:44 INFO Received push request method=POST path=/46362026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=046372026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period46382026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=046392026/11/11 22:35:44 INFO Received uploads request method=POST path=/46402026/11/11 22:35:44 INFO Received complete upload request method=POST path=/46412026/11/11 22:35:44 INFO Received complete upload request method=POST path=/46422026/11/11 22:35:44 INFO Completed upload id=21 objects=25 duration=466.125µs46432026/11/11 22:35:44 INFO Completed upload id=31 objects=3 duration=6.777708ms46442026/11/11 22:35:44 INFO Received uploads request method=POST path=/46452026/11/11 22:35:44 INFO Received complete upload request method=POST path=/46462026/11/11 22:35:44 INFO Completed upload id=22 objects=2 duration=263.791µs46472026/11/11 22:35:44 INFO Vacuumed table table=pending_closures46482026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=046492026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period46502026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046512026/11/11 22:35:44 INFO Received complete push request method=POST path=/46522026/11/11 22:35:44 INFO Vacuumed table table=pending_closures46532026/11/11 22:35:44 INFO Completed push id=11 objects=6 duration=422.291µs46542026/11/11 22:35:44 INFO Received complete push request method=POST path=/46552026/11/11 22:35:44 INFO Received complete push request method=POST path=/46562026/11/11 22:35:44 INFO Vacuumed table table=pending_objects46572026/11/11 22:35:44 INFO Completed push id=23 objects=6 duration=534.709µs46582026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads46592026/11/11 22:35:44 INFO Completed push id=17 objects=22 duration=917.417µs46602026/11/11 22:35:44 INFO Vacuumed table table=pending_objects46612026/11/11 22:35:44 INFO Vacuumed table table=closures46622026/11/11 22:35:44 INFO Received complete push request method=POST path=/46632026/11/11 22:35:44 INFO Received uploads request method=POST path=/46642026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads46652026/11/11 22:35:44 INFO Vacuumed table table=objects46662026/11/11 22:35:44 INFO Completed push id=24 objects=6 duration=281.166µs46672026/11/11 22:35:44 INFO Vacuumed table table=closures46682026/11/11 22:35:44 INFO Received complete upload request method=POST path=/46692026/11/11 22:35:44 INFO Vacuumed table table=objects46702026/11/11 22:35:44 INFO Completed upload id=18 objects=2 duration=759µs46712026/11/11 22:35:44 INFO Received push request method=POST path=/46722026/11/11 22:35:44 INFO Received push request method=POST path=/46732026/11/11 22:35:44 INFO Received complete push request method=POST path=/46742026/11/11 22:35:44 INFO Completed push id=19 objects=14 duration=436.167µs46752026/11/11 22:35:44 INFO Received complete push request method=POST path=/46762026/11/11 22:35:44 INFO Completed push id=20 objects=13 duration=835.75µs46772026/11/11 22:35:44 INFO Received uploads request method=POST path=/46782026/11/11 22:35:44 INFO Received complete push request method=POST path=/46792026/11/11 22:35:44 INFO Completed push id=22 objects=4 duration=226.083µs46802026/11/11 22:35:44 INFO Received complete upload request method=POST path=/46812026/11/11 22:35:44 INFO Completed upload id=34 objects=24 duration=269.042µs46822026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=046832026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period46842026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=046852026/11/11 22:35:44 INFO Vacuumed table table=pending_closures46862026/11/11 22:35:44 INFO Received complete push request method=POST path=/46872026/11/11 22:35:44 INFO Completed push id=25 objects=7 duration=453.667µs46882026/11/11 22:35:44 INFO Vacuumed table table=pending_objects46892026/11/11 22:35:44 INFO Received complete upload request method=POST path=/46902026/11/11 22:35:44 INFO Received complete push request method=POST path=/46912026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads46922026/11/11 22:35:44 INFO Completed upload id=23 objects=7 duration=362.292µs46932026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=3 old-closures-deleted=1 objects-marked-for-deletion=3 objects-deleted-after-grace-period=3 objects-failed-to-delete=046942026/11/11 22:35:44 INFO Vacuumed table table=closures46952026/11/11 22:35:44 INFO Vacuumed table table=pending_closures46962026/11/11 22:35:44 INFO Completed push id=9 objects=24 duration=6.620125ms46972026/11/11 22:35:44 INFO Vacuumed table table=objects46982026/11/11 22:35:44 INFO Received complete push request method=POST path=/46992026/11/11 22:35:44 INFO Completed push id=24 objects=5 duration=476.583µs47002026/11/11 22:35:44 INFO Vacuumed table table=pending_objects47012026/11/11 22:35:44 INFO Received uploads request method=POST path=/47022026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads47032026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47042026/11/11 22:35:44 INFO Completed upload id=20 objects=6 duration=317.25µs47052026/11/11 22:35:44 INFO Vacuumed table table=closures47062026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47072026/11/11 22:35:44 INFO Completed upload id=25 objects=2 duration=334.958µs47082026/11/11 22:35:44 INFO Received uploads request method=POST path=/47092026/11/11 22:35:44 INFO Received uploads request method=POST path=/47102026/11/11 22:35:44 INFO Vacuumed table table=objects47112026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47122026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47132026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47142026/11/11 22:35:44 INFO Completed upload id=26 objects=20 duration=404.208µs47152026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47162026/11/11 22:35:44 INFO Completed upload id=10 objects=10 duration=6.644292ms47172026/11/11 22:35:44 INFO Completed upload id=21 objects=2 duration=6.632959ms47182026/11/11 22:35:44 INFO Received push request method=POST path=/47192026/11/11 22:35:44 INFO Completed upload id=13 objects=7 duration=333.791µs47202026/11/11 22:35:44 INFO Received uploads request method=POST path=/47212026/11/11 22:35:44 INFO Received uploads request method=POST path=/47222026/11/11 22:35:44 INFO Received uploads request method=POST path=/47232026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47242026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=047252026/11/11 22:35:44 INFO Completed upload id=20 objects=4 duration=236.166µs47262026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period47272026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=047282026/11/11 22:35:44 INFO Received push request method=POST path=/47292026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47302026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047312026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47322026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047332026/11/11 22:35:44 INFO Received push request method=POST path=/47342026/11/11 22:35:44 INFO Completed upload id=12 objects=6 duration=273.625µs47352026/11/11 22:35:44 INFO Vacuumed table table=pending_closures47362026/11/11 22:35:44 INFO Vacuumed table table=pending_closures47372026/11/11 22:35:44 INFO Completed upload id=23 objects=7 duration=5.560958ms47382026/11/11 22:35:44 INFO Vacuumed table table=pending_objects47392026/11/11 22:35:44 INFO Vacuumed table table=pending_objects47402026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads47412026/11/11 22:35:44 INFO Received complete push request method=POST path=/47422026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads47432026/11/11 22:35:44 INFO Vacuumed table table=closures47442026/11/11 22:35:44 INFO Vacuumed table table=closures47452026/11/11 22:35:44 INFO Completed push id=17 objects=3 duration=7.148625ms47462026/11/11 22:35:44 INFO Vacuumed table table=objects47472026/11/11 22:35:44 INFO Vacuumed table table=objects47482026/11/11 22:35:44 INFO Received uploads request method=POST path=/47492026/11/11 22:35:44 INFO Received uploads request method=POST path=/47502026/11/11 22:35:44 INFO Received complete push request method=POST path=/47512026/11/11 22:35:44 INFO Received complete push request method=POST path=/47522026/11/11 22:35:44 INFO Received push request method=POST path=/47532026/11/11 22:35:44 INFO Completed push id=14 objects=3 duration=283.417µs47542026/11/11 22:35:44 INFO Completed push id=28 objects=7 duration=6.2315ms47552026/11/11 22:35:44 INFO Received push request method=POST path=/47562026/11/11 22:35:44 INFO Received complete push request method=POST path=/47572026/11/11 22:35:44 INFO Completed push id=24 objects=24 duration=977.958µs47582026/11/11 22:35:44 INFO Received complete push request method=POST path=/47592026/11/11 22:35:44 INFO Completed push id=23 objects=5 duration=344.208µs47602026/11/11 22:35:44 INFO Received push request method=POST path=/47612026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=047622026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period47632026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47642026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047652026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=047662026/11/11 22:35:44 INFO Completed upload id=24 objects=3 duration=274.875µs47672026/11/11 22:35:44 INFO Vacuumed table table=pending_closures47682026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period47692026/11/11 22:35:44 INFO Received complete push request method=POST path=/47702026/11/11 22:35:44 INFO Vacuumed table table=pending_objects47712026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047722026/11/11 22:35:44 INFO Completed push id=25 objects=4 duration=242.792µs47732026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads47742026/11/11 22:35:44 INFO Vacuumed table table=closures47752026/11/11 22:35:44 INFO Vacuumed table table=objects47762026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47772026/11/11 22:35:44 INFO Vacuumed table table=pending_closures47782026/11/11 22:35:44 INFO Completed upload id=30 objects=6 duration=297.25µs47792026/11/11 22:35:44 INFO Received uploads request method=POST path=/47802026/11/11 22:35:44 INFO Vacuumed table table=pending_objects47812026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads47822026/11/11 22:35:44 INFO Received complete push request method=POST path=/47832026/11/11 22:35:44 INFO Vacuumed table table=closures47842026/11/11 22:35:44 INFO Received uploads request method=POST path=/47852026/11/11 22:35:44 INFO Completed push id=31 objects=5 duration=332.375µs47862026/11/11 22:35:44 INFO Vacuumed table table=objects47872026/11/11 22:35:44 INFO Received push request method=POST path=/47882026/11/11 22:35:44 INFO Received complete upload request method=POST path=/47892026/11/11 22:35:44 INFO Completed upload id=26 objects=24 duration=739.292µs47902026/11/11 22:35:44 INFO Received uploads request method=POST path=/47912026/11/11 22:35:44 INFO Received push request method=POST path=/47922026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=047932026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period47942026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=047952026/11/11 22:35:44 INFO Vacuumed table table=pending_closures47962026/11/11 22:35:44 INFO Received uploads request method=POST path=/47972026/11/11 22:35:44 INFO Vacuumed table table=pending_objects47982026/11/11 22:35:44 INFO Received uploads request method=POST path=/47992026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads48002026/11/11 22:35:44 INFO Vacuumed table table=closures48012026/11/11 22:35:44 INFO Vacuumed table table=objects48022026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=048032026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period48042026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048052026/11/11 22:35:44 INFO Vacuumed table table=pending_closures48062026/11/11 22:35:44 INFO Vacuumed table table=pending_objects48072026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads48082026/11/11 22:35:44 INFO Received push request method=POST path=/48092026/11/11 22:35:44 INFO Vacuumed table table=closures48102026/11/11 22:35:44 INFO Vacuumed table table=objects48112026/11/11 22:35:44 INFO Received uploads request method=POST path=/48122026/11/11 22:35:44 INFO Received uploads request method=POST path=/48132026/11/11 22:35:44 INFO Received uploads request method=POST path=/48142026/11/11 22:35:44 INFO Received uploads request method=POST path=/48152026/11/11 22:35:44 INFO Received complete push request method=POST path=/48162026/11/11 22:35:44 INFO Received complete push request method=POST path=/48172026/11/11 22:35:44 INFO Completed push id=32 objects=26 duration=387.833µs48182026/11/11 22:35:44 INFO Completed push id=18 objects=6 duration=6.17225ms48192026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48202026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48212026/11/11 22:35:44 INFO Completed upload id=33 objects=2 duration=225.125µs48222026/11/11 22:35:44 INFO Completed upload id=23 objects=7 duration=4.2775ms48232026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48242026/11/11 22:35:44 INFO Completed upload id=23 objects=9 duration=373.875µs48252026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48262026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48272026/11/11 22:35:44 INFO Completed upload id=34 objects=5 duration=348.167µs48282026/11/11 22:35:44 INFO Completed upload id=26 objects=5 duration=456µs48292026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48302026/11/11 22:35:44 INFO Completed upload id=35 objects=11 duration=197.208µs48312026/11/11 22:35:44 INFO Received push request method=POST path=/48322026/11/11 22:35:44 INFO Received complete push request method=POST path=/48332026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48342026/11/11 22:35:44 INFO Completed upload id=36 objects=3 duration=159.708µs48352026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48362026/11/11 22:35:44 INFO Completed push id=27 objects=3 duration=450.375µs48372026/11/11 22:35:44 INFO Completed upload id=24 objects=18 duration=262.208µs48382026/11/11 22:35:44 INFO Received uploads request method=POST path=/48392026/11/11 22:35:44 INFO Received complete upload request method=POST path=/48402026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=048412026/11/11 22:35:44 INFO Completed upload id=28 objects=5 duration=438.25µs48422026/11/11 22:35:44 INFO Received complete push request method=POST path=/48432026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period48442026/11/11 22:35:44 INFO Received push request method=POST path=/48452026/11/11 22:35:44 INFO Received complete push request method=POST path=/48462026/11/11 22:35:44 INFO Completed push id=25 objects=2 duration=492.583µs48472026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048482026/11/11 22:35:44 INFO Completed push id=29 objects=17 duration=275.292µs48492026/11/11 22:35:44 INFO Received complete push request method=POST path=/48502026/11/11 22:35:44 INFO Received complete push request method=POST path=/48512026/11/11 22:35:44 INFO Completed push id=27 objects=4 duration=447.458µs48522026/11/11 22:35:44 INFO Vacuumed table table=pending_closures48532026/11/11 22:35:44 INFO Completed push id=16 objects=26 duration=4.468166ms48542026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=048552026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period48562026/11/11 22:35:44 INFO Aborted multipart uploads count=0 kept=048572026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=1 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048582026/11/11 22:35:44 INFO Vacuumed table table=pending_objects48592026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads48602026/11/11 22:35:44 WARN Force mode enabled - objects will be deleted immediately without grace period48612026/11/11 22:35:44 INFO Vacuumed table table=closures48622026/11/11 22:35:44 INFO Vacuumed table table=pending_closures48632026/11/11 22:35:44 INFO Vacuumed table table=objects48642026/11/11 22:35:44 INFO Garbage collection completed failed-uploads-deleted=4 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=048652026/11/11 22:35:44 INFO Vacuumed table table=pending_closures48662026/11/11 22:35:44 INFO Vacuumed table table=pending_objects48672026/11/11 22:35:44 INFO Vacuumed table table=pending_objects48682026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads48692026/11/11 22:35:44 INFO Vacuumed table table=multipart_uploads48702026/11/11 22:35:44 INFO Vacuumed table table=closures48712026/11/11 22:35:44 INFO Vacuumed table table=objects48722026/11/11 22:35:45 INFO Vacuumed table table=closures48732026/11/11 22:35:45 INFO Vacuumed table table=objects48742026/11/11 22:35:45 INFO Received complete push request method=POST path=/48752026/11/11 22:35:45 INFO Completed push id=27 objects=6 duration=1.01375ms48762026/11/11 22:35:45 INFO Received complete upload request method=POST path=/48772026/11/11 22:35:45 INFO Received complete upload request method=POST path=/48782026/11/11 22:35:45 INFO Completed upload id=15 objects=2 duration=343.25µs48792026/11/11 22:35:45 INFO Completed upload id=27 objects=26 duration=8.231709ms48802026/11/11 22:35:45 INFO Received complete push request method=POST path=/48812026/11/11 22:35:45 INFO Completed push id=28 objects=6 duration=331.042µs48822026/11/11 22:35:45 INFO Received complete push request method=POST path=/48832026/11/11 22:35:45 INFO Completed push id=26 objects=23 duration=393.25µs48842026/11/11 22:35:45 INFO Received complete push request method=POST path=/48852026/11/11 22:35:45 INFO Completed push id=29 objects=6 duration=470µs48862026/11/11 22:35:45 INFO Received push request method=POST path=/48872026/11/11 22:35:45 INFO Received uploads request method=POST path=/48882026/11/11 22:35:45 INFO Received uploads request method=POST path=/48892026/11/11 22:35:45 INFO Received complete upload request method=POST path=/48902026/11/11 22:35:45 INFO Completed upload id=26 objects=8 duration=211.875µs48912026/11/11 22:35:45 INFO Received complete push request method=POST path=/48922026/11/11 22:35:45 INFO Completed push id=28 objects=26 duration=674.958µs48932026/11/11 22:35:45 INFO Received complete push request method=POST path=/48942026/11/11 22:35:45 INFO Completed push id=28 objects=14 duration=317.75µs48952026/11/11 22:35:45 INFO Received complete push request method=POST path=/48962026/11/11 22:35:45 INFO Completed push id=30 objects=3 duration=184.917µs48972026/11/11 22:35:45 INFO Received push request method=POST path=/48982026/11/11 22:35:45 INFO Received complete push request method=POST path=/48992026/11/11 22:35:45 INFO Completed push id=32 objects=19 duration=303.75µs49002026/11/11 22:35:45 INFO Received uploads request method=POST path=/49012026/11/11 22:35:45 INFO Aborted multipart uploads count=0 kept=049022026/11/11 22:35:45 INFO Aborted multipart uploads count=0 kept=049032026/11/11 22:35:45 WARN Force mode enabled - objects will be deleted immediately without grace period49042026/11/11 22:35:45 WARN Force mode enabled - objects will be deleted immediately without grace period49052026/11/11 22:35:45 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049062026/11/11 22:35:45 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049072026/11/11 22:35:45 INFO Vacuumed table table=pending_closures49082026/11/11 22:35:45 INFO Vacuumed table table=pending_objects49092026/11/11 22:35:45 INFO Vacuumed table table=multipart_uploads49102026/11/11 22:35:45 INFO Vacuumed table table=closures49112026/11/11 22:35:45 INFO Vacuumed table table=pending_closures49122026/11/11 22:35:45 INFO Vacuumed table table=objects49132026/11/11 22:35:45 INFO Received uploads request method=POST path=/49142026/11/11 22:35:45 INFO Vacuumed table table=pending_objects49152026/11/11 22:35:45 INFO Vacuumed table table=multipart_uploads49162026/11/11 22:35:45 INFO Vacuumed table table=closures49172026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49182026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49192026/11/11 22:35:45 INFO Completed upload id=21 objects=9 duration=586.5µs49202026/11/11 22:35:45 INFO Completed upload id=13 objects=14 duration=890.292µs49212026/11/11 22:35:45 INFO Vacuumed table table=objects49222026/11/11 22:35:45 INFO Aborted multipart uploads count=0 kept=049232026/11/11 22:35:45 INFO Received complete push request method=POST path=/49242026/11/11 22:35:45 INFO Completed push id=25 objects=10 duration=377.667µs49252026/11/11 22:35:45 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049262026/11/11 22:35:45 INFO Vacuumed table table=pending_closures49272026/11/11 22:35:45 INFO Vacuumed table table=pending_objects49282026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49292026/11/11 22:35:45 INFO Vacuumed table table=multipart_uploads49302026/11/11 22:35:45 INFO Completed upload id=29 objects=5 duration=6.651625ms49312026/11/11 22:35:45 INFO Vacuumed table table=closures49322026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49332026/11/11 22:35:45 INFO Completed upload id=30 objects=2 duration=185.417µs49342026/11/11 22:35:45 INFO Vacuumed table table=objects49352026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49362026/11/11 22:35:45 INFO Completed upload id=30 objects=8 duration=305.667µs49372026/11/11 22:35:45 INFO Received complete push request method=POST path=/49382026/11/11 22:35:45 INFO Received complete push request method=POST path=/49392026/11/11 22:35:45 INFO Completed push id=31 objects=20 duration=403.167µs49402026/11/11 22:35:45 INFO Completed push id=27 objects=15 duration=697.667µs49412026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49422026/11/11 22:35:45 INFO Completed upload id=32 objects=5 duration=256.417µs49432026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49442026/11/11 22:35:45 INFO Completed upload id=33 objects=3 duration=117.209µs49452026/11/11 22:35:45 INFO Aborted multipart uploads count=0 kept=049462026/11/11 22:35:45 INFO Received complete push request method=POST path=/49472026/11/11 22:35:45 WARN Force mode enabled - objects will be deleted immediately without grace period49482026/11/11 22:35:45 INFO Completed push id=31 objects=6 duration=6.642917ms49492026/11/11 22:35:45 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049502026/11/11 22:35:45 INFO Received uploads request method=POST path=/49512026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49522026/11/11 22:35:45 INFO Vacuumed table table=pending_closures49532026/11/11 22:35:45 INFO Completed upload id=31 objects=6 duration=240.292µs49542026/11/11 22:35:45 INFO Vacuumed table table=pending_objects49552026/11/11 22:35:45 INFO Vacuumed table table=multipart_uploads49562026/11/11 22:35:45 INFO Vacuumed table table=closures49572026/11/11 22:35:45 INFO Vacuumed table table=objects49582026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49592026/11/11 22:35:45 INFO Completed upload id=32 objects=4 duration=394.541µs49602026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49612026/11/11 22:35:45 INFO Completed upload id=33 objects=10 duration=243.291µs49622026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49632026/11/11 22:35:45 INFO Completed upload id=34 objects=23 duration=379.792µs49642026/11/11 22:35:45 INFO Received complete push request method=POST path=/49652026/11/11 22:35:45 INFO Completed push id=28 objects=19 duration=484.208µs49662026/11/11 22:35:45 INFO Received complete push request method=POST path=/49672026/11/11 22:35:45 INFO Completed push id=35 objects=6 duration=424.25µs49682026/11/11 22:35:45 INFO Aborted multipart uploads count=0 kept=049692026/11/11 22:35:45 WARN Force mode enabled - objects will be deleted immediately without grace period49702026/11/11 22:35:45 INFO Garbage collection completed failed-uploads-deleted=2 old-closures-deleted=1 objects-marked-for-deletion=0 objects-deleted-after-grace-period=1 objects-failed-to-delete=049712026/11/11 22:35:45 INFO Vacuumed table table=pending_closures49722026/11/11 22:35:45 INFO Vacuumed table table=pending_objects49732026/11/11 22:35:45 INFO Vacuumed table table=multipart_uploads49742026/11/11 22:35:45 INFO Vacuumed table table=closures49752026/11/11 22:35:45 INFO Vacuumed table table=objects49762026/11/11 22:35:45 INFO Received complete push request method=POST path=/49772026/11/11 22:35:45 INFO Completed push id=29 objects=10 duration=361.333µs49782026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49792026/11/11 22:35:45 INFO Completed upload id=30 objects=6 duration=415.25µs49802026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49812026/11/11 22:35:45 INFO Completed upload id=31 objects=5 duration=341.75µs49822026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49832026/11/11 22:35:45 INFO Completed upload id=34 objects=3 duration=347.459µs49842026/11/11 22:35:45 INFO Aborted multipart uploads count=0 kept=049852026/11/11 22:35:45 INFO Received complete push request method=POST path=/49862026/11/11 22:35:45 WARN Force mode enabled - objects will be deleted immediately without grace period49872026/11/11 22:35:45 INFO Completed push id=1 objects=9 duration=386.5µs49882026/11/11 22:35:45 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=049892026/11/11 22:35:45 INFO Vacuumed table table=pending_closures49902026/11/11 22:35:45 INFO Vacuumed table table=pending_objects49912026/11/11 22:35:45 INFO Vacuumed table table=multipart_uploads49922026/11/11 22:35:45 INFO Vacuumed table table=closures49932026/11/11 22:35:45 INFO Vacuumed table table=objects49942026/11/11 22:35:45 INFO Received complete upload request method=POST path=/49952026/11/11 22:35:45 INFO Completed upload id=2 objects=7 duration=1.325292ms49962026/11/11 22:35:46 INFO Received complete upload request method=POST path=/49972026/11/11 22:35:46 INFO Completed upload id=8 objects=6 duration=1.338667ms49982026/11/11 22:35:46 INFO Received complete upload request method=POST path=/49992026/11/11 22:35:46 INFO Completed upload id=12 objects=9 duration=1.422208ms50002026/11/11 22:35:46 INFO Received complete upload request method=POST path=/50012026/11/11 22:35:46 INFO Completed upload id=18 objects=22 duration=1.521625ms50022026/11/11 22:35:46 INFO Received complete upload request method=POST path=/50032026/11/11 22:35:46 INFO Completed upload id=21 objects=8 duration=657.75µs50042026/11/11 22:35:46 INFO Received complete upload request method=POST path=/50052026/11/11 22:35:46 INFO Completed upload id=22 objects=7 duration=769.333µs50062026/11/11 22:35:46 INFO Received complete push request method=POST path=/50072026/11/11 22:35:46 INFO Completed push id=24 objects=5 duration=436.166µs50082026/11/11 22:35:46 INFO Received complete upload request method=POST path=/50092026/11/11 22:35:46 INFO Completed upload id=25 objects=8 duration=313.583µs50102026/11/11 22:35:46 INFO Received complete push request method=POST path=/50112026/11/11 22:35:46 INFO Completed push id=26 objects=4 duration=357.917µs50122026/11/11 22:35:46 INFO Received complete push request method=POST path=/50132026/11/11 22:35:46 INFO Completed push id=30 objects=2 duration=274.583µs50142026/11/11 22:35:46 INFO Received complete push request method=POST path=/50152026/11/11 22:35:46 INFO Completed push id=32 objects=7 duration=322.25µs50162026/11/11 22:35:46 INFO Received complete upload request method=POST path=/50172026/11/11 22:35:46 INFO Completed upload id=33 objects=6 duration=227.791µs50182026/11/11 22:35:46 INFO Received complete upload request method=POST path=/50192026/11/11 22:35:46 INFO Completed upload id=34 objects=3 duration=214.416µs50202026/11/11 22:35:46 INFO Aborted multipart uploads count=0 kept=050212026/11/11 22:35:46 WARN Force mode enabled - objects will be deleted immediately without grace period50222026/11/11 22:35:46 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=0 objects-marked-for-deletion=0 objects-deleted-after-grace-period=0 objects-failed-to-delete=050232026/11/11 22:35:46 INFO Vacuumed table table=pending_closures50242026/11/11 22:35:46 INFO Vacuumed table table=pending_objects50252026/11/11 22:35:46 INFO Vacuumed table table=multipart_uploads50262026/11/11 22:35:46 INFO Vacuumed table table=closures50272026/11/11 22:35:46 INFO Vacuumed table table=objects5028--- PASS: FuzzPushGC (0.00s)5029 --- PASS: FuzzPushGC/seed#8 (7.00s)5030 --- PASS: FuzzPushGC/seed#0 (7.94s)5031 --- PASS: FuzzPushGC/seed#5 (8.13s)5032 --- PASS: FuzzPushGC/seed#14 (9.33s)5033 --- PASS: FuzzPushGC/seed#15 (9.67s)5034 --- PASS: FuzzPushGC/seed#4 (11.03s)5035 --- PASS: FuzzPushGC/seed#3 (13.63s)5036 --- PASS: FuzzPushGC/seed#2 (13.96s)5037 --- PASS: FuzzPushGC/seed#9 (14.15s)5038 --- PASS: FuzzPushGC/seed#11 (14.73s)5039 --- PASS: FuzzPushGC/seed#1 (14.79s)5040 --- PASS: FuzzPushGC/seed#7 (15.01s)5041 --- PASS: FuzzPushGC/seed#6 (15.13s)5042 --- PASS: FuzzPushGC/seed#12 (15.42s)5043 --- PASS: FuzzPushGC/seed#13 (15.51s)5044 --- PASS: FuzzPushGC/seed#10 (16.50s)5045PASS5046{"timestamp":"2026-11-11T22:35:46.7365Z","level":"ERROR","message":"HTTP transport failed","event":"http_transport_failed","component":"server","subsystem":"transport","peer_addr":"127.0.0.1:55421","error_kind":"io_error","error":"Cancelled","result":"transport_error","target":"rustfs::server::http","filename":"rustfs/src/server/http.rs","line_number":2561,"threadName":"rustfs-worker","threadId":"ThreadId(5)"}50472026-11-11 22:35:46.885 UTC [65917] LOG: received smart shutdown request50482026-11-11 22:35:46.886 UTC [65917] LOG: background worker "logical replication launcher" (PID 65927) exited with exit code 150492026-11-11 22:35:47.848 UTC [65922] LOG: checkpoint complete: wrote 3411 buffers (20.8%), wrote 5 SLRU buffers; 0 WAL file(s) added, 0 removed, 33 recycled; write=26.899 s, sync=0.834 s, total=27.816 s; sync files=42366, longest=0.020 s, average=0.001 s; distance=533081 kB, estimate=533081 kB; lsn=0/279A4588, redo lsn=0/2202366050502026-11-11 22:35:47.850 UTC [65922] LOG: shutting down50512026-11-11 22:35:47.850 UTC [65922] LOG: checkpoint starting: shutdown immediate50522026-11-11 22:35:48.344 UTC [65922] LOG: checkpoint complete: wrote 8949 buffers (54.6%), wrote 4 SLRU buffers; 0 WAL file(s) added, 0 removed, 5 recycled; write=0.437 s, sync=0.049 s, total=0.495 s; sync files=2954, longest=0.001 s, average=0.001 s; distance=91651 kB, estimate=488938 kB; lsn=0/279A4600, redo lsn=0/279A460050532026-11-11 22:35:48.351 UTC [65917] LOG: database system is shut down5054Running OIDC tests...5055=== RUN TestAudienceForIssuer5056=== PAUSE TestAudienceForIssuer5057=== RUN TestGlobMatch5058=== PAUSE TestGlobMatch5059=== RUN TestValidateToken_ValidToken5060=== PAUSE TestValidateToken_ValidToken5061=== RUN TestValidateToken_WrongAudience5062=== PAUSE TestValidateToken_WrongAudience5063=== RUN TestValidateToken_Expired5064=== PAUSE TestValidateToken_Expired5065=== RUN TestValidateToken_BoundClaimsMismatch5066=== PAUSE TestValidateToken_BoundClaimsMismatch5067=== RUN TestValidateToken_BoundSubjectMismatch5068=== PAUSE TestValidateToken_BoundSubjectMismatch5069=== RUN TestValidateToken_MultipleProviders5070=== PAUSE TestValidateToken_MultipleProviders5071=== RUN TestValidateToken_NoMatchingProvider5072=== PAUSE TestValidateToken_NoMatchingProvider5073=== RUN TestValidateToken_KubernetesServiceAccount5074=== PAUSE TestValidateToken_KubernetesServiceAccount5075=== RUN TestNewValidator_KubernetesRequiresCA5076=== PAUSE TestNewValidator_KubernetesRequiresCA5077=== RUN TestValidateToken_KubernetesIssuerFromOwnToken5078=== PAUSE TestValidateToken_KubernetesIssuerFromOwnToken5079=== RUN TestPins_ReservedForMatchingRule5080=== PAUSE TestPins_ReservedForMatchingRule5081=== RUN TestPins_TopLevelShorthand5082=== PAUSE TestPins_TopLevelShorthand5083=== RUN TestPins_ConfigValidation5084=== PAUSE TestPins_ConfigValidation5085=== RUN TestScopes_LegacyProviderDefaultsToWrite5086=== PAUSE TestScopes_LegacyProviderDefaultsToWrite5087=== RUN TestScopes_Rules5088=== PAUSE TestScopes_Rules5089=== RUN TestScopes_ConfigValidation5090=== PAUSE TestScopes_ConfigValidation5091=== CONT TestAudienceForIssuer5092--- PASS: TestAudienceForIssuer (0.00s)5093=== CONT TestValidateToken_NoMatchingProvider5094=== CONT TestPins_ConfigValidation5095=== CONT TestValidateToken_KubernetesServiceAccount5096=== CONT TestPins_ReservedForMatchingRule5097=== CONT TestValidateToken_KubernetesIssuerFromOwnToken5098=== CONT TestValidateToken_Expired5099=== CONT TestPins_TopLevelShorthand5100--- PASS: TestPins_ConfigValidation (0.00s)5101=== CONT TestScopes_ConfigValidation5102--- PASS: TestScopes_ConfigValidation (0.00s)5103=== CONT TestScopes_Rules5104=== CONT TestValidateToken_ValidToken5105=== CONT TestValidateToken_WrongAudience5106=== CONT TestScopes_LegacyProviderDefaultsToWrite5107=== CONT TestNewValidator_KubernetesRequiresCA5108=== CONT TestGlobMatch5109=== RUN TestGlobMatch/foo_foo5110=== PAUSE TestGlobMatch/foo_foo5111=== RUN TestGlobMatch/foo_bar5112=== PAUSE TestGlobMatch/foo_bar5113=== RUN TestGlobMatch/*_5114=== PAUSE TestGlobMatch/*_5115=== RUN TestGlobMatch/*_anything5116=== PAUSE TestGlobMatch/*_anything5117=== RUN TestGlobMatch/foo*_foo5118=== PAUSE TestGlobMatch/foo*_foo5119=== RUN TestGlobMatch/foo*_foobar5120=== PAUSE TestGlobMatch/foo*_foobar5121=== RUN TestGlobMatch/foo*_bar5122=== PAUSE TestGlobMatch/foo*_bar5123=== RUN TestGlobMatch/*bar_bar5124=== PAUSE TestGlobMatch/*bar_bar5125=== RUN TestGlobMatch/*bar_foobar5126=== PAUSE TestGlobMatch/*bar_foobar5127=== RUN TestGlobMatch/*bar_foo5128=== PAUSE TestGlobMatch/*bar_foo5129=== RUN TestGlobMatch/foo*bar_foobar5130=== PAUSE TestGlobMatch/foo*bar_foobar5131=== RUN TestGlobMatch/foo*bar_foo123bar5132=== PAUSE TestGlobMatch/foo*bar_foo123bar5133=== RUN TestGlobMatch/foo*bar_foobarbaz5134=== PAUSE TestGlobMatch/foo*bar_foobarbaz5135=== RUN TestGlobMatch/*/*_foo/bar5136=== PAUSE TestGlobMatch/*/*_foo/bar5137=== RUN TestGlobMatch/*/*_foo5138=== PAUSE TestGlobMatch/*/*_foo5139=== RUN TestGlobMatch/refs/heads/*_refs/heads/main5140=== PAUSE TestGlobMatch/refs/heads/*_refs/heads/main5141=== RUN TestGlobMatch/refs/heads/*_refs/tags/v1.05142=== PAUSE TestGlobMatch/refs/heads/*_refs/tags/v1.05143=== RUN TestGlobMatch/refs/*/main_refs/heads/main5144=== PAUSE TestGlobMatch/refs/*/main_refs/heads/main5145=== RUN TestGlobMatch/fo?_foo5146=== PAUSE TestGlobMatch/fo?_foo5147=== RUN TestGlobMatch/fo?_fo5148=== PAUSE TestGlobMatch/fo?_fo5149=== RUN TestGlobMatch/fo?_fooo5150=== PAUSE TestGlobMatch/fo?_fooo5151=== RUN TestGlobMatch/?oo_foo5152=== PAUSE TestGlobMatch/?oo_foo5153=== RUN TestGlobMatch/?oo_boo5154=== PAUSE TestGlobMatch/?oo_boo5155=== RUN TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5156=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5157=== RUN TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5158=== PAUSE TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5159=== CONT TestGlobMatch/foo_foo5160=== CONT TestValidateToken_BoundSubjectMismatch5161=== CONT TestGlobMatch/*/*_foo/bar5162=== CONT TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main5163=== CONT TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main5164=== CONT TestGlobMatch/?oo_boo5165=== CONT TestGlobMatch/?oo_foo5166=== CONT TestGlobMatch/fo?_fooo5167=== CONT TestGlobMatch/fo?_fo5168=== CONT TestGlobMatch/fo?_foo5169=== CONT TestGlobMatch/refs/*/main_refs/heads/main5170=== CONT TestGlobMatch/refs/heads/*_refs/tags/v1.05171=== CONT TestGlobMatch/refs/heads/*_refs/heads/main5172=== CONT TestGlobMatch/*/*_foo5173=== CONT TestGlobMatch/*bar_bar5174=== CONT TestGlobMatch/foo*bar_foobarbaz5175=== CONT TestGlobMatch/foo*bar_foo123bar5176=== CONT TestGlobMatch/foo*bar_foobar5177=== CONT TestGlobMatch/*bar_foo5178=== CONT TestGlobMatch/*bar_foobar5179=== CONT TestGlobMatch/foo*_foo5180=== CONT TestGlobMatch/foo*_bar5181=== CONT TestGlobMatch/foo*_foobar5182=== CONT TestGlobMatch/*_5183=== CONT TestGlobMatch/*_anything5184=== CONT TestGlobMatch/foo_bar5185--- PASS: TestGlobMatch (0.00s)5186 --- PASS: TestGlobMatch/foo_foo (0.00s)5187 --- PASS: TestGlobMatch/*/*_foo/bar (0.00s)5188 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:otherorg/myrepo:ref:refs/heads/main (0.00s)5189 --- PASS: TestGlobMatch/repo:myorg/*:*_repo:myorg/myrepo:ref:refs/heads/main (0.00s)5190 --- PASS: TestGlobMatch/?oo_boo (0.00s)5191 --- PASS: TestGlobMatch/?oo_foo (0.00s)5192 --- PASS: TestGlobMatch/fo?_fooo (0.00s)5193 --- PASS: TestGlobMatch/fo?_fo (0.00s)5194 --- PASS: TestGlobMatch/fo?_foo (0.00s)5195 --- PASS: TestGlobMatch/refs/*/main_refs/heads/main (0.00s)5196 --- PASS: TestGlobMatch/refs/heads/*_refs/tags/v1.0 (0.00s)5197 --- PASS: TestGlobMatch/refs/heads/*_refs/heads/main (0.00s)5198 --- PASS: TestGlobMatch/*/*_foo (0.00s)5199 --- PASS: TestGlobMatch/*bar_bar (0.00s)5200 --- PASS: TestGlobMatch/foo*bar_foobarbaz (0.00s)5201 --- PASS: TestGlobMatch/foo*bar_foo123bar (0.00s)5202 --- PASS: TestGlobMatch/foo*bar_foobar (0.00s)5203 --- PASS: TestGlobMatch/*bar_foo (0.00s)5204 --- PASS: TestGlobMatch/*bar_foobar (0.00s)5205 --- PASS: TestGlobMatch/foo*_foo (0.00s)5206 --- PASS: TestGlobMatch/foo*_bar (0.00s)5207 --- PASS: TestGlobMatch/foo*_foobar (0.00s)5208 --- PASS: TestGlobMatch/*_ (0.00s)5209 --- PASS: TestGlobMatch/*_anything (0.00s)5210 --- PASS: TestGlobMatch/foo_bar (0.00s)5211=== CONT TestValidateToken_MultipleProviders5212=== CONT TestValidateToken_BoundClaimsMismatch52132026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55912/oidc52142026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55913/oidc5215--- PASS: TestValidateToken_ValidToken (0.06s)52162026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55917/oidc5217--- PASS: TestPins_ReservedForMatchingRule (0.07s)52182026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55921/oidc5219--- PASS: TestValidateToken_WrongAudience (0.07s)52202026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55918/oidc52212026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55925/oidc52222026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55924/oidc52232026/11/11 22:35:50 http: TLS handshake error from 127.0.0.1:55920: read tcp 127.0.0.1:55916->127.0.0.1:55920: use of closed network connection5224--- PASS: TestNewValidator_KubernetesRequiresCA (0.09s)5225--- PASS: TestScopes_LegacyProviderDefaultsToWrite (0.10s)5226--- PASS: TestValidateToken_Expired (0.11s)5227--- PASS: TestScopes_Rules (0.11s)5228--- PASS: TestValidateToken_BoundSubjectMismatch (0.09s)52292026/11/11 22:35:50 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:55930/oidc52302026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55932/oidc52312026/11/11 22:35:50 INFO OIDC provider initialized name=provider1 issuer=http://127.0.0.1:55911/oidc52322026/11/11 22:35:50 INFO OIDC provider initialized name=provider2 issuer=http://127.0.0.1:55934/oidc52332026/11/11 22:35:50 INFO OIDC provider initialized name=kubernetes issuer=https://127.0.0.1:559315234--- PASS: TestPins_TopLevelShorthand (0.14s)52352026/11/11 22:35:50 INFO OIDC provider initialized name=kubernetes issuer=https://oidc.eks.invalid/id/ABC1235236--- PASS: TestValidateToken_MultipleProviders (0.12s)5237--- PASS: TestValidateToken_NoMatchingProvider (0.15s)52382026/11/11 22:35:50 INFO OIDC provider initialized name=test issuer=http://127.0.0.1:55941/oidc5239--- PASS: TestValidateToken_KubernetesServiceAccount (0.15s)5240--- PASS: TestValidateToken_BoundClaimsMismatch (0.12s)5241--- PASS: TestValidateToken_KubernetesIssuerFromOwnToken (0.15s)5242PASS5243Running hook tests...5244=== RUN TestSendPathsEmpty5245=== PAUSE TestSendPathsEmpty5246=== RUN TestQueueEnqueueAndFetch5247=== PAUSE TestQueueEnqueueAndFetch5248=== RUN TestQueueDeduplication5249=== PAUSE TestQueueDeduplication5250=== RUN TestQueueRemove5251=== PAUSE TestQueueRemove5252=== RUN TestQueueFetchBatchLimit5253=== PAUSE TestQueueFetchBatchLimit5254=== RUN TestQueueRetryMovesToBack5255=== PAUSE TestQueueRetryMovesToBack5256=== RUN TestQueueFetchRemoveLifecycle5257=== PAUSE TestQueueFetchRemoveLifecycle5258=== RUN TestQueueConcurrentWriters5259=== PAUSE TestQueueConcurrentWriters5260=== RUN TestQueueRemoveLargeClosure5261=== PAUSE TestQueueRemoveLargeClosure5262=== RUN TestServerClientIntegration5263--- PASS: TestServerClientIntegration (0.00s)5264=== RUN TestServerQueueError52652026/11/11 22:35:50 ERROR Failed to queue paths error="permission denied" count=15266--- PASS: TestServerQueueError (0.00s)5267=== RUN TestGetListenerSocketActivation5268 server_test.go:145: systemd socket activation does not exist on darwin5269--- SKIP: TestGetListenerSocketActivation (0.00s)5270=== RUN TestServerStalledClientDoesNotBlockShutdown5271=== PAUSE TestServerStalledClientDoesNotBlockShutdown5272=== RUN TestServerBacksOffOnAcceptErrors5273=== PAUSE TestServerBacksOffOnAcceptErrors5274=== RUN TestDrainIsolatesPoisonPath5275=== PAUSE TestDrainIsolatesPoisonPath5276=== RUN TestRunNotBlockedByPoisonHead5277=== PAUSE TestRunNotBlockedByPoisonHead5278=== RUN TestDrainGivesUpWhenServerDown5279=== PAUSE TestDrainGivesUpWhenServerDown5280=== RUN TestFailedPathPrunedByLaterClosure5281=== PAUSE TestFailedPathPrunedByLaterClosure5282=== RUN TestWorkerUploadsAndRemoves5283=== PAUSE TestWorkerUploadsAndRemoves5284=== RUN TestWorkerSkipsGCdPaths5285=== PAUSE TestWorkerSkipsGCdPaths5286=== RUN TestWorkerPrunesClosureDeps5287=== PAUSE TestWorkerPrunesClosureDeps5288=== RUN TestDrainTimeout5289=== PAUSE TestDrainTimeout5290=== RUN TestWorkerRemoveFailureIsNotProgress5291=== PAUSE TestWorkerRemoveFailureIsNotProgress5292=== RUN TestWorkerKeepsPathItCannotStat5293=== PAUSE TestWorkerKeepsPathItCannotStat5294=== CONT TestSendPathsEmpty5295=== CONT TestRunNotBlockedByPoisonHead5296--- PASS: TestSendPathsEmpty (0.00s)5297=== CONT TestWorkerKeepsPathItCannotStat5298=== CONT TestWorkerRemoveFailureIsNotProgress5299=== CONT TestDrainTimeout5300=== CONT TestWorkerPrunesClosureDeps5301=== CONT TestWorkerSkipsGCdPaths5302=== CONT TestWorkerUploadsAndRemoves5303=== CONT TestFailedPathPrunedByLaterClosure5304=== CONT TestDrainGivesUpWhenServerDown5305=== CONT TestDrainIsolatesPoisonPath5306=== CONT TestQueueRetryMovesToBack5307=== CONT TestQueueFetchBatchLimit5308=== CONT TestQueueFetchRemoveLifecycle5309=== CONT TestServerBacksOffOnAcceptErrors5310=== CONT TestQueueRemove5311=== CONT TestServerStalledClientDoesNotBlockShutdown5312=== CONT TestQueueDeduplication53132026/11/11 22:35:50 ERROR Accept failed error="too many open files"5314=== CONT TestQueueRemoveLargeClosure5315=== CONT TestQueueEnqueueAndFetch5316=== CONT TestQueueConcurrentWriters53172026/11/11 22:35:50 ERROR Accept failed error="too many open files"53182026/11/11 22:35:50 INFO Uploading batch count=453192026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=45320--- PASS: TestQueueFetchBatchLimit (0.01s)53212026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainIsolatesPoisonPath1832321222/002/bbb53222026/11/11 22:35:50 INFO Upload queue status pending=25323--- PASS: TestQueueRetryMovesToBack (0.01s)53242026/11/11 22:35:50 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerSkipsGCdPaths3802254344/002/nonexistent53252026/11/11 22:35:50 INFO Upload queue status pending=353262026/11/11 22:35:50 INFO Uploading batch count=153272026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=153282026/11/11 22:35:50 INFO Upload queue status pending=25329--- PASS: TestQueueEnqueueAndFetch (0.01s)53302026/11/11 22:35:50 INFO Uploading batch count=153312026/11/11 22:35:50 INFO Uploading batch count=253322026/11/11 22:35:50 INFO Uploading batch count=153332026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=153342026/11/11 22:35:50 INFO Uploading batch count=153352026/11/11 22:35:50 INFO Uploading batch count=153362026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=153372026/11/11 22:35:50 ERROR Accept failed error="too many open files"5338--- PASS: TestQueueFetchRemoveLifecycle (0.02s)53392026/11/11 22:35:50 INFO Upload queue status pending=253402026/11/11 22:35:50 INFO Uploading batch count=253412026/11/11 22:35:50 INFO Uploading batch count=153422026/11/11 22:35:50 WARN Cannot stat store path, will retry later path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerKeepsPathItCannotStat4269260876/002/locked/aaa error="stat /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerKeepsPathItCannotStat4269260876/002/locked/aaa: permission denied"5343--- PASS: TestQueueRemove (0.02s)53442026/11/11 22:35:50 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerRemoveFailureIsNotProgress2695918298/002/nonexistent53452026/11/11 22:35:50 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153462026/11/11 22:35:50 INFO Uploading batch count=153472026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=153482026/11/11 22:35:50 WARN Cannot stat store path, will retry later path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerKeepsPathItCannotStat4269260876/002/locked/aaa error="stat /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerKeepsPathItCannotStat4269260876/002/locked/aaa: permission denied"53492026/11/11 22:35:50 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerRemoveFailureIsNotProgress2695918298/002/nonexistent53502026/11/11 22:35:50 INFO Uploading batch count=153512026/11/11 22:35:50 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153522026/11/11 22:35:50 WARN Store path no longer exists (garbage collected?), removing from queue path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerRemoveFailureIsNotProgress2695918298/002/nonexistent53532026/11/11 22:35:50 INFO Uploading batch count=253542026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=253552026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainGivesUpWhenServerDown2261271775/002/a53562026/11/11 22:35:50 INFO Uploading batch count=153572026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=15358--- PASS: TestQueueDeduplication (0.02s)53592026/11/11 22:35:50 ERROR Failed to remove paths from queue error="deleting paths: attempt to write a readonly database (8)" count=153602026/11/11 22:35:50 WARN Cannot stat store path, will retry later path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerKeepsPathItCannotStat4269260876/002/locked/aaa error="stat /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestWorkerKeepsPathItCannotStat4269260876/002/locked/aaa: permission denied"53612026/11/11 22:35:50 ERROR Drain finished with paths left in queue remaining=153622026/11/11 22:35:50 ERROR Drain finished with paths left in queue remaining=153632026/11/11 22:35:50 ERROR Drain finished with paths left in queue remaining=153642026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainGivesUpWhenServerDown2261271775/002/b5365--- PASS: TestWorkerRemoveFailureIsNotProgress (0.02s)53662026/11/11 22:35:50 INFO Uploading batch count=253672026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=253682026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainGivesUpWhenServerDown2261271775/002/c5369--- PASS: TestFailedPathPrunedByLaterClosure (0.02s)53702026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainGivesUpWhenServerDown2261271775/002/d53712026/11/11 22:35:50 INFO Uploading batch count=253722026/11/11 22:35:50 ERROR Upload failed error="upload failed" count=253732026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainGivesUpWhenServerDown2261271775/002/e53742026/11/11 22:35:50 ERROR Upload failed, will retry later error="upload failed" path=/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestDrainGivesUpWhenServerDown2261271775/002/f5375--- PASS: TestWorkerKeepsPathItCannotStat (0.02s)5376--- PASS: TestDrainIsolatesPoisonPath (0.02s)53772026/11/11 22:35:50 ERROR Drain finished with paths left in queue remaining=105378--- PASS: TestDrainGivesUpWhenServerDown (0.02s)5379--- PASS: TestWorkerSkipsGCdPaths (0.04s)5380--- PASS: TestWorkerPrunesClosureDeps (0.04s)53812026/11/11 22:35:50 ERROR Accept failed error="too many open files"5382--- PASS: TestWorkerUploadsAndRemoves (0.04s)5383--- PASS: TestQueueRemoveLargeClosure (0.05s)5384--- PASS: TestQueueConcurrentWriters (0.05s)53852026/11/11 22:35:50 ERROR Accept failed error="too many open files"53862026/11/11 22:35:50 ERROR Accept failed error="too many open files"53872026/11/11 22:35:50 ERROR Failed to decode request error="read unix /private/var/tb/7/scratch/bbb413e2ef876c00/build/hook1355983572/test.sock->: i/o timeout"53882026/11/11 22:35:50 ERROR Failed to write response error="write unix /private/var/tb/7/scratch/bbb413e2ef876c00/build/hook1355983572/test.sock->: i/o timeout"5389--- PASS: TestServerStalledClientDoesNotBlockShutdown (0.20s)53902026/11/11 22:35:50 ERROR Upload failed error="context deadline exceeded" count=253912026/11/11 22:35:50 ERROR Drain finished with paths left in queue remaining=45392--- PASS: TestDrainTimeout (0.22s)53932026/11/11 22:35:51 ERROR Accept failed error="too many open files"53942026/11/11 22:35:51 ERROR Accept failed error="too many open files"5395--- PASS: TestServerBacksOffOnAcceptErrors (0.64s)53962026/11/11 22:35:51 INFO Uploading batch count=153972026/11/11 22:35:51 INFO Uploading batch count=153982026/11/11 22:35:51 INFO Uploading batch count=153992026/11/11 22:35:51 ERROR Upload failed error="upload failed" count=154002026/11/11 22:35:51 INFO Uploading batch count=154012026/11/11 22:35:51 ERROR Upload failed error="upload failed" count=154022026/11/11 22:35:51 INFO Uploading batch count=154032026/11/11 22:35:51 ERROR Upload failed error="upload failed" count=154042026/11/11 22:35:51 INFO Uploading batch count=154052026/11/11 22:35:51 ERROR Upload failed error="upload failed" count=154062026/11/11 22:35:51 ERROR Drain finished with paths left in queue remaining=15407--- PASS: TestRunNotBlockedByPoisonHead (1.03s)5408PASS5409Running signing tests...5410=== RUN TestExternalSigner5411=== PAUSE TestExternalSigner5412=== RUN TestExternalSignerWrongPublicKey5413=== PAUSE TestExternalSignerWrongPublicKey5414=== RUN TestExternalSignerErrors5415=== PAUSE TestExternalSignerErrors5416=== RUN TestExternalSignerRestartsAfterCrash5417=== PAUSE TestExternalSignerRestartsAfterCrash5418=== RUN TestExternalSignerProgramErrorKeepsProcess5419=== PAUSE TestExternalSignerProgramErrorKeepsProcess5420=== RUN TestExternalSignerClose5421=== PAUSE TestExternalSignerClose5422=== RUN TestExternalSignerRejectsInvalidPublicKey5423=== PAUSE TestExternalSignerRejectsInvalidPublicKey5424=== RUN TestExternalSignerCancellation5425=== PAUSE TestExternalSignerCancellation5426=== RUN TestGenerateFingerprint5427=== PAUSE TestGenerateFingerprint5428=== RUN TestParseSigningKey5429=== PAUSE TestParseSigningKey5430=== RUN TestSign5431=== PAUSE TestSign5432=== RUN TestSignBatch5433=== PAUSE TestSignBatch5434=== RUN TestNilKeyPublicKey5435=== PAUSE TestNilKeyPublicKey5436=== RUN TestSignErrors5437=== PAUSE TestSignErrors5438=== CONT TestExternalSigner5439=== CONT TestExternalSignerCancellation5440=== CONT TestSign5441=== CONT TestExternalSignerProgramErrorKeepsProcess5442=== CONT TestGenerateFingerprint5443=== CONT TestExternalSignerClose5444=== RUN TestGenerateFingerprint/basic_with_references5445=== PAUSE TestGenerateFingerprint/basic_with_references5446=== RUN TestGenerateFingerprint/no_references5447=== PAUSE TestGenerateFingerprint/no_references5448=== RUN TestGenerateFingerprint/unsorted_references_get_sorted5449=== PAUSE TestGenerateFingerprint/unsorted_references_get_sorted5450=== RUN TestGenerateFingerprint/invalid_nar_hash_prefix5451=== PAUSE TestGenerateFingerprint/invalid_nar_hash_prefix5452=== RUN TestGenerateFingerprint/invalid_nar_hash_length5453=== PAUSE TestGenerateFingerprint/invalid_nar_hash_length5454=== RUN TestGenerateFingerprint/invalid_store_path_prefix5455=== PAUSE TestGenerateFingerprint/invalid_store_path_prefix5456=== RUN TestGenerateFingerprint/invalid_reference_prefix5457=== PAUSE TestGenerateFingerprint/invalid_reference_prefix5458=== CONT TestGenerateFingerprint/basic_with_references5459=== CONT TestSignErrors5460=== CONT TestNilKeyPublicKey5461--- PASS: TestNilKeyPublicKey (0.00s)5462=== CONT TestParseSigningKey5463=== RUN TestParseSigningKey/valid_32-byte_key5464=== PAUSE TestParseSigningKey/valid_32-byte_key5465=== RUN TestParseSigningKey/valid_32-byte_key_with_different_name5466=== PAUSE TestParseSigningKey/valid_32-byte_key_with_different_name5467=== RUN TestParseSigningKey/no_colon5468=== PAUSE TestParseSigningKey/no_colon5469=== RUN TestParseSigningKey/empty_name5470=== PAUSE TestParseSigningKey/empty_name5471=== RUN TestParseSigningKey/invalid_base645472=== PAUSE TestParseSigningKey/invalid_base645473=== RUN TestParseSigningKey/wrong_length5474=== CONT TestGenerateFingerprint/invalid_nar_hash_prefix5475=== CONT TestExternalSignerErrors5476=== RUN TestExternalSignerErrors/invalid_JSON5477=== CONT TestExternalSignerRestartsAfterCrash5478=== CONT TestExternalSignerWrongPublicKey5479=== CONT TestSignBatch5480=== CONT TestGenerateFingerprint/invalid_reference_prefix5481=== CONT TestGenerateFingerprint/invalid_store_path_prefix5482=== CONT TestGenerateFingerprint/invalid_nar_hash_length5483=== CONT TestGenerateFingerprint/no_references5484=== CONT TestGenerateFingerprint/unsorted_references_get_sorted5485=== CONT TestExternalSignerRejectsInvalidPublicKey5486--- PASS: TestGenerateFingerprint (0.00s)5487 --- PASS: TestGenerateFingerprint/basic_with_references (0.00s)5488 --- PASS: TestGenerateFingerprint/invalid_nar_hash_prefix (0.00s)5489 --- PASS: TestGenerateFingerprint/invalid_reference_prefix (0.00s)5490 --- PASS: TestGenerateFingerprint/invalid_store_path_prefix (0.00s)5491 --- PASS: TestGenerateFingerprint/invalid_nar_hash_length (0.00s)5492 --- PASS: TestGenerateFingerprint/no_references (0.00s)5493 --- PASS: TestGenerateFingerprint/unsorted_references_get_sorted (0.00s)5494=== RUN TestExternalSignerRejectsInvalidPublicKey/#005495=== PAUSE TestExternalSignerRejectsInvalidPublicKey/#005496=== PAUSE TestExternalSignerErrors/invalid_JSON5497=== RUN TestExternalSignerRejectsInvalidPublicKey/no-colon5498=== PAUSE TestExternalSignerRejectsInvalidPublicKey/no-colon5499=== PAUSE TestParseSigningKey/wrong_length5500=== CONT TestParseSigningKey/valid_32-byte_key5501=== RUN TestExternalSignerErrors/wrong_signatures_shape5502=== PAUSE TestExternalSignerErrors/wrong_signatures_shape5503=== CONT TestParseSigningKey/wrong_length5504=== CONT TestParseSigningKey/invalid_base645505=== RUN TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5506=== CONT TestParseSigningKey/empty_name5507=== PAUSE TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5508=== CONT TestParseSigningKey/no_colon5509=== CONT TestParseSigningKey/valid_32-byte_key_with_different_name5510=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5511=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5512=== RUN TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5513=== RUN TestExternalSignerErrors/wrong_shape5514=== PAUSE TestExternalSignerErrors/wrong_shape5515=== RUN TestExternalSignerErrors/null5516=== PAUSE TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5517=== CONT TestExternalSignerRejectsInvalidPublicKey/#005518=== CONT TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=5519=== CONT TestExternalSignerRejectsInvalidPublicKey/no-colon5520=== PAUSE TestExternalSignerErrors/null5521=== RUN TestExternalSignerErrors/too_few_signatures5522=== PAUSE TestExternalSignerErrors/too_few_signatures5523=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:invalid!5524=== CONT TestExternalSignerRejectsInvalidPublicKey/test-key:YQ==5525--- PASS: TestExternalSignerRejectsInvalidPublicKey (0.00s)5526 --- PASS: TestExternalSignerRejectsInvalidPublicKey/#00 (0.00s)5527 --- PASS: TestExternalSignerRejectsInvalidPublicKey/:AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= (0.00s)5528 --- PASS: TestExternalSignerRejectsInvalidPublicKey/no-colon (0.00s)5529 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:invalid! (0.00s)5530 --- PASS: TestExternalSignerRejectsInvalidPublicKey/test-key:YQ== (0.00s)5531=== RUN TestExternalSignerErrors/invalid_signature_base645532=== PAUSE TestExternalSignerErrors/invalid_signature_base645533=== RUN TestExternalSignerErrors/wrong_id5534=== PAUSE TestExternalSignerErrors/wrong_id5535=== RUN TestExternalSignerErrors/missing_signatures5536=== PAUSE TestExternalSignerErrors/missing_signatures5537=== RUN TestExternalSignerErrors/null_signatures5538=== PAUSE TestExternalSignerErrors/null_signatures5539=== RUN TestExternalSignerErrors/unrequested_key5540=== PAUSE TestExternalSignerErrors/unrequested_key5541=== RUN TestExternalSignerErrors/missing_signature_name5542=== PAUSE TestExternalSignerErrors/missing_signature_name5543=== RUN TestExternalSignerErrors/wrong_signature_name5544=== PAUSE TestExternalSignerErrors/wrong_signature_name5545=== RUN TestExternalSignerErrors/wrong_signature_length5546=== PAUSE TestExternalSignerErrors/wrong_signature_length5547=== RUN TestExternalSignerErrors/program_error5548=== PAUSE TestExternalSignerErrors/program_error5549=== RUN TestExternalSignerErrors/exit_at_startup5550=== PAUSE TestExternalSignerErrors/exit_at_startup5551=== RUN TestExternalSignerErrors/exit_on_request5552=== PAUSE TestExternalSignerErrors/exit_on_request5553=== CONT TestExternalSignerErrors/invalid_JSON5554=== CONT TestExternalSignerErrors/null_signatures5555=== RUN TestSignErrors/nil_key5556--- PASS: TestSign (0.00s)5557=== CONT TestExternalSignerErrors/exit_at_startup5558=== CONT TestExternalSignerErrors/invalid_signature_base645559=== CONT TestExternalSignerErrors/wrong_signature_name5560=== CONT TestExternalSignerErrors/unrequested_key5561=== CONT TestExternalSignerErrors/wrong_shape5562=== CONT TestExternalSignerErrors/exit_on_request5563=== PAUSE TestSignErrors/nil_key5564=== RUN TestSignErrors/nil_narinfo5565=== PAUSE TestSignErrors/nil_narinfo5566=== RUN TestSignErrors/invalid_narinfo5567=== PAUSE TestSignErrors/invalid_narinfo5568=== RUN TestSignErrors/canceled5569=== PAUSE TestSignErrors/canceled5570=== CONT TestExternalSignerErrors/missing_signatures5571=== CONT TestExternalSignerErrors/program_error5572=== CONT TestExternalSignerErrors/too_few_signatures5573=== CONT TestExternalSignerErrors/wrong_signature_length5574=== CONT TestExternalSignerErrors/missing_signature_name5575=== CONT TestExternalSignerErrors/wrong_id5576=== CONT TestExternalSignerErrors/wrong_signatures_shape5577--- PASS: TestSignBatch (0.00s)5578=== CONT TestSignErrors/nil_key5579=== CONT TestSignErrors/canceled5580=== CONT TestExternalSignerErrors/null5581--- PASS: TestParseSigningKey (0.00s)5582 --- PASS: TestParseSigningKey/wrong_length (0.00s)5583 --- PASS: TestParseSigningKey/invalid_base64 (0.00s)5584 --- PASS: TestParseSigningKey/empty_name (0.00s)5585 --- PASS: TestParseSigningKey/no_colon (0.00s)5586 --- PASS: TestParseSigningKey/valid_32-byte_key (0.00s)5587 --- PASS: TestParseSigningKey/valid_32-byte_key_with_different_name (0.00s)5588=== CONT TestSignErrors/invalid_narinfo5589=== CONT TestSignErrors/nil_narinfo5590--- PASS: TestSignErrors (0.00s)5591 --- PASS: TestSignErrors/nil_key (0.00s)5592 --- PASS: TestSignErrors/canceled (0.00s)5593 --- PASS: TestSignErrors/invalid_narinfo (0.00s)5594 --- PASS: TestSignErrors/nil_narinfo (0.00s)5595--- PASS: TestExternalSigner (0.23s)5596--- PASS: TestExternalSignerCancellation (0.42s)5597--- PASS: TestExternalSignerWrongPublicKey (0.59s)5598--- PASS: TestExternalSignerRestartsAfterCrash (1.37s)5599/private/var/tb/7/scratch/bbb413e2ef876c00/build/TestExternalSignerRestartsAfterCrash2128920956/001/sign program: line 7: /private/var/tb/7/scratch/bbb413e2ef876c00/build/TestExternalSignerRestartsAfterCrash2128920956/001/sign program.starts: No such file or directory5600--- PASS: TestExternalSignerProgramErrorKeepsProcess (2.10s)5601--- PASS: TestExternalSignerClose (2.29s)5602--- PASS: TestExternalSignerErrors (0.00s)5603 --- PASS: TestExternalSignerErrors/invalid_signature_base64 (0.78s)5604 --- PASS: TestExternalSignerErrors/missing_signature_name (0.97s)5605 --- PASS: TestExternalSignerErrors/exit_at_startup (1.16s)5606 --- PASS: TestExternalSignerErrors/program_error (1.53s)5607 --- PASS: TestExternalSignerErrors/null (1.72s)5608 --- PASS: TestExternalSignerErrors/exit_on_request (1.91s)5609 --- PASS: TestExternalSignerErrors/wrong_id (2.47s)5610 --- PASS: TestExternalSignerErrors/wrong_signature_length (2.67s)5611 --- PASS: TestExternalSignerErrors/wrong_signature_name (2.86s)5612 --- PASS: TestExternalSignerErrors/wrong_shape (3.05s)5613 --- PASS: TestExternalSignerErrors/invalid_JSON (3.25s)5614 --- PASS: TestExternalSignerErrors/wrong_signatures_shape (3.43s)5615 --- PASS: TestExternalSignerErrors/unrequested_key (3.62s)5616 --- PASS: TestExternalSignerErrors/missing_signatures (3.81s)5617 --- PASS: TestExternalSignerErrors/null_signatures (4.01s)5618 --- PASS: TestExternalSignerErrors/too_few_signatures (4.19s)5619PASS5620Running OpenBao signer tests...5621=== RUN TestSign5622=== PAUSE TestSign5623=== RUN TestSignErrors5624=== PAUSE TestSignErrors5625=== RUN TestServe5626=== PAUSE TestServe5627=== RUN TestServeRejectsGarbage5628=== PAUSE TestServeRejectsGarbage5629=== CONT TestSign5630=== CONT TestServeRejectsGarbage5631=== CONT TestSignErrors5632--- PASS: TestServeRejectsGarbage (0.00s)5633=== CONT TestServe5634=== RUN TestSignErrors/http_error5635=== PAUSE TestSignErrors/http_error5636=== RUN TestSignErrors/invalid_json5637=== PAUSE TestSignErrors/invalid_json5638=== RUN TestSignErrors/no_prefix5639=== PAUSE TestSignErrors/no_prefix5640=== RUN TestSignErrors/invalid_base645641=== PAUSE TestSignErrors/invalid_base645642=== CONT TestSignErrors/http_error5643=== CONT TestSignErrors/no_prefix5644=== CONT TestSignErrors/invalid_base645645=== CONT TestSignErrors/invalid_json5646--- PASS: TestServe (0.00s)5647--- PASS: TestSign (0.00s)5648--- PASS: TestSignErrors (0.00s)5649 --- PASS: TestSignErrors/http_error (0.00s)5650 --- PASS: TestSignErrors/no_prefix (0.00s)5651 --- PASS: TestSignErrors/invalid_base64 (0.00s)5652 --- PASS: TestSignErrors/invalid_json (0.00s)5653PASS