these 2 derivations will be built:
  /nix/store/mm6lp04hzq7hszkakjlx682azwjx96cg-niks3-tests-1.4.0.drv
  /nix/store/cabhiny5qwcvyjg4wd35rkn9njizb0w8-niks3-go-unit-tests.drv
Failed to find a machine for remote build!
derivation: mm6lp04hzq7hszkakjlx682azwjx96cg-niks3-tests-1.4.0.drv
required (system, features): (aarch64-linux, [])
1 available machines:
(systems, maxjobs, supportedFeatures, mandatoryFeatures)
([aarch64-darwin, x86_64-darwin], 8, [big-parallel, recursive-nix], [])
building '/nix/store/mm6lp04hzq7hszkakjlx682azwjx96cg-niks3-tests-1.4.0.drv'
niks3-tests-1.4.0> tribuchet: building on eliza
niks3-tests-1.4.0> Running phase: unpackPhase
niks3-tests-1.4.0> unpacking source archive /nix/store/1pxnvqpngvn51vrld6w6hf80x8a7g7i5-source
niks3-tests-1.4.0> source root is source
niks3-tests-1.4.0> Running phase: patchPhase
niks3-tests-1.4.0> Running phase: updateAutotoolsGnuConfigScriptsPhase
niks3-tests-1.4.0> Running phase: configurePhase
niks3-tests-1.4.0> Running phase: buildPhase
niks3-tests-1.4.0> buildPhase completed in 40 seconds
niks3-tests-1.4.0> Running phase: installPhase
niks3-tests-1.4.0> Running phase: fixupPhase
niks3-tests-1.4.0> shrinking RPATHs of ELF executables and libraries in /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0
niks3-tests-1.4.0> shrinking /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0/bin/niks3-client.test
niks3-tests-1.4.0> shrinking /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0/bin/niks3-server.test
niks3-tests-1.4.0> shrinking /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0/bin/niks3-server-oidc.test
niks3-tests-1.4.0> shrinking /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0/bin/niks3-hook.test
niks3-tests-1.4.0> checking for references to /build/ in /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0...
niks3-tests-1.4.0> patching script interpreter paths in /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0
niks3-tests-1.4.0> stripping (with command strip and flags -S -p) in  /nix/store/7ihd2gp80basd6ch0w8py3yqkr7975bm-niks3-tests-1.4.0/bin
Failed to find a machine for remote build!
derivation: cabhiny5qwcvyjg4wd35rkn9njizb0w8-niks3-go-unit-tests.drv
required (system, features): (aarch64-linux, [])
1 available machines:
(systems, maxjobs, supportedFeatures, mandatoryFeatures)
([aarch64-darwin, x86_64-darwin], 8, [big-parallel, recursive-nix], [])
building '/nix/store/cabhiny5qwcvyjg4wd35rkn9njizb0w8-niks3-go-unit-tests.drv'
niks3-go-unit-tests> tribuchet: building on eliza
niks3-go-unit-tests> Running client tests...
niks3-go-unit-tests> === RUN   TestDoServerRequestAttachesToken
niks3-go-unit-tests> === PAUSE TestDoServerRequestAttachesToken
niks3-go-unit-tests> === RUN   TestCaseHackSuffix
niks3-go-unit-tests> === PAUSE TestCaseHackSuffix
niks3-go-unit-tests> === RUN   TestFilterOversizedClosures
niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures
niks3-go-unit-tests> === RUN   TestPartSizeForNAR
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR
niks3-go-unit-tests> === RUN   TestUploadMultipart_SupersededByPeer
niks3-go-unit-tests> === PAUSE TestUploadMultipart_SupersededByPeer
niks3-go-unit-tests> === RUN   TestDumpPathMatchesNix
niks3-go-unit-tests> === PAUSE TestDumpPathMatchesNix
niks3-go-unit-tests> === RUN   TestDumpPathSingleFile
niks3-go-unit-tests> === PAUSE TestDumpPathSingleFile
niks3-go-unit-tests> === RUN   TestDumpPathWriterError
niks3-go-unit-tests> === PAUSE TestDumpPathWriterError
niks3-go-unit-tests> === RUN   TestEncodeNixBase32
niks3-go-unit-tests> === PAUSE TestEncodeNixBase32
niks3-go-unit-tests> === RUN   TestEncodeNixBase32WithRealHash
niks3-go-unit-tests> === PAUSE TestEncodeNixBase32WithRealHash
niks3-go-unit-tests> === RUN   TestConvertHashToNix32
niks3-go-unit-tests> === PAUSE TestConvertHashToNix32
niks3-go-unit-tests> === RUN   TestGetStorePathHash
niks3-go-unit-tests> === PAUSE TestGetStorePathHash
niks3-go-unit-tests> === RUN   TestPathInfoHashCompatibility
niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility
niks3-go-unit-tests> === RUN   TestParsePathInfoJSON
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON
niks3-go-unit-tests> === RUN   TestParsePathInfoJSONMultiplePaths
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSONMultiplePaths
niks3-go-unit-tests> === RUN   TestPathInfoCACompatibility
niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility
niks3-go-unit-tests> === RUN   TestRateLimiterFeedback
niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback
niks3-go-unit-tests> === RUN   TestRateLimiterFeedback_400DoesNotCountAsSuccess
niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback_400DoesNotCountAsSuccess
niks3-go-unit-tests> === RUN   TestResolveStorePath
niks3-go-unit-tests> === PAUSE TestResolveStorePath
niks3-go-unit-tests> === RUN   TestDoWithRetry_BodyReplayedViaGetBody
niks3-go-unit-tests> === PAUSE TestDoWithRetry_BodyReplayedViaGetBody
niks3-go-unit-tests> === RUN   TestShellSplit
niks3-go-unit-tests> === PAUSE TestShellSplit
niks3-go-unit-tests> === RUN   TestShellSplitErrors
niks3-go-unit-tests> === PAUSE TestShellSplitErrors
niks3-go-unit-tests> === RUN   TestSetClientTLS
niks3-go-unit-tests> === PAUSE TestSetClientTLS
niks3-go-unit-tests> === RUN   TestSetClientTLSDoesNotMutateDefaultTransport
niks3-go-unit-tests> === PAUSE TestSetClientTLSDoesNotMutateDefaultTransport
niks3-go-unit-tests> === RUN   TestSetClientTLSErrors
niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors
niks3-go-unit-tests> === RUN   TestStaticToken
niks3-go-unit-tests> === PAUSE TestStaticToken
niks3-go-unit-tests> === RUN   TestFileTokenReadsAndCaches
niks3-go-unit-tests> === PAUSE TestFileTokenReadsAndCaches
niks3-go-unit-tests> === RUN   TestFileTokenMissing
niks3-go-unit-tests> === PAUSE TestFileTokenMissing
niks3-go-unit-tests> === RUN   TestFileTokenEmpty
niks3-go-unit-tests> === PAUSE TestFileTokenEmpty
niks3-go-unit-tests> === RUN   TestScriptTokenNoExpiryRerunsEveryCall
niks3-go-unit-tests> === PAUSE TestScriptTokenNoExpiryRerunsEveryCall
niks3-go-unit-tests> === RUN   TestScriptTokenCachesUntilRefresh
niks3-go-unit-tests> === PAUSE TestScriptTokenCachesUntilRefresh
niks3-go-unit-tests> === RUN   TestScriptTokenEmptyToken
niks3-go-unit-tests> === PAUSE TestScriptTokenEmptyToken
niks3-go-unit-tests> === RUN   TestScriptTokenBadJSON
niks3-go-unit-tests> === PAUSE TestScriptTokenBadJSON
niks3-go-unit-tests> === RUN   TestScriptTokenScriptFails
niks3-go-unit-tests> === PAUSE TestScriptTokenScriptFails
niks3-go-unit-tests> === RUN   TestScriptTokenEmptyCommand
niks3-go-unit-tests> === PAUSE TestScriptTokenEmptyCommand
niks3-go-unit-tests> === CONT  TestDoServerRequestAttachesToken
niks3-go-unit-tests> === CONT  TestFileTokenMissing
niks3-go-unit-tests> === CONT  TestResolveStorePath
niks3-go-unit-tests> === CONT  TestEncodeNixBase32WithRealHash
niks3-go-unit-tests> --- PASS: TestEncodeNixBase32WithRealHash (0.00s)
niks3-go-unit-tests> === CONT  TestParsePathInfoJSON
niks3-go-unit-tests> === RUN   TestParsePathInfoJSON/Nix_format
niks3-go-unit-tests> === CONT  TestParsePathInfoJSONMultiplePaths
niks3-go-unit-tests> === CONT  TestRateLimiterFeedback_400DoesNotCountAsSuccess
niks3-go-unit-tests> === CONT  TestStaticToken
niks3-go-unit-tests> === RUN   TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths
niks3-go-unit-tests> --- PASS: TestStaticToken (0.00s)
niks3-go-unit-tests> === CONT  TestFileTokenReadsAndCaches
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths
niks3-go-unit-tests> === RUN   TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths
niks3-go-unit-tests> === CONT  TestSetClientTLSDoesNotMutateDefaultTransport
niks3-go-unit-tests> --- PASS: TestFileTokenMissing (0.00s)
niks3-go-unit-tests> === CONT  TestDumpPathMatchesNix
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=5
niks3-go-unit-tests> --- PASS: TestFileTokenReadsAndCaches (0.00s)
niks3-go-unit-tests> === CONT  TestScriptTokenNoExpiryRerunsEveryCall
niks3-go-unit-tests> --- PASS: TestResolveStorePath (0.00s)
niks3-go-unit-tests> === CONT  TestScriptTokenCachesUntilRefresh
niks3-go-unit-tests> === CONT  TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths
niks3-go-unit-tests> === CONT  TestPathInfoHashCompatibility
niks3-go-unit-tests> === RUN   TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)
niks3-go-unit-tests> === CONT  TestGetStorePathHash
niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)
niks3-go-unit-tests> === RUN   TestPathInfoHashCompatibility/old_string_format_with_colon
niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/old_string_format_with_colon
niks3-go-unit-tests> === CONT  TestScriptTokenEmptyToken
niks3-go-unit-tests> === CONT  TestScriptTokenEmptyCommand
niks3-go-unit-tests> === CONT  TestScriptTokenScriptFails
niks3-go-unit-tests> === CONT  TestScriptTokenBadJSON
niks3-go-unit-tests> === CONT  TestRateLimiterFeedback
niks3-go-unit-tests> === CONT  TestPathInfoCACompatibility
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/Nix_format
niks3-go-unit-tests> === CONT  TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths
niks3-go-unit-tests> === CONT  TestShellSplitErrors
niks3-go-unit-tests> === CONT  TestSetClientTLS
niks3-go-unit-tests> === CONT  TestUploadMultipart_SupersededByPeer
niks3-go-unit-tests> === CONT  TestEncodeNixBase32
niks3-go-unit-tests> === CONT  TestDumpPathWriterError
niks3-go-unit-tests> === CONT  TestDumpPathSingleFile
niks3-go-unit-tests> === RUN   TestGetStorePathHash/valid_store_path
niks3-go-unit-tests> === RUN   TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI
niks3-go-unit-tests> === CONT  TestFilterOversizedClosures
niks3-go-unit-tests> === RUN   TestEncodeNixBase32/test_string_hash
niks3-go-unit-tests> === PAUSE TestEncodeNixBase32/test_string_hash
niks3-go-unit-tests> === RUN   TestEncodeNixBase32/empty_input
niks3-go-unit-tests> === PAUSE TestEncodeNixBase32/empty_input
niks3-go-unit-tests> === RUN   TestRateLimiterFeedback/429_enables_limiter
niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/429_enables_limiter
niks3-go-unit-tests> === CONT  TestConvertHashToNix32
niks3-go-unit-tests> === PAUSE TestGetStorePathHash/valid_store_path
niks3-go-unit-tests> === RUN   TestGetStorePathHash/basename_without_hyphen_should_error
niks3-go-unit-tests> === RUN   TestFilterOversizedClosures/no_limit_keeps_everything
niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures/no_limit_keeps_everything
niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI
niks3-go-unit-tests> === RUN   TestPathInfoHashCompatibility/new_structured_format_with_sha512
niks3-go-unit-tests> === PAUSE TestGetStorePathHash/basename_without_hyphen_should_error
niks3-go-unit-tests> === CONT  TestSetClientTLSErrors
niks3-go-unit-tests> === RUN   TestParsePathInfoJSON/Lix_format
niks3-go-unit-tests> === CONT  TestFileTokenEmpty
niks3-go-unit-tests> === RUN   TestRateLimiterFeedback/503_enables_limiter
niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/503_enables_limiter
niks3-go-unit-tests> === CONT  TestCaseHackSuffix
niks3-go-unit-tests> === CONT  TestPartSizeForNAR
niks3-go-unit-tests> === RUN   TestPathInfoCACompatibility/null_ca_field
niks3-go-unit-tests> === RUN   TestUploadMultipart_SupersededByPeer/exists
niks3-go-unit-tests> === RUN   TestConvertHashToNix32/SRI_format_to_Nix32
niks3-go-unit-tests> === CONT  TestShellSplit
niks3-go-unit-tests> === RUN   TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped
niks3-go-unit-tests> --- PASS: TestScriptTokenEmptyCommand (0.00s)
niks3-go-unit-tests> === PAUSE TestPathInfoHashCompatibility/new_structured_format_with_sha512
niks3-go-unit-tests> === RUN   TestGetStorePathHash/hash_with_invalid_characters_should_error
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/Lix_format
niks3-go-unit-tests> === CONT  TestDoWithRetry_BodyReplayedViaGetBody
niks3-go-unit-tests> === RUN   TestParsePathInfoJSON/empty_input
niks3-go-unit-tests> === RUN   TestRateLimiterFeedback/200_does_not_enable_limiter
niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/null_ca_field
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/zero_stays_at_minimum
niks3-go-unit-tests> === PAUSE TestUploadMultipart_SupersededByPeer/exists
niks3-go-unit-tests> --- PASS: TestShellSplitErrors (0.00s)
niks3-go-unit-tests> --- PASS: TestScriptTokenScriptFails (0.00s)
niks3-go-unit-tests> --- PASS: TestScriptTokenEmptyToken (0.00s)
niks3-go-unit-tests> --- PASS: TestFileTokenEmpty (0.00s)
niks3-go-unit-tests> --- PASS: TestDoServerRequestAttachesToken (0.01s)
niks3-go-unit-tests> === CONT  TestEncodeNixBase32/empty_input
niks3-go-unit-tests> === PAUSE TestConvertHashToNix32/SRI_format_to_Nix32
niks3-go-unit-tests> === RUN   TestSetClientTLSErrors/missing_cert_file
niks3-go-unit-tests> === CONT  TestPathInfoHashCompatibility/new_structured_format_with_sha512
niks3-go-unit-tests> --- PASS: TestShellSplit (0.00s)
niks3-go-unit-tests> --- PASS: TestParsePathInfoJSONMultiplePaths (0.00s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSONMultiplePaths/Lix_multiple_paths (0.00s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSONMultiplePaths/Nix_multiple_paths (0.00s)
niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/200_does_not_enable_limiter
niks3-go-unit-tests> === PAUSE TestGetStorePathHash/hash_with_invalid_characters_should_error
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/zero_stays_at_minimum
niks3-go-unit-tests> === RUN   TestUploadMultipart_SupersededByPeer/missing
niks3-go-unit-tests> === CONT  TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI)
niks3-go-unit-tests> === RUN   TestConvertHashToNix32/already_Nix32_format
niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/missing_cert_file
niks3-go-unit-tests> === CONT  TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI
niks3-go-unit-tests> === CONT  TestEncodeNixBase32/test_string_hash
niks3-go-unit-tests> === RUN   TestPathInfoCACompatibility/old_string_format_-_text
niks3-go-unit-tests> === RUN   TestGetStorePathHash/hash_with_wrong_length_should_error
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/empty_input
niks3-go-unit-tests> === CONT  TestPathInfoHashCompatibility/old_string_format_with_colon
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/small_stays_at_minimum
niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=5
niks3-go-unit-tests> === RUN   TestRateLimiterFeedback/400_does_not_enable_limiter
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=1 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:41765
niks3-go-unit-tests> === PAUSE TestGetStorePathHash/hash_with_wrong_length_should_error
niks3-go-unit-tests> === PAUSE TestUploadMultipart_SupersededByPeer/missing
niks3-go-unit-tests> === RUN   TestParsePathInfoJSON/whitespace_only
niks3-go-unit-tests> --- PASS: TestScriptTokenBadJSON (0.01s)
niks3-go-unit-tests> === PAUSE TestConvertHashToNix32/already_Nix32_format
niks3-go-unit-tests> === RUN   TestFilterOversizedClosures/all_closures_skipped
niks3-go-unit-tests> === RUN   TestSetClientTLSErrors/missing_key_file
niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/missing_key_file
niks3-go-unit-tests> === RUN   TestSetClientTLSErrors/missing_ca_file
niks3-go-unit-tests> === PAUSE TestRateLimiterFeedback/400_does_not_enable_limiter
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/small_stays_at_minimum
niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/old_string_format_-_text
niks3-go-unit-tests> === CONT  TestGetStorePathHash/valid_store_path
niks3-go-unit-tests> === CONT  TestRateLimiterFeedback/400_does_not_enable_limiter
niks3-go-unit-tests> === CONT  TestGetStorePathHash/hash_with_wrong_length_should_error
niks3-go-unit-tests> === CONT  TestUploadMultipart_SupersededByPeer/missing
niks3-go-unit-tests> --- PASS: TestEncodeNixBase32 (0.00s)
niks3-go-unit-tests>     --- PASS: TestEncodeNixBase32/empty_input (0.00s)
niks3-go-unit-tests>     --- PASS: TestEncodeNixBase32/test_string_hash (0.00s)
niks3-go-unit-tests> --- PASS: TestSetClientTLSDoesNotMutateDefaultTransport (0.02s)
niks3-go-unit-tests> === RUN   TestConvertHashToNix32/invalid_format
niks3-go-unit-tests> --- PASS: TestPathInfoHashCompatibility (0.01s)
niks3-go-unit-tests>     --- PASS: TestPathInfoHashCompatibility/new_structured_format_with_sha512 (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoHashCompatibility/old_string_format_with_colon (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoHashCompatibility/old_string_format_with_dash_(SRI) (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoHashCompatibility/new_structured_format_-_converts_to_SRI (0.00s)
niks3-go-unit-tests> === PAUSE TestConvertHashToNix32/invalid_format
niks3-go-unit-tests> === CONT  TestConvertHashToNix32/SRI_format_to_Nix32
niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/missing_ca_file
niks3-go-unit-tests> === CONT  TestRateLimiterFeedback/429_enables_limiter
niks3-go-unit-tests> === RUN   TestSetClientTLSErrors/invalid_ca_file
niks3-go-unit-tests> === RUN   TestSetClientTLS/rejects_connection_without_client_cert
niks3-go-unit-tests> === PAUSE TestSetClientTLS/rejects_connection_without_client_cert
niks3-go-unit-tests> === RUN   TestSetClientTLS/succeeds_with_client_cert_and_CA
niks3-go-unit-tests> === PAUSE TestSetClientTLS/succeeds_with_client_cert_and_CA
niks3-go-unit-tests> === RUN   TestSetClientTLS/preserves_debug_logging_transport
niks3-go-unit-tests> === PAUSE TestSetClientTLSErrors/invalid_ca_file
niks3-go-unit-tests> === CONT  TestSetClientTLSErrors/missing_cert_file
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter backed off name=server-test rate=5
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/80_GiB_fits_at_minimum
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=2 max_attempts=6 backoff=0s status=503 url=http://127.0.0.1:41765
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/80_GiB_fits_at_minimum
niks3-go-unit-tests> === RUN   TestPathInfoCACompatibility/old_string_format_-_fixed_recursive
niks3-go-unit-tests> === PAUSE TestFilterOversizedClosures/all_closures_skipped
niks3-go-unit-tests> === CONT  TestGetStorePathHash/basename_without_hyphen_should_error
niks3-go-unit-tests> --- PASS: TestScriptTokenCachesUntilRefresh (0.02s)
niks3-go-unit-tests> === CONT  TestSetClientTLSErrors/missing_key_file
niks3-go-unit-tests> === CONT  TestGetStorePathHash/hash_with_invalid_characters_should_error
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/115_GiB_needs_larger_parts
niks3-go-unit-tests> === CONT  TestFilterOversizedClosures/all_closures_skipped
niks3-go-unit-tests> === CONT  TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped
niks3-go-unit-tests> --- PASS: TestGetStorePathHash (0.01s)
niks3-go-unit-tests>     --- PASS: TestGetStorePathHash/valid_store_path (0.00s)
niks3-go-unit-tests>     --- PASS: TestGetStorePathHash/hash_with_wrong_length_should_error (0.00s)
niks3-go-unit-tests>     --- PASS: TestGetStorePathHash/basename_without_hyphen_should_error (0.00s)
niks3-go-unit-tests>     --- PASS: TestGetStorePathHash/hash_with_invalid_characters_should_error (0.00s)
niks3-go-unit-tests> === CONT  TestSetClientTLSErrors/missing_ca_file
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb-vm-image nar_size=5000 max_nar_size=2000
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Skipping closure: path exceeds server max NAR size top_level_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper oversized_path=/nix/store/cccccccccccccccccccccccccccccccc-wrapper nar_size=100 max_nar_size=50
niks3-go-unit-tests> === CONT  TestFilterOversizedClosures/no_limit_keeps_everything
niks3-go-unit-tests> === CONT  TestConvertHashToNix32/invalid_format
niks3-go-unit-tests> === CONT  TestUploadMultipart_SupersededByPeer/exists
niks3-go-unit-tests> === CONT  TestConvertHashToNix32/already_Nix32_format
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/whitespace_only
niks3-go-unit-tests> === CONT  TestRateLimiterFeedback/503_enables_limiter
niks3-go-unit-tests> === PAUSE TestSetClientTLS/preserves_debug_logging_transport
niks3-go-unit-tests> === CONT  TestRateLimiterFeedback/200_does_not_enable_limiter
niks3-go-unit-tests> === CONT  TestSetClientTLSErrors/invalid_ca_file
niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/old_string_format_-_fixed_recursive
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/115_GiB_needs_larger_parts
niks3-go-unit-tests> === RUN   TestPathInfoCACompatibility/new_structured_format_-_text
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/1_TiB
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=5
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=429 url=http://127.0.0.1:43365
niks3-go-unit-tests> --- PASS: TestFilterOversizedClosures (0.02s)
niks3-go-unit-tests>     --- PASS: TestFilterOversizedClosures/closure_with_oversized_dependency_is_skipped (0.00s)
niks3-go-unit-tests>     --- PASS: TestFilterOversizedClosures/all_closures_skipped (0.00s)
niks3-go-unit-tests>     --- PASS: TestFilterOversizedClosures/no_limit_keeps_everything (0.00s)
niks3-go-unit-tests> --- PASS: TestDoWithRetry_BodyReplayedViaGetBody (0.02s)
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter backed off name=server-test rate=5
niks3-go-unit-tests> === RUN   TestParsePathInfoJSON/invalid_JSON
niks3-go-unit-tests> === CONT  TestSetClientTLS/rejects_connection_without_client_cert
niks3-go-unit-tests> === CONT  TestSetClientTLS/preserves_debug_logging_transport
niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/new_structured_format_-_text
niks3-go-unit-tests> === RUN   TestPathInfoCACompatibility/new_structured_format_-_nar_method
niks3-go-unit-tests> === PAUSE TestPathInfoCACompatibility/new_structured_format_-_nar_method
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter enabled after throttle name=server-test rate=5
niks3-go-unit-tests> === PAUSE TestParsePathInfoJSON/invalid_JSON
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Request returned retryable status, retrying attempt=1 max_attempts=2 backoff=0s status=503 url=http://127.0.0.1:39901
niks3-go-unit-tests> === CONT  TestPathInfoCACompatibility/old_string_format_-_text
niks3-go-unit-tests> === CONT  TestSetClientTLS/succeeds_with_client_cert_and_CA
niks3-go-unit-tests> 2026/08/20 17:24:08 WARN Rate limiter backed off name=server-test rate=5
niks3-go-unit-tests> === CONT  TestParsePathInfoJSON/Nix_format
niks3-go-unit-tests> --- PASS: TestConvertHashToNix32 (0.01s)
niks3-go-unit-tests>     --- PASS: TestConvertHashToNix32/SRI_format_to_Nix32 (0.00s)
niks3-go-unit-tests>     --- PASS: TestConvertHashToNix32/invalid_format (0.00s)
niks3-go-unit-tests>     --- PASS: TestConvertHashToNix32/already_Nix32_format (0.00s)
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/1_TiB
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/5_TiB_S3_max_object
niks3-go-unit-tests> === CONT  TestPathInfoCACompatibility/new_structured_format_-_text
niks3-go-unit-tests> === CONT  TestPathInfoCACompatibility/new_structured_format_-_nar_method
niks3-go-unit-tests> === CONT  TestPathInfoCACompatibility/null_ca_field
niks3-go-unit-tests> === CONT  TestPathInfoCACompatibility/old_string_format_-_fixed_recursive
niks3-go-unit-tests> === CONT  TestParsePathInfoJSON/invalid_JSON
niks3-go-unit-tests> === CONT  TestParsePathInfoJSON/Lix_format
niks3-go-unit-tests> === CONT  TestParsePathInfoJSON/whitespace_only
niks3-go-unit-tests> === CONT  TestParsePathInfoJSON/empty_input
niks3-go-unit-tests> --- PASS: TestScriptTokenNoExpiryRerunsEveryCall (0.02s)
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/5_TiB_S3_max_object
niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback (0.01s)
niks3-go-unit-tests>     --- PASS: TestRateLimiterFeedback/400_does_not_enable_limiter (0.01s)
niks3-go-unit-tests>     --- PASS: TestRateLimiterFeedback/429_enables_limiter (0.01s)
niks3-go-unit-tests>     --- PASS: TestRateLimiterFeedback/503_enables_limiter (0.00s)
niks3-go-unit-tests>     --- PASS: TestRateLimiterFeedback/200_does_not_enable_limiter (0.00s)
niks3-go-unit-tests> === RUN   TestPartSizeForNAR/capped_at_5_GiB
niks3-go-unit-tests> === PAUSE TestPartSizeForNAR/capped_at_5_GiB
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/zero_stays_at_minimum
niks3-go-unit-tests> --- PASS: TestPathInfoCACompatibility (0.02s)
niks3-go-unit-tests>     --- PASS: TestPathInfoCACompatibility/old_string_format_-_text (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoCACompatibility/new_structured_format_-_text (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoCACompatibility/new_structured_format_-_nar_method (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoCACompatibility/null_ca_field (0.00s)
niks3-go-unit-tests>     --- PASS: TestPathInfoCACompatibility/old_string_format_-_fixed_recursive (0.00s)
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/capped_at_5_GiB
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/115_GiB_needs_larger_parts
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/5_TiB_S3_max_object
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/80_GiB_fits_at_minimum
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/small_stays_at_minimum
niks3-go-unit-tests> === CONT  TestPartSizeForNAR/1_TiB
niks3-go-unit-tests> --- PASS: TestUploadMultipart_SupersededByPeer (0.01s)
niks3-go-unit-tests>     --- PASS: TestUploadMultipart_SupersededByPeer/missing (0.01s)
niks3-go-unit-tests>     --- PASS: TestUploadMultipart_SupersededByPeer/exists (0.00s)
niks3-go-unit-tests> --- PASS: TestParsePathInfoJSON (0.03s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSON/Nix_format (0.00s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSON/invalid_JSON (0.00s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSON/Lix_format (0.00s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSON/whitespace_only (0.00s)
niks3-go-unit-tests>     --- PASS: TestParsePathInfoJSON/empty_input (0.00s)
niks3-go-unit-tests> --- PASS: TestPartSizeForNAR (0.02s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/zero_stays_at_minimum (0.00s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/capped_at_5_GiB (0.00s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/115_GiB_needs_larger_parts (0.00s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/5_TiB_S3_max_object (0.00s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/80_GiB_fits_at_minimum (0.00s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/small_stays_at_minimum (0.00s)
niks3-go-unit-tests>     --- PASS: TestPartSizeForNAR/1_TiB (0.00s)
niks3-go-unit-tests> --- PASS: TestSetClientTLSErrors (0.01s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLSErrors/missing_cert_file (0.00s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLSErrors/missing_key_file (0.00s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLSErrors/missing_ca_file (0.01s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLSErrors/invalid_ca_file (0.00s)
niks3-go-unit-tests> 2026/08/20 17:24:08 http: TLS handshake error from 127.0.0.1:58464: remote error: tls: bad certificate
niks3-go-unit-tests> --- PASS: TestSetClientTLS (0.02s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLS/succeeds_with_client_cert_and_CA (0.00s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLS/preserves_debug_logging_transport (0.00s)
niks3-go-unit-tests>     --- PASS: TestSetClientTLS/rejects_connection_without_client_cert (0.01s)
niks3-go-unit-tests> --- PASS: TestDumpPathWriterError (0.05s)
niks3-go-unit-tests> --- PASS: TestDumpPathSingleFile (0.10s)
niks3-go-unit-tests> --- PASS: TestCaseHackSuffix (0.09s)
niks3-go-unit-tests> --- PASS: TestDumpPathMatchesNix (0.11s)
niks3-go-unit-tests> --- PASS: TestRateLimiterFeedback_400DoesNotCountAsSuccess (1.00s)
niks3-go-unit-tests> PASS
niks3-go-unit-tests> Running server tests...
niks3-go-unit-tests> The files belonging to this database system will be owned by user "nixbld".
niks3-go-unit-tests> This user must also own the server process.
niks3-go-unit-tests> 
niks3-go-unit-tests> The database cluster will be initialized with locale "C".
niks3-go-unit-tests> The default database encoding has accordingly been set to "SQL_ASCII".
niks3-go-unit-tests> The default text search configuration will be set to "english".
niks3-go-unit-tests> 
niks3-go-unit-tests> Data page checksums are enabled.
niks3-go-unit-tests> 
niks3-go-unit-tests> creating directory /build/postgres716756029/data ... ok
niks3-go-unit-tests> creating subdirectories ... ok
niks3-go-unit-tests> selecting dynamic shared memory implementation ... posix
niks3-go-unit-tests> selecting default "max_connections" ... 100
niks3-go-unit-tests> selecting default "shared_buffers" ... 128MB
niks3-go-unit-tests> selecting default time zone ... UTC
niks3-go-unit-tests> creating configuration files ... ok
niks3-go-unit-tests> running bootstrap script ... ok
niks3-go-unit-tests> performing post-bootstrap initialization ... ok
niks3-go-unit-tests> syncing data to disk ... ok
niks3-go-unit-tests> 
niks3-go-unit-tests> initdb: warning: enabling "trust" authentication for local connections
niks3-go-unit-tests> initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.
niks3-go-unit-tests> 
niks3-go-unit-tests> Success. You can now start the database server using:
niks3-go-unit-tests> 
niks3-go-unit-tests>     pg_ctl -D /build/postgres716756029/data -l logfile start
niks3-go-unit-tests> 
niks3-go-unit-tests> /build/postgres716756029:5432 - no response
niks3-go-unit-tests> 2026-08-20 17:24:09.989 UTC [111] LOG:  starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit
niks3-go-unit-tests> 2026-08-20 17:24:09.989 UTC [111] LOG:  listening on Unix socket "/build/postgres716756029/.s.PGSQL.5432"
niks3-go-unit-tests> 2026-08-20 17:24:09.993 UTC [118] LOG:  database system was shut down at 2026-08-20 17:24:09 UTC
niks3-go-unit-tests> 2026-08-20 17:24:09.997 UTC [111] LOG:  database system is ready to accept connections
niks3-go-unit-tests> /build/postgres716756029:5432 - accepting connections
niks3-go-unit-tests> === RUN   TestService_AuthMiddleware
niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware
niks3-go-unit-tests> === RUN   TestService_AuthMiddleware_MTLSProxyHeader
niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_MTLSProxyHeader
niks3-go-unit-tests> === RUN   TestService_AuthMiddleware_MTLSBoundSubjects
niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_MTLSBoundSubjects
niks3-go-unit-tests> === RUN   TestService_ReadAuthMiddleware
niks3-go-unit-tests> === PAUSE TestService_ReadAuthMiddleware
niks3-go-unit-tests> === RUN   TestService_AuthMiddleware_OIDC
niks3-go-unit-tests> === PAUSE TestService_AuthMiddleware_OIDC
niks3-go-unit-tests> === RUN   TestCacheConfigHandler
niks3-go-unit-tests> === PAUSE TestCacheConfigHandler
niks3-go-unit-tests> === RUN   TestCacheStatsHandler
niks3-go-unit-tests> === PAUSE TestCacheStatsHandler
niks3-go-unit-tests> === RUN   TestClientCADerivations
niks3-go-unit-tests> === PAUSE TestClientCADerivations
niks3-go-unit-tests> === RUN   TestClientErrorHandling
niks3-go-unit-tests> === PAUSE TestClientErrorHandling
niks3-go-unit-tests> === RUN   TestClientIntegration
niks3-go-unit-tests> === PAUSE TestClientIntegration
niks3-go-unit-tests> === RUN   TestClientMultipleUploads
niks3-go-unit-tests> === PAUSE TestClientMultipleUploads
niks3-go-unit-tests> === RUN   TestClientWithDependencies
niks3-go-unit-tests> === PAUSE TestClientWithDependencies
niks3-go-unit-tests> === RUN   TestPinProtectsFromGC
niks3-go-unit-tests> === PAUSE TestPinProtectsFromGC
niks3-go-unit-tests> === RUN   TestGCAdvisoryLockBlocksConcurrentRun
niks3-go-unit-tests> 2026-08-20 17:24:13.112 UTC [518] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.112 UTC [518] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (11.63ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (1.52ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (2.8ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (2.77ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.07ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (862.55µs)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> --- PASS: TestGCAdvisoryLockBlocksConcurrentRun (0.28s)
niks3-go-unit-tests> === RUN   TestGCBugBareHashReferences
niks3-go-unit-tests> === PAUSE TestGCBugBareHashReferences
niks3-go-unit-tests> === RUN   TestGCMetrics
niks3-go-unit-tests> === PAUSE TestGCMetrics
niks3-go-unit-tests> === RUN   TestGCTaskStore_StartNew
niks3-go-unit-tests> === PAUSE TestGCTaskStore_StartNew
niks3-go-unit-tests> === RUN   TestGCTaskStore_DeduplicateSameParams
niks3-go-unit-tests> === PAUSE TestGCTaskStore_DeduplicateSameParams
niks3-go-unit-tests> === RUN   TestGCTaskStore_ConflictDifferentParams
niks3-go-unit-tests> === PAUSE TestGCTaskStore_ConflictDifferentParams
niks3-go-unit-tests> === RUN   TestGCTaskStore_GetEmpty
niks3-go-unit-tests> === PAUSE TestGCTaskStore_GetEmpty
niks3-go-unit-tests> === RUN   TestGCTaskStore_GetReturnsLatest
niks3-go-unit-tests> === PAUSE TestGCTaskStore_GetReturnsLatest
niks3-go-unit-tests> === RUN   TestGCTaskStore_CompletedAllowsNewTask
niks3-go-unit-tests> === PAUSE TestGCTaskStore_CompletedAllowsNewTask
niks3-go-unit-tests> === RUN   TestGCTaskStore_PhaseUpdates
niks3-go-unit-tests> === PAUSE TestGCTaskStore_PhaseUpdates
niks3-go-unit-tests> === RUN   TestGCTaskStore_Fail
niks3-go-unit-tests> === PAUSE TestGCTaskStore_Fail
niks3-go-unit-tests> === RUN   TestGracefulShutdownDrainsInflight
niks3-go-unit-tests> === PAUSE TestGracefulShutdownDrainsInflight
niks3-go-unit-tests> === RUN   TestService_healthCheckHandler
niks3-go-unit-tests> === PAUSE TestService_healthCheckHandler
niks3-go-unit-tests> === RUN   TestGenerateLandingPage
niks3-go-unit-tests> === PAUSE TestGenerateLandingPage
niks3-go-unit-tests> === RUN   TestCacheConfigHandlerMaxNarSize
niks3-go-unit-tests> === PAUSE TestCacheConfigHandlerMaxNarSize
niks3-go-unit-tests> === RUN   TestCreatePendingClosureRejectsOversizedNAR
niks3-go-unit-tests> === PAUSE TestCreatePendingClosureRejectsOversizedNAR
niks3-go-unit-tests> === RUN   TestNARDeduplicationMetadataUploadBug
niks3-go-unit-tests> === PAUSE TestNARDeduplicationMetadataUploadBug
niks3-go-unit-tests> === RUN   TestMetricsInventory
niks3-go-unit-tests> === PAUSE TestMetricsInventory
niks3-go-unit-tests> === RUN   TestService_NativeMTLS
niks3-go-unit-tests> === PAUSE TestService_NativeMTLS
niks3-go-unit-tests> === RUN   TestServerTLSConfig
niks3-go-unit-tests> === PAUSE TestServerTLSConfig
niks3-go-unit-tests> === RUN   TestMultipartCleanup
niks3-go-unit-tests> === PAUSE TestMultipartCleanup
niks3-go-unit-tests> === RUN   TestObjectStatsTrigger
niks3-go-unit-tests> === PAUSE TestObjectStatsTrigger
niks3-go-unit-tests> === RUN   TestOrphanedObjectsGC
niks3-go-unit-tests> === PAUSE TestOrphanedObjectsGC
niks3-go-unit-tests> === RUN   TestOrphanedObjectsGCStressTest
niks3-go-unit-tests> === PAUSE TestOrphanedObjectsGCStressTest
niks3-go-unit-tests> === RUN   TestResurrectedObjectNotDeleted
niks3-go-unit-tests> === PAUSE TestResurrectedObjectNotDeleted
niks3-go-unit-tests> === RUN   TestParseSingleRange
niks3-go-unit-tests> === PAUSE TestParseSingleRange
niks3-go-unit-tests> === RUN   TestIsValidCachePath
niks3-go-unit-tests> === PAUSE TestIsValidCachePath
niks3-go-unit-tests> === RUN   TestReadProxyNarinfo
niks3-go-unit-tests> === PAUSE TestReadProxyNarinfo
niks3-go-unit-tests> === RUN   TestReadProxyNarinfoAlreadyDecompressed
niks3-go-unit-tests> === PAUSE TestReadProxyNarinfoAlreadyDecompressed
niks3-go-unit-tests> === RUN   TestReadProxyNarStreaming
niks3-go-unit-tests> === PAUSE TestReadProxyNarStreaming
niks3-go-unit-tests> === RUN   TestReadProxy404
niks3-go-unit-tests> === PAUSE TestReadProxy404
niks3-go-unit-tests> === RUN   TestReadProxyInvalidPath
niks3-go-unit-tests> === PAUSE TestReadProxyInvalidPath
niks3-go-unit-tests> === RUN   TestReadProxyHead
niks3-go-unit-tests> === PAUSE TestReadProxyHead
niks3-go-unit-tests> === RUN   TestReadProxyConditionalGet
niks3-go-unit-tests> === PAUSE TestReadProxyConditionalGet
niks3-go-unit-tests> === RUN   TestReadProxyRootRedirectsToIndexHTML
niks3-go-unit-tests> === PAUSE TestReadProxyRootRedirectsToIndexHTML
niks3-go-unit-tests> === RUN   TestReadProxyDisabled
niks3-go-unit-tests> === PAUSE TestReadProxyDisabled
niks3-go-unit-tests> === RUN   TestReadProxyRangeRequest
niks3-go-unit-tests> === PAUSE TestReadProxyRangeRequest
niks3-go-unit-tests> === RUN   TestRedundantMultipartUpload
niks3-go-unit-tests> === PAUSE TestRedundantMultipartUpload
niks3-go-unit-tests> === RUN   TestCompleteMultipartUpload_ErrorButObjectExists
niks3-go-unit-tests> === PAUSE TestCompleteMultipartUpload_ErrorButObjectExists
niks3-go-unit-tests> === RUN   TestCompletedNarNotReofferedAcrossClosures
niks3-go-unit-tests> === PAUSE TestCompletedNarNotReofferedAcrossClosures
niks3-go-unit-tests> === RUN   TestPresignedUploadRegisteredBeforeCommit
niks3-go-unit-tests> === PAUSE TestPresignedUploadRegisteredBeforeCommit
niks3-go-unit-tests> === RUN   TestService_Rustfstest
niks3-go-unit-tests> === PAUSE TestService_Rustfstest
niks3-go-unit-tests> === RUN   TestParseSize
niks3-go-unit-tests> === PAUSE TestParseSize
niks3-go-unit-tests> === RUN   TestSkippedUploadsHandler
niks3-go-unit-tests> === PAUSE TestSkippedUploadsHandler
niks3-go-unit-tests> === RUN   TestSystemdListenerNotActivated
niks3-go-unit-tests> --- PASS: TestSystemdListenerNotActivated (0.00s)
niks3-go-unit-tests> === RUN   TestWatchdogBeatsWhenHealthy
niks3-go-unit-tests> --- PASS: TestWatchdogBeatsWhenHealthy (0.02s)
niks3-go-unit-tests> === RUN   TestWatchdogSkipsWhenUnhealthy
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN watchdog liveness check failed, skipping heartbeat error="context deadline exceeded"
niks3-go-unit-tests> --- PASS: TestWatchdogSkipsWhenUnhealthy (0.20s)
niks3-go-unit-tests> === RUN   TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle
niks3-go-unit-tests> === PAUSE TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle
niks3-go-unit-tests> === RUN   TestProxyWriteTimeout
niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout
niks3-go-unit-tests> === RUN   TestIsValidUploadKey
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectInvalidKeys
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectOversizedBody
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody
niks3-go-unit-tests> === RUN   TestService_cleanupPendingClosuresHandler
niks3-go-unit-tests> === PAUSE TestService_cleanupPendingClosuresHandler
niks3-go-unit-tests> === RUN   TestService_createPendingClosureHandler
niks3-go-unit-tests> === PAUSE TestService_createPendingClosureHandler
niks3-go-unit-tests> === RUN   TestService_verifyS3Integrity
niks3-go-unit-tests> === PAUSE TestService_verifyS3Integrity
niks3-go-unit-tests> === RUN   TestCompleteMultipartUnregistered
niks3-go-unit-tests> === PAUSE TestCompleteMultipartUnregistered
niks3-go-unit-tests> === RUN   TestCreatePendingClosure_SmallNARUsesSimplePUT
niks3-go-unit-tests> === PAUSE TestCreatePendingClosure_SmallNARUsesSimplePUT
niks3-go-unit-tests> === CONT  TestCreatePendingClosure_SmallNARUsesSimplePUT
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectOversizedBody
niks3-go-unit-tests> === CONT  TestOrphanedObjectsGC
niks3-go-unit-tests> === CONT  TestMetricsInventory
niks3-go-unit-tests> === CONT  TestService_AuthMiddleware
niks3-go-unit-tests> === CONT  TestCompleteMultipartUnregistered
niks3-go-unit-tests> === CONT  TestObjectStatsTrigger
niks3-go-unit-tests> === CONT  TestService_verifyS3Integrity
niks3-go-unit-tests> === CONT  TestMultipartCleanup
niks3-go-unit-tests> === CONT  TestService_createPendingClosureHandler
niks3-go-unit-tests> === CONT  TestServerTLSConfig
niks3-go-unit-tests> === RUN   TestServerTLSConfig/no_client_CA
niks3-go-unit-tests> === CONT  TestService_cleanupPendingClosuresHandler
niks3-go-unit-tests> === PAUSE TestServerTLSConfig/no_client_CA
niks3-go-unit-tests> === RUN   TestServerTLSConfig/missing_CA_file
niks3-go-unit-tests> === CONT  TestService_NativeMTLS
niks3-go-unit-tests> === CONT  TestNARDeduplicationMetadataUploadBug
niks3-go-unit-tests> === PAUSE TestServerTLSConfig/missing_CA_file
niks3-go-unit-tests> === CONT  TestCreatePendingClosureRejectsOversizedNAR
niks3-go-unit-tests> === RUN   TestServerTLSConfig/not_a_PEM_file
niks3-go-unit-tests> === PAUSE TestServerTLSConfig/not_a_PEM_file
niks3-go-unit-tests> === CONT  TestGenerateLandingPage
niks3-go-unit-tests> === CONT  TestGCBugBareHashReferences
niks3-go-unit-tests> === CONT  TestPinProtectsFromGC
niks3-go-unit-tests> === CONT  TestClientWithDependencies
niks3-go-unit-tests> === CONT  TestClientMultipleUploads
niks3-go-unit-tests> === CONT  TestClientIntegration
niks3-go-unit-tests> === CONT  TestClientErrorHandling
niks3-go-unit-tests> === CONT  TestGCMetrics
niks3-go-unit-tests> === CONT  TestCacheConfigHandlerMaxNarSize
niks3-go-unit-tests> === CONT  TestClientCADerivations
niks3-go-unit-tests> 2026/08/20 17:24:13 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> --- PASS: TestCreatePendingClosureRejectsOversizedNAR (0.00s)
niks3-go-unit-tests> === CONT  TestCacheStatsHandler
niks3-go-unit-tests> --- PASS: TestGenerateLandingPage (0.00s)
niks3-go-unit-tests> === RUN   TestClientErrorHandling/InvalidStorePath
niks3-go-unit-tests> === PAUSE TestClientErrorHandling/InvalidStorePath
niks3-go-unit-tests> === RUN   TestClientErrorHandling/InvalidAuthToken
niks3-go-unit-tests> === PAUSE TestClientErrorHandling/InvalidAuthToken
niks3-go-unit-tests> === RUN   TestClientErrorHandling/ServerNotAvailable
niks3-go-unit-tests> === PAUSE TestClientErrorHandling/ServerNotAvailable
niks3-go-unit-tests> === CONT  TestCacheConfigHandler
niks3-go-unit-tests> === RUN   TestCacheConfigHandler/full_config,_no_issuer
niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/full_config,_no_issuer
niks3-go-unit-tests> === RUN   TestCacheConfigHandler/no_cache_url_configured
niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/no_cache_url_configured
niks3-go-unit-tests> === CONT  TestGracefulShutdownDrainsInflight
niks3-go-unit-tests> === RUN   TestCacheConfigHandler/no_signing_keys
niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/no_signing_keys
niks3-go-unit-tests> === RUN   TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator
niks3-go-unit-tests> === PAUSE TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator
niks3-go-unit-tests> === CONT  TestService_AuthMiddleware_OIDC
niks3-go-unit-tests> === CONT  TestService_healthCheckHandler
niks3-go-unit-tests> 2026/08/20 17:24:13 INFO Starting HTTP server address=127.0.0.1:34515
niks3-go-unit-tests> --- PASS: TestCacheConfigHandlerMaxNarSize (0.00s)
niks3-go-unit-tests> 2026/08/20 17:24:13 INFO Shutdown signal received, draining in-flight requests timeout=10s
niks3-go-unit-tests> 2026/08/20 17:24:13 INFO OIDC provider initialized name=test
niks3-go-unit-tests> 2026-08-20 17:24:13.616 UTC [579] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.616 UTC [579] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (21.3ms)
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectOversizedBody/create_pending_closure
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody/create_pending_closure
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectOversizedBody/complete_multipart
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody/complete_multipart
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectOversizedBody/request_more_parts
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectOversizedBody/request_more_parts
niks3-go-unit-tests> === CONT  TestGCTaskStore_Fail
niks3-go-unit-tests> --- PASS: TestGCTaskStore_Fail (0.00s)
niks3-go-unit-tests> === CONT  TestService_ReadAuthMiddleware
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [591] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [591] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [594] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [594] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [592] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [592] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [593] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.686 UTC [593] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.694 UTC [597] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.694 UTC [597] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (17.34ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (16.49ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (19.77ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (4.43ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (4.28ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> --- PASS: TestGracefulShutdownDrainsInflight (0.15s)
niks3-go-unit-tests> === CONT  TestGCTaskStore_PhaseUpdates
niks3-go-unit-tests> --- PASS: TestGCTaskStore_PhaseUpdates (0.00s)
niks3-go-unit-tests> === CONT  TestService_AuthMiddleware_MTLSBoundSubjects
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (33.34ms)
niks3-go-unit-tests> 2026-08-20 17:24:13.752 UTC [599] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.752 UTC [599] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (38.64ms)
niks3-go-unit-tests> 2026-08-20 17:24:13.757 UTC [600] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.757 UTC [600] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.759 UTC [603] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.759 UTC [603] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.759 UTC [602] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.759 UTC [602] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (5.25ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (40.13ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (5.76ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (41.48ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (40.76ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (6.53ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (5.31ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (5.37ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (10.51ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (11.16ms)
niks3-go-unit-tests> 2026-08-20 17:24:13.775 UTC [605] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.775 UTC [605] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.776 UTC [607] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.776 UTC [607] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.776 UTC [606] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.776 UTC [606] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (13.26ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (19.09ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (19.39ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (19.76ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (30.26ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (22.66ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (27.28ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (15.4ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (6.76ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (27.97ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (9.97ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (9.95ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (28.65ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.5ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (4.15ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (6.23ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (5.01ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (5.36ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (7.85ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (8.16ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (7.96ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (7.7ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (7.44ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (5.08ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (7.14ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (7.04ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (4.02ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (4.21ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (9.35ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (6.12ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (9.5ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (19.21ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (10.1ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (21.03ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (21.06ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (16.98ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (14.5ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (11.3ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (11.25ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (13.51ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (11.57ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (11.62ms)
niks3-go-unit-tests> 2026-08-20 17:24:13.829 UTC [609] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.829 UTC [609] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.830 UTC [608] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.830 UTC [608] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (5.02ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (5.4ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (5.2ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (7.6ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (7.8ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (6.87ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (4.62ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (8.66ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.838575829Z","level":"ERROR","duration":"603.385µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.839472956Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7640cf7d-9503-45df-9ce1-31ac1dcbbb64","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":1,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (7.62ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (7.39ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026-08-20 17:24:13.843 UTC [610] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.843 UTC [610] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (7.57ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026-08-20 17:24:13.844 UTC [613] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.844 UTC [613] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.845100086Z","level":"ERROR","duration":"563.645µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.845172306Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f812f508-5074-4e7b-9a18-4ead2792a4b5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket11/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> 2026-08-20 17:24:13.845 UTC [614] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.845 UTC [614] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.845 UTC [611] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.845 UTC [611] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.846 UTC [616] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.846 UTC [616] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.846 UTC [612] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.846 UTC [612] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:13.846 UTC [615] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.846 UTC [615] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (6.53ms)
niks3-go-unit-tests> 2026-08-20 17:24:13.850 UTC [617] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.850 UTC [617] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (8.44ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (13.9ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (5.8ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (14.23ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (4.35ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.857755996Z","level":"ERROR","duration":"636.225µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.857837677Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dee46eec-39b9-40ce-bbc7-5f732b059771","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (5.01ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (15.41ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.858971587Z","level":"ERROR","duration":"450.904µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.859026267Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"32485ee8-0cbf-46f7-9596-4fa68c982504","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.9ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (2.83ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.863459826Z","level":"ERROR","duration":"492.484µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.863543867Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"89010736-8013-4403-964a-309f753b3d89","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket14/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (4.75ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (6.39ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (12.19ms)
niks3-go-unit-tests> 2026-08-20 17:24:13.869 UTC [618] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.869 UTC [618] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (13.22ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (14.16ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (6.12ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (12.65ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (13.89ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (14.64ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.36ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (6.53ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (13.62ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (14.57ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (2.81ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.08ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (2.56ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (4.09ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (4.86ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (2.31ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.81ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.99ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.11ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (4.5ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (5.91ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (2.45ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (4.33ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (3.26ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (5.31ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (4.41ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.880076212Z","level":"ERROR","duration":"386.884µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (5.64ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.880134112Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"db24bdb4-3af9-49cd-be00-b079bf28affc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (5.72ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (5.03ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (4.23ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (5.58ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (5.4ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (5.2ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (6.28ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (5.36ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (5.24ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.15ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (4.37ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (4.47ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (9.06ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.24ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.39ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.24ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (1.9ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (3.08ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.13ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.15ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.33ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (2.03ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.34ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (2.48ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.888811328Z","level":"ERROR","duration":"534.045µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.888892929Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cbb8eb72-a1d9-43ad-b466-9ed476e1552d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.27ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.82ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.31ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.889559515Z","level":"ERROR","duration":"558.444µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.889642835Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"0bbbf0f5-6923-4430-b70b-a320c86d1c9f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.1ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.889776836Z","level":"ERROR","duration":"498.904µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(302)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.889849477Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ddbf30da-e1eb-4658-a47b-cf667cc96edc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(302)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.57ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.890423242Z","level":"ERROR","duration":"343.203µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.890469642Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2ff9e6cd-8fb9-43ec-824b-1d2e9522fda6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.890731185Z","level":"ERROR","duration":"287.283µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.890770825Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"731de673-e414-49da-ac1e-e5ca83490424","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.890827526Z","level":"ERROR","duration":"448.964µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.890893306Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8163d349-039f-42d2-9ce4-39c736603d77","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.891098908Z","level":"ERROR","duration":"419.704µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.891141328Z","level":"ERROR","duration":"252.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.891175629Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"0fe078c5-d20b-4f3f-8c6e-26659d4fb8c5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.891170729Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4ae67482-73a1-48ac-9dc3-39c80dd4add4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251218171726_add_pins.sql (3.76ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20260628120000_add_object_size_and_stats.sql (3.5ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN mTLS auth: subject not in bound subjects subject="CN=writer"
niks3-go-unit-tests> --- PASS: TestService_ReadAuthMiddleware (0.21s)
niks3-go-unit-tests> === CONT  TestGCTaskStore_CompletedAllowsNewTask
niks3-go-unit-tests> --- PASS: TestGCTaskStore_CompletedAllowsNewTask (0.00s)
niks3-go-unit-tests> === CONT  TestService_AuthMiddleware_MTLSProxyHeader
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   1_commit_pending_closure.sql (1.72ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   2_object_stats_trigger.sql (1.07ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.900197868Z","level":"ERROR","duration":"560.725µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.900287768Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"602567ba-1f03-4757-a3bd-d430a6ec7e92","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket25/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.904581146Z","level":"ERROR","duration":"128.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.904622866Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f499148e-9dcb-4203-a909-30c244a242b6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.906519683Z","level":"ERROR","duration":"421.984µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.906543183Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1e2c8e97-f3ce-4486-8e43-adb28323f422","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.932240668Z","level":"ERROR","duration":"187.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.932292688Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7724f930-4af5-4081-aa68-5a5c0e84da38","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.934434867Z","level":"ERROR","duration":"569.325µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.934517468Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8c84c2ad-7ab8-4a27-b51a-1a591cd848a8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.937203791Z","level":"ERROR","duration":"140.841µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.937254572Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ba8779dd-376b-4cf0-916a-5c48d3cdf2c2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket11/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(303)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.940226418Z","level":"ERROR","duration":"231.962µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:13.940300939Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ae14831c-fc6f-49d7-90e3-18182a0e90ca","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> 2026/08/20 17:24:13 WARN Authentication failed token_preview=wrongtoken token_length=10 reason="static API token mismatch"
niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware (0.41s)
niks3-go-unit-tests> === CONT  TestGCTaskStore_GetReturnsLatest
niks3-go-unit-tests> --- PASS: TestGCTaskStore_GetReturnsLatest (0.00s)
niks3-go-unit-tests> === CONT  TestGCTaskStore_GetEmpty
niks3-go-unit-tests> --- PASS: TestGCTaskStore_GetEmpty (0.00s)
niks3-go-unit-tests> === CONT  TestGCTaskStore_ConflictDifferentParams
niks3-go-unit-tests> --- PASS: TestGCTaskStore_ConflictDifferentParams (0.00s)
niks3-go-unit-tests> === CONT  TestParseSize
niks3-go-unit-tests> --- PASS: TestParseSize (0.00s)
niks3-go-unit-tests> === CONT  TestGCTaskStore_DeduplicateSameParams
niks3-go-unit-tests> --- PASS: TestGCTaskStore_DeduplicateSameParams (0.00s)
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectInvalidKeys
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key
niks3-go-unit-tests> === RUN   TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key
niks3-go-unit-tests> === PAUSE TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key
niks3-go-unit-tests> === CONT  TestGCTaskStore_StartNew
niks3-go-unit-tests> --- PASS: TestGCTaskStore_StartNew (0.00s)
niks3-go-unit-tests> === CONT  TestIsValidUploadKey
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/narinfo
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/narinfo
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/nar_zst
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_zst
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/nar_xz
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_xz
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/nar_plain
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_plain
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/listing
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/listing
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/build_log
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/build_log_home-manager_file
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_home-manager_file
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/build_log_plus_in_name
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_plus_in_name
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/build_log_question_mark
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_question_mark
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/build_log_equals
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/build_log_equals
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/realisation
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/realisation
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/realisation_plus_in_output
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/realisation_plus_in_output
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/nix-cache-info
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nix-cache-info
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/index.html
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/index.html
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/narinfo_key,_nar_type
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/narinfo_key,_nar_type
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/nar_key,_narinfo_type
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/nar_key,_narinfo_type
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/listing_key,_narinfo_type
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/listing_key,_narinfo_type
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/traversal
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/traversal
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/traversal_nar
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/traversal_nar
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/absolute
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/absolute
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/empty_key
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/empty_key
niks3-go-unit-tests> === RUN   TestIsValidUploadKey/unknown_type
niks3-go-unit-tests> === PAUSE TestIsValidUploadKey/unknown_type
niks3-go-unit-tests> === CONT  TestProxyWriteTimeout
niks3-go-unit-tests> === RUN   TestProxyWriteTimeout/narinfo
niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/narinfo
niks3-go-unit-tests> === RUN   TestProxyWriteTimeout/1_GiB_nar
niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/1_GiB_nar
niks3-go-unit-tests> === RUN   TestProxyWriteTimeout/10_GiB_nar
niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/10_GiB_nar
niks3-go-unit-tests> === RUN   TestProxyWriteTimeout/unknown_size
niks3-go-unit-tests> === PAUSE TestProxyWriteTimeout/unknown_size
niks3-go-unit-tests> === CONT  TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle
niks3-go-unit-tests> --- PASS: TestMetricsInventory (0.42s)
niks3-go-unit-tests> === CONT  TestReadProxyDisabled
niks3-go-unit-tests> 2026-08-20 17:24:13.969 UTC [625] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:13.969 UTC [625] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20241026095416_initial_model.sql (13.99ms)
niks3-go-unit-tests> 2026/08/20 17:24:13 OK   20251210153512_drop_unused_gin_index.sql (3.68ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251218171726_add_pins.sql (11.72ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20260628120000_add_object_size_and_stats.sql (6.45ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   1_commit_pending_closure.sql (2.24ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   2_object_stats_trigger.sql (976.23µs)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: up to current file version: 2
niks3-go-unit-tests> 2026-08-20 17:24:14.029 UTC [626] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:14.029 UTC [626] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026-08-20 17:24:14.029 UTC [627] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:14.029 UTC [627] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20241026095416_initial_model.sql (9.86ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20241026095416_initial_model.sql (10.03ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251210153512_drop_unused_gin_index.sql (1.2ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251210153512_drop_unused_gin_index.sql (1.41ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251218171726_add_pins.sql (3.43ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251218171726_add_pins.sql (3.22ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20260628120000_add_object_size_and_stats.sql (3.31ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20260628120000_add_object_size_and_stats.sql (3.39ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   1_commit_pending_closure.sql (1.8ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   1_commit_pending_closure.sql (2.05ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   2_object_stats_trigger.sql (927.43µs)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: up to current file version: 2
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   2_object_stats_trigger.sql (900.35µs)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302289024Z","level":"ERROR","duration":"215.482µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302366045Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c544cfef-1323-4b34-a234-1fbe96232f34","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(355)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302632967Z","level":"ERROR","duration":"730.486µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302658268Z","level":"ERROR","duration":"608.226µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302704068Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"982d8beb-1331-49a6-9eda-1a0941e3ff89","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(304)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302712748Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4ed7aa25-8b87-4272-98a9-2d9df6002597","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(381)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302705108Z","level":"ERROR","duration":"609.585µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.302768109Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"91a8a36a-6f64-4e2b-a993-2261d0ff5161","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(264)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.463333773Z","level":"ERROR","duration":"259.682µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.463392254Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3e5ce4af-effa-44ff-b4a1-34884c9bb571","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":5,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.483434829Z","level":"ERROR","duration":"2.563523ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.483488889Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ac122e17-e1f9-4d69-948a-a2b1454824ac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":2,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted,O=Other"
niks3-go-unit-tests> 2026/08/20 17:24:14 WARN mTLS auth: bound subjects configured but subject DN unavailable
niks3-go-unit-tests> 2026/08/20 17:24:14 WARN mTLS auth: subject not in bound subjects subject="CN=untrusted"
niks3-go-unit-tests> --- PASS: TestService_AuthMiddleware_MTLSBoundSubjects (0.73s)
niks3-go-unit-tests> === CONT  TestSkippedUploadsHandler
niks3-go-unit-tests> 2026/08/20 17:24:14 INFO Client skipped oversized paths paths=3 nar_bytes=5000000000
niks3-go-unit-tests> --- PASS: TestSkippedUploadsHandler (0.01s)
niks3-go-unit-tests> === CONT  TestCompleteMultipartUpload_ErrorButObjectExists
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.519906268Z","level":"ERROR","duration":"217.723265ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(387)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.519968429Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"026653ea-b8d4-4b91-824c-63c2d3235f8a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":218,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(387)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.533392746Z","level":"ERROR","duration":"14.392686ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.533452246Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a74e783d-24ee-4af3-90b5-757409e2c3fd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":14,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(356)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.533684248Z","level":"ERROR","duration":"14.680388ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.533742549Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e7d8eb3a-1119-4afa-a61c-902813594412","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":14,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(374)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.542844149Z","level":"ERROR","duration":"325.663µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.542885269Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"745674c3-4b15-44a9-9a1f-8008be885c95","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.54299373Z","level":"ERROR","duration":"264.122µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.54303529Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"110b3e09-67d9-447a-a1be-ccab6363b131","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}
niks3-go-unit-tests> 2026-08-20 17:24:14.569 UTC [631] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:14.569 UTC [631] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.569946225Z","level":"ERROR","duration":"159.981µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.570002766Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2551dfde-e54b-4c16-b69f-1975c71b556a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20241026095416_initial_model.sql (10.58ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251210153512_drop_unused_gin_index.sql (2.29ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.589600137Z","level":"ERROR","duration":"148.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.589644678Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"07ded1c0-53a7-4b3a-af8c-92e13b120da2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251218171726_add_pins.sql (3.62ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20260628120000_add_object_size_and_stats.sql (2.99ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   1_commit_pending_closure.sql (1.85ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   2_object_stats_trigger.sql (850.99µs)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.600653034Z","level":"ERROR","duration":"446.704µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.600712275Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b3cde81a-f286-4455-b438-2b406659d914","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.613759889Z","level":"ERROR","duration":"83.022946ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.61381395Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1c4f4b0d-ddb3-4508-840a-af5add465839","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":93,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> --- PASS: TestCreatePendingClosure_SmallNARUsesSimplePUT (1.12s)
niks3-go-unit-tests> === CONT  TestRedundantMultipartUpload
niks3-go-unit-tests> === NAME  TestOrphanedObjectsGC
niks3-go-unit-tests>     orphaned_objects_gc_test.go:290: GC Test Summary:
niks3-go-unit-tests>     orphaned_objects_gc_test.go:291:   - Kept:    2 objects from closure A
niks3-go-unit-tests>     orphaned_objects_gc_test.go:292:   - Deleted: 2 objects from closure B
niks3-go-unit-tests>     orphaned_objects_gc_test.go:293:   - Deleted: 6 orphaned chain objects (X1->X2->X3)
niks3-go-unit-tests>     orphaned_objects_gc_test.go:294:   - Deleted: 2 orphaned single objects (Y)
niks3-go-unit-tests>     orphaned_objects_gc_test.go:295:   - Total deleted: 10 objects
niks3-go-unit-tests> --- PASS: TestOrphanedObjectsGC (1.19s)
niks3-go-unit-tests> === CONT  TestReadProxyRangeRequest
niks3-go-unit-tests> 2026-08-20 17:24:14.721 UTC [652] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:14.721 UTC [652] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.730354229Z","level":"ERROR","duration":"4.043135ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.730429209Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ceb67692-e4bd-46d6-a206-287cb65c3a74","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":197,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20241026095416_initial_model.sql (10.65ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251210153512_drop_unused_gin_index.sql (2.7ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251218171726_add_pins.sql (4.61ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.750882628Z","level":"ERROR","duration":"1.690755ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.750942709Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5ae09685-0e35-4ebc-815e-f3edc25c50d4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":1,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20260628120000_add_object_size_and_stats.sql (5.35ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.753174428Z","level":"ERROR","duration":"107.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.753202089Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d68e7bf0-f5ae-48f7-83f2-03b3b074fb9c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   1_commit_pending_closure.sql (3.31ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   2_object_stats_trigger.sql (2.04ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.758799697Z","level":"ERROR","duration":"621.885µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.758883918Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3e0799d7-9883-488d-9a50-d1c7098b97ad","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.772122654Z","level":"ERROR","duration":"548.025µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.772195815Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9b41b880-e811-42d5-a851-1ee1fc691c1d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(354)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.783267131Z","level":"ERROR","duration":"316.662µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.783348852Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5c29463f-175f-4333-862b-7ae3aa420b97","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> 2026-08-20 17:24:14.797 UTC [655] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:14.797 UTC [655] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20241026095416_initial_model.sql (9.99ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251210153512_drop_unused_gin_index.sql (1.28ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20251218171726_add_pins.sql (3.6ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   20260628120000_add_object_size_and_stats.sql (3.8ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   1_commit_pending_closure.sql (1.81ms)
niks3-go-unit-tests> 2026/08/20 17:24:14 OK   2_object_stats_trigger.sql (826.45µs)
niks3-go-unit-tests> 2026/08/20 17:24:14 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.82765696Z","level":"ERROR","duration":"498.205µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.82774524Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7ba71cc9-612e-4c32-be64-5292c395a3a8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(214)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.833703353Z","level":"ERROR","duration":"205.522µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.833785793Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dea98965-1564-4d7e-bc4f-2083b151d64e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(295)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.862972129Z","level":"ERROR","duration":"3.33773ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.863027789Z","level":"ERROR","duration":"3.547591ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(353)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.86306411Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4fe987b8-e83e-48cd-ba54-06e6eabed7b0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":3,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(353)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.866106136Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5b5a1944-d980-4b2d-b54d-07b359c50c98","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":563,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.866201157Z","level":"ERROR","duration":"6.355096ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.866249797Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c67adb81-4eb7-4b6a-a5f6-61a23e272e0f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":11,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.86653986Z","level":"ERROR","duration":"7.92753ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.86658976Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cc8dcf58-f288-49ab-a3cd-fe06fb3f38d9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":12,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.894498685Z","level":"ERROR","duration":"201.502µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.894543305Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"aa7e262d-d7b0-4bfc-b019-993d8563bcde","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.918456014Z","level":"ERROR","duration":"213.322µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.918551575Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e36644e4-6801-4f08-855e-27a999afa0ac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.930218277Z","level":"ERROR","duration":"91.241µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.930246617Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3bc7412a-8a26-4677-a8a7-5d3e70ca2acd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.985375219Z","level":"ERROR","duration":"138.601µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.9854286Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"98fa6c0c-8db7-4ba8-96f4-f3cef7bfd7e1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.995346786Z","level":"ERROR","duration":"206.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:14.995428067Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"62412df7-975f-45bd-80a2-cffd5ed92f57","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.020204904Z","level":"ERROR","duration":"117.441µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.020252084Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d91080ac-9fd6-40ac-b4ad-47e2a415e82e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.022851047Z","level":"ERROR","duration":"130.161µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.022902408Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a1c77c8f-89ef-4eb2-a1cd-09be5f5a1c56","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.027448827Z","level":"ERROR","duration":"95.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.027490028Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"55b08210-864f-400b-a171-8b499056275b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.042269157Z","level":"ERROR","duration":"141.041µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.042318918Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"09a613aa-d74a-49cc-a1bd-7c84bd3f3772","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.047633864Z","level":"ERROR","duration":"248.742µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.047681804Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"93929fab-4e62-4dc2-8c7e-c9b670338d56","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.06661017Z","level":"ERROR","duration":"6.012053ms","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.066709911Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"46f9b99f-f9ab-4c3d-aab5-e204780fb4d6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":6,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.068502606Z","level":"ERROR","duration":"172.961µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.068556447Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a21e12e7-d1d0-4222-b8b7-8158ade718f9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.068975411Z","level":"ERROR","duration":"138.402µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.069010671Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1ddf3f36-5ecf-4714-898e-e398d609e093","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.084537327Z","level":"ERROR","duration":"64.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.084560247Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b821e0e-ff11-4e67-b278-f22593612105","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.12614601Z","level":"ERROR","duration":"60.28µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.126170931Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"babc2524-0342-41a1-9a8f-4ca718c862a8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.150938488Z","level":"ERROR","duration":"164.822µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.151002208Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"68a0121e-ddce-4661-83ef-56f8f8fc9a72","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.159964066Z","level":"ERROR","duration":"232.842µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.160052287Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"820768fb-cb91-4d9e-a0ca-f19c0b2c8a22","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.161639621Z","level":"ERROR","duration":"119.941µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.161686542Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"97c944af-1e30-4668-b06e-f5ba801740d2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.168251979Z","level":"ERROR","duration":"97.301µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.168296239Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ab938d80-ce0c-4a47-9953-b4ff842f5645","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.208991895Z","level":"ERROR","duration":"133.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.209045996Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b9ac5dcd-3698-45aa-8e4a-2840dd6cbc68","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.213707777Z","level":"ERROR","duration":"117.141µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.213755997Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"fb357d1f-1a57-43ef-a624-97d732c0d204","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.255455702Z","level":"ERROR","duration":"226.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.255505442Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c5ae862b-463c-4f5d-9ec1-2310e354c83f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.321276617Z","level":"ERROR","duration":"161.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.321340978Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7b7656c0-2fa2-4591-9179-1719c74b252e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.321352258Z","level":"ERROR","duration":"209.002µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.321429379Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"25e85367-8501-4ec8-9b25-720083b6e623","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.402140825Z","level":"ERROR","duration":"170.742µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.402208245Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4a540611-533a-4b51-b47d-867bc2a998e0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.404870048Z","level":"ERROR","duration":"105.401µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.404914649Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9a706396-26bf-4356-9836-3890da237398","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.461497224Z","level":"ERROR","duration":"107.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.461544004Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"885c2d5c-aff5-45a9-bc27-75484e1e12ec","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.47819247Z","level":"ERROR","duration":"105.921µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.47823711Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"926a358d-26b4-4c11-b875-0255173490b0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.557873987Z","level":"ERROR","duration":"178.182µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.557922867Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a800239e-34aa-46a5-b766-2d90dfff84fc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.571558787Z","level":"ERROR","duration":"98.461µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.571600067Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b9e43e33-3083-43d3-a9fc-05e51723d38c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.622175069Z","level":"ERROR","duration":"95.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.62221759Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5a5eca40-2029-44b3-8bdd-4770fc9c1cc1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.691854599Z","level":"ERROR","duration":"97.901µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.691897679Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6662c1a8-bf38-46aa-a3ad-35c23a57f3f5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.701798486Z","level":"ERROR","duration":"199.182µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.701874206Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7f5c9ac7-e214-477e-9353-76c374a2c130","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.779811828Z","level":"ERROR","duration":"223.362µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.779912569Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6c4f67ba-4e78-4a2c-ba73-db4ae3ca3bf5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.83601666Z","level":"ERROR","duration":"244.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.83610636Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a1c3f77d-4e20-4c31-b9dd-fefa52150c68","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.842839119Z","level":"ERROR","duration":"152.021µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.84289522Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"70c35c62-43ad-43bd-b582-cd709d3c6c3d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.884835887Z","level":"ERROR","duration":"268.003µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.884916807Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dc56c7b1-c50e-4684-9759-2327e0e198eb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.91383764Z","level":"ERROR","duration":"163.201µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.913896461Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e80bd0d4-0f09-4321-aa4d-064107a54cce","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.925767985Z","level":"ERROR","duration":"137.202µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.925820645Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8bedbf53-4d99-407a-a37e-b9e0c12111c1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.946852069Z","level":"ERROR","duration":"208.282µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.94693057Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b1603d94-9d71-4c57-80ae-a6f0d0249b65","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.992855911Z","level":"ERROR","duration":"169.281µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:15.992914332Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3ea890af-d42b-4c34-a675-79b3dd08b7e1","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.051885408Z","level":"ERROR","duration":"163.102µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.051947388Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"77102fde-7f78-4e0b-8a36-bac22b256aac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.061887955Z","level":"ERROR","duration":"230.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.061973096Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2892d973-de85-4374-bd75-212ac0dc739d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.097009302Z","level":"ERROR","duration":"194.841µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.097077903Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b55e1dbf-4214-4a20-92e4-4fc5b4fd78ec","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.106742088Z","level":"ERROR","duration":"133.682µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.106794608Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"16b9fdd3-3207-4f88-85dc-ee36b6f1abc3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.114332894Z","level":"ERROR","duration":"111.921µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.114382035Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c9064201-2782-443c-b499-d2a839a10c7b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.159061085Z","level":"ERROR","duration":"121.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.159110966Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"260a9cb3-5200-4f6c-b125-7aca9c74836e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.16987352Z","level":"ERROR","duration":"107.541µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.16991998Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6a958734-9f90-4dea-8684-b8056efa0e24","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.173675433Z","level":"ERROR","duration":"213.342µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.173757354Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a439d6d0-97cb-42d0-9d76-326364618707","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.175351248Z","level":"ERROR","duration":"120.141µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.175402688Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6df32b54-c5a7-4570-90ad-8434fc97ca45","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.197177418Z","level":"ERROR","duration":"209.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.197232859Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2a68f5ff-b233-4c4e-aa44-7305a7abf689","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.228062589Z","level":"ERROR","duration":"200.602µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.228136809Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c4f4708e-8e96-4b86-a925-6c5ab1b01a11","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.228457512Z","level":"ERROR","duration":"105.681µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.228500172Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d1c9725e-99c4-48f3-bce8-4e06468649a3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.251148071Z","level":"ERROR","duration":"98.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.251192031Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"04bf696b-9115-4f51-a8c3-3774176fa35c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.271853352Z","level":"ERROR","duration":"112.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.271905492Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c52f1fa7-ff53-4dd0-aa38-24a1be8a5db9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket24/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.318738682Z","level":"ERROR","duration":"183.222µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.318810123Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c300c108-608c-4393-8ac9-37541158de38","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.349607012Z","level":"ERROR","duration":"143.981µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.349660952Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"209496e1-ae7e-4b72-9e6d-d74fa8b9f484","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.393366315Z","level":"ERROR","duration":"135.942µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.393421815Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c728bf29-934b-4ce6-abef-6615bb065477","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.437155058Z","level":"ERROR","duration":"197.202µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.437227598Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b107971-ae89-46ba-8680-3b2be9ab4de6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.455912282Z","level":"ERROR","duration":"149.062µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.455968282Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"586b1dcd-9fbc-40f6-9c3c-38e8da0fe129","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.474853767Z","level":"ERROR","duration":"191.221µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.474924688Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"32135969-6bab-49c0-ace5-cc6a13ab8a5a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.493703352Z","level":"ERROR","duration":"149.601µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.493760493Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"68a1ccfa-9120-4212-8999-118b406b4cf5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.511626469Z","level":"ERROR","duration":"253.582µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.51169593Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"41f90a18-667c-41ea-8ea4-bf48b3ca6082","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.524521382Z","level":"ERROR","duration":"164.482µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.524587062Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"580954a0-921e-4068-aa42-ddc7ba89097c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.564419491Z","level":"ERROR","duration":"170.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.564484511Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6be67a04-9e40-4ad7-9bc0-b1ace94a68dc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.695535378Z","level":"ERROR","duration":"221.602µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.695622438Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6ec8b565-2840-4dbb-b734-b6a990e4f040","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.730539784Z","level":"ERROR","duration":"230.982µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.730608284Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1c63e533-c8a0-4808-8e7b-ba83ca64c2f4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.813643611Z","level":"ERROR","duration":"275.183µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.813736851Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"379421de-d11b-466f-b9f7-4451f0e05903","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.847604468Z","level":"ERROR","duration":"200.622µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.847677588Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8403103f-9a18-4df8-b2d4-6c3272a673ee","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.883708763Z","level":"ERROR","duration":"219.142µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.883790604Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b51cedb-fab9-4173-a3a0-3f02e0b160f8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.885514099Z","level":"ERROR","duration":"143.441µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.88556888Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8aec7e7b-405d-4e81-a539-0d7e577d5491","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.950458627Z","level":"ERROR","duration":"166.201µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.950574529Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e43d3b0c-0a87-4e5d-92b9-8d812ad50b37","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.98732177Z","level":"ERROR","duration":"147.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:16.98737887Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"87c3ecf2-d249-4a9d-ab46-74cdec32cd39","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.025255842Z","level":"ERROR","duration":"203.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.025328962Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b593fe15-92e4-412c-8c45-954cfe3761cc","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket23/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.028083586Z","level":"ERROR","duration":"129.781µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.028134347Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c6234239-3b56-41a5-b8a9-48388e37970a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.095796218Z","level":"ERROR","duration":"164.881µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.095859959Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f9a8ff82-1b80-4236-8eee-c072bfb139df","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.111542576Z","level":"ERROR","duration":"132.901µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.111598937Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"83443aef-8b9d-469f-936d-d529b0450c91","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> === NAME  TestClientMultipleUploads
niks3-go-unit-tests>     client_integration_test.go:310:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestClientMultipleUploads (3.54s)
niks3-go-unit-tests> === CONT  TestReadProxyNarStreaming
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.144565785Z","level":"ERROR","duration":"221.422µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.144623786Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b6b09235-a438-4d8b-b888-c123afc6034e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026-08-20 17:24:17.190 UTC [658] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:17.190 UTC [658] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20241026095416_initial_model.sql (9.25ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20251210153512_drop_unused_gin_index.sql (1.28ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20251218171726_add_pins.sql (3.32ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20260628120000_add_object_size_and_stats.sql (2.51ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.213167345Z","level":"ERROR","duration":"235.202µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.213254646Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ac8fc157-94bf-481a-9fe6-e7738505ea7c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   1_commit_pending_closure.sql (1.75ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   2_object_stats_trigger.sql (773.59µs)
niks3-go-unit-tests> 2026/08/20 17:24:17 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.217329762Z","level":"ERROR","duration":"714.307µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.217412302Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"124fdfcb-56d7-4cab-bb51-b22e8cbd7503","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.25950941Z","level":"ERROR","duration":"225.962µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.259592811Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e55b203b-9f00-45c0-baa1-c10cbf684fc4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.305486093Z","level":"ERROR","duration":"210.602µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.305566053Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b5ccbe05-46f2-4452-8f07-857bf975196d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.312529874Z","level":"ERROR","duration":"227.802µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.312617315Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9067b202-d6e0-4314-848e-27f1b8738d80","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.328528874Z","level":"ERROR","duration":"189.761µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.328594115Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e3b268f6-9bd6-4a08-9e74-82f2afaddb27","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.345286321Z","level":"ERROR","duration":"145.521µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.345378222Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c1636f20-aa0e-4767-b7da-854b022e980e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.356047495Z","level":"ERROR","duration":"120.521µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.356094055Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"394f41b2-39c3-4416-b2fd-88598d38e85c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.396790451Z","level":"ERROR","duration":"147.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.396842672Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c57d0f70-9cc4-40ad-b1db-f368d075741e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.420453278Z","level":"ERROR","duration":"98.461µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.420497659Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"0d67b069-15ae-41dd-b8a1-4868d7ea6971","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.462261724Z","level":"ERROR","duration":"207.722µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.462316904Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e008d494-4666-45f5-b45b-7b005e0b8218","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.476037784Z","level":"ERROR","duration":"101.301µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.476085505Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b378647d-56bb-4f09-8891-e89284f9a690","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket31/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.483958094Z","level":"ERROR","duration":"227.382µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.484044714Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"967ab24c-e625-4cea-bb6e-ed84f019cfb5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.571750201Z","level":"ERROR","duration":"122.961µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.571797942Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b481e1c5-f875-4c12-ab01-f2f7d1077d18","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.609373911Z","level":"ERROR","duration":"102.021µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.609417511Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"48b05ea7-6eee-4e1b-a328-7ea7ffe1c110","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.625957956Z","level":"ERROR","duration":"96.481µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.625999876Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"11ecc2ff-4259-41ba-a0b4-32b6caa6f019","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> === NAME  TestGCBugBareHashReferences
niks3-go-unit-tests>     gc_bug_test.go:18:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestGCBugBareHashReferences (4.03s)
niks3-go-unit-tests> === CONT  TestReadProxyRootRedirectsToIndexHTML
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.674755662Z","level":"ERROR","duration":"120.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.674803103Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"20d20de4-4228-4ea7-8f1e-cdd34325f27a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026-08-20 17:24:17.686 UTC [661] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:17.686 UTC [661] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20241026095416_initial_model.sql (8.91ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20251210153512_drop_unused_gin_index.sql (1.25ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20251218171726_add_pins.sql (2.76ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   20260628120000_add_object_size_and_stats.sql (2.88ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   1_commit_pending_closure.sql (1.72ms)
niks3-go-unit-tests> 2026/08/20 17:24:17 OK   2_object_stats_trigger.sql (751.87µs)
niks3-go-unit-tests> 2026/08/20 17:24:17 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.711334782Z","level":"ERROR","duration":"588.405µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.711410723Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f17365c4-1198-42e2-9363-49abf28b8dad","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.726414994Z","level":"ERROR","duration":"220.702µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.726510435Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3861057d-bf87-4918-a108-1f255ee9a31a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.767585675Z","level":"ERROR","duration":"299.063µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.767667375Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"47a3fb07-94ba-4e63-85a9-038770013870","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket19/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.76940385Z","level":"ERROR","duration":"217.722µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.769484611Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"024bfcee-b2db-43dc-9c49-56090f4bbb6b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.80137685Z","level":"ERROR","duration":"144.621µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.801431311Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c39b114d-ea51-4008-87f1-a31669fe9554","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.828060023Z","level":"ERROR","duration":"123.881µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.828106864Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"91e6ae4e-97fc-4a78-ad73-5f66546737ab","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.85283128Z","level":"ERROR","duration":"150.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.852885781Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7a6382f5-47ce-4110-a074-eb23155f00ec","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.908523887Z","level":"ERROR","duration":"104.541µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:17.908566968Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a326ee64-3075-4450-b781-5850c9905b63","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.052272225Z","level":"ERROR","duration":"120.962µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.052320985Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"703dfa87-4855-4a76-97cc-3ac534dd1fd7","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.070923128Z","level":"ERROR","duration":"167.422µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.070969928Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"468d4d9a-63ba-410b-bf9c-9d85473b0401","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.078651735Z","level":"ERROR","duration":"110.241µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.078696076Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b6fec57-511e-4ec6-b76b-a2e353b9b822","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket12/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.091354206Z","level":"ERROR","duration":"165.681µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.091415327Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c15b7d7a-2d05-4917-aaf5-17b05ef8be63","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> === NAME  TestReadProxyRangeRequest
niks3-go-unit-tests>     proxy_test.go:406:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestReadProxyRangeRequest (3.43s)
niks3-go-unit-tests> === CONT  TestReadProxyConditionalGet
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.156300614Z","level":"ERROR","duration":"142.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.156358995Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"98a5cbec-f38b-4129-9c00-ec05fd9b102c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.164011502Z","level":"ERROR","duration":"114.461µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.164058862Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4a8e7d60-07ce-4b05-9bcc-1ea546f6573a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket30/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.172636897Z","level":"ERROR","duration":"135.841µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.172690658Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"17a7fa2a-ce42-4978-b7e4-5f55f86cb26d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.176223229Z","level":"ERROR","duration":"102.161µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.176266889Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"16e6fc2c-d706-40b7-9257-6287efca0e3c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket17/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.180745008Z","level":"ERROR","duration":"93.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.180787529Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cda536d6-7079-482d-b320-529734dd1674","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.193404419Z","level":"ERROR","duration":"104.501µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.193451059Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"304fdf0d-d3a4-4581-ae38-76979dd3c976","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket20/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026-08-20 17:24:18.216 UTC [664] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.216 UTC [664] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (9.31ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.231419351Z","level":"ERROR","duration":"223.442µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.231501492Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1576968a-60a2-40c1-9dae-ac61718b7902","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.231836775Z","level":"ERROR","duration":"115.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.231881295Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a89a4f1e-84b1-4d95-b4d3-083d09f0f8dd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (1.26ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (3.21ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (2.67ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (1.81ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (865.07µs)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.243153814Z","level":"ERROR","duration":"573.845µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.243232755Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"66ebd295-f980-462d-9d8f-c6bb860f5faf","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.251211745Z","level":"ERROR","duration":"226.322µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.251291025Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d8a0a397-c266-4cf3-ac28-638b04330f64","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.331153024Z","level":"ERROR","duration":"150.342µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.331206864Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"54dac2b0-999e-43ce-a1d9-5cf17c7d6ace","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.334060549Z","level":"ERROR","duration":"124.821µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.33411171Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e90f489f-bbe8-4816-8304-377c2c875737","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> === NAME  TestService_healthCheckHandler
niks3-go-unit-tests>     health_test.go:10:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestService_healthCheckHandler (4.77s)
niks3-go-unit-tests> === CONT  TestService_Rustfstest
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.407183009Z","level":"ERROR","duration":"276.963µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.407249569Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"dce66147-901c-4b6a-859f-713513f74c91","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026-08-20 17:24:18.439 UTC [667] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.439 UTC [667] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (9.35ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (1.26ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (3.22ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (2.83ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (1.79ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (785.43µs)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.466231965Z","level":"ERROR","duration":"669.646µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.466317986Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6d861fba-f98a-404d-ab49-433841395f5a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.478360831Z","level":"ERROR","duration":"219.322µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.478433592Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"14b9a5d5-3c6f-41a4-9de5-d73f149fda09","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.49419261Z","level":"ERROR","duration":"123.621µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.49424475Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a7665358-2615-4884-88da-0a64fac9dd07","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket18/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.579200474Z","level":"ERROR","duration":"217.022µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.579282294Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"cfd953be-0d94-413b-98be-378695d09300","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.589939667Z","level":"ERROR","duration":"122.201µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.589987808Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2e3e5606-c547-402c-9b28-288c04b860b9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.605798966Z","level":"ERROR","duration":"175.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.605861547Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"accd142d-5b3e-45a9-b9b8-cbd7e7f859ac","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket27/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.615615272Z","level":"ERROR","duration":"148.301µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.615671412Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"843b261c-3184-487b-96ea-334441386b4d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.66343243Z","level":"ERROR","duration":"111.061µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.66347877Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3fc44afe-c6c4-4b0f-8c69-d143dafa5af8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.664911023Z","level":"ERROR","duration":"89.161µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.664951463Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"aa3d3604-82df-4fc6-b4f3-413e6a5e479e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket13/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.677406672Z","level":"ERROR","duration":"90.36µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.677448813Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7c5e9bab-de4a-4b71-801b-d0d090690b79","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket15/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.681214666Z","level":"ERROR","duration":"228.622µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.681300386Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7304c797-8620-42f3-9ba5-ad0f380f85bb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> === NAME  TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle
niks3-go-unit-tests>     throttle_test.go:112:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestCompleteMultipartUploadHandler_RateLimitTriggersThrottle (4.74s)
niks3-go-unit-tests> === CONT  TestReadProxyHead
niks3-go-unit-tests> === NAME  TestNARDeduplicationMetadataUploadBug
niks3-go-unit-tests>     metadata_upload_test.go:25:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestNARDeduplicationMetadataUploadBug (5.19s)
niks3-go-unit-tests> === CONT  TestReadProxy404
niks3-go-unit-tests> === NAME  TestClientWithDependencies
niks3-go-unit-tests>     client_integration_test.go:577:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestClientWithDependencies (5.13s)
niks3-go-unit-tests> === CONT  TestReadProxyInvalidPath
niks3-go-unit-tests> 2026-08-20 17:24:18.753 UTC [674] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.753 UTC [674] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> === NAME  TestPinProtectsFromGC
niks3-go-unit-tests>     client_integration_test.go:603:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestPinProtectsFromGC (5.16s)
niks3-go-unit-tests> === CONT  TestCompletedNarNotReofferedAcrossClosures
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.76405091Z","level":"ERROR","duration":"199.361µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.764098551Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d3779ffd-25b3-413f-b6ea-ffd29fbf89a3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (12.43ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (2.35ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (4.54ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.782412991Z","level":"ERROR","duration":"103.641µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.782454731Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d72495a8-cfe4-440f-9695-677bf5a94570","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket22/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (4.65ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (4.12ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (2.03ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.793519028Z","level":"ERROR","duration":"553.665µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.793589329Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"26be5d11-a0c0-446f-869c-861585c38031","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026-08-20 17:24:18.798 UTC [677] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.798 UTC [677] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> === NAME  TestClientIntegration
niks3-go-unit-tests>     client_integration_test.go:252:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestClientIntegration (5.21s)
niks3-go-unit-tests> === CONT  TestIsValidCachePath
niks3-go-unit-tests> === RUN   TestIsValidCachePath/narinfo
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/narinfo
niks3-go-unit-tests> === RUN   TestIsValidCachePath/narinfo_all_nix_base32_chars
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/narinfo_all_nix_base32_chars
niks3-go-unit-tests> === RUN   TestIsValidCachePath/nar_zst
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_zst
niks3-go-unit-tests> === RUN   TestIsValidCachePath/nar_xz
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_xz
niks3-go-unit-tests> === RUN   TestIsValidCachePath/nar_bz2
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_bz2
niks3-go-unit-tests> === RUN   TestIsValidCachePath/nar_uncompressed
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nar_uncompressed
niks3-go-unit-tests> === RUN   TestIsValidCachePath/ls
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/ls
niks3-go-unit-tests> === RUN   TestIsValidCachePath/log
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/log
niks3-go-unit-tests> === RUN   TestIsValidCachePath/realisation
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/realisation
niks3-go-unit-tests> === RUN   TestIsValidCachePath/nix-cache-info
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/nix-cache-info
niks3-go-unit-tests> === RUN   TestIsValidCachePath/index.html
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/index.html
niks3-go-unit-tests> === RUN   TestIsValidCachePath/traversal_parent
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/traversal_parent
niks3-go-unit-tests> === RUN   TestIsValidCachePath/traversal_in_middle
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/traversal_in_middle
niks3-go-unit-tests> === RUN   TestIsValidCachePath/invalid_char_e
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/invalid_char_e
niks3-go-unit-tests> === RUN   TestIsValidCachePath/invalid_char_u
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/invalid_char_u
niks3-go-unit-tests> === RUN   TestIsValidCachePath/random_path
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/random_path
niks3-go-unit-tests> === RUN   TestIsValidCachePath/empty
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/empty
niks3-go-unit-tests> === RUN   TestIsValidCachePath/leading_slash
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/leading_slash
niks3-go-unit-tests> === RUN   TestIsValidCachePath/wrong_extension
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/wrong_extension
niks3-go-unit-tests> === RUN   TestIsValidCachePath/short_hash
niks3-go-unit-tests> === PAUSE TestIsValidCachePath/short_hash
niks3-go-unit-tests> === CONT  TestPresignedUploadRegisteredBeforeCommit
niks3-go-unit-tests> 2026-08-20 17:24:18.817 UTC [679] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.817 UTC [679] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (10.78ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.820831667Z","level":"ERROR","duration":"230.302µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.820918808Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d0717844-f5cf-4c16-873d-c244fef50c8a","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (2.44ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (4.23ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (4.24ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (11.17ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (4.1ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (2.25ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (1.86ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> 2026-08-20 17:24:18.838 UTC [681] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.838 UTC [681] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.839405229Z","level":"ERROR","duration":"573.725µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.83949663Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"33e8b441-4e9e-4ab4-937e-91e0d1d41064","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket37/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (4.01ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (3.52ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (2.83ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (1.55ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.850529847Z","level":"ERROR","duration":"440.644µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.850580727Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a3bf280b-a8fe-440a-9a0f-9ab32334e63b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (10.93ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (2.24ms)
niks3-go-unit-tests> === NAME  TestService_AuthMiddleware_OIDC
niks3-go-unit-tests>     auth_test.go:270:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (3.98ms)
niks3-go-unit-tests> --- FAIL: TestService_AuthMiddleware_OIDC (5.26s)
niks3-go-unit-tests> === CONT  TestReadProxyNarinfoAlreadyDecompressed
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (4.01ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (2.1ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (877.13µs)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.871309288Z","level":"ERROR","duration":"532.804µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.871382229Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"50c8a1d5-e494-4eb8-9fec-6ac5fc62a3ee","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026-08-20 17:24:18.877 UTC [684] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.877 UTC [684] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (10.95ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (2.3ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (3.62ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.901543893Z","level":"ERROR","duration":"217.762µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.901652494Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"498840b5-c2a4-4c93-bfd8-6b7d57d75e82","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (3.68ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (2.55ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (1.82ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.911377059Z","level":"ERROR","duration":"575.465µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.91145566Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"b406380a-9804-43a7-9f46-f5ab8cf8aaf0","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026-08-20 17:24:18.925 UTC [685] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:18.925 UTC [685] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.932624385Z","level":"ERROR","duration":"5.034130972s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.932693245Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e53ed0b5-08e7-42a4-98a4-d8114aa82d37","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket14/","status_code":503,"duration_ms":5034,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20241026095416_initial_model.sql (9.14ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251210153512_drop_unused_gin_index.sql (1.09ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20251218171726_add_pins.sql (3.16ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   20260628120000_add_object_size_and_stats.sql (2.91ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   1_commit_pending_closure.sql (1.72ms)
niks3-go-unit-tests> 2026/08/20 17:24:18 OK   2_object_stats_trigger.sql (780.91µs)
niks3-go-unit-tests> 2026/08/20 17:24:18 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.950461001Z","level":"ERROR","duration":"203.642µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.950549101Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"866877e8-9514-4d9d-9a13-1832f0718c7e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.951392389Z","level":"ERROR","duration":"446.464µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.951450569Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2045ec8a-5b75-46dd-986e-a39e0a5c1b10","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.953231045Z","level":"ERROR","duration":"197.542µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.953310266Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c99abe18-e7aa-4c2b-9a9e-aa58cd152ce2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.953587668Z","level":"ERROR","duration":"107.721µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.953629069Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f6216389-d2d2-4c35-a78f-9c2b9c4cde21","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.964386082Z","level":"ERROR","duration":"113.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.964431403Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c6a07f27-9ed9-4952-ab9e-cd0209b14937","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.97321712Z","level":"ERROR","duration":"194.702µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.97328856Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"adfbf444-e322-4dd4-9157-2990969e79a3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.985943491Z","level":"ERROR","duration":"131.741µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.985997972Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"18374d88-1515-41f3-85db-3a139c859c1c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.993626978Z","level":"ERROR","duration":"91.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:18.993668759Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"de5d7f57-ece4-452e-86bf-ed25c0965216","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket14/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.019241662Z","level":"ERROR","duration":"112.82µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.019286903Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"bdb00c7f-f19d-4560-86f9-caf757e198da","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> === NAME  TestRedundantMultipartUpload
niks3-go-unit-tests>     redundant_multipart_test.go:24:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestRedundantMultipartUpload (4.38s)
niks3-go-unit-tests> === CONT  TestResurrectedObjectNotDeleted
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.052207091Z","level":"ERROR","duration":"111.901µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.052254911Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"6b2ec2c9-5570-44c0-9c8c-3335cbb126f2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.080987663Z","level":"ERROR","duration":"201.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.081036363Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1663ec23-ed7c-485f-bf5b-5227d120c40c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket26/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026-08-20 17:24:19.097 UTC [688] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:19.097 UTC [688] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20241026095416_initial_model.sql (9ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251210153512_drop_unused_gin_index.sql (1.11ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251218171726_add_pins.sql (2.93ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20260628120000_add_object_size_and_stats.sql (2.24ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   1_commit_pending_closure.sql (1.68ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   2_object_stats_trigger.sql (705.59µs)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.122292004Z","level":"ERROR","duration":"560.905µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.122360204Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"d5d71513-1308-4832-83e4-4f3facc7808d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket42/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> === NAME  TestCacheStatsHandler
niks3-go-unit-tests>     cache_stats_test.go:17:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestCacheStatsHandler (5.59s)
niks3-go-unit-tests> === CONT  TestReadProxyNarinfo
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.16645783Z","level":"ERROR","duration":"232.682µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.166564011Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"21a5d6f8-739b-4a82-a423-3eaecfabf8c2","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> === NAME  TestGCMetrics
niks3-go-unit-tests>     gc_metrics_test.go:18:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestGCMetrics (5.57s)
niks3-go-unit-tests> === CONT  TestOrphanedObjectsGCStressTest
niks3-go-unit-tests> 2026-08-20 17:24:19.186 UTC [693] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:19.186 UTC [693] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.195214381Z","level":"ERROR","duration":"177.321µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.195273862Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7931f087-5252-40fc-bb13-8ba6c0c32d47","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket42/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20241026095416_initial_model.sql (10.08ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251210153512_drop_unused_gin_index.sql (1.9ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251218171726_add_pins.sql (3.71ms)
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.209301365Z","level":"ERROR","duration":"133.241µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.209352325Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9dc8efe7-e6c4-4df7-b6a9-c6bd16e89860","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20260628120000_add_object_size_and_stats.sql (4.03ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   1_commit_pending_closure.sql (2.97ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   2_object_stats_trigger.sql (1.71ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.219571355Z","level":"ERROR","duration":"242.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.219653255Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"fb689265-1095-427d-9223-0ce825d09689","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.219789216Z","level":"ERROR","duration":"453.264µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.219853637Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1a3f1ed8-7094-4f86-9f2b-2d9516c7066d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> 2026-08-20 17:24:19.231 UTC [694] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:19.231 UTC [694] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20241026095416_initial_model.sql (8.79ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251210153512_drop_unused_gin_index.sql (1.09ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251218171726_add_pins.sql (2.43ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20260628120000_add_object_size_and_stats.sql (2.21ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   1_commit_pending_closure.sql (1.53ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   2_object_stats_trigger.sql (691.35µs)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.254171097Z","level":"ERROR","duration":"527.344µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.254254258Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3546ccfa-84d4-4d35-b8b0-383a37deae46","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket44/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.263099355Z","level":"ERROR","duration":"140.021µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.263146036Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1decffc1-403f-4b3a-8faa-b74df093b4d7","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.27164531Z","level":"ERROR","duration":"94.321µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.27168741Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2dd56fe8-7c42-4fb2-86c0-d0b877a1dac4","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.313287334Z","level":"ERROR","duration":"149.281µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.313333775Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4b32a099-0d89-4485-949e-1577c277cdef","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.355879987Z","level":"ERROR","duration":"105.861µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.355924107Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"56be4b1e-b4a5-44e1-ae67-f5732f6bd0f5","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.360496887Z","level":"ERROR","duration":"88.681µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.360537108Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"1057264b-fde5-4686-bd28-72a1b6301c98","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket29/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.364157459Z","level":"ERROR","duration":"83.78µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.36419642Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"27560f02-6e64-4c6f-aa11-babae31034bb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.381778893Z","level":"ERROR","duration":"158.921µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.381820194Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"91401318-0f18-4526-bc4c-4688739d9d05","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.403410862Z","level":"ERROR","duration":"94.16µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.403453203Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e01ddbb9-bb0d-400f-a87c-7cd04cde5c8c","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket44/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.418046891Z","level":"ERROR","duration":"86.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.418086591Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"79ddb778-6f81-48d4-a6da-00a7011f07f9","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket42/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.438845533Z","level":"ERROR","duration":"215.802µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.438930733Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f2a88fc4-368f-4efb-9434-7f5f014cf41e","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.440417286Z","level":"ERROR","duration":"91.321µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.440459267Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9ccbf731-0988-4f90-b18b-352f4eed5dd6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.467953827Z","level":"ERROR","duration":"84.441µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.467992747Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a9a1949c-6824-4a69-9e04-4a28a8faf79d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.471280816Z","level":"ERROR","duration":"5.010341104s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.471320817Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"84c7f742-c53c-4696-8a70-978ae5b8a218","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":5010,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.499109259Z","level":"ERROR","duration":"140.861µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.4991596Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c438ba25-4775-4840-9181-6a4b22beb853","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.507803696Z","level":"ERROR","duration":"102.181µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.507845636Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"a0409dc7-5a31-4fd8-a694-deba9f1623f7","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket28/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.53453057Z","level":"ERROR","duration":"145.442µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.53457561Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"c059a1d3-5aea-4825-b784-47e9f707bfc3","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket33/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.581248198Z","level":"ERROR","duration":"169.182µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.581306578Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"7ed0dfcc-20e9-40ea-b7d1-c75a9a1de36b","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket34/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.631890461Z","level":"ERROR","duration":"107.101µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.631935281Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"47ba8b94-e27e-4e82-82cb-4127f004a813","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> === NAME  TestReadProxyDisabled
niks3-go-unit-tests>     proxy_test.go:392:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestReadProxyDisabled (5.71s)
niks3-go-unit-tests> === CONT  TestParseSingleRange
niks3-go-unit-tests> === RUN   TestParseSingleRange/none
niks3-go-unit-tests> === PAUSE TestParseSingleRange/none
niks3-go-unit-tests> === RUN   TestParseSingleRange/unknown_unit
niks3-go-unit-tests> === PAUSE TestParseSingleRange/unknown_unit
niks3-go-unit-tests> === RUN   TestParseSingleRange/multi-range_ignored
niks3-go-unit-tests> === PAUSE TestParseSingleRange/multi-range_ignored
niks3-go-unit-tests> === RUN   TestParseSingleRange/malformed_no_dash
niks3-go-unit-tests> === PAUSE TestParseSingleRange/malformed_no_dash
niks3-go-unit-tests> === RUN   TestParseSingleRange/malformed_both_empty
niks3-go-unit-tests> === PAUSE TestParseSingleRange/malformed_both_empty
niks3-go-unit-tests> === RUN   TestParseSingleRange/malformed_end_before_start
niks3-go-unit-tests> === PAUSE TestParseSingleRange/malformed_end_before_start
niks3-go-unit-tests> === RUN   TestParseSingleRange/closed
niks3-go-unit-tests> === PAUSE TestParseSingleRange/closed
niks3-go-unit-tests> === RUN   TestParseSingleRange/open-ended
niks3-go-unit-tests> === PAUSE TestParseSingleRange/open-ended
niks3-go-unit-tests> === RUN   TestParseSingleRange/end_clamped_to_size
niks3-go-unit-tests> === PAUSE TestParseSingleRange/end_clamped_to_size
niks3-go-unit-tests> === RUN   TestParseSingleRange/suffix
niks3-go-unit-tests> === PAUSE TestParseSingleRange/suffix
niks3-go-unit-tests> === RUN   TestParseSingleRange/suffix_exceeds_size
niks3-go-unit-tests> === PAUSE TestParseSingleRange/suffix_exceeds_size
niks3-go-unit-tests> === RUN   TestParseSingleRange/single_byte
niks3-go-unit-tests> === PAUSE TestParseSingleRange/single_byte
niks3-go-unit-tests> === RUN   TestParseSingleRange/start_past_EOF
niks3-go-unit-tests> === PAUSE TestParseSingleRange/start_past_EOF
niks3-go-unit-tests> === RUN   TestParseSingleRange/start_far_past_EOF
niks3-go-unit-tests> === PAUSE TestParseSingleRange/start_far_past_EOF
niks3-go-unit-tests> === CONT  TestServerTLSConfig/no_client_CA
niks3-go-unit-tests> === CONT  TestServerTLSConfig/not_a_PEM_file
niks3-go-unit-tests> === CONT  TestServerTLSConfig/missing_CA_file
niks3-go-unit-tests> --- PASS: TestServerTLSConfig (0.00s)
niks3-go-unit-tests>     --- PASS: TestServerTLSConfig/no_client_CA (0.00s)
niks3-go-unit-tests>     --- PASS: TestServerTLSConfig/not_a_PEM_file (0.00s)
niks3-go-unit-tests>     --- PASS: TestServerTLSConfig/missing_CA_file (0.00s)
niks3-go-unit-tests> === CONT  TestClientErrorHandling/InvalidStorePath
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.662941973Z","level":"ERROR","duration":"125.121µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.662990173Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4d4db978-c4c4-43b0-98b7-322311f23846","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket44/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.694397968Z","level":"ERROR","duration":"5.007007115s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.694440628Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"27c2cefc-006b-4bc8-9c03-acaa70e20fc6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":5007,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026-08-20 17:24:19.719 UTC [697] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:19.719 UTC [697] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20241026095416_initial_model.sql (8.41ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251210153512_drop_unused_gin_index.sql (1.34ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20251218171726_add_pins.sql (2.88ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   20260628120000_add_object_size_and_stats.sql (2.93ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   1_commit_pending_closure.sql (1.63ms)
niks3-go-unit-tests> 2026/08/20 17:24:19 OK   2_object_stats_trigger.sql (731.39µs)
niks3-go-unit-tests> 2026/08/20 17:24:19 goose: up to current file version: 2
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.780141018Z","level":"ERROR","duration":"157.562µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.780213078Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ecd50544-fef3-4703-9571-9627fa8d4c62","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.853958263Z","level":"ERROR","duration":"111.5µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.854002884Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"3b87fa81-5056-486e-8e53-d7996c1de3b8","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket38/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.882660994Z","level":"ERROR","duration":"109.581µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.882704975Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"65d98a1c-d47e-4b6f-88c2-653bff3c69fa","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket36/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.883170679Z","level":"ERROR","duration":"135.381µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.883219119Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"ca833c41-9aa4-45c9-8424-6ab36d321510","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket41/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.890702585Z","level":"ERROR","duration":"99.741µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.890744305Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"4e94802a-33ef-4483-9b69-e55c92e0bcbd","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> === NAME  TestService_AuthMiddleware_MTLSProxyHeader
niks3-go-unit-tests>     auth_test.go:55:  unexpected error: bucket creation concurrency limit reached; retry later
niks3-go-unit-tests>         
niks3-go-unit-tests> --- FAIL: TestService_AuthMiddleware_MTLSProxyHeader (6.03s)
niks3-go-unit-tests> === CONT  TestClientErrorHandling/ServerNotAvailable
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.96444853Z","level":"ERROR","duration":"214.822µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:19.96452015Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"f7f82a87-e1ec-483a-a702-425310bd067d","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket43/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.041470583Z","level":"ERROR","duration":"6.230027932s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.041529304Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"2b2683d1-32dd-49ca-bfd8-18dbff7105cb","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket5/","status_code":503,"duration_ms":6230,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(351)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.055710668Z","level":"ERROR","message":"Scanner data usage save failed","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","path":"buckets/.usage.v2.json","state":"save_failed","error":"Lock error: Lock acquisition timeout for resource '.rustfs.sys/buckets/.usage.v2.json@latest' after 5s","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":3872,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.05590307Z","level":"ERROR","message":"Scanner cycle completed without a durable data usage snapshot","event":"scanner_persist_state","component":"scanner","subsystem":"runtime","cycle":4,"state":"usage_not_durable","target":"rustfs::scanner","filename":"crates/scanner/src/scanner.rs","line_number":2763,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.069814071Z","level":"ERROR","duration":"6.108289987s","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>ServiceUnavailable</Code><Message>The service is unavailable. Please retry.</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.069874692Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"db403570-9418-4455-a5cc-012b0103bae6","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket11/","status_code":503,"duration_ms":6108,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(371)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.09597318Z","level":"ERROR","duration":"206.062µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.096051001Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8ba74d1b-c511-4a7a-b4c3-25bb63132b6f","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket10/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/api/multipart/complete
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.109316897Z","level":"ERROR","duration":"190.922µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.109380578Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"9cedb832-64cc-45b9-a9d1-1d62da6c7d46","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket40/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(370)"}
niks3-go-unit-tests> 2026/08/20 17:24:20 ERROR Failed to get multipart upload error="no rows in result set" upload_id=does-not-exist object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst
niks3-go-unit-tests> --- PASS: TestCompleteMultipartUnregistered (6.58s)
niks3-go-unit-tests> === CONT  TestClientErrorHandling/InvalidAuthToken
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.111250194Z","level":"ERROR","duration":"166.261µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.111299594Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"5e351c7a-a705-4324-8023-7e628e726166","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket21/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.127287734Z","level":"ERROR","duration":"224.622µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.127360515Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"e28ee438-30d1-4bb5-9574-2ab2a1a5faab","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket32/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=195.788734ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.139945945Z","level":"ERROR","duration":"214.142µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.140020866Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"86158fed-898c-4f58-b344-93190e187555","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket35/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(350)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.159908579Z","level":"ERROR","duration":"181.141µs","resp":"Response { status: 503, version: HTTP/1.1, headers: {\"content-type\": \"application/xml\"}, body: Body { once: b\"<?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?><Error><Code>SlowDown</Code><Message>bucket creation concurrency limit reached; retry later</Message></Error>\" } }","target":"s3s::service","filename":"/build/rustfs-1.0.0-beta.12-vendor/source-git-1/s3s-0.14.1/src/service.rs","line_number":640,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> {"timestamp":"2026-08-20T17:24:20.15997716Z","level":"ERROR","message":"HTTP request completed","event":"http_request_completed","component":"server","subsystem":"http","request_id":"8f253782-f717-4981-adea-d4052ed75023","trace_id":"unknown","span_id":"unknown","peer_addr":"127.0.0.1","method":"PUT","uri":"/bucket39/","status_code":503,"duration_ms":0,"result":"server_error","target":"rustfs::server::layer","filename":"rustfs/src/server/layer.rs","line_number":392,"threadName":"rustfs-worker","threadId":"ThreadId(312)"}
niks3-go-unit-tests> --- PASS: TestReadProxy404 (1.45s)
niks3-go-unit-tests> === CONT  TestCacheConfigHandler/full_config,_no_issuer
niks3-go-unit-tests> === CONT  TestCacheConfigHandler/no_signing_keys
niks3-go-unit-tests> === CONT  TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator
niks3-go-unit-tests> === CONT  TestCacheConfigHandler/no_cache_url_configured
niks3-go-unit-tests> --- PASS: TestCacheConfigHandler (0.00s)
niks3-go-unit-tests>     --- PASS: TestCacheConfigHandler/full_config,_no_issuer (0.00s)
niks3-go-unit-tests>     --- PASS: TestCacheConfigHandler/no_signing_keys (0.00s)
niks3-go-unit-tests>     --- PASS: TestCacheConfigHandler/issuer_requested_but_no_OIDC_validator (0.00s)
niks3-go-unit-tests>     --- PASS: TestCacheConfigHandler/no_cache_url_configured (0.00s)
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectOversizedBody/create_pending_closure
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/
niks3-go-unit-tests> 2026-08-20 17:24:20.177 UTC [753] ERROR:  relation "goose_db_version" does not exist at character 36
niks3-go-unit-tests> 2026-08-20 17:24:20.177 UTC [753] STATEMENT:  SELECT version_id, is_applied from goose_db_version ORDER BY id DESC
niks3-go-unit-tests> 2026/08/20 17:24:20 OK   20241026095416_initial_model.sql (9.81ms)
niks3-go-unit-tests> 2026/08/20 17:24:20 OK   20251210153512_drop_unused_gin_index.sql (1.29ms)
niks3-go-unit-tests> 2026/08/20 17:24:20 OK   20251218171726_add_pins.sql (3.33ms)
niks3-go-unit-tests> 2026/08/20 17:24:20 OK   20260628120000_add_object_size_and_stats.sql (2.73ms)
niks3-go-unit-tests> 2026/08/20 17:24:20 goose: successfully migrated database to version: 20260628120000
niks3-go-unit-tests> 2026/08/20 17:24:20 OK   1_commit_pending_closure.sql (1.73ms)
niks3-go-unit-tests> 2026/08/20 17:24:20 OK   2_object_stats_trigger.sql (825.91µs)
niks3-go-unit-tests> 2026/08/20 17:24:20 goose: up to current file version: 2
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectOversizedBody/request_more_parts
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received request for more parts method=POST path=/
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> --- PASS: TestResurrectedObjectNotDeleted (1.21s)
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectOversizedBody/complete_multipart
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/api/multipart/complete
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=433.204953ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received complete multipart upload request method=POST path=/
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/
niks3-go-unit-tests> === CONT  TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received request for more parts method=POST path=/
niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectInvalidKeys (0.00s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_nix-cache-info (0.00s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectInvalidKeys/complete_multipart_rejects_non-NAR_key (0.00s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectInvalidKeys/create_pending_closure_rejects_path_traversal (0.00s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectInvalidKeys/request_more_parts_rejects_non-NAR_key (0.00s)
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/narinfo
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/listing_key,_narinfo_type
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/nar_key,_narinfo_type
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/traversal
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/narinfo_key,_nar_type
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/index.html
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/nix-cache-info
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/realisation_plus_in_output
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/realisation
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/build_log_equals
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/build_log_question_mark
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/build_log_plus_in_name
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/build_log_home-manager_file
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/build_log
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/listing
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/nar_plain
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/nar_xz
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/nar_zst
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/unknown_type
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/absolute
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/empty_key
niks3-go-unit-tests> === CONT  TestIsValidUploadKey/traversal_nar
niks3-go-unit-tests> --- PASS: TestIsValidUploadKey (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/narinfo (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/listing_key,_narinfo_type (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/nar_key,_narinfo_type (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/traversal (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/narinfo_key,_nar_type (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/index.html (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/nix-cache-info (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/realisation_plus_in_output (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/realisation (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/build_log_equals (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/build_log_question_mark (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/build_log_plus_in_name (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/build_log_home-manager_file (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/build_log (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/listing (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/nar_plain (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/nar_xz (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/nar_zst (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/unknown_type (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/absolute (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/empty_key (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidUploadKey/traversal_nar (0.00s)
niks3-go-unit-tests> === CONT  TestProxyWriteTimeout/narinfo
niks3-go-unit-tests> === CONT  TestProxyWriteTimeout/10_GiB_nar
niks3-go-unit-tests> === CONT  TestProxyWriteTimeout/unknown_size
niks3-go-unit-tests> === CONT  TestProxyWriteTimeout/1_GiB_nar
niks3-go-unit-tests> --- PASS: TestProxyWriteTimeout (0.00s)
niks3-go-unit-tests>     --- PASS: TestProxyWriteTimeout/narinfo (0.00s)
niks3-go-unit-tests>     --- PASS: TestProxyWriteTimeout/10_GiB_nar (0.00s)
niks3-go-unit-tests>     --- PASS: TestProxyWriteTimeout/unknown_size (0.00s)
niks3-go-unit-tests>     --- PASS: TestProxyWriteTimeout/1_GiB_nar (0.00s)
niks3-go-unit-tests> === CONT  TestIsValidCachePath/narinfo
niks3-go-unit-tests> === CONT  TestIsValidCachePath/short_hash
niks3-go-unit-tests> === CONT  TestIsValidCachePath/wrong_extension
niks3-go-unit-tests> === CONT  TestIsValidCachePath/leading_slash
niks3-go-unit-tests> === CONT  TestIsValidCachePath/empty
niks3-go-unit-tests> === CONT  TestIsValidCachePath/random_path
niks3-go-unit-tests> === CONT  TestIsValidCachePath/invalid_char_u
niks3-go-unit-tests> === CONT  TestIsValidCachePath/invalid_char_e
niks3-go-unit-tests> === CONT  TestIsValidCachePath/traversal_in_middle
niks3-go-unit-tests> === CONT  TestIsValidCachePath/traversal_parent
niks3-go-unit-tests> === CONT  TestIsValidCachePath/index.html
niks3-go-unit-tests> === CONT  TestIsValidCachePath/nix-cache-info
niks3-go-unit-tests> === CONT  TestIsValidCachePath/nar_bz2
niks3-go-unit-tests> === CONT  TestIsValidCachePath/nar_xz
niks3-go-unit-tests> === CONT  TestIsValidCachePath/nar_zst
niks3-go-unit-tests> === CONT  TestIsValidCachePath/narinfo_all_nix_base32_chars
niks3-go-unit-tests> === CONT  TestIsValidCachePath/log
niks3-go-unit-tests> === CONT  TestIsValidCachePath/realisation
niks3-go-unit-tests> === CONT  TestIsValidCachePath/ls
niks3-go-unit-tests> === CONT  TestIsValidCachePath/nar_uncompressed
niks3-go-unit-tests> --- PASS: TestIsValidCachePath (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/narinfo (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/short_hash (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/wrong_extension (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/leading_slash (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/empty (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/random_path (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/invalid_char_u (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/invalid_char_e (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/traversal_in_middle (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/traversal_parent (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/index.html (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/nix-cache-info (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/nar_bz2 (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/nar_xz (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/nar_zst (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/narinfo_all_nix_base32_chars (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/log (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/realisation (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/ls (0.00s)
niks3-go-unit-tests>     --- PASS: TestIsValidCachePath/nar_uncompressed (0.00s)
niks3-go-unit-tests> === CONT  TestParseSingleRange/none
niks3-go-unit-tests> === CONT  TestParseSingleRange/suffix_exceeds_size
niks3-go-unit-tests> === CONT  TestParseSingleRange/suffix
niks3-go-unit-tests> === CONT  TestParseSingleRange/end_clamped_to_size
niks3-go-unit-tests> === CONT  TestParseSingleRange/open-ended
niks3-go-unit-tests> === CONT  TestParseSingleRange/single_byte
niks3-go-unit-tests> === CONT  TestParseSingleRange/closed
niks3-go-unit-tests> === CONT  TestParseSingleRange/malformed_end_before_start
niks3-go-unit-tests> === CONT  TestParseSingleRange/malformed_both_empty
niks3-go-unit-tests> === CONT  TestParseSingleRange/malformed_no_dash
niks3-go-unit-tests> === CONT  TestParseSingleRange/multi-range_ignored
niks3-go-unit-tests> === CONT  TestParseSingleRange/unknown_unit
niks3-go-unit-tests> === CONT  TestParseSingleRange/start_far_past_EOF
niks3-go-unit-tests> === CONT  TestParseSingleRange/start_past_EOF
niks3-go-unit-tests> --- PASS: TestParseSingleRange (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/none (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/suffix_exceeds_size (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/suffix (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/end_clamped_to_size (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/open-ended (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/single_byte (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/closed (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/malformed_end_before_start (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/malformed_both_empty (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/malformed_no_dash (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/multi-range_ignored (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/unknown_unit (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/start_far_past_EOF (0.00s)
niks3-go-unit-tests>     --- PASS: TestParseSingleRange/start_past_EOF (0.00s)
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received cleanup request method=DELETE path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Aborted multipart uploads count=1
niks3-go-unit-tests> --- PASS: TestMultipartCleanup (6.89s)
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received cleanup request method=DELETE path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Aborted multipart uploads count=0
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received cleanup request method=DELETE path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Aborted multipart uploads count=1
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete
niks3-go-unit-tests> 2026-08-20 17:24:20.465 UTC [600] ERROR:  Closure does not exist: id=1
niks3-go-unit-tests> 2026-08-20 17:24:20.465 UTC [600] CONTEXT:  PL/pgSQL function commit_pending_closure(bigint) line 16 at RAISE
niks3-go-unit-tests> 2026-08-20 17:24:20.465 UTC [600] STATEMENT:  -- name: CommitPendingClosure :exec
niks3-go-unit-tests> 	SELECT commit_pending_closure($1::bigint)
niks3-go-unit-tests> 	
niks3-go-unit-tests> --- PASS: TestService_cleanupPendingClosuresHandler (6.93s)
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN CompleteMultipartUpload errored but object exists; treating as success error="The specified key does not exist." object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLjY3ZjU0ODFjLWQyMjktNGFmZC04MTgzLWM0NTUyYTE1NzgyOHgxNzg3MjQ2NjYwMjMxNDM2NTA1
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN mTLS auth: subject not in bound subjects subject="CN=reader"
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN mTLS auth: subject not in bound subjects subject="CN=writer"
niks3-go-unit-tests> --- PASS: TestService_NativeMTLS (7.03s)
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Completed multipart upload object_key=nar/gggggggggggggggggggggggggggggg0300000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLjY3ZjU0ODFjLWQyMjktNGFmZC04MTgzLWM0NTUyYTE1NzgyOHgxNzg3MjQ2NjYwMjMxNDM2NTA1 parts=1
niks3-go-unit-tests> --- PASS: TestCompleteMultipartUpload_ErrorButObjectExists (6.07s)
niks3-go-unit-tests> --- PASS: TestService_Rustfstest (2.22s)
niks3-go-unit-tests> --- PASS: TestReadProxyNarinfo (1.50s)
niks3-go-unit-tests> --- PASS: TestReadProxyRootRedirectsToIndexHTML (3.00s)
niks3-go-unit-tests> --- PASS: TestReadProxyInvalidPath (1.91s)
niks3-go-unit-tests> --- PASS: TestReadProxyHead (1.97s)
niks3-go-unit-tests> --- PASS: TestReadProxyNarinfoAlreadyDecompressed (1.82s)
niks3-go-unit-tests> --- PASS: TestReadProxyConditionalGet (2.57s)
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"
niks3-go-unit-tests> --- PASS: TestObjectStatsTrigger (7.22s)
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=840.049035ms error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:20 WARN Authentication failed token_preview=invalid-token token_length=13 reason="static API token mismatch"
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Registered completed upload object_key=nar/jjjjjjjjjjjjjjjjjjjjjjjjjjjjjj0100000000000000000000.nar.zst
niks3-go-unit-tests> 2026/08/20 17:24:20 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> --- PASS: TestPresignedUploadRegisteredBeforeCommit (2.09s)
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received complete multipart upload request method=POST path=/api/multipart/complete
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Completed multipart upload object_key=nar/dadb44fdadb44fdadb44fdadb44f000000000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLmM0YjY1MTZiLWYwMjEtNGM1MC1iNzNlLTg2NWQxZjg2YWM1NXgxNzg3MjQ2NjYwMjUyOTEzMTkz parts=10
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Completed upload id=1
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Object in database but missing from S3 key=dadb44fdadb44fdadb44fdadb44f0000.narinfo
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Found objects in DB but missing from S3, will re-upload count=1
niks3-go-unit-tests> --- PASS: TestService_verifyS3Integrity (7.56s)
niks3-go-unit-tests> --- PASS: TestReadProxyNarStreaming (4.00s)
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Uploaded nix-cache-info to bucket bucket=bucket21
niks3-go-unit-tests> === NAME  TestClientCADerivations
niks3-go-unit-tests>     client_ca_test.go:136: Built CA derivation: /build/TestClientCADerivations3831868512/001/store/qlp8b1lcfhdmp940psw4z2irxcbyc8hd-ca-test
niks3-go-unit-tests>     client_ca_test.go:139: Found 1 dependencies (including self)
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received complete multipart upload request method=POST path=/api/multipart/complete
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Completed multipart upload object_key=nar/hhhhhhhhhhhhhhhhhhhhhhhhhhhhhh0100000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLjY2YTE4NTMzLWYwODktNDIzMC05MTM4LTllOWUxNDVmMGVkMngxNzg3MjQ2NjYwMjM5NjQyNTE3 parts=12
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> --- PASS: TestCompletedNarNotReofferedAcrossClosures (2.56s)
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: server returned 404: 404 page not found\n"
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Uploading 1 paths to 127.0.0.1 (0 already cached)
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Uploading qlp8b1lcfhdmp940psw4z2irxcbyc8hd-ca-test (144B)
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Failed to register uploaded object key=log/9aqhq7a94nlwfxagbg7jls3vv1dbcdbn-ca-test.drv error="server returned 404: 404 page not found\n"
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Failed to register uploaded object key=nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst error="server returned 404: 404 page not found\n"
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Failed to register uploaded object key=qlp8b1lcfhdmp940psw4z2irxcbyc8hd.ls error="server returned 404: 404 page not found\n"
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Signed narinfos id=1 count=1
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Uploading 1 narinfos
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Failed to register uploaded object key=qlp8b1lcfhdmp940psw4z2irxcbyc8hd.narinfo error="server returned 404: 404 page not found\n"
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Completed upload id=1
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Upload complete. (89ms)
niks3-go-unit-tests> === NAME  TestClientCADerivations
niks3-go-unit-tests>     client_ca_test.go:180: Narinfo contains CA field: StorePath: /build/TestClientCADerivations3831868512/001/store/qlp8b1lcfhdmp940psw4z2irxcbyc8hd-ca-test
niks3-go-unit-tests>         URL: nar/04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n.nar.zst
niks3-go-unit-tests>         Compression: zstd
niks3-go-unit-tests>         NarHash: sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n
niks3-go-unit-tests>         NarSize: 144
niks3-go-unit-tests>         References: 
niks3-go-unit-tests>         Deriver: /build/TestClientCADerivations3831868512/001/store/9aqhq7a94nlwfxagbg7jls3vv1dbcdbn-ca-test.drv
niks3-go-unit-tests>         CA: fixed:r:sha256:04jj7iiy79vhzp5kk3r2751n9x3xa44j98y5bk1ds4jp31kky74n
niks3-go-unit-tests>     client_ca_test.go:185: Checking for realisation files in S3...
niks3-go-unit-tests>     client_ca_test.go:207: No realisation files uploaded - this is expected for locally built CA derivations
niks3-go-unit-tests>     client_ca_test.go:208: Locally built CA derivations don't have DrvOutput IDs until they're substituted from a cache
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received complete multipart upload request method=POST path=/api/multipart/complete
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Completed multipart upload object_key=nar/0000000000000000000000000000000000000000000000000000.nar.zst upload_id=NzJkNzE1NjItNGYyZS00NjRhLThhOTgtZTMwMGRmMjI3YmVjLmExNWZhZjBmLTI2MDktNDg0Yi1hYjYzLTY3NjY5MTZlNDNlMXgxNzg3MjQ2NjYxMDgyNTYyMjA5 parts=10
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete
niks3-go-unit-tests>     client_ca_test.go:258: nix copy output: warning: you don't have Internet access; disabling some network-dependent features
niks3-go-unit-tests>         warning: failed to create TLS context for AWS credential providers; SSO, STS WebIdentity, and ECS container authentication will be unavailable
niks3-go-unit-tests>         error: binary cache 's3://bucket21?endpoint=http://localhost:33415&region=eu-west-1' is for Nix stores with prefix '/nix/store', not '/build/TestClientCADerivations3831868512/001/store'
niks3-go-unit-tests>     client_ca_test.go:259: nix copy failed (might be expected with isolated stores): exit status 1
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Completed upload id=1
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received get closure request method=GET path=/api/closures/00000000000000000000000000000000
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received uploads request method=POST path=/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Starting cleanup of old closures method=DELETE path=/api/closures
niks3-go-unit-tests> --- PASS: TestClientCADerivations (7.95s)
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Aborted multipart uploads count=0
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Garbage collection completed failed-uploads-deleted=0 old-closures-deleted=1 objects-marked-for-deletion=2 objects-deleted-after-grace-period=0 objects-failed-to-delete=0
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Vacuumed table table=pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Vacuumed table table=pending_objects
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Vacuumed table table=multipart_uploads
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Vacuumed table table=closures
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Vacuumed table table=objects
niks3-go-unit-tests> 2026/08/20 17:24:21 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.634228022s error="Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/cache-config
niks3-go-unit-tests> 2026/08/20 17:24:21 INFO Received get closure request method=GET path=/api/closures/00000000000000000000000000000000
niks3-go-unit-tests> --- PASS: TestService_createPendingClosureHandler (8.07s)
niks3-go-unit-tests> === NAME  TestOrphanedObjectsGCStressTest
niks3-go-unit-tests>     orphaned_objects_gc_test.go:425: Created 10 active closures, 5 to-delete closures, 20 orphaned chains
niks3-go-unit-tests>     orphaned_objects_gc_test.go:446: Marked 210 objects for deletion
niks3-go-unit-tests> --- PASS: TestUploadHandlersRejectOversizedBody (0.16s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectOversizedBody/request_more_parts (0.11s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectOversizedBody/complete_multipart (0.11s)
niks3-go-unit-tests>     --- PASS: TestUploadHandlersRejectOversizedBody/create_pending_closure (1.62s)
niks3-go-unit-tests> === NAME  TestOrphanedObjectsGCStressTest
niks3-go-unit-tests>     orphaned_objects_gc_test.go:509: Stress test completed successfully:
niks3-go-unit-tests>     orphaned_objects_gc_test.go:510:   - Active objects preserved: 20
niks3-go-unit-tests>     orphaned_objects_gc_test.go:511:   - Objects deleted: 210
niks3-go-unit-tests>     orphaned_objects_gc_test.go:512:   - Total GC'd: 210
niks3-go-unit-tests> --- PASS: TestOrphanedObjectsGCStressTest (2.92s)
niks3-go-unit-tests> 2026/08/20 17:24:23 WARN Failed to fetch cache config, uploading without size limit error="fetching cache config: sending request: request failed after retries: Get \"http://localhost:19999/api/cache-config\": dial tcp [::1]:19999: connect: connection refused"
niks3-go-unit-tests> 2026/08/20 17:24:23 WARN Request failed, retrying attempt=1 max_attempts=6 backoff=100ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:23 WARN Request failed, retrying attempt=2 max_attempts=6 backoff=184.397493ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:23 WARN Request failed, retrying attempt=3 max_attempts=6 backoff=425.072459ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:23 WARN Request failed, retrying attempt=4 max_attempts=6 backoff=744.986769ms error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures
niks3-go-unit-tests> 2026/08/20 17:24:24 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.45109695s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures
niks3-go-unit-tests> --- PASS: TestClientErrorHandling (0.00s)
niks3-go-unit-tests>     --- PASS: TestClientErrorHandling/InvalidStorePath (0.56s)
niks3-go-unit-tests>     --- PASS: TestClientErrorHandling/InvalidAuthToken (0.67s)
niks3-go-unit-tests>     --- PASS: TestClientErrorHandling/ServerNotAvailable (6.26s)
niks3-go-unit-tests> FAIL
niks3-go-unit-tests> 2026-08-20 17:24:26.477 UTC [111] LOG:  received smart shutdown request
niks3-go-unit-tests> 2026/08/20 17:24:36 ERROR failed to kill rustfs error="no such process"
niks3-go-unit-tests> 2026/08/20 17:24:36 INFO killed rustfs
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [610] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [615] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [611] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [616] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [613] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [609] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.480 UTC [607] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [612] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [626] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [655] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [605] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [625] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [627] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [652] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026-08-20 17:24:36.481 UTC [614] FATAL:  terminating connection due to unexpected postmaster exit
niks3-go-unit-tests> 2026/08/20 17:24:36 ERROR failed to wait for rustfs error="signal: killed"
error: Cannot build '/nix/store/cabhiny5qwcvyjg4wd35rkn9njizb0w8-niks3-go-unit-tests.drv'.
       Reason: builder failed with exit code 1.
       Output paths:
         /nix/store/v76l7j8zrq8hzp2143p64yxbn3wv7k13-niks3-go-unit-tests
       Last 25 log lines:
       > 2026/08/20 17:24:24 WARN Request failed, retrying attempt=5 max_attempts=6 backoff=1.45109695s error="Post \"http://localhost:19999/api/pending_closures\": dial tcp [::1]:19999: connect: connection refused" url=http://localhost:19999/api/pending_closures
       > --- PASS: TestClientErrorHandling (0.00s)
       >     --- PASS: TestClientErrorHandling/InvalidStorePath (0.56s)
       >     --- PASS: TestClientErrorHandling/InvalidAuthToken (0.67s)
       >     --- PASS: TestClientErrorHandling/ServerNotAvailable (6.26s)
       > FAIL
       > 2026-08-20 17:24:26.477 UTC [111] LOG:  received smart shutdown request
       > 2026/08/20 17:24:36 ERROR failed to kill rustfs error="no such process"
       > 2026/08/20 17:24:36 INFO killed rustfs
       > 2026-08-20 17:24:36.480 UTC [610] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.480 UTC [615] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.480 UTC [611] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.480 UTC [616] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.480 UTC [613] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.480 UTC [609] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.480 UTC [607] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [612] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [626] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [655] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [605] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [625] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [627] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [652] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026-08-20 17:24:36.481 UTC [614] FATAL:  terminating connection due to unexpected postmaster exit
       > 2026/08/20 17:24:36 ERROR failed to wait for rustfs error="signal: killed"
       For full logs, run:
         nix log /nix/store/cabhiny5qwcvyjg4wd35rkn9njizb0w8-niks3-go-unit-tests.drv