Skip to content

Conversation

@arsh
Copy link
Owner

@arsh arsh commented May 8, 2024

Caching in XOZ v0.

mount-s3 \
--cache-xoz mp-iad-cache--use1-az6--x-s3 \
--cache-xoz-block-size=1 \
--allow-overwrite \
--profile default \
--region us-east-1 \
--metadata-ttl indefinite \
-l ~/mnt-logs \
-d --debug-crt \
mp-arn ~/mnt

Description of change

Benchmarking (throughput) results from an IAD instance in the same zone as the XOZ bucket.

# disk caching
[
  {
    "name": "sequential_read_small_file",
    "value": 1862.91904296875,
    "unit": "MiB/s"
  }
]
# xoz caching
[
  {
    "name": "sequential_read_small_file",
    "value": 148.47177734375,
    "unit": "MiB/s"
  }
]
# no caching
[
  {
    "name": "sequential_read_small_file",
    "value": 62.69189453125,
    "unit": "MiB/s"
  }
]

Relevant issues:

Does this change impact existing behavior?


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

At times we're getting what seems to be a livelock within CRT.

Signed-off-by: Andres Santana <hernaa@amazon.com>
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 8, 2024 14:54 — with GitHub Actions Failure
Doing this prevents the CRT hanging.

Signed-off-by: Andres Santana <hernaa@amazon.com>
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 07:58 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 07:58 — with GitHub Actions Queued
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 07:58 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 07:58 — with GitHub Actions Queued
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 07:58 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 07:58 — with GitHub Actions Abandoned
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 07:58 — with GitHub Actions Failure
Signed-off-by: Andres Santana <hernaa@amazon.com>
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 08:55 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 08:55 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 08:55 — with GitHub Actions Queued
@arsh arsh requested a deployment to PR integration tests May 9, 2024 08:55 — with GitHub Actions Queued
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 08:55 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 08:55 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 08:55 — with GitHub Actions Queued
Signed-off-by: Andres Santana <hernaa@amazon.com>
@arsh arsh requested a deployment to PR integration tests May 9, 2024 12:45 — with GitHub Actions Queued
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 12:45 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 12:45 — with GitHub Actions Abandoned
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 12:45 — with GitHub Actions Failure
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 12:45 — with GitHub Actions Failure
@arsh arsh requested a deployment to PR integration tests May 9, 2024 12:45 — with GitHub Actions Queued
@arsh arsh had a problem deploying to PR integration tests May 9, 2024 12:45 — with GitHub Actions Failure
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants