How do I get more information about failing uploads?

[christhegrand]

Some of our servers crashed overnight when trying to upload data to GCS. The error was:

error: {
message: "Retry limit exceeded - """
name: "Error"
stack: "Error: Retry limit exceeded - ""
    at Upload.attemptDelayedRetry (/home/node/app/Backend/node_modules/@google-cloud/storage/build/cjs/src/resumable-upload.js:822:26)
    at Upload.onResponse (/home/node/app/Backend/node_modules/@google-cloud/storage/build/cjs/src/resumable-upload.js:786:18)
    at Upload.makeRequestStream (/home/node/app/Backend/node_modules/@google-cloud/storage/build/cjs/src/resumable-upload.js:772:40)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async Upload.startUploading (/home/node/app/Backend/node_modules/@google-cloud/storage/build/cjs/src/resumable-upload.js:573:26)"
}

The actual reason why the uploads were failing is missing, though. Do I need to change something in the library's configuration to log that data? And what is the default retry limit value?

I am on version 7.14.0.

[clintonb]

Update: Ignore my comment. My issue is CPU related.

I encountered an issue where my calls were requests returning a 429 response were being retried in a loop, ultimately bringing down my service. This started after upgrading from version 6.11.0 to 7.17.2.

I solved the problem by disabling retries for 429 responses. That said, it's still unclear why the error occurred in the first place.

const res = await bucket.storage.authClient.request({
  method: 'GET',
  url,
  retryConfig: {
    shouldRetry: (err) => {
      // Don't retry 429 rate limit errors - retrying makes it worse
      return err.status !== 429;
    }
  }
});