Skip to content

Conversation

@MariusStorhaug
Copy link
Member

The action now provides more detailed and actionable error messages when test results fail. When tests don't execute properly or result files are missing, you'll receive specific information about what went wrong, making it easier to diagnose and fix issues with your test suites.

Improved Error Reporting

The action now generates specific error messages for each type of test failure, including:

  • Missing result files
  • Tests that weren't executed
  • Failed test results
  • No tests reported
  • No tests passed
  • Inconclusive tests
  • Tests that weren't run

Each error message clearly identifies which test suite and result file is affected, helping you quickly locate and resolve issues.

Safer Property Access

The action now checks for null values before accessing test result properties (Tests, Passed, Failed, Inconclusive, NotRun). This prevents errors when processing incomplete or malformed test result files.

Better Categorization

Missing result files are now tracked separately from unexecuted tests, providing clearer insight into whether a test file wasn't found in the artifacts or if it was present but marked as not executed.

@MariusStorhaug MariusStorhaug marked this pull request as ready for review October 6, 2025 19:43
Copilot AI review requested due to automatic review settings October 6, 2025 19:43
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Enhances test result failure handling by adding granular error categorization and safer null checks, aiming to provide clearer diagnostics in CI runs.

  • Adds per-condition failure reason collection and reporting (missing files, not executed, failed, inconclusive, etc.).
  • Introduces null-guard variables before numeric property access.
  • Changes behavior of exit code to increment per failure reason instead of per failing test file.

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@MariusStorhaug MariusStorhaug merged commit d9fbbed into main Oct 6, 2025
18 of 21 checks passed
@MariusStorhaug MariusStorhaug deleted the fix/test-results-failure-handling branch October 6, 2025 19:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Fix]: Improve test results failure handling and reporting

2 participants