0
Under review

Inconsistent Test Results in Warewolf Test Framework

jigar patel 5 months ago in Studio updated 3 weeks ago 2

The Warewolf test framework is exhibiting unpredictable behavior. During a single test execution, the framework returns both 'Passed' and 'Failed' results for the same test case. This inconsistency occurs within the same run, making it difficult to rely on the test outcomes for accurate results.

The issue has been observed multiple times and affects various test cases.

I have encountered this issue in multiple versions of Warewolf, including the latest one.

Please refer below screenshot

Image 1148

Under review

It's possible your test result is dependent on a flakey, external service. Try adding mocks to isolate the unit under test more. This should improve consistency.

The current workflow isn't dependent on external services; we're already mocking them where needed. We're experiencing similar inconsistencies across multiple workflows.