The average calls response time can get inconsistency in results of 36% or even sometimes more when comparing results of 2 runs of the same test. This make it difficult to analyze our web application for any type of performance degradation from one build to another.
As far as we understand, Neoload executes scripts step by step but not waiting the result from the 1st step and going immediately to the second one.
Let’s say we have in one page:
Step1
Step2
Step3
All those steps executed one by one (meaning Step1 executed 1st, Step2 executed 2nd and Step3 executed 3rd but have different response time).
When we run Check User Path, for example, we can get Step3 response first, Step2 response 2nd and Step1 response 3rd.
Considering this can bring to inconsistent results from one run to another, and if so, can we change default behavior of Neoload to execute steps sequentially instead of in parallel?
↧
How to achieve consistent results in multiple runs of the same test?
↧