Perf tests are failing after fresh perf test server start

Description

There is a problem with performance jobs failing after fresh start of perftest server. This is most likely due to perftest still starting or being cold (Spring components haven't started yet etc.). After restarting those performance jobs they seem to pass again. We need to figure out how to make them pass after perftest redeploy.

Possible solutions:

  • run each performance test job twice

  • increase wait time after deploy to perftest

  • do tests for 2 min and take results only from the second half

  • ?????

Environment

None

Activity

Show:
Sebastian Brudziński
October 22, 2018, 9:55 AM

No, let’s keep it for now. If it fails frequently, we will bump the threshold temporarily or disable.

Mateusz Kwiatkowski
October 22, 2018, 8:38 AM
Edited

we have a ticket for fixing this issue: OLMIS-3750. Should I disable this test for now?

Sebastian Brudziński
October 22, 2018, 8:24 AM

I noticed it failed on one check in reference data over the weekend - “Get user role assignments”. This is a simple get for one user and the limit is already set to 20s. This is working way too slow. Can you check whether we have a ticket for this endpoint? If not, create one.

Mateusz Kwiatkowski
October 19, 2018, 1:42 PM

it failed because of problem in fulfillment service, I've redeployed pertest server and all performance jobs passed.

Sebastian Brudziński
October 19, 2018, 8:08 AM

Looks like it failed again.

Done

Assignee

Mateusz Kwiatkowski

Reporter

Sebastian Brudziński

Labels

None

Story Points

3

Time tracking

0m

Time remaining

0m

Sprint

None

Fix versions

Priority

Critical