Details
-
New Feature
-
Status: Closed (View Workflow)
-
P2
-
Resolution: Done
-
None
-
customfield_11100 23294
-
Core: Platform - Sprint 56, Core: Platform - Sprint 57
-
3
-
Core: Platform
Description
As evaluk tries to establish an expected response time baseline for a simple performance tests we have decided that the test suite needs to be reorganized to allow us to understand the results:
- the tests need to be isolated – e.g by introducing a cooldown and warmup times between tests. Currently the tests directly influence each other which makes it impossible to understand perf regressions in particular APIs
- we need smaller number of vetted test cases (workflows) – many of the tests are testing raw APIs with artificial parameters. This is too large surface area and too many conditions to optimize for. We should focus on tests that represent real-life load on the system.
Tasks to be peformed:
- Cross check existing tests against 2 real world work flows.
- Examine all large queries from standpoint of real world usage
- set up a new Jenkins job to include only verified tests
- Include only tests listed below
- Delete/disable other tests
- Add cool-down time between tests to isolate them
- set up test parameters to match the number of threads used to configure our baseline test in
FOLIO-1744
Test to be included in the initial job
- check-in and rtac workflows (
FOLIO-1815) - the identifier/isbn filtering test (
FOLIO-1757) - a look up of instance by id (
MODINVSTOR-246) - a look up of item by id (
MODINVSTOR-248) - a look up of item by barcode (
MODINVSTOR-247) - a look up of instance by location (
MODINVSTOR-256)
TestRail: Results
Attachments
Issue Links
- blocks
-
MODINVSTOR-182 analyze and optimize identifiers array indexes (ISBN, ISSN, LCCN, OCLC, …)
-
- Closed
-
-
MODINVSTOR-238 Performance: GET 200 - instance-storage by ID from POST above
-
- Closed
-
- relates to
-
FOLIO-1757 Add a test case for instance identifier search
-
- Closed
-
-
FOLIO-1829 set up a Jenkins job to run 'platform-workflow-performance'
-
- Closed
-
-
FOLIO-1830 review 'platform-work-performance' tests
-
- Closed
-
-
MODINVSTOR-246 filtering /instance-storage/instances by 'query=id=xxx' does not perform
-
- Closed
-
-
MODINVSTOR-247 filtering /item-storage/items by 'query=barcode==123' does not perform
-
- Closed
-
-
MODINVSTOR-248 filtering /item-storage/items when used with 'query=id=XXX' is too slow
-
- Closed
-
-
MODINVSTOR-256 Improve performance of /instance-storage/instances?query=holdingsRecords.permanentLocationId=abc*
-
- Closed
-
-
FOLIO-1744 SPIKE: establish expected response time for performance benchmarks in Jenkins
-
- Closed
-
-
FOLIO-1815 SPIKE: "profile" checkin/out-by-barcode API response time
-
- Closed
-