Archived Performance Metrics
- Wesley Brown
Please do not update this page. This page has been archived so that this historical information can be reviewed as required but future updates should be make to the Performance Metrics page.
Work in Progress
This page is a working page to collect test results from manual UI Performance testing. This is being used around the 3.2.1 and 3.3.0 releases to help measure our results improving performance and identify which areas to prioritize for further work. Previous versions of this page have other draft ideas/data. In the future, this kind of testing may be tracked in Zephyr and/or may be automated.
Profiled Performance Data
What is this data?
Each of the tests shows the time it takes an end-user to complete a user story. We do this testing with bandwidth and CPU throttled and with a large sample data set to simulate real-world data and connectivity. Each story is run with a different type of performant user, identified at the top in the column headers. Each column is a different test run.
Each row is a different step in the user story. Each cell captures the the time it takes a person while waiting for the OpenLMIS system to respond. Currently these times are made with a stopwatch, so they are not 100% accurate. Time spent typing or filling in forms or data is not included in the performance time; we only measure the time spent waiting for OpenLMIS to respond. Some cells include a list of API calls involved or a list of downloads, along with the wait times or data transfer sizes for each.
Data Volume
- Brandon Bowersox-Johnson to capture counts of how many data elements this testing has been conducted with (# of non-full-supply products, # of full-supply products, # of facilities, etc, as suggested in OLMIS-4274 - Getting issue details... STATUS )
Speed Improvements from Oct 2017 to 3.2.1
We tested in October 2017 (blue) and again at 3.2.1-RC1 (green). The chart below show significant improvements in those loading times.
As illustrated above, the most significant speed improvements were in these areas:
- Convert to Order is the biggest area of improvement: OLMIS-3318 - Getting issue details... STATUS and OLMIS-3320 - Getting issue details... STATUS .
- Requisition Approve is significantly faster: OLMIS-3346 - Getting issue details... STATUS .
- Requisition Initiate is faster: OLMIS-3332 - Getting issue details... STATUS and OLMIS-3322 - Getting issue details... STATUS .
- Requisition Submit and Authorize are also faster (improved by those other tickets).
- Batch Approve is finally an official working version that performs better scrolling through large numbers of products.
See the entire epic of 3.2.1 performance tickets.
UI File Size
The UI file size influences a user's initial download time. We captured past sizes so we can continue monitoring and optimizing this.
Work in Progress
These charts are not yet updated with comparisons to 3.2.1-RC1.
How do I record more test runs?
Setting up for a test run:
- Add a column into this table to record your results. In the top column header, add your name, which performant user, which version of OpenLMIS you are testing, and the date you are testing.
- Use Chrome, open Dev Tools, and in the Performance tab set a Network and CPU throttle. Record what level of throttling in the column header.
- In Chrome, open Task Manager to see the memory size of each browser window.
- Clear your browser cache so your times will measure the initial downloads.
What to record during testing:
- As you begin each step/row in the table, reset your stopwatch timer to zero. Fill out the form or get ready to click. When you are ready to click/submit data, start your stopwatch timer at the instant you click. OpenLMIS will spin for a while, maybe many minutes. As soon as OpenLMIS is done loading and becomes responsive/usable again, stop your stopwatch and record the time.
- If this step was a long wait, you may want to list each API call or download along with the times and data sizes for each.
| Story | 3.2.1-SNAPSHOT early October 2017 | 3.2.1-SNAPSHOT 30 Oct 2017 | 3.2.1-SNAPSHOT 31 Oct 2017 | 3.2.1-SNAPSHOT 1 Nov 2017 | 3.2.1-RC1 3 Nov 2017 | 3.3.0-SNAPSHOT 13 March 2018 | 3.3.0-SNAPSHOT | 3.3.0-SNAPSHOT 21 March 2018 | 3.3.0-SNAPSHOT 21 March 2018 | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
nick Typical performant user dhitale account on MW UAT server "slow 3g" "processor throttle 6x" | nick "slow 3g" "processor throttle 6x" (same server and user) | brandon "slow 3g" "processor throttle 6x" (same server and user) | brandon (same throttling, same server and same user) | josh (same throttling, same server and same user) | chongsun (same throttling, same server and same user) | brandon (same throttling) dhitale account on perftest.openlmis.org | brandon (same throttling) dhitale account on perftest.openlmis.org | brandon (same throttling) dhitale account on perftest.openlmis.org | brandon (same throttling) dhitale account on perftest.openlmis.org | brandon (same throttling) PerfTest Data Set – Not MW Data Set! Used "srmanager2" account on perftest.openlmis.org | chongsun (same throttling) dhitale account on perftest.openlmis.org NOTE: this was on "cold startup" | chongsun (same throttling) dhitale account on perftest.openlmis.org | brandon network "slow 3g" CPU "6x slowdown" dhitale account on perftest.openlmis.org (using MW data) | ||||||
| Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | |||||||||||||||||||
| Initial UI load | 17.13s At end: 368mb
| 22.38s Memory use of this browser tab before launching OpenLMIS: ~199MB Memory use at end: ~204MB
| 22.85s Memory use at end: ~222MB
| 27s Memory use at end: ~211MB
| 22s
| 4s Memory use: 257MB | 4s | 21s Memory use: 243MB
| |||||||||||
| Login End of time is when CPU usage drops | 207.68s 15 calls to supervised facilities | 26s At end: 438mb | 83.54s ~15 calls to supervisedFacilities | 25.35s Lots of API calls including:
| 18.35s Memory use at end: ~250MB Fewer API calls than previous versions (~15 calls to supervisedFacilities is gone!)
| 26s Memory use at end: ~231MB
| 22s Memory use at end: 252MB
| 17s Memory: 297MB
| 14s Same API calls | 19s Memory use at end: 251MB
| |||||||||
| Total | 225s | 48s | 41s | 53s | 44s | 21s | 18s | 40s | |||||||||||
| Initiate Requisition | |||||||||||||||||||
| TB program | TB program | Essential Meds program | Essential Meds at Chiwamba HC | Essential Meds program at Lilongwe DHO Pharmacy | Essential Meds program (271 products) | TB program (15 products) | Essential Meds program (271 products) | TB program (15 products) | Essential Meds program (~9000 products) ← Not same MW test data as other tests → | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program (271 products) at Lilongwe DHO Pharmacy | TB program (15 products) | ||||||
| Navigate to Requisitions > Create/Authorize | immediate Memory use at end: ~260MB | immediate Memory use later: ~352MB | Immediate Memory use: 363MB | Immediate Memory use: 254MB | Immediate Memory use: 285MB | Immediate | Immediate Memory use: 249MB | Immediate Memory use: 253MB | immediate Memory: 299MB | immediate | immediate Memory: 254MB | immediate Memory: 259MB | |||||||
| Select Facility and Program, Regular type & Click 'Search' | 29.83 | 17.49s
| 16.99s
Memory use at end: ~305MB | 17.83s
| 8s
Memory use at end: 270MB | 8s
Memory use at end: 290MB | 6s
| 8s
16s (when server was totally cold after re-deploying) | 7s
Memory use at end: 237MB | 33s Huge CPU spike! PeriodsForInitiate returns 13,000+ lines of JSON and the UI table displays ~1000 periods.
Memory use at end: 611MB | 38s
Memory use: 308MB | 6s
| 4s
Memory: 260MB | 4s
Memory: 260MB | |||||
| Click Proceed for latest 'Not yet started' period | 12:08.01 | 53.53s Memory use at end: ~303MB
| 117.32s Memory use at end: ~364MB
| 59.92s
Memory at end: 398mb | 79s
Memory use at end: 313MB | 44s (when service is warm)
124s (when service is cold)
| 18s
| 45s
51s (first time I initiated for this program; maybe DB-level caching was colder?)
| 12s
18s (when server was cold)
| 180s
Huge delay! Requisition data is 210,000+ lines of JSON; roughly 9000 products. May have crashed server. Further requests to ReferenceData get a 500 NGINX error. | 184s for one that is initiated (possible "cold startup" of server) | 154s (possible "cold startup" of first initiate) 27s when done again
| ERROR "message" : "An error occurred when contacting the Reference Data service. For more information see logs or contact system administrator." OLMIS-4368 | ERROR "message" : "Fulfillment service is not found. OpenLMIS Fulfillment service is required by this version of Requisition service." OLMIS-4380 | |||||
| Total | 12:37.84 | ~70s | ~134s | 77.78s | 87s | 52s - 132s | 24s | 53s | 19s | 213s | 222s | 160s 33s when run again | |||||||
| Sync Requisition | |||||||||||||||||||
| TB program | TB program | Essential Meds program | Essential Meds program | Essential Meds program (271 products) | TB program (15 products) | Essential Meds program (~9000 products) ← Not same MW test data as other tests → | Essential Meds program | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | |||||||||||
| Press "Sync with Server" | ~ 25.46 | 16.80s (requisition has 15 line items)
| 74.52s (requisition has 271 line items)
| 63s (requisition has 271 line items)
| 53s
(I notice that data entry within the Requistion form is laggy/delayed when typing and tabbing, whether or not the CPU throttle is on; there is even a delay from the time I click Previous or Next to the time it switches pages) | 13s
| ERROR! Server crashed temporarily, or somehow it cannot Sync this requisition:
Same error blocks Submit or Authorize on that requisition. | 67s
| 64s
| ||||||||||
| Total | ~ 25.46 | 16.80s | 74.52s | 63s | 53s | 13s | 67s | 64s | |||||||||||
| Submit Requisition | |||||||||||||||||||
| TB program | TB program | Essential Meds program | Essential Meds program | Essential Meds program (271 products) | TB program (15 products) | ← Not same MW test data as other tests → | Essential Meds program (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | |||||||||||
| Press "Submit" (opens modal) | 1.81 | ~immediate | ~immediate | ~immediate | ~immediate | ~immediate | ~immediate | ~immediate | immediate | ||||||||||
| Confirm Submit in modal | 34.91s NOTE: 3 API calls here
| 30.62s
| 68.09s
| 42s
(same API calls as previously) Memory use at end: 472MB | 43s
| 10s
| 54s
| 44s
| |||||||||||
| Total | 36.72 | ~30s | ~68s | 42s | 43s | 10s | 54s | 44s | |||||||||||
| Authorize Requisition | |||||||||||||||||||
| TB Program | Essential Meds program | Essential Meds program | Essential Meds program (271 products) | TB program (15 products) | Family Planning program (~24 products) Using 'administrator' account now. ← Not same MW test data as other tests → | Essential Meds program (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | ||||||||||||
| Navigate to Requisitions > Create/Authorize | ~1s | immediate | immediate | immediate | immediate | immediate | |||||||||||||
| Select Program at My Facility with Type Regular and click Search | 54.56s NOTE: 2 API calls here
| 15s | 6s (same 2 API calls here as previously) | 5s
| 5s
NOTE: 2 API calls here, which run in parallel | 5s
| 3s
| ||||||||||||
| Click Proceed for 'Submitted' requisition | 30.53s NOTE: 2 API calls here
Note: changing pages on the R&R form is really slow (~10 seconds). | 29.76s
| 32s (same 2 API calls here as previously) | 31s | 15s
(Note: all the API calls are done 4 seconds in, but it takes another 10-11 seconds for CPU for browser to display the form) | 21s
| 21s
| ||||||||||||
| Click 'Authorize' (opens modal) | immediate | immediate | immediate | immediate | immediate | immediate | immediate | ||||||||||||
| Click 'Authorize' in modal | 87.00s NOTE: 4 API calls here
| 92.00s
| 51s (same 4 API calls here as previously) | 51s
| 11s
| 61s
| 54s
| ||||||||||||
| Total | ~171s | ~137s | 89s | 87s | 31s | 87s | 78s | ||||||||||||
| Approve Requisition (Single) | |||||||||||||||||||
| Used Malaria Program (no TB Requisitions found!?) | Malaria program | Essential Meds program | Malaria program | Essential Meds program | Malaria program | Essential Meds program (271 products) | Malaria program | Essential Meds program (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | ||||||||||
| Navigate to Requisitions > Approve | 16.11s 3 API calls:
| 45.09s 3 API calls:
Filter by Malaria program and search 8.45s 3 API calls:
Second full run: ~10s | 5s (ditto) | 5s Faster and Fewer API calls than previous versions (calls to programs are gone!)
| 4s
| 4s
| 7s
| 18s
| 2s
| ||||||||||
| Filter by Program and click 'Search' | Filter by Essential Meds and search 6s
| Filter by Malaria program and search 5s
| Filter by Essential Meds and search 5s
| 8s
(showing 10 items out of 31 total for this program) | 4s
(showing 10 items out of 62 total for this program) | 3s
10 out of 31 total | 3s
10 out of 31 total | ||||||||||||
| Select 1 and click 'View Requisition' | 26.77s Memory at end: ~370MB 2 API calls:
| Timed out on GET /requisitions/id after 15 minutes Second time 16.09s 2 API calls:
Second full run: ~15s | 22s
| 12s
| 23s
(Note: this whole step runs in 8 seconds if CPU is not throttled and network is still throttled to "slow 3g") | 16s
Memory use: 3.9GB (not sure where between the time above and now the memory started spiking!) | 13s
| 20s
| 20s
| ||||||||||
| Click 'Approve' (opens modal) | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | |||||||||
| Click 'Approve' in modal | 66.15s Memory at end: ~334MB 5 API calls:
| 39.13s No large change in memory 5 API calls:
Second full run: ~29s (with ~15s done by POST approve and ~6s by PUT requisitions/id) | 31s (Reduced to 3 API calls; calls to /programs are gone!)
| 12s Memory use at end: 497MB (ditto!)
| 15s
(Note: this whole step runs in 10.43 seconds if CPU is not throttled and network is still throttled to "slow 3g". In that scenario, the API calls take the same time as shown here, but there is less time delay between each API call.) | 16.73s
----- 11s
| 19s
| 11s
| 55s
| 48s
| |||||||||
OLMIS-3346 - Getting issue details... STATUS OLMIS-3362 - Getting issue details... STATUS (will save a few seconds here and there) | more we can improve: OLMIS-3474 - Getting issue details... STATUS | ||||||||||||||||||
| Total | 47s | 35s | 96s | 73s | |||||||||||||||
| Batch Approve Requisition | |||||||||||||||||||
| Used Malaria Program (no TB Requisitions found!?) | Essential Meds program (~150 products x 10 requisitions) | Malaria program (16 products x 10 requisitions) | Essential Meds program (271 products) | Malaria program | Essential Meds program | Malaria program | |||||||||||||
| Navigate to Requisitions > Approve | 12.15s (same API calls above) | 6.75s 3 API calls:
Second full run: ~6s | 5s As above, Faster and Fewer API calls than previous versions (calls to programs are gone!)
| 6s As above, Faster and Fewer API calls than previous versions (calls to programs are gone!)
| 5s
| 5s
| 3s
| 3s
| |||||||||||
| Select Program and click Search | 18.95s (same 3 API calls again) | 7.18s 3 API calls:
Second full run: ~6s | 5s
| 6s
| 5s
(showing 10 results out of 30) | 5s
(showing 10 results out of 61) | 3s
| 3s
| |||||||||||
| Select All 10 requisitions and click 'View Selected Requisitions' | 150.40s Memory at end: ~401MB
| 63.40s Memory at end: ~413MB
Second full run: ~61s (with retrieveAll ~46s) | 212s Memory at end: ~784MB Note: Page scroll is herky-jerky because the browser is overwhelmed by all the table cells.
(Note: if I turn off CPU throttling, the page takes about 32 seconds total) | 21s Memory at end: ~557MB
(Note: if I turn off CPU throttling, the page takes about 5 seconds total; only 2 seconds is the Network time; the big delay here is the layout) | 20s
(Again, most of the time is CPU in browser) | 21s
| 5s
| 3s
| |||||||||||
| Click 'Approve' (open modal) | immediate | immediate | immediate | immediate | 5s (no API calls) | 5s (no API calls) | immediate | immediate | |||||||||||
| Click 'OK' in modal | 161.26s Got "10 errors" and did not approve them. | 144.18s Got errors and did not approve. Memory at end: ~460MB
Second full run: ~195s (with similar ratios on the APIs) | 142s Memory at end: ~763MB
| Got errors and did not approve. Memory at end: ~562MB
| 115s
| Got errors and did not approve. Error message: There were 10 errors. It's not clear what is wrong or how to fix it. | 206s
| Got errors and did not approve. Error message: There were 10 errors. It's not clear what is wrong or how to fix it. | |||||||||||
OLMIS-3351 - Getting issue details... STATUS OLMIS-3352 - Getting issue details... STATUS OLMIS-3363 - Getting issue details... STATUS | |||||||||||||||||||
| Total | 150s | 217s | |||||||||||||||||
| Convert to Order | |||||||||||||||||||
Used 'superuser' user account and Essential Meds program Memory after login: ~289MB | same Memory after login: ~281MB | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | ||||||||||||||
| Navigate to Requisitions > Convert to Order | 254.74s (4+ minutes to show a list of 9 Essential Meds requisitions)
| 88.3s (8 ess meds programs), 256MB
2nd run: all roughly the same, mem at 276mb | 7s (8 essential meds requisitions), 3.4KB (This appears to be a much smaller representation that loads much faster!)
4.32s (when 0 requisitions to convert) | 3s
(10 showing out of 11 requisitions ready to convert) | 6s
1 out of 1 requisitions ready to convert | 6s
10 out of 11 requisitions ready to convert | |||||||||||||
| Select 1, Select a Warehouse, and click 'Convert to Order' (open modal) | immediate Memory at end: ~276MB | immediate Memory at end: 277MB | 4s | 2s | immediate | immediate | |||||||||||||
| Click 'OK' in modal | 307.52s (5+ minutes to convert 1 and show a list of 8) Memory at end: ~280MB
| 93.57s (convert 1, show a list of 6) Memory at end: 271MB
2nd run: all roughly the same88s (convert 1, show 5), 288MB. | 21s (to convert 8 and display a list of 0 left to convert) Much improved!
| 20s (to convert 8 and display 2 left to convert)
6s (to convert 1)
| 34s (to convert 1)
| 178s (to convert 10)
6s (to convert 1)
Tried again (to convert 8, leaving 2): 30s
| |||||||||||||
OLMIS-3320 - Getting issue details... STATUS (goal? will help screens first load and any other search the user does) OLMIS-3318 - Getting issue details... STATUS (will save 84s after convert to order button clicked) | |||||||||||||||||||
| Total | 25s | 40s | 178s, 6s | ||||||||||||||||
| Manage POD | |||||||||||||||||||
| Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Could not find a user to Manage PODs | Could not find a user to Manage PODs | |||||||||||||||
| Navigate to Orders > Manage PODs | immediate (no network activity) Memory at end: ~272MB | immediate (no network activity) | immediate (no network activity) | ||||||||||||||||
| Select Program Essential Meds at My Facility (Lilongwe DHO Pharmacy), click Search | 11.25s (Showing 10 items out of 34067 total) Memory at end: ~271MB | 14s (showing 10 items out of 61 total) | 12s
(showing 10 items out of 61 total) | (Resumed testing 7 Nov 2017 on perftest with latest code) 15s
(showing 10 items out of 61 total) | |||||||||||||||
| Select an Order (ORDER-EOLYVFU7R from ZA2722 - Zomba Central Hospital) and click 'View Order' | 75.47s Memory at end: ~326MB
| 34s (used a different Order)
| 28s | 78s
| |||||||||||||||
| Enter Quantities (random partial data entry) | (UI was a bit slow on tabbing and typing in text) | (On the View screen I could not find a way to enter quantities) | (On the View screen I could not find a way to enter quantities) | ||||||||||||||||
| Click 'Submit' (opens modal) | immediate | ||||||||||||||||||
| Click 'OK' in modal | ~70s (UI had errors here – the loading spinner showed during the first API call, but then the screen was editable again during a second API call, but then a loading spinner took away screen control without notice to the user during a third or fourth API call!)
| ||||||||||||||||||
| View Order | |||||||||||||||||||
| Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | |||||||||||||||||
| Navigate to Orders > View Orders | 3s 3 API calls Memory at end: ~389MB | 4s Reduced to 1 API call
| 3s
| ||||||||||||||||
| Select Supplying Facility=CMST Central | 4s 1 API call | 4s
| 3s
| ||||||||||||||||
| Select Requesting Facility=Lilongwe DHO Pharmacy | immediate | immediate | immediate | ||||||||||||||||
| Select Program=Essential Meds | immediate | immediate | immediate | ||||||||||||||||
| Click 'Search' | 8s 5 API calls (Showing 10 items out of 61 total) Memory at end: ~404MB | 14s Reduced to 3 API calls
| 12s
| ||||||||||||||||
| Click 'Print' next to an Order (O6fc98f7f-085e-4a85-a8a0-9fb4376f1d43) | 14s Displays PDF in new tab | 11s Displays PDF in new tab | 13s Displays PDF in new tab | ||||||||||||||||
| Password Reset | |||||||||||||||||||
| Click 'Forgot Password' | immediate | ||||||||||||||||||
| Enter an email and click 'Reset Password' | Error: (did not have a matching password to test) | ||||||||||||||||||
| Application Shut Down | |||||||||||||||||||
| Logout | 3.94s | 3.98s | 3.13s | ||||||||||||||||
Release testing for 3.3
Steps:
- Use and update Chrome (current version is 66); don't use firefox
- Clear chrome's history, application cache, etc.
- Navigate to perftest.openlmis.org
- Open dev tools, goto Performance tab, select Slow 3G and 6x CPU throttle
- Use credentials:
- Username: dhitale
- Password: password
- Add a column to the right, add the version, date, operating system, and your name
- Open the network tab and filter by XHR
- Have a manual timer so you have a way to time the overall feel to the user.
- Start the story in the leftmost column, and start recording timing, noting CPU and memory changes, etc.
- Use the network tab, clicking on an operation and looking at the timing tab to get (Request sent, TTFB, Content Download)
- Watch this video for an overview of these instructions.
| Story | 3.2.1-RC1 ** this is the reference ** | 3.3.0-SNAPSHOT | 3.3.0-SNAPSHOT 21 March 2018 | 3.3.0-SNAPSHOT 30 March 2018 | 3.3.0-SNAPSHOT 1 April 2018 | 3.3.0-SNAPSHOT 24 April 2018 | 3.3.0 24 April 2018 OS 10.11 | 3.3.0 25 April 2018 Windows 8.1 | 3.3.0 25 April 2018 Windows 10 | 3.3.0 25 April 2018 Windows 10 | 3.3.0 25 April 2018 Ubuntu 16.04 | 3.3.0 25 April 2018 Ubuntu 16.04 | 3.3.0 25-26 April 2018 Ubuntu 14.04 | 3.3.0 25 April 2018 Windows 8.1 | 3.3.0 26 April 2018 Ubuntu 16.04 | 3.3.0 26 April 2018 Ubuntu 16.04 LTS | 3.3.0 26 April 2018 Windows 10 | 3.3.0 26 April 2018 Ubuntu 17.04 | 3.3.0 26 April 2018 Ubuntu 16.04 | 3.3.0 27 April 2018 Ubuntu 16.04 | 3.3.0 27 April 2018 Ubuntu 14.04 | 3.3.0 27 April 2018 Ubuntu 16.04 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| UbuntuUbin | brandon (same throttling) dhitale account on perftest.openlmis.org | chongsun (same throttling) dhitale account on perftest.openlmis.org NOTE: this was on "cold startup" | chongsun (same throttling) dhitale account on perftest.openlmis.org | chongsun (same throttling) dhitale account on perftest.openlmis.org | chongsun (same throttling) dhitale account on perftest.openlmis.org NOTE: this set of steps is for EMERGENCY requisitions | chongsun (same throttling) dhitale account on perftest.openlmis.org | Josh dhitale on | Łukasz Lewczyński (Deactivated) dhitale on perftest.openlmis.org | Nikodem dhitale | Paweł Albecki dhitale on perftest.openlmis.org | Jakub Kondrat dhitale on perftest.openlmis.org | Jakub Kondrat dhitale on perftest.openlmis.org | Sebastian Brudziński dhitale on perftest.openlmis.org | Sebastian Brudziński dhitale on perftest.openlmis.org | Mateusz Kwiatkowski dhitale on perftest.openlmis.org | Joanna Bebak dhitale on perftest.openlmis.org | Nikodem Graczewski dhitale | Paweł Albecki | Jakub Kondrat dhitale on perftest.openlmis.org | Mateusz Kwiatkowski dhitale on perftest.openlmis.org | Klaudia Pałkowska superuser on perftest.openlmis.org | Joanna Bebak Slow 3G, 6x CPU throttling slowdown dhitale on |
| Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up | ||||||||||||||
| Initial UI load | 27s Memory use at end: ~211MB
| 4s Memory use: 257MB | 4s | 4s | 4s | 26s | 24s Memory use: 80,876K | 23s openlmis.js (606KB) - 17s | 23s | 20s | 3s | |||||||||||
| Login End of time is when CPU usage drops | 26s Memory use at end: ~231MB
| 17s Memory: 297MB
| 14s Same API calls | 17s Same API calls | 20s Same API calls | 17s Memory: 75,032K (one time there were more than 120,000K) Same API calls | 17s Calls:
They seem to be sent one by one instead of some of them being sent concurrently. | 19s Calls:
| 15s Calls:
| 17s GET /token - 2.03s GET /currencySettings - 2.02s GET /facilities/minimal - 2.57s GET /users/:id - 2.02s GET /users/:id/permissionStrings - 2.25s GET /users/:id/programs - 2.03s | ||||||||||||
| Total | 53s | 21s | 18s | 21s | 24s | 41s | 40s | 42s | 35s | 20s | ||||||||||||
| Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | |||||||||||||||
| Essential Meds program (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds in Lilongwe DHO Pharmacy (271 line items), September 2017 | |||||||||||||
| Navigate to Requisitions > Create/Authorize | Immediate Memory use: 249MB | immediate Memory: 299MB | immediate | immediate | immediate | immediate | immediate Memory: 89,436K | immediate Memory: 92MB | immediate Memory: 92MB | Immediate | ||||||||||||
| Select Facility and Program, Regular type & Click 'Search' | 8s
16s (when server was totally cold after re-deploying) | 38s
Memory use: 308MB | 6s
| 9s
| Emergency 4s
| 8s
| 35s Memory: 96,248K Endpoints:
| 8s Memory: 118B
| 7.5s Memory: 118B
| 5s GET /requisitions/periodsForInitiate - 2.02s GET /requisitions/search - 3.57s | ||||||||||||
| Click Proceed for latest 'Not yet started' period | 45s
51s (first time I initiated for this program; maybe DB-level caching was colder?)
| 184s for one that is initiated (possible "cold startup" of server) | 154s (possible "cold startup" of first initiate) 27s when done again
| 24s for initiated one 39s
| 27s
| 51s
| 1m53s (possible "cold startup" of server) Memory: 174,560K Endpoints:
| 61s
| 42s
| 34s POST /requisitions/initiate - 31.13s | ||||||||||||
| Total | 53s | 222s | 160s 33s when run again | 48s | 59s | 2m29s | 69s | 50s | 39s | |||||||||||||
| Sync Requisition | Sync Requisition | Sync Requisition | Sync Requisition | Add Product | Sync Requisition | Sync Requisition | Sync Requisition | Sync Requisition | ||||||||||||||
| Essential Meds program (271 products) | Essential Meds program | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy | Essential Meds program at Lilongwe DHO Pharmacy | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | ||||||||||||||
| Press "Sync with Server" | 53s
(I notice that data entry within the Requistion form is laggy/delayed when typing and tabbing, whether or not the CPU throttle is on; there is even a delay from the time I click Previous or Next to the time it switches pages) | 67s
| 64s
| 48s
There seems to be some intensive UI work in saving before hitting the API. | Open modal: immediate Adding product: immediate 30s
| 42s
| 2m47s Memory: 187,652K Endpoints:
| 24s Endpoints:
| 27s PUT requisitions/ID - 12.44s GET requisitions/ID - 9.37s GET statusMessages - 2.01s | |||||||||||||
| Total | 53s | 67s | 64s | 48s | 30s | 42s | 2m47s | 24s | 27s | |||||||||||||
| Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | ||||||||||||||
| Essential Meds program (271 products) | Essential Meds program (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | ||||||||||||||
| Press "Submit" (opens modal) | ~immediate | ~immediate | immediate | immediate | immediate | immediate | immediate | Immediate | ||||||||||||||
| Confirm Submit in modal | 43s
| 54s
| 44s
| 70s
Another iteration, 37s
| 40s
| 51s Memory: 310,792K Endpoints:
| 44s | 26s - total 13.94s - PUT requisition 3.31s - submit 2.02s - periods for initiate 4.60s - search requisitions | 24s PUT /requisitions/:id - 13.58s POST /requisitions/:id/submit - 4.75s GET requisitions/:id/periodsForInitiate - 2.03s GET requisitions/search - 3.75s | |||||||||||||
| Total | 43s | 54s | 44s | 70s, 37s | 40s | 51s | 44s | 26s | 24s | |||||||||||||
| Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | ||||||||||||||
| Essential Meds program (271 products) | Essential Meds program (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | ||||||||||||||
| Navigate to Requisitions > Create/Authorize | immediate | Not executed because I was on the right screen after I submitted the requisition | Not executed because I was on the right screen after I submitted the requisition | Not executed because I was on the right screen after I submitted the requisition | Immediate | |||||||||||||||||
| Select Program at My Facility with Type Regular and click Search | 5s
| 5s
| 3s
| 5s
| 5s
| Not executed because I was on the right screen after I submitted the requisition | Not executed because I was on the right screen after I submitted the requisition | 6s GET /requisitions/periodsForInitiate - 2.02s GET /requisitions/search - 3.49s | ||||||||||||||
| Click Proceed for 'Submitted' requisition | 31s | 21s
| 21s
| 12s
| 12s
| 29s Memory: 352,460K Endpoints:
| 27s | 12s - total 9.63 s - GET requisition 2.02 s - status messages | 12s GET /requisitions/:id - 9.60s GET /statusMessages - 2.03s | |||||||||||||
| Click 'Authorize' (opens modal) | immediate | immediate | immediate | immediate | immediate | 0.5s | immediate | Immediate | ||||||||||||||
| Click 'Authorize' in modal | 51s
| 61s
| 54s
| 44s
Another iteration, 39s
| 44s
| 50s Memory: 136,020K Endpoints:
| 45s Memory: 196MB | 26s 12.41s PUT requisition 6.59s authorize 2.00s - periods for initiate 4.08s - search requsiitions | 26s PUT /requisitions/:id - 12.99s POST /requisitions/:id/authorize - 5.73s GET /requisitions/periodsForInitiate - 2.02s GET /requisitions/search - 2.95s | |||||||||||||
| Total | 87s | 87s | 78s | 61s, 56s | 61s | 1m19s | 72s | 38s | 44s | |||||||||||||
| Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | ||||||
| Essential Meds program (271 products) | Essential Meds program (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (267 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Nkhoma Hospital (31 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds program at Lilongwe DHO Pharmacy (271 products) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | ||||||
| Navigate to Requisitions > Approve | 4s
| 18s
| 2s
| 2s
| 2s
| 17s Memory: 161,708K Endpoints:
| 5s
| 6s Memory: 175MB
| 6s
| 6s
| 5s
| 4s
| 3s
| 4s
| 7s
| 13s
| 3s GET /requisitions/requisitionsForApproval: 2.04s | |||||
| Filter by Program and click 'Search' | 8s
(showing 10 items out of 31 total for this program) | 3s
10 out of 31 total | 3s
10 out of 31 total | 2s
| 2s
| 8s Memory: 159,864K Endpoints:
| 5s
| 5s | 7s
| 7s
| 7s
| 4s
| 3s
| 3s
| 7s
| 3s
| 3s GET /requisitions/requisitionsForApproval: 2.10s | |||||
| Select 1 and click 'View Requisition' | 16s
Memory use: 3.9GB (not sure where between the time above and now the memory started spiking!) | 20s
| 20s
| 12s
| 12s
| 28s Memory: 181,444K Endpoints:
| 20s Calls:
| 25s Memory: 225MB
| 22s Calls:
| 29s Calls:
| 24s
| 13s
| 12s
| 11s
| 30s
| 14s
| 14s GET /requisitions/:id - 9.53s GET /statusMessages - 2.01s | |||||
| Click 'Approve' (opens modal) | immediate | immediate | immediate | immediate | immediate | immediate | 0.5s | 0.5s | 0.5s | immediate | Immediate | Immediate | immediate | immediate | immediate | Immediate | ||||||
| Click 'Approve' in modal | 19s
| 55s
| 48s
| 45s
Another iteration, 37s
| 41s
| 35s Memory: 145,724K Endpoints:
Get 400 with error message: Cannot release requisition as order. Requisition must have supplying facility. | 41s Calls:
| 54s Memory: 217MB Endpoints:
| 18.2s Calls:
| 37.6s Calls:
Got 400 error: | 42s
| 37s
| 32s
| 19s
| 31s
| 31s
| 31s PUT /requisitions/:id - 13.25s POST /requisitions/:id/approve - 13.30s GET /requisitions/requisitionsForApproval: 2.07s | |||||
| Total | 47s | 96s | 73s | 61s, 53s | 57s | 1m28s | 71s (1m 11s) | 91s | 53.7s | 80.1s | 78s | 58s | 50s | 37s | 58s | 51s | ||||||
| Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | Batch Approve Requisition | ||||||||||||||
| Essential Meds program (271 products) | Essential Meds program | Malaria program | Essential Meds program | Essential Meds program | Essential Meds program | Essential Meds program | Essential Meds program | Essential Meds program | ||||||||||||||
| Navigate to Requisitions > Approve | 5s
| 3s
| 3s
| 3s
| 3s
| 5s Memory: 151,088K Endpoints:
| Not executed | 4s Endpoints:
| 3s | |||||||||||||
| Select Program and click Search | 5s
(showing 10 results out of 30) | 3s
| 3s
| 3s
| 3s
| 7s Memory: 151,664K Endpoints:
| Not executed | 4s Endpoints:
| 3s | |||||||||||||
| Select All 10 requisitions and click 'View Selected Requisitions' | 20s
(Again, most of the time is CPU in browser) | 5s
| 3s
| 5s
| 6s
| There is no option to select several requisitions. | There is no option to select several requisitions. | 7s retrieve all - 5.06s
| 8s | |||||||||||||
| Click 'Approve' (open modal) | 5s (no API calls) | immediate | immediate | immediate | immediate | immediate | Immediate | |||||||||||||||
| Click 'OK' in modal | 115s
| 206s
| Got errors and did not approve. Error message: There were 10 errors. It's not clear what is wrong or how to fix it. | 114s
Another iteration, 77s
| 84s
| 91s
| 155s
| |||||||||||||||
| Total | 150s | 217s | 125s, 88s | 96s | 12s | null | 106s | 169s | ||||||||||||||
| Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | ||||||||||
| Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | Used 'superuser' user account and Essential Meds program | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | ||||||||||
| Navigate to Requisitions > Convert to Order | 3s
(10 showing out of 11 requisitions ready to convert) | 6s
1 out of 1 requisitions ready to convert | 6s
10 out of 11 requisitions ready to convert | 5s
| 5s
| 8s Memory: 163,908K Endpoints:
| 4s | 6s (12 requisitions available) | 2.36s
| 3.5s
| 7.5s
| 16.5s
| 3s /requisitions/requisitionsForConvert: 2.14s (11 requisitions available) | |||||||||
| Select 1, Select a Warehouse, and click 'Convert to Order' (open modal) | 2s | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | immediate | 1 requisition - Immediate 8 requisitions - Immediate | |||||||||
| Click 'OK' in modal | 20s (to convert 8 and display 2 left to convert)
6s (to convert 1)
| 34s (to convert 1)
| 178s (to convert 10)
6s (to convert 1)
Tried again (to convert 8, leaving 2): 30s
| 234s (to convert 10)
Getting results all over the place: To convert 1, got 4s, 5s, 10minutes | 15s (to convert 1), 5s (second time to convert 1)
89s (to convert 10)
| 18s (to convert 1) Memory: 143,508K Endpoints:
1m6s (to convert 9) Memory: 123,936K Endpoints:
| 7s (to convert 1) Memory: 178MB
| 8s to convert 1 requisition /convertToOrder: 2.04s (TTFB: 2.02s) 11s to convert 8 requisitions /convertToOrder: 7.17s (TTFB: 7.15s) | 7s to convert 1 requisition /convertToOrder: 6.30s but got an error 33s to convert 8 requisitions | 3s to convert 1 requisition /convertToOrder: 2s (TTFB all) 30s to convert 8 requisitions | 9s to convert 1 requisition /convertToOrder: 3.02s 44s to convert 8 requisitions | 32s to convert 1 requisition (Essential Meds - Likuni Hospital)
100s to convert 8 requisitions
| Convert 1 requisition - 4s POST /convertToOrder – 2.64s Convert 8 requisitions - 27s POST /convertToOrder - 24.51s | |||||||||
| Total | 25s | 40s | 178s, 6s | 89s, 15s (5s second time) | 26s / 1m14s | 11s | 14s / 17s | 7s / 33s | 6.5s / 33.5s | 16.5s / 51.5s | 48.5s / 116.5s | 1 requisition - 7s, 8 requisitions - 30s | ||||||||||
| Manage POD | Manage POD | |||||||||||||||||||||
| Used 'superuser' user account and Essential Meds program | Could not find a user to Manage PODs | Could not find a user to Manage PODs | Could not find a user to Manage PODs | |||||||||||||||||||
| Navigate to Orders > Manage PODs | immediate (no network activity) | |||||||||||||||||||||
| Select Program Essential Meds at My Facility (Lilongwe DHO Pharmacy), click Search | 12s
(showing 10 items out of 61 total) | |||||||||||||||||||||
| Select an Order (ORDER-EOLYVFU7R from ZA2722 - Zomba Central Hospital) and click 'View Order' | 28s | |||||||||||||||||||||
| Enter Quantities (random partial data entry) | ||||||||||||||||||||||
| Click 'Submit' (opens modal) | ||||||||||||||||||||||
| Click 'OK' in modal | ||||||||||||||||||||||
| Total | --s | |||||||||||||||||||||
| View Order | View Order | |||||||||||||||||||||
| Navigate to Orders > View Orders | 1s Memory: 147,472K Endpoints:
| |||||||||||||||||||||
| Select Supplying Facility=CMST Central and click Search button | 4s Memory: 126,508K Endpoints:
| |||||||||||||||||||||
Open filter modal,select Lilongwe DHO Pharmacy as Requesting Facility, Essential Meds as Program and click search button | 3s Memory: 143,076K Endpoints:
| |||||||||||||||||||||
| Click 'Print' next to an Order (O6fc98f7f-085e-4a85-a8a0-9fb4376f1d43) | 33s Memory: 161,264K Endpoints:
| |||||||||||||||||||||
| Total | 41s | |||||||||||||||||||||
| Password Reset | Password Reset | |||||||||||||||||||||
| Click 'Forgot Password' | immediate | |||||||||||||||||||||
| Enter an email and click 'Reset Password' | 3s Memory: 157,248s Endpoints:
Get 400 with error message: User with provided email does not exist. | |||||||||||||||||||||
| Total | 3s | |||||||||||||||||||||
| Application Shut Down | Application Shut Down | Application Shut Down | Application Shut Down | Application Shut Down | Application Shut Down | |||||||||||||||||
| Logout | 1s Memory: 139,632K No API calls | 2.5s
| ||||||||||||||||||||
| Total | 1s | 2.5s |
| Story | 3.2.1 26 April 2018 | 3.2.1 26 April 2018 | 3.2.1 26 April 2018 | 3.2.1 26 April 2018 | 3.3.0 (post UI fixes) 26 April 2018 | 3.3.1 16 July 2018 | 3.3.1 16 July 2018 |
|---|---|---|---|---|---|---|---|
Nikodem slow 3g, 6x cpu throttling slowdown dhitale | slow 3g, 6x cpu throttling slowdown dowa | slow 3g, 6x cpu throttling slowdown dowa | Nikodem Graczewski slow 3g, 6x cpu throttling dowa | Chongsun Ahn slow 3g, 6x cpu throttling dhitale | Klaudia Pałkowska slow 3G, 6x CPU throttling dhitale | Mateusz Kwiatkowski slow 3G, 6x CPU throttling dhitale | |
| Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | |||||
| Initial UI load | 22s
| 20s
| 22s | 21s | 21s | ||
| Login End of time is when CPU usage drops | 8s
| 13s
| 14s | 15s | 14s | ||
| Total | 30s | 33s | 36s | 36s | 35s | ||
| Initiate Requisition | Initiate Requisition | Initiate Requisition | |||||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Dowa DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | |||
| Navigate to Requisitions > Create/Authorize | Immediate | Immediate | immediate | immediate | immediate | ||
| Select Facility and Program, Regular type & Click 'Search' | 4s
| 4s
| 4s API results similar | 9s
| 4s
| ||
| Click Proceed for latest 'Not yet started' period | 40s
| 25s
| 34s
| 59s
| 28s
| ||
| Total | 44s | 29s | 38s | 1m 8s | 32s | ||
| Sync Requisition | Sync Requisition | Sync Requisition | |||||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | |||
| Press "Sync with Server" | 51s
| 68s
| 24s What is notable is PUT is 12s, with request sent now ~3s. | 57s
| 24s
| ||
| Total | 51s | 68s | 24s | 57s | 24s | ||
| Submit Requisition | Submit Requisition | Submit Requisition | |||||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | |||
| Press "Submit" (opens modal) | Immediate | Immediate | immediate | immediate | immediate | ||
| Confirm Submit in modal | 40s
| 46s
| 19s PUT is 12s again, with request sent 3s. Submit 2s. | 34s
| 34s
| ||
| Total | 40s | 46s | 19s | 34s | 34s | ||
| Authorize Requisition | Authorize Requisition | Authorize Requisition | |||||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | |||
| Navigate to Requisitions > Create/Authorize | Immediate | Immediate | immediate | immediate | immediate | ||
| Select Program at My Facility with Type Regular and click Search | 5s
| 7s
| 4s | 9s | 4s | ||
| Click Proceed for 'Submitted' requisition | 20s
| 34s
| 12s | 37s | 12s | ||
| Click 'Authorize' (opens modal) | Immediate | Immediate | immediate | immediate | immediate | ||
| Click 'Authorize' in modal | 50s
| 56s
| 21s PUT 12s again, with request sent 3s. Authorize 6s. | 32s | 22s
| ||
| Total | 75s | 97s | 37s | 1m 18s | 38s | ||
| Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | ||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | ||
| Navigate to Requisitions > Approve | 4s
| 6s (10 requisitions out of 159 total)
| 6s (10 requisitions out of 159 total)
| 5s
| 3s | 8s
| 2s
|
| Filter by Program and click 'Search' | 3s
| 7s (10 requisitions out of 38 total)
| 6s (10 requisitions out of 38 total)
| 6s
| 3s | 8s
| 3s
|
| Select 1 and click 'View Requisition' | 18s
| 31s
| 34s
| 31s
| 12s | 36s | 13s |
| Click 'Approve' (opens modal) | Immediate | Immediate | Immediate | Immediate | immediate | immediate | immediate |
| Click 'Approve' in modal | 36s
| 43s
| 41s
| 53s
| 20s PUT 12s, with request sent 3s. Approve 5s. | 30s
| 25s
|
| Total | 61s | 87s | 87s | 95s | 38s | 1m 22s | 43s |
| Batch Approve | |||||||
| Navigate to Requisitions > Approve | 3s | ||||||
| Filter by Program and click 'Search' | 5s | ||||||
| Select All 10 requisitions and click 'View Selected Requisitions' | 7s | ||||||
| Click 'Approve' (opens modal) | immediate | ||||||
| Click 'Approve' in modal | 89s Saving took 48s. Approving took 39s. | ||||||
| Total | 104s | ||||||
| Convert to Order | Convert to Order | Convert to Order | |||||
User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Dowa DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe Airbase Health Centre (149 line items) | User: superuser Convert 1 requisition - Essential Meds in Lilongwe Airbase Health Centre (149 line items) | |||
| Navigate to Requisitions > Convert to Order | Convert 1 requisition - 3s
Convert 8 requisitions - 8s
| 9 requisitions for convert to order: 8s
| 3s | 9 requisitions for convert to order: 11s
| 3s | ||
| Select 1, Select a Warehouse, and click 'Convert to Order' (open modal) | 1 requisition - Immediate 8 requisitions - Immediate | 1 requisition - 1s 8 requisitions - 1s | immediate | immediate | immediate | ||
| Click 'OK' in modal | Convert 1 requisition - 8s
Convert 8 requisitions - 60s
| Convert 1 requisition - 31s
Convert 8 requisitions - 36s
| Convert 1 requisition (Lilongwe DHO Pharmacy) - 5s Convert 8 requisitions - 26s (this one can vary based on facilities for the 8 requisitions) | Convert 1 requisition (Lilongwe Airbase Health Centre) - 6s Convert 8 requisitions - 20s | Convert 1 requisition - 5s
| ||
| Total | 1 requisition - 11s, 8 requisition - 68s | 1 requisition - 40s, 8 requisition - 45s | 1 requisition - 8s, 8 requisition - 29s | 1 requisition - 17s, 8 requisition - 31s |
Release Testing for 3.4
| Story | 3.2.1 26 April 2018 | 3.2.1 26 April 2018 | 3.2.1 26 April 2018 | 3.2.1 26 April 2018 | 3.4.0 19 July 2018 | 3.4.0 19 July 2018 |
|---|---|---|---|---|---|---|
Nikodem slow 3g, 6x cpu throttling slowdown dhitale | Nikodem Graczewski slow 3g, 6x cpu throttling dowa | Mateusz Kwiatkowski slow 3g, 6x cpu throttling dhitale | Klaudia Pałkowska slow 3g, 6x CPU throttling dhitale | |||
| Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | ||||
| Initial UI load | 22s
| 20s
| 21s
| 21s
| ||
| Login End of time is when CPU usage drops | 8s
| 13s
| 16s
| 16.5s
| ||
| Total | 30s | 33s | 37s | 37.5s | ||
| Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | ||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Dowa DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | |||
| Navigate to Requisitions > Create/Authorize | Immediate | Immediate | immediate | immediate | ||
| Select Facility and Program, Regular type & Click 'Search' | 4s
| 4s
| 4s
| 3s
| ||
| Click Proceed for latest 'Not yet started' period | 40s
| 25s
| 29s
| 30s
| ||
| Total | 44s | 29s | 33s | 33s | ||
| Sync Requisition | Sync Requisition | Sync Requisition | Sync Requisition | Sync Requisition | ||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | |||
| Press "Sync with Server" | 51s
| 68s
| 31s
| 28s
| ||
| Total | 51s | 68s | 31s | 28s | ||
| Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | ||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | |||
| Press "Submit" (opens modal) | Immediate | Immediate | immediate | immediate | ||
| Confirm Submit in modal | 40s
| 46s
| 18s
| 18s
| ||
| Total | 40s | 46s | 18s | 18s | ||
| Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | ||
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | |||
| Navigate to Requisitions > Create/Authorize | Immediate | Immediate | immediate | immediate | ||
| Select Program at My Facility with Type Regular and click Search | 5s
| 7s
| 3s
| 3s
| ||
| Click Proceed for 'Submitted' requisition | 20s
| 34s
| 12s
| 13s
| ||
| Click 'Authorize' (opens modal) | Immediate | Immediate | immediate | immediate | ||
| Click 'Authorize' in modal | 50s
| 56s
| 21s
| 22s
| ||
| Total | 75s | 97s | 36s | 38s | ||
| Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | |
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Dowa DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | ||
| Navigate to Requisitions > Approve | 4s
| 6s (10 requisitions out of 159 total)
| 6s (10 requisitions out of 159 total)
| 5s
| 2s
| 2.5s
|
| Filter by Program and click 'Search' | 3s
| 7s (10 requisitions out of 38 total)
| 6s (10 requisitions out of 38 total)
| 6s
| 3s
| 3s
|
| Select 1 and click 'View Requisition' | 18s
| 31s
| 34s
| 31s
| 12s
| 14s
|
| Click 'Approve' (opens modal) | Immediate | Immediate | Immediate | Immediate | immediate | immediate |
| Click 'Approve' in modal | 36s
| 43s
| 41s
| 53s
| 20s
| 21s
|
| Total | 61s | 87s | 87s | 95s | 37s | 40.5s |
| Batch Approve | ||||||
| Navigate to Requisitions > Approve | ||||||
| Filter by Program and click 'Search' | ||||||
| Select All 10 requisitions and click 'View Selected Requisitions' | ||||||
| Click 'Approve' (opens modal) | ||||||
| Click 'Approve' in modal | ||||||
| Total | ||||||
| Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order | ||
User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Dowa DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | |||
| Navigate to Requisitions > Convert to Order | Convert 1 requisition - 3s
Convert 8 requisitions - 8s
| 9 requisitions for convert to order: 8s
| 4s
| 3s
| ||
| Select 1, Select a Warehouse, and click 'Convert to Order' (open modal) | 1 requisition - Immediate 8 requisitions - Immediate | 1 requisition - 1s 8 requisitions - 1s | immediate | immediate | ||
| Click 'OK' in modal | Convert 1 requisition - 8s
Convert 8 requisitions - 60s
| Convert 1 requisition - 31s
Convert 8 requisitions - 36s
| Convert 1 requisition - 3s
Convert 8 requisitions - 21s
| Convert 1 requisition - 3s
Convert 8 requisitions - 21s
| ||
| Total | 1 requisition - 11s, 8 requisition - 68s | 1 requisition - 40s, 8 requisition - 45s | 1 requisition - 7s, 8 requisition - 25s | 1 requisition - 6s, 8 requisition - 24s |
| Story | 3.4.0 7 August 2018 | 3.4.0 8 August 2018 | 3.4.0 8 August 2018 | 3.4.0 9 August 2018 |
|---|---|---|---|---|
Nikodem Graczewski slow 3g, 6x cpu throttling dhitale | Klaudia Pałkowska slow 3g, 6x CPU throttling dhitale | Mateusz Kwiatkowski slow 3g, 6x CPU throttling dhitale | Paulina Mironiuk slow 3g, 6x CPU throttling dhitale | |
| Application Start Up This reflects a person downloading OpenLMIS in a browser for the first time and logging in | ||||
| Initial UI load | 21s
| 21s
| 22s
| 22s
|
| Login End of time is when CPU usage drops | 17s
| 17s
| 16s
| 21s
|
| Total | 38s | 38s | 38s | 43s |
| Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition | Initiate Requisition |
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | Essential Meds in Lilongwe DHO Pharmacy (271 line items) | |
| Navigate to Requisitions > Create/Authorize | immediate | immediate | immediate | immediate |
| Select Facility and Program, Regular type & Click 'Search' | 4s
| 3s
| 3s
| 3s
|
| Click Proceed for latest 'Not yet started' period | 31s
| 32s
| 29s
| 35s
|
| Total | 35s | 35s | 31s | 38s |
| Sync Requisition | Sync Requisition | Sync Requisition | Sync Requisition | Sync Requisition |
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for initiate | |
| Press "Sync with Server" | 28s
| 35s
| 27s
| 28s
|
| Total | 28s | 35s | 27s | 28s |
| Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition | Submit Requisition |
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for sync | |
| Press "Submit" (opens modal) | immediate | immediate | immediate | immediate |
| Confirm Submit in modal | 19s
| 19s
| 18s
| 19s
|
| Total | 19s | 19s | 18s | 19s |
| Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition | Authorize Requisition |
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for submit | |
| Navigate to Requisitions > Create/Authorize | immediate | immediate | immediate | immediate |
| Select Program at My Facility with Type Regular and click Search | 3s
| 3s
| 3s
| 3s
|
| Click Proceed for 'Submitted' requisition | 14s
| 17s
| 13s
| 18s
|
| Click 'Authorize' (opens modal) | immediate | immediate | immediate | immediate |
| Click 'Authorize' in modal | 23s
| 23s
| 21s
| 24s
|
| Total | 40s | 43s | 37s | 45s |
| Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) | Approve Requisition (Single) |
| Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | Essential Meds in Lilongwe DHO Pharmacy (271 line items) - same requisition as for authorize | |
| Navigate to Requisitions > Approve | 3s
| 3s
| 3s
| 3s
|
| Filter by Program and click 'Search' | 3s
| 3s
| 3s
| 3s
|
| Select 1 and click 'View Requisition' | 14s
| 15s
| 13s
| 12s
|
| Click 'Approve' (opens modal) | immediate | immediate | immediate | immediate |
| Click 'Approve' in modal | 28s
| 23s
| 22s
| 22s
|
| Total | 48s | 44s | 41s | 40s |
| Batch Approve | ||||
| Navigate to Requisitions > Approve | ||||
| Filter by Program and click 'Search' | ||||
| Select All 10 requisitions and click 'View Selected Requisitions' | ||||
| Click 'Approve' (opens modal) | ||||
| Click 'Approve' in modal | ||||
| Total | ||||
| Convert to Order | Convert to Order | Convert to Order | Convert to Order | Convert to Order |
User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | User: superuser Convert 1 requisition - Essential Meds in Lilongwe DHO Pharmacy (271 line items) same requisition as for approve | |
| Navigate to Requisitions > Convert to Order | 3s
| 3s
| 3s
| 3s
|
| Select 1, Select a Warehouse, and click 'Convert to Order' (open modal) | immediate | immediate | immediate | immediate |
| Click 'OK' in modal | Convert 1 requisition - 5s
Convert 8 requisitions - 24s
| Convert 1 requisition - 4s
Convert 8 requisitions - 17s
| Convert 1 requisition - 4s
Convert 8 requisitions - 17s
| Convert 1 requisition - 6s
Convert 8 requisitions - 25s
|
| Total | 1 requisition - 8s, 10 requisition - 27s | 1 requisition - 7s, 8 requisition - 20s | 1 requisition - 7s, 8 requisition - 20s | 1 requisition - 9s, 8 requisition - 28s |
Reported Performance from Malawi
Nuran Idris (Unlicensed) reported this information in MW-529. This information is being stored here so we can find it again.
This is reported times for a user (Nuran?) Working in MW's Emergency Medicine program to approve requisitions.
| Step | Action | Duration | Total seconds |
|---|---|---|---|
| 1 | Select EM Search | 0 | 0 |
| 2 | First page of 10 forms appear | 02:06.36 | 126.36 |
| 3 | Click page 2 | 02:20.28 | 266.64 |
| 4 | Click page 1 | 02:02.91 | 389.55 |
| 5 | Click one random form to approve - view requisition page | 00:19.66 | 409.21 |
| 6 | Click approve | 02:54.75 | 583.96 |
| 7 | On approve screen - click 5 random requisitions | 00:45.24 | 629.2 |
| 8 | On batch approve screen - Click approve | 04:14.20 | 883.4 |
| 9 | On approve screen - click 2 forms to approve | 00:26.71 | 910.11 |
| 10 | On batch approve screen - click approve | 02:48.40 | 1078.51 |
OpenLMIS: the global initiative for powerful LMIS software