Technical Assessment Trip Testing Checklist
- Sarah Jackson (Deactivated)
- Josh Zamor
Scope
This pages address the tests that will be conduced during the May 2014 technical assessment trip to Mozambique. These tests are not an exhaustive regression test of all SELV and Tableau functions. The focus of these test is on activities that are likely to have problems in-country.Â
Testing Roles & Responsibilities
| Test Activity | Team | Who | Status |
|---|---|---|---|
| SELV Application Testing (Seattle) | ISG | Sarah |
|
| Tableau Report Testing (Seattle) | HSG | Vidya |
|
| SELV Application Testing (Maputo and provincial offices) | ISG | Josh |
|
SELV Technical Knowledge Transfer to Tatenda | ISG | Josh & Sarah |
|
| SELV Business Knowledge Transfer to Tatenda | HSG | Vidya |
|
| SELV Tablet Demo/Gather Feedback | ISG | Josh |
|
Test Checklist
Â
Tests to Conduct at VillageReach Office - Maputo (Josh) | ||
| Category | Test | Result |
|---|---|---|
Basic System Functioning Over Wifi, Josh's Laptop | Access selv website | Good ~7-17s without cache ~6-9s with cache |
| Â | Access selv training website | Good |
| Â | Login | Good ~4s |
| Â | Lost password - receive email | Good Check where fc1-fc10 @ villagereach.org emails go Not to Josh or Tatenda |
| Â | Access Initiate Distribution page. Application successfully cached. | Good ~2.5-3.5s |
| Â | View Load Amounts | Good Real time load was only a couple seconds |
| Â | Initiate distribution | Good A couple seconds |
|  | Enter data in offline mode, and change between online and offline | Good, however from manage distribution the "Go Online" button doesn't appear until user clicks on "Home" tab and then navigates back to Manage Distribution. Before this tabs that will not work, e.g. Reports are available though they fail nice: go back to home screen |
| Â | Sync distribution | Good |
| Â | Sync distribution including facility already synced by another user | Good with issues filed |
Basic System Functioning Over 3G, Josh's Laptop | Access selv website | Good ~10-11s |
| Â | Access selv-training website | Good ~10-11s |
|  | Login | Good ~17s – kinda slow |
| Â | Lost password - receive email | Not going to repeat |
| Â | Access Initiate Distribution page. Application successfully cached. | Good 28s |
| Â | Initiate distribution. Distribution successfully cached. | Good ~7s |
| Â | View load ammounts | Good ~9s |
| Â | Enter data in offline mode, and change between online and offline | Not to going repeat |
| Â | Sync distribution | Good ~4s for one facility with "NR" data |
| Â | Sync distribution including facility already synced by another user | Not going to repeat |
Basic System Functioning Over Wifi, Tatenda's Laptop | Access selv website | Good |
| Â | Access selv-training website | Good |
| Â | Login | Good |
| Â | Lost password - receive email | Good |
| Â | Access initiate distribution page. Application successfully cached. | Good |
| Â | Initiate distribution. Distribution successfully cached. | Good |
| Â | Enter data in offline mode, and change between online and offline | Good |
| Â | Sync distribution | Good |
| Â | Sync distribution including facility already synced by another user | Good, errors noted as in above |
 End-to-End | Enter data for paper data collection forms (or vrMIS if none are available). Run reporting process, confirm flow-through to Tableau. | Good |
|  | Open tableau workbook in tableau reader | Good on Tatenda's laptop. Usual "slowness" in selecting filters. |
|  | Spot check that data entered matches data in Tableau | Good. Confirmed for Ancuabe Sede and C.S. Mariri on Tatenda's laptop. |
| Admin Functions | Add a field coordinator user, ensure Tatenda receives email | Email okay, except fc1-fc10 not going to Tatenda or Josh as previously noted, created user "clinic" with Josh's personal email |
| Â | Disable user | Good |
| Â | Add a facility (use new facilities identified during recent field coordinator meeting) | Added C112 - Ancuabe Clinic (made up) |
| Â | Remove a facility (use facility no longer serving as an immunization post identified during field coordinator meeting) | Deactivated facility from Vacinas program, C112 |
| Â | Override ISA for facility | Good |
| Â | View data completeness report | Good |
| Â | Install data edit tool | Â |
| Â | View synced data in data edit tool | Â |
| Â | Edit synced data in data edit tool, confirm flow-through to Tableau | Â |
| Tablet over 3G | Start-up tablet | Good |
| Â | Access SELV, login | Good |
|  | Initiate Distribution | Good |
| Â | Enter Distribution Data | Good |
| Â | Sync Distribution | Good |
Tests to Conduct at VillageReach Office - Maputo (Tatenda) | ||
| Category | Test | Result |
|---|---|---|
Translations | Translations on SELV website (all pages) are correct | Â |
| Â | Translations in Tableau workbook (all pages) are correct | Â |
Â
Â
Tests to Conduct for Matola Site Visit | ||
| Category | Test | Result |
|---|---|---|
Basic System Functioning Over 3G, Field Coordinator PC | Access selv website | Good DPS network is wired, not from 3G dongle |
| Â | Access selv training website | Good |
| Â | Login | Good |
| Â | Access Initiate Distribution page. Application successfully cached. | Good |
| Â | Initiate distribution. Distribution successfully cached. | Good |
| Â | Page download times are acceptable | Good, similar as VR Moz office |
| Â | Field coordinator enters data in offline mode from a paper distribution form (repeat as time allows) | No, didn't have time to enter data from paper form but FC did enter made up data. |
| Â | Sync distribution | Good |
| Â | Clear cache and delete indexdb file at end of visit (note location) | Wasn't able to get back to DPS office |
| Tablet Demo | Field Coordinator tries tablet at Provincial Office. Feedback gathered. | Good, feedback noted |
|  | Field Coordinator tries tablet at health center. Feedback gathered. | Worked at a hospital in Xai Xai if the person sat outside at the desk that hospital workers knew had the best chance of internet. Didn't work at a clinic about ~1-1.5hr from Maputo; 3G internet was available but speed was too slow to use - 2-3 minutes just to get to login page. |
|  | Tablet works in real-world conditions while in-route to provincial office. | MCel doesn't work hardly anywhere outside of Maputo. 2nd trip to clinic Tatenda instructed FieldCoordinator in SELV and the tablet in the car despite all the glare and bumps. Page was cached using Movitel by the time vehicle left Maputo (the toll booth). |
Post Visit Report Testing | View data entered by FieldCoordinator on-site in data edit tool | Â |
| Â | Confirm data flow-through to Tableau. Compare calculated values with vrMIS if applicable | Didn't have chance for FC to enter real data |
| Â | View Data Completeness Report | Good, saw that "fake" data entered by FC updated data completeness report |
Â
Â
Tests to Conduct for Xai Xai Site Visit | ||
| Category | Test | Result |
|---|---|---|
Basic System Functioning Over 3G, Field Coordinator PC | Access selv website | Good ~10s |
| Â | Access selv training website | Good |
| Â | Login | Good ~9s |
| Â | Access Initiate Distribution page. Application successfully cached. | Good |
| Â | Initiate distribution. Distribution successfully cached. | Good |
| Â | Page download times are acceptable | Good |
| Â | Field coordinator enters data in offline mode from a paper distribution form (repeat as time allows) | No time to enter directly from paper form, FC did enter made up data. |
| Â | Sync distribution | Good |
| Â | Clear cache and delete indexdb file at end of visit (note location) | Good C:\Documents and Settings\VillageReach\ApplicationData\Mozilla\indexdb\<profile>\<selv> |
| Tablet Demo | Field Coordinator tries tablet at Provincial Office. Feedback gathered. | Good |
|  | Tablet works in real-world conditions while in-route to provincial office. | I had MCel, not tested as Movitel works in more areas. Also "in route" meaning on the road is unlikely - it's very bumpy |
Post Visit Report Testing | View data entered by FieldCoordinator on-site in data edit tool | Â |
| Â | Confirm data flow-through to Tableau. Compare calculated values with vrMIS if applicable | Â |
| Â | View Data Completeness Report | Â |