Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 16 Next »

IndicatorExpected DifferenceImpacts Migrated Data from vrMIS?Impacts Data After SELV Launch?Explanation 

Validation Approach

for Future Tests

Health Units ReportingShould almost always be the same. SELV might be slightly less than vrMIS.Yes, revised metricYes, revised metric

The business rules is that a HU has reported if the HU was visited, or if routine data is reported. The two systems implement this in different ways:

  • vrMIS counts a HU as reporting if the HU was synched. The facility may have been visited, or not visited. In vrMIS, if you don't have any data you don't have to enter anything at all.
  • In SELV you have to enter data for each facility (for reporting to be accurate). SELV counts a HU as reporting if the facility was visited, or if it was not visited and some data was entered on the child coverage screen.

In most cases these two approaches will yield the same results, but if a facility was synched in vrMIS, but there was no data on the child coverage screen (all "N/R"), it will "count" as reported in vrMIS but not in SELV.

 Identify the HU that shows as "Reported" in vrMIS but not SELV. Look in vrMIS and check if data for the facility was synched, but no data on child coverage screen. I
Tetanus UsedSELV will be higher than vrMISYes, revised metricYes, revised metricvrMIS wasn't calculating this correctly. It should be the sum of all 1st and 2-5 doses administered to all groups of women. Verify one health center manually
PCV Supplies Delivered and Full DeliveriesSELV will be less than vrMISYes, revised metricYes, revised metric

vrMIS had mistaken information on vial size (10 doses per vial instead of 2 doses per vial)

PCV Vial Size Info:

http://apps.who.int/iris/bitstream/10665/90378/1/WHO_IVB_13.09_eng.pdf

 vrMIS PCV Supplies Delivered / 10 * 2 = SELV PCV Supplies Delivered
Child Coverage RateSELV will be higher than vrMISYes, revised metricYes, revised metric

vrMIS was erroneously including cases where no coverage data was reported in the overall coverage rate calculation. When no coverage data was reported, the target group number was still included in the overage coverage rate calculation. For example, if there are three HUs (note the row in pink is the source of the error):

 Doses AdministeredTarget Group for facility

Coverage Rate

(vrMIS)

Coverage Rate

(Correct)

HU11010010%10%
HU2null1000%NULL
HU301000%0%
  Summary Coverage Rate for all 3 Health Units10 + 0 / 300 = 3%10 + 0 / 200 = 5%

 

 

 

Hand calculate correct coverage rate in excel and compare to Argentina's data

 

Child & Adult Coverage RateSELV will be much lower than vrMIS. This is only for data entered directly into SELV (NOT migrated from vrMIS)NoNo

The target group in SELV is the ANNUAL target rate, not the monthly target rate. This will be fixed in the next release.

 

 

 

Hand calculate the correct coverage rate and compare with vrMIS. Note that even after hand correcting the line item above (SELV higher than vrMIS) will still apply:

0-11 mo doses / (target group / 12)

Child & Adult Coverage TargetSELV may be 1 higher than vrMISYes, revised metricYes, revised MetricvrMIS always rounded child/adult coverage target down (floor function). Vidya checked and it should be a round, not a floor. This has been changed in the migrated data and going forward. If same or 1 more than vrMIS, test passes.
PCV product deliveriesSELV values will be 0 for reports before August 2013 (? tbc)Yes, revised metricYes, revised metricNeed to check with Vidya, but no data was reported for that time period. Check the date of the report.
% target group covered (? ) by EPI1 point difference between valuesYes, revised metricYes, revised metricThere is a rounding convention that differs between vrMIS and SELV. (Explanation to be expanded.)  
ISA (on EPI Inventory Screen/Load Amounts Screen)

ISA in SELV will be 1 higher than vrMIS value for vial sizes > 1

 

NoYes

SELV rounds up when converting from doses to vials, vrMIS rounds down.


Example: ISA doses is 124. Vial size is 10. vrMIS says # of vials for a full delivery is 12. SELV says # of vials for a full delivery is 13.

 If SELV is within 1 of vrMIS, test passes.
ISA, Full Deliveries, Child Coverage Target - PCV10ISA in SELV will be ~25% lower than vrMISNoYesvrMIS erronously was calculating PCV10 targets at 4 doses per year, not 3. Changed to 3 in SELV. This impacts the child coverage targets and the ideal quantity on the EPI Inventory and View Load Amounts screen If SELV is ~25% lower than vrMIS targets, test passes.
ISA, Full Deliveries - MeaslesvrMIS has a minimum number of doses of 50 (5 vials). SELV has no minimum.NoYesvrMIS had a minimum number of measles doses in the ISA calculation, but no one knows why. We removed this in SELV. Thus in some cases the Ideal Quantity in vrMIS will be 5, but in SELV will be 1, 2, 3, or 4. If vrMIS is 5 and SELV is less, test passes. For values >=5, vrMIS will be one more than SELV (see related rounding issue)
  • No labels