Reporting - DevOps Work for Reporting

Owned by Peter Lubell-Doughtie (Unlicensed)
Last updated: Jun 28, 2018 by Mary Jo Kochendorfer (Deactivated)
1 min read
Target release
Epic

OLMIS-4626 - Getting issue details... STATUS

OLMIS-4901 - Getting issue details... STATUS

Status
DRAFTED
PriorityHigh
eLMIS StatusUnimplemented
OpenLMIS StatusUnimplemented
Ona Craig Appl (Unlicensed)
OpenLMIS -
JSI -

Goals/Scope

Make it easy to standup the reporting infrastructure.

Background

Assumptions

User Stories

#TitleUser StoryLabelImportanceNotesJIRA Tickets


Ansible to Docker images

  • Likely not related but can use existing Ansible scripts as a reference for designing the docker files






Docker images for each service

  • NiFi, all of Druid's services, Kafka, Superset






Move Druid scripts to NiFi







Run BDW on Kubernetes and Consul







Documentation

  • For running the docker containers and their compose
  • For loading NiFi, Superset






Auto-load flows







Auto-load Superset metrics







Server monitoring (Graylog, Grafana, Graphite?) What doe OpenLMIS use?



Dependencies

DescriptionLink

Jira Epics

OLMIS-4626 - Getting issue details... STATUS



Open Questions

Below is a list of questions to be addressed as a result of this requirements document:

#QuestionOutcomeStatus
1We probably want to provide setup for an additional database, like Postgres

2We may want to provide an additional raw data store (like HDFS) in addition to Kafka

3We may want to support backing up Kafka data in a more robust way

4We may want to have greater support for authentication in NiFi

5We may want to add more restricted security settings to Druid and Kafka

Out of Scope


Tasks


Gap Estimation Notes 4/12/2018

  • Doesn't block or depend on other work
  • Required for Gap completion

OpenLMIS: the global initiative for powerful LMIS software