Reporting - DevOps Work for Reporting

Reporting - DevOps Work for Reporting

Target release

Epic

OLMIS-4626: Reporting - DevOpsDone

OLMIS-4901: Setup the reporting database(s)Done

Status

drafted

Priority

High

eLMIS Status

Unimplemented

OpenLMIS Status

Unimplemented

Ona 

@Craig Appl (Unlicensed)

OpenLMIS 

-

JSI 

-

Goals/Scope

Make it easy to standup the reporting infrastructure.

Background

Assumptions

User Stories

#

Title

User Story

Label

Importance

Notes

JIRA Tickets

#

Title

User Story

Label

Importance

Notes

JIRA Tickets

 

 

Ansible to Docker images

  • Likely not related but can use existing Ansible scripts as a reference for designing the docker files

 

 

 

 

 

 

Docker images for each service

  • NiFi, all of Druid's services, Kafka, Superset

 

 

 

 

 

 

Move Druid scripts to NiFi

 

 

 

 

 

 

Run BDW on Kubernetes and Consul

 

 

 

 

 

 

Documentation

  • For running the docker containers and their compose

  • For loading NiFi, Superset

 

 

 

 

 

 

Auto-load flows

 

 

 

 

 

 

Auto-load Superset metrics

 

 

 

 

 

 

Server monitoring (Graylog, Grafana, Graphite?) What doe OpenLMIS use?

 

 

 

 

Dependencies

Description

Link

Jira Epics

OLMIS-4626: Reporting - DevOpsDone

 

 

Open Questions

Below is a list of questions to be addressed as a result of this requirements document:

#

Question

Outcome

Status

#

Question

Outcome

Status

1

We probably want to provide setup for an additional database, like Postgres

 

 

2

We may want to provide an additional raw data store (like HDFS) in addition to Kafka

 

 

3

We may want to support backing up Kafka data in a more robust way

 

 

4

We may want to have greater support for authentication in NiFi

 

 

5

We may want to add more restricted security settings to Druid and Kafka

 

 

Out of Scope

 

Tasks

  •  

Gap Estimation Notes 4/12/2018

  • Doesn't block or depend on other work

  • Required for Gap completion

OpenLMIS: the global initiative for powerful LMIS software