Reintroduce data-pumps/streaming architecture to reporting stack

Description

The reporting stack currently uses mostly Nifi to synchronize OpenLMIS v3 data into the OpenLMIS v3 reporting database. This leads to unreliable and delayed data synchronization for reporting data. An alternative is to use a streaming approach with Kafka, Kafka Connect and Debezium to synchronize the data, with near real-time results. The reporting stack originally had Kafka and related components, but it was discarded early on. This task is to reintroduce it, to utilize the benefits of streaming architecture.

Activity

Show:

Josh Zamor May 19, 2020 at 8:42 PM

Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Components

Priority

Time Assistant

Created May 19, 2020 at 4:21 PM
Updated February 8, 2023 at 1:28 PM