Debizium is required to be installed on requisition db
topics in Kafka
Kafka connect - a wrapper around Kafka for defining connectors, config has a connection to the source database, whitelist contains all tables that we want to watch, those would correspond to topics in Kafka
Kafka and Kafka connect are established for reporting stack so we can use its docker-compose as an example
feed vs debizium
would be nice to include 3 services (kafka, kafka connector and zookeeper) into the OpenLMIS docker-compose file
it would be nice to have a service that data would be streamed into and could be used for demo purposes
when we could move those services into core
add kafka and others to OpenLMIS Ref Distro.
start building new service.
stream the changes out of Requisition service.
stream data into batch service (aggregate on write).
remove kafka and others from reporting stack, as it's now in ref distro.