...
Nifi and Transformations?
Key Question is we know that Nifi /can/ do these things, the question is it the best tool for this job? Key concern with Nifi has been managing it.
Batch transformation with Streams
- On joining streams: https://debezium.io/blog/2018/03/08/creating-ddd-aggregates-with-debezium-and-kafka-streams/
- An alternative that publishes an aggregate (domain root) before it hits the stream: https://debezium.io/blog/2018/09/20/materializing-aggregate-views-with-hibernate-and-debezium/
- Note: this would require modifying the source system, which for this project is less attractive.