...
- (Priority: Medium) Improve Automation of loading Superset
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5270 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5285 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5286 - When you create a chart in Superset, each chart has a different configuration. If it's a bar graph, you need to know the configuration that's specific for Bar Charts in the JSON that we define in Nifi. We can solve this by adding JSON in Nifi per chart type.
- Auto loading the data source, we have to create the data source in Superset and then create the .yaml file
-
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5266 Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5287 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5288
(Priority: High | Antonate) Ingesting referencedata microservice and store in OpenLMIS v3 postgres data structure- (Priority: High | Clay) Perform the following for the Reporting Rate Report
- (template) Mapping from each report to data table required for that report, and from that to the API endpoints storing that data
- For each report we want to build
- A list of data needed for that report (the columns)
- A list of API endpoints you need to access to fetch that data
- Use this to determine
- If there are any reports we do not have all the data for
- If there are ways to represent multiple reports via less than a single table per report
- For each report we want to build
- (template) Mapping from each report to data table required for that report, and from that to the API endpoints storing that data
- (Priority: High| Jason)Reporting Jenkins
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5257 - Standing up Jenkins jobs for the demo setups
-
Jira Legacy server System JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5276 -
Jira Legacy server System JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5280 -
Jira Legacy server System JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5281 -
Jira Legacy server System JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5282 -
Jira Legacy server System JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5283 -
Jira Legacy server System JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5284
-
- Demo setup may need to scale horizontally. Determine if Docker or Ansible should be used for demo setups or if docker-compose is sufficient.
- Research and document the process for horizontal scaling of the demo services
- Standing up Jenkins jobs for the demo setups
- (Priority: Medium) Develop training materials so implementers can build reports
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5256 - Nifi Categories:
- Configuring Controller Services for OpenLMIS
- Processor configuration
- Overview of the standard flow (Invoke HTTP, Evaluate JSON, Split, etc)
- Nifi Registry interactions
- Postgres database structure
- The process for end-to-end automation - Document the dev workflow for reporting (like git flow documentation)
- Getting JSI up to speed (requisition service is core compared to stock management)
- Nifi Categories:
- TLS - Figure out access to the Nifi Registry behind HTTPS (Currently, HTTP is required without Sign-in and may be )
- Backup all persistent NiFi Registry data
(Priority: High | Jason) Deployment of NiFi to a production environment- (Priority: Medium) Research improve loading passwords in Nifi Templates that were downloaded from the Nifi Registry
- Research to identify if there is a central service that can store these passwords (Something like Ansible Vault)
- Architect a way to store passwords for controller services and loading them into a specific template once it's been downloaded.
- (Size: Large) Define an automated process for integration testing of the OpenLMIS v3 microservices
- This needs to be fleshed out more this week
- End-to-end
- (Priority: High | Janette) Storing data in Kafka for replay
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5258 - Storing raw incoming data in Kafka so it can be replayed
- Data for further processing comes from Kafka not API
- Backing up Kafka data
- Research options
- Replicate to off-site
- Copy raw files
- Choose and implement one of the above
- Research options
- (Priority: High | Clay Starting on 22nd Aug in partnership with JSI) Evaluate all 24 12 reports and look for overlap between the reports.
- Stock On Hand Report
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5259
- Stock On Hand Report
- Craig Appl (Unlicensed) review this ->(Priority: High | Clay in partnership with JSI and VR) Evaluate each report to determine if data elements are present in OpenLMIS v3. If not available, we need to expose that and bring them back to the community as feature requests.
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5265 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5267 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5268 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5269 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5271 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5272 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5273 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5274 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5275 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5277 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5278 -
Jira Legacy server System JIRA serverId 448ba138-230b-3f91-a83e-16e7db1deed1 key OLMIS-5279
-
- Next Priorities:
- Data Pumps
- This is dependent on ingesting and standardizing the ingestion process to identify the pain points in the current ingestion process.
- Suggested areas for Data Pumps
- Stock On Hand to push stock events to Nifi or allow us to get access to all stock events through a single user instead of looping through each facility.
- Pushing changes to the geographic hierarchy to the facility registry as updates
- (Peter) Single Sign-on related epics
- Review the OAuth process of OpenLMIS as a candidate system for Single Sign on
- Role Based Access Control for Nifi Registry
- Role Based Access Control for Superset
- Identify actor roles for each component of the reporting stack. Who needs what access?
- Compare that against other services like LDAP that can function to sign on to Superset
- Data Pumps