Uploaded image for project: 'UX Product'
  1. UX Product
  2. UXPROD-1806

NFR: Data Import Pub-Sub (Event Driven) Infrastructure, part 1

    XMLWordPrintable

Details

    • Large < 10 days
    • Small < 3 days
    • Low
    • XXL < 30 days
    • Folijet
    • 105

    Description

      Broken out from other Data Import work and features in June 2019, so that we can have a feature to capture all of the pub-sub/event-driven work

      Managed by Taras_Spashchenko and OleksiiKuzminov in consultation with vbar and the Tech Council

      Additional Q4 2019 work defined in UXPROD-2012

      This will be backend work, to allow for Data Import to interact with other FOLIO applications for matching, actions, and logging

      Requirements:

      • Define preferred approach
      • Review with Tech Council and POs/Tech Leads for affected apps (Inventory, MARCcat, Acquisitions)
      • Create POC
      • Create complete working infrastructure

      https://github.com/folio-org/rfcs/blob/645ac5c208f3f63909700ad4755841df4e769112/text/0000-pub-sub.md

      TestRail: Results

        Attachments

          Issue Links

            defines

            Umbrella - FOLIO-1712 PubSub support in FOLIO

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Open

            Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. UXPROD-47 Batch Importer (Bib/Acq)

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Analysis Complete
            is continued by

            New Feature - New feature requests UXPROD-2012 NFR: Data Import Pub-Sub (Event Driven) Infrastructure, part 2

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            is defined by

            Umbrella - MODDATAIMP-104 SPIKE: Create PoC which will demonstrate the event-driven approach for Data Import profile processing.

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODDATAIMP-117 Finalize PoC with event approach and add examples of usage and integrations

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-1 Create a new module "mod-pubsub"

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-2 Create API for event type registration

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-3 Define and create JSON Schema for audit trail for mod-pubsub

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-4 Define and create JSON Schemas for Event Descriptor and Event used by pub-sub

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-5 Create a matrix for relation between Data Import use cases and Event types

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-6 Design config file for Publishers and Subscribers

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-7 Design register for Publishers, Subscribers and Events

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-9 Rework project to client/server structure

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-10 SPIKE: DB Client PoC

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-11 SPIKE: Vert.x Kafka client PoC

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Umbrella - MODPUBSUB-12 Data Model used by pub-sub

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Umbrella - MODPUBSUB-13 DB Repository.

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-23 Create technical design for Pub-Sub functionality

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-24 Extend JSON Schema for Event

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-31 Integration with Liquibase

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODPUBSUB-33 Establish module documentation for scripts

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-35 Create DAO components for module schema

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-36 Create DAO component for tenant schema

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed
            relates to

            New Feature - New feature requests UXPROD-665 Import Inventory Instances and MARCcat bib records in MARC format

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            New Feature - New feature requests UXPROD-1768 NFR: Data Import (Batch Importer for Bib Acq) Q3 2019 Technical, NFR, & Misc bug work

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            New Feature - New feature requests UXPROD-1805 SRS MARC-Inventory Instance relationship refinement

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            New Feature - New feature requests UXPROD-1860 Migration. Simple UI for edit of the default MARC mapping of holdings records

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Draft

            New Feature - New feature requests UXPROD-2076 NFR: Data Import (Batch Importer for Bib Acq) Q4 2019 Technical, NFR, & Misc bug work

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            New Feature - New feature requests UXPROD-2078 SRS MARC-Inventory Instance relationship refinement, part 2

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Umbrella - FOLIO-1331 Define and describe the architecture for how to keep data in sync across multiple apps

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Open

            New Feature - New feature requests UXPROD-1397 Generating a MARC bibliographic record from an Inventory Instance record

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            New Feature - New feature requests UXPROD-1499 Accept files in JSON for intital migration for input and output

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            New Feature - New feature requests UXPROD-2115 Define human readable identifiers (HRIDs) for SRS MARC Bib records

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Activity

              People

                abreaux Ann-Marie Breaux
                abreaux Ann-Marie Breaux
                Niels Erik Gilvad Nielsen Niels Erik Gilvad Nielsen
                Viktor Soroka Viktor Soroka
                Taras Spashchenko Taras Spashchenko
                Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases