Uploaded image for project: 'UX Product'
  1. UX Product
  2. UXPROD-3429

NFR: R2 2022 Morning Glory Data import Stability/Reliability/Performance work

    XMLWordPrintable

Details

    • Morning Glory (R2 2022)
    • Out of scope
    • Medium
    • XXL < 30 days
    • Folijet
    • 115
    • R1
    • R1

    Description

      Update the description once we know what will be left from Lotus UXPROD-3210 and UXPROD-3261

      Moving to Spring will help make the modules easier to maintain

      Investigation required for:

      • Review folio-spring-base and how it can be used in mod-data-import
      • Define an approach for Spring transition for mod-source-record-manager and mod-source-record-storage (and the use of data-import-processing-core for Vertx-based and Spring-based modules)
      • mod-data-import stores input file in memory, limiting size of uploaded file and possibly having oom

      Proposed solution/stories

      • Moving mod-data-import to use Spring
      • Improve logging to help in troubleshooting
      • Test performance after all the changes are applied

      Questions

      TestRail: Results

        Attachments

          Issue Links

            continues

            New Feature - New feature requests UXPROD-3210 NFR: R1 2022 Lotus Data import Stability/Reliability work

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            New Feature - New feature requests UXPROD-3261 NFR: R1 2022 Lotus Data import performance work

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            is defined by

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODDATAIMP-639 Test DI performance - Morning Glory

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODDICORE-254 Add logic to skip sending DI_ERROR from mod-inventory in case for duplicates - Morning Glory

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODINV-664 Add logic to skip sending DI_ERROR from mod-inventory in case for duplicates - Morning Glory

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODINVSTOR-894 Create Instance Optimization

            • TBD - To be determined
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURCE-499 Alleviate Eventloop Blocking During Batch Save of Records

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-710 [100k-500k imports] Improve performance of sql query for retrieving log entries for particular job execution

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-759 Improve sql query used by UI to know is processing completed - Morning Glory

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODSOURMAN-772 Timeout when importing MARC files - Morning Glory

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-791 Reduce Conversion of Parsed Content Into A MARC4J Record

            • TBD - To be determined
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-792 Fix Race Conditions During Mapping Parameter Initialization

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODSOURMAN-813 Remove JobExecutionCache to improve progress bar on distributed envs

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            relates to

            New Feature - New feature requests UXPROD-3471 NFR: R2 2022 Morning Glory: Implement flow control for Data Import

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            New Feature - New feature requests UXPROD-3555 NFR: Data Import Vertx-to-Spring Migration

            • P2 - normal priority level, must be included in the current development cycle
            • Open

            Activity

              People

                abreaux Ann-Marie Breaux
                Taisiya Trunova Taisiya Trunova (Inactive)
                Kateryna Senchenko Kateryna Senchenko
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases