Uploaded image for project: 'UX Product'
  1. UX Product
  2. UXPROD-3023

NFR: R2 2021 Juniper Data Import Stabilization and Reliability work

    XMLWordPrintable

Details

    • Very Small (VS) < 1day
    • Medium
    • Jumbo: > 45 days
    • Folijet
    • 115
    • R2 2021

    Description

      Architectural and Infrastructure work to make Data Import more stable and performant

      Based on feedback from the PTF and architects

      As of 14 April 2021, PTF has tested importing files of 50K MARC to create Bibs, Instances, Holdings, Item

      Additional testing still needed

      • Multiple imports triggered by different users at the same time
      • Imports that update SRS and Inventory records (so have matching portion in the job profile, which creates does not have)
      • EDIFACT - abreaux to get a large renewal invoice from Anne C, so that we can see if that causes any issues

      TestRail: Results

        Attachments

          Issue Links

            defines

            Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. UXPROD-47 Batch Importer (Bib/Acq)

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Analysis Complete
            is defined by

            Task - A task that needs to be done. MODDATAIMP-412 SPIKE: investigate and create stories for this feature

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODDATAIMP-424 Import of 5 concurrent jobs become stuck

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODDATAIMP-436 SPIKE Find out reasons for low coverage reported by Sonar

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODDATAIMP-453 Kafka consumers reconnect

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODDATAIMP-456 Setup coverage report for Sonar in Data Import modules

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODDICORE-137 Item update failed

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODINV-397 Investigate Memory Leaks on Long Duration Data Import

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODINV-400 Errors in Subsequent Updates

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODINV-404 Item update failed

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODINV-423 Excessive CPU usage in a system with no user activity

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODPUBSUB-98 Kafka requirements for mod-pubsub and Data-Import modules

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURCE-278 Record from chunk is not saved occasionally

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODSOURMAN-447 SPIKE prepare a mechanism for monitoring Job Status Is "stuck"

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Task - A task that needs to be done. MODSOURMAN-453 Add index for the " job_execution_source_chunks"

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURMAN-454 Excessive CPU usage in a system with no user activity

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURMAN-456 Error causing UPDATE import to stop

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed
            relates to

            New Feature - New feature requests UXPROD-3191 NFR: R3 2021 Kiwi Data import performance work

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Activity

              People

                abreaux Ann-Marie Breaux
                abreaux Ann-Marie Breaux
                Ivan Kryzhanovskyi Ivan Kryzhanovskyi
                Ann-Marie Breaux Ann-Marie Breaux
                Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases