Uploaded image for project: 'mod-data-import'
  1. mod-data-import
  2. MODDATAIMP-474

SPIKE: Review PTF job that created more Inventory records than were in the file & fix

    XMLWordPrintable

Details

    • 8
    • Folijet Support

    Description

      Review logs for PTF job that created more Instances, Holdings, Items than were in the imported file

      • hhttps://iris-cap2.int.aws.folio.org/
      • Job 1682 run by folio folio
      • 25,000 record file, 25K.mrc, attached
      • Using job profile: PTF - Create 2
      • Job started 23 june 22:04 UTC, completed 24 June 1:20 UTC, so 3 hours, 16 min.
      • UI log summary shows Completed
      • Stats
        • 25K SRS MARC
        • 36,500 Instances
        • 36,506 Holdings
        • 36,506 Items
      • No indication of why there are duplicates

      TestRail: Results

        Attachments

          1. 25K.zip
            3.71 MB
          2. screenshot-1.png
            screenshot-1.png
            10 kB

          Issue Links

            defines

            New Feature - New feature requests UXPROD-3193 NFR: R3 2021 Kiwi Data import Stability/Reliability work

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            relates to

            Task - A task that needs to be done. MODDATAIMP-491 Improve logging to be able to trace the path of each record and file_chunks

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODDATAIMP-495 SPIKE: Analysis of the possibilities of implementing idempotence through monitoring processed records with the participation of the persistence level

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODINV-444 Spike: CPU spikes related to events_cache topic

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODINV-455 Inventory created more Instances records than were in the file (Iris hotfix)

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODINV-456 Inventory created more Instances records than were in the file (Juniper bugfix)

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            Task - A task that needs to be done. MODINV-460 SPIKE: Analyze possibilities to implement some constraints on the persistence level for blocking duplicate "holdings" and "items".

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURMAN-521 Remove duplicate kafka headers

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURMAN-522 Fix the effect of DI_ERROR messages when trying to duplicate records on the import job progress bar

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODDATAIMP-440 SPIKE: Data Import job is creating duplicate records with or without any background activity

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            Activity

              People

                afedasiuk Aliaksandr Fedasiuk
                abreaux Ann-Marie Breaux
                Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases