Uploaded image for project: 'mod-data-import'
  1. mod-data-import
  2. MODDATAIMP-390

Spike: Memory not released after import

    XMLWordPrintable

Details

    • Folijet Sprint 112, Folijet Sprint 114, Folijet Sprint 115, Folijet Sprint 116
    • 5
    • Folijet

    Description

      Overview:
      When uploading a MARC file in an Iris environment, mod-data-import seems to use up all the memory necessary to process the file, but after the test is over, the memory does not get released. This causes the container to crash because it runs out of memory on subsequent imports.

      Steps to Reproduce:
      Upload a moderate file multiple times. Depending on the size of the file and the memory allocated to the container, the container will crash after 2 or more uploads. Can also observe the container's memory graphs on Cloudwatch or similar tools.

      Expected Results:
      Memory is released after an import, multiple subsequent uploads of the same file will not crash the system.

      Actual Results:
      See above,

      Additional Information:
      A heap dump was taken after importing 50K records. It can be provided upon request.
      Interested parties:
      OleksiiKuzminov abreaux Kateryna Senchenko

      TestRail: Results

        Attachments

          1. 42_10K_imp.jpg
            42_10K_imp.jpg
            415 kB
          2. 42_10K_inv.jpg
            42_10K_inv.jpg
            219 kB
          3. memory-profile.png
            memory-profile.png
            101 kB
          4. ptf-env2-mod-data-import.png
            ptf-env2-mod-data-import.png
            97 kB
          5. ptf-env-mod-data-import.png
            ptf-env-mod-data-import.png
            97 kB
          6. screenshot-1.png
            screenshot-1.png
            15 kB
          7. Unreachable objects.png
            Unreachable objects.png
            46 kB

          Issue Links

            Activity

              People

                afedasiuk Aliaksandr Fedasiuk
                mtraneis Martin Tran
                Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases