Uploaded image for project: 'perf-testing'
  1. perf-testing
  2. PERF-118

POST /user-import

    XMLWordPrintable

Details

    • Story
    • Status: Closed (View Workflow)
    • TBD
    • Resolution: Done
    • None
    • None
    • University of Alabama

    Description

      • App name/area of issue - mod-user-import/batch import new users
      • Brief statement of issue - Observed high memory usage and multiple task restarts when using POST /user-import for approximately 50k users for UA. Would like to better understand memory issues/performance and any improvements that are possible.
      • How many users at any given time - due to task restarts, there were multiple POST requests submitted over a short period of time. These are done via Postman or curl request
      • Volume of data - approx 50k users imported in file - users were imported in batches from 5000 to 14000
      • Expected response time - tbd
      • Main modules that are involved in the process (if obvious or if known) - mod-user-import, mod-users, mod-permissions
      • * Any specific settings or items or scenarios (ex: exporting MARC bib records was going on while doing a check-in, or a checking out an item that has 10 requests attached to it)* - none
      • A list of the backend software modules (to obtain this list, go to Settings → Software versions, and copy & paste the middle column "Okapi Services" into a file and attach it to the JIRA. Another way to do this is while doing step #5, go to this page and scroll down slowly so that the versions are captured on the video) - added module list (Goldenrod initial release - pre hotifxes)

      Attachments

        1. high-mem-usage.png
          high-mem-usage.png
          431 kB
        2. memory-issues-oom.png
          memory-issues-oom.png
          628 kB
        3. mod-user-import-modules.txt
          5 kB
        4. screenshot-1.png
          screenshot-1.png
          10 kB
        5. user-import-calls.png
          user-import-calls.png
          564 kB
        6. user import results.png
          user import results.png
          476 kB

        Issue Links

          Activity

            People

              varunjavalkar Varun Javalkar
              cgodfrey Carole Godfrey
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: