Uploaded image for project: 'mod-data-export'
  1. mod-data-export
  2. MDEXP-166

Make records processing parallel

    XMLWordPrintable

    Details

    • Template:
    • Sprint:
      Concorde - Sprint 90, Concorde - Sprint 91, Concorde - Sprint 92, Concorde - Sprint 93
    • Story Points:
      3
    • Development Team:
      Concorde

      Description

      Overview
      Currently we are processing the records in the uploaded file in a sequential manner. One of the reasons why the export job could be taking longer for larger UUID files

      Some things to try:
      1) Increasing worker executor pool size -we are using just 1 worker pool
      2) Creating only one http connection for each job, currently we are opening and closing http connection for each chunk of records(50)
      3) Adjusting the batch size pulled each time

      Acceptance Criteria

      • Time to run a job is measured before and after and an attempt is made to decrease the job execution time
      • Additional stories are created , if the changes cannot be fixed in scope of this story

        TestRail: Results

          Attachments

          1. screenshot-1.png
            screenshot-1.png
            127 kB
          2. screenshot-2.png
            screenshot-2.png
            121 kB
          3. screenshot-3.png
            screenshot-3.png
            238 kB

            Issue Links

              Activity

                People

                Assignee:
                Igor_Gorchakov Igor Gorchakov
                Reporter:
                KVupp Kruthi Vuppala
                Tester Assignee:
                Magda Zacharska Magda Zacharska
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved:

                    TestRail: Runs

                      TestRail: Cases