Uploaded image for project: 'mod-data-export-worker'
  1. mod-data-export-worker
  2. MODEXPW-255

Bulk edit: 10528 upstream timed out (110: Connection timed out) Error

    XMLWordPrintable

Details

    • Firebird - Sprint 150, Firebird - Sprint 151
    • 3
    • Firebird
    • Nolana (R3 2022)
    • TBD

    Description

      If there are multiple concurrent bulk edit jobs of the larger data sets (~10k records) and some of them have subset of records that do not need change in value then the Preview on the "Are you sure" form takes a long time to load and fails on timeout, due to [error] 50#50: *10528 upstream timed out (110: Connection timed out)

      Steps to Reproduce:

      1. Navigate to the "Bulk Edit" => Select "Inventory-Items" app => Select "Items barcodes" from "Record identifier" dropdown
      2. Upload a .csv file with 5000 Items barcodes (e.g. with status "Available")
      3. Click "Actions" menu => Select "Start Bulk edit" option
      4. Select action from the dropdown that will not affect any record (for example, the same status that Items are related yet:  status = "Available")
      5. Click "Confirm changes" button

      Expected Results:

      *"Are you sure?" form opens
      *"Preview of the records to be changed" uploaded and  contains all valid Ids from the uploaded file, even if they are not going to be updated
      Actual Results:

      "Preview of the records to be changed" is NOT uploaded, request fails on timeout

      Log

      2022/09/15 11:44:07 [error] 50#50: *10528 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.23.35.53, server: , request: "POST /mod-data-export-worker/bulk-edit/abfe0d91-7fb0-4599-9d73-c6331b55ad0c/items-content-update/upload HTTP/1.1", upstream: "http://127.0.0.1:8082/bulk-edit/abfe0d91-7fb0-4599-9d73-c6331b55ad0c/items-content-update/upload", host: "pvt.lb.lcp2.folio-eis.us-east-1:8051"

      Response time for POST /bulk-edit/${jobId}/items-content-update/upload

      For 100 records - about 10-20 seconds
      For 1000 records -about 2-3 minutes
      For 10k records - unable to get a successful response
      For 100k records - unable to get a successful response

      Attached log files

      Additional information:
      From Yauheniya Kryshtafovich: For example, if the user updates item status from to Available to Missing we see following behavior:
      1. If the file contains 10K items and some of them (more than 4000 or so) do not need to be updated (already have Status_1= Missing), we may wait a long time for an answer from the endpoint and the preview will time out
      2. If the file contains 10K items, and part of them (less than 4000 or so) do not need to be updated (already with Status_1= Missing), the preview will take a long time to be downloaded, but up to 10 minutes, and the preview will be updated

      TestRail: Results

        Attachments

          1. 10k-item-barcodes.csv
            102 kB
          2. are you sure.png
            are you sure.png
            902 kB
          3. barcodes-10000.csv
            87 kB
          4. chrome_LFRLYhIOSz.png
            chrome_LFRLYhIOSz.png
            47 kB
          5. chrome_sjj1ug4Lbm.png
            chrome_sjj1ug4Lbm.png
            112 kB
          6. chrome_ZzbIVPO2vA.png
            chrome_ZzbIVPO2vA.png
            170 kB
          7. image-2022-10-13-23-08-15-588.png
            image-2022-10-13-23-08-15-588.png
            165 kB
          8. log-events-viewer-result (1).csv
            0.9 kB
          9. logs-insights-results (4).csv
            391 kB
          10. MODEXPW-255_2022-10-12_14h34_02.mp4
            5.21 MB
          11. result.png
            result.png
            804 kB
          12. screenshot-1.png
            screenshot-1.png
            105 kB
          13. screenshot-2.png
            screenshot-2.png
            115 kB
          14. screenshot-3.png
            screenshot-3.png
            146 kB

          Issue Links

            Activity

              People

                Charniak Siarhei Charniak
                Olga Kondratenko Olga Kondratenko
                Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases