Uploaded image for project: 'mod-source-record-storage'
  1. mod-source-record-storage
  2. MODSOURCE-85

Timeout when making GET requests to /source-storage/sourceRecords, part 1

    XMLWordPrintable

Details

    • EPAM BatchLoader Sprint 31, EPAM BatchLoader Sprint 32
    • 2
    • Folijet

    Description

      I discovered this when trying to harvest records over /oai/records?verb=ListRecords&metadataPrefix=marc21&set=all. That request is making requests to /source-storage/sourceRecords

      Steps to reproduce:

      Add the below mentioned amount of records to srs
      Make a GET request to /source-storage/sourceRecords

      What should happen:
      Records are returned.

      What actually happens:
      Request times out after 6minutes and 40 seconds

      Additional information:
      In the FC and Alabama tenants there are about 7.6 and 5.5 million SRS records.
      Using the same mapping and loading process, i loaded only 20k of records, and with that ammount, everything worked fine.
      Module version: mod-oai-pmh-1.1.0

      When we query the database, hitting the tables is pretty fast. The issues seem to occur when querying the view.

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                ruslan_lavrov Ruslan Lavrov
                ttolstoy Theodor Tolstoy
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases