Uploaded image for project: 'mod-source-record-storage'
  1. mod-source-record-storage
  2. MODSOURCE-85

Timeout when making GET requests to /source-storage/sourceRecords, part 1

    XMLWordPrintable

Details

    • EPAM BatchLoader Sprint 31, EPAM BatchLoader Sprint 32
    • 2
    • Folijet

    Description

      I discovered this when trying to harvest records over /oai/records?verb=ListRecords&metadataPrefix=marc21&set=all. That request is making requests to /source-storage/sourceRecords

      Steps to reproduce:

      Add the below mentioned amount of records to srs
      Make a GET request to /source-storage/sourceRecords

      What should happen:
      Records are returned.

      What actually happens:
      Request times out after 6minutes and 40 seconds

      Additional information:
      In the FC and Alabama tenants there are about 7.6 and 5.5 million SRS records.
      Using the same mapping and loading process, i loaded only 20k of records, and with that ammount, everything worked fine.
      Module version: mod-oai-pmh-1.1.0

      When we query the database, hitting the tables is pretty fast. The issues seem to occur when querying the view.

      TestRail: Results

        Attachments

          Issue Links

            blocks

            Bug - A problem which impairs or prevents the functions of the product. MODOAIPMH-82 ListRecords requests times out for Five Colleges and Alabama

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Task - A task that needs to be done. MODSOURCE-90 Release v3.0.1

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            defines

            New Feature - New feature requests UXPROD-2076 NFR: Data Import (Batch Importer for Bib Acq) Q4 2019 Technical, NFR, & Misc bug work

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed
            relates to

            Bug - A problem which impairs or prevents the functions of the product. MODSOURCE-89 Lookups in SRS for records by Instance UUID are timing out, part 1

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURCE-91 Timeout when making GET requests to /source-storage/sourceRecords, part 2

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. MODSOURCE-92 Lookups in SRS for records by Instance UUID are timing out, part 2

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Activity

              People

                ruslan_lavrov Ruslan Lavrov
                ttolstoy Theodor Tolstoy (One-Group.se)
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases