Uploaded image for project: 'mod-source-record-storage'
  1. mod-source-record-storage
  2. MODSOURCE-183

Add bulk query/streaming support to /records web API

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: P3
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
    • Template:
    • Story Points:
      8
    • Development Team:
      Folijet
    • Epic Link:

      Description

      Some web APIs stream database results through the web API without first buffering them in an array. Examples, are the web APIs for querying instances, holdings, and items in the Inventory module and the users web API in the users module. It appears that /records doesn't do this. If you don't limit the results to something like 1,000 and page through the data, the server process will crash with an out of memory error, or, Docker will kill off the process. One should be able to query and get back all records without having to page through the data.

        TestRail: Results

          Attachments

            Issue Links

            defines

            New Feature - New feature requests UXPROD-559 Migrate Bibliographic & Holdings data

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            New Feature - New feature requests UXPROD-2790 NFR: Make some revisions to Source Record Storage to improve performance for data migration

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            is duplicated by

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURCE-202 SRS revision: Stream get records; full record with marc record, raw record, and error record if any

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

              Activity

                People

                Assignee:
                wwelling William Welling
                Reporter:
                jemiller Jon Miller
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved:

                    TestRail: Runs

                      TestRail: Cases