Uploaded image for project: 'perf-testing'
  1. perf-testing
  2. PERF-145

Harvesting 10M using marc21 metadata prefix

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Open (View Workflow)
    • Priority: P2
    • Resolution: Unresolved
    • Labels:
      None
    • Template:
    • Development Team:
      None

      Description

      • App name/area of issue:
        OAI-PMH harvesting
      • Brief statement of the issue:
        Determine the performance of the harvest of 10M inventory records with metadataPrefix set to marc21
      • Steps to recreate the issue:
      1. initiate the harvest with request: https://<edge_url>/oai?verb=ListRecords&metadataPrefix=marc21&apikey=<apiKey>
      2. in consecutive requests use the resumptionToken returned in the prior requests until all data is harvested. The request containing resumptionToken has following structure:
        https://<edge_url>/oai?verb=ListRecords&apikey=<apiKey>&resumptionToken<resumptionToken>
      • How many users at any given time:
        1
      • Volume of data:
        10M
      • Expected response time:
        Less than 6h
      • Main modules that are involved in the process (if obvious or if known):
        edge-oai-pmh, mod-oai-pmh, srs modules, mod-inventory-storage
      • Any specific settings or items or scenarios:

      Please conduct the tests with post-honeysuckle edge- and mod-oai-pmh release (2.3.0 and 3.3.0 respectively)

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              magdaz Magda Zacharska
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated: