Uploaded image for project: 'mod-data-export'
  1. mod-data-export
  2. MDEXP-1

SPIKE: Investigate the way to read large csv files

    XMLWordPrintable

    Details

    • Template:
    • Sprint:
      Concorde - Sprint 80
    • Development Team:
      Concorde

      Description

      Purpose
      While exporting the inventory instance record that have associate record SRS we will use this record in the export as SRS is considered the source of truth.

      Scenario

      • Given: The file with inventory instance UUIDs list
      • When: the underlying MARC Bib record in SRS exists
      • Then: the underlying record in SRS is being used in the export

      Things to consider:

      • Consider how the uploaded file can be read with sizes ~300-400MB
      • We can use vert.x streaming capabilities to read and write large files or Also look at data-import handling file uploads

      Acceptance Criteria:

      1. Results are discussed with the team and posted in the ticket, so that additional stories can be created
      2. All MARC bib record fields that are stored in SRS are included in the generated output

        TestRail: Results

          Attachments

            Issue Links

              Activity

                People

                Assignee:
                energ1zr Dmytro Popov
                Reporter:
                KVupp Kruthi Vuppala
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved:

                    TestRail: Runs

                      TestRail: Cases