Uploaded image for project: 'mod-data-export'
  1. mod-data-export
  2. MDEXP-1

SPIKE: Investigate the way to read large csv files

    XMLWordPrintable

Details

    • Concorde - Sprint 80
    • Concorde

    Description

      Purpose
      While exporting the inventory instance record that have associate record SRS we will use this record in the export as SRS is considered the source of truth.

      Scenario

      • Given: The file with inventory instance UUIDs list
      • When: the underlying MARC Bib record in SRS exists
      • Then: the underlying record in SRS is being used in the export

      Things to consider:

      • Consider how the uploaded file can be read with sizes ~300-400MB
      • We can use vert.x streaming capabilities to read and write large files or Also look at data-import handling file uploads

      Acceptance Criteria:

      1. Results are discussed with the team and posted in the ticket, so that additional stories can be created
      2. All MARC bib record fields that are stored in SRS are included in the generated output

      TestRail: Results

        Attachments

          Issue Links

            defines

            Umbrella - MDEXP-34 Export inventory instance record with underlying MARC Bib record in binary MARC format

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            New Feature - New feature requests UXPROD-141 Export Inventory Instances with underlying SRS records to MARC Bib

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            New Feature - New feature requests UXPROD-978 Filters to select Instance records for batch export

            • P1 - highest priority item, drop everything else before this is resolved, reserved for critical bugfixes
            • Closed

            New Feature - New feature requests UXPROD-2315 Export Inventory Instances to other non-MARC formats

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed
            has to be done before

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MDEXP-36 RecordLoaderService: retrieve MARC records from SRS

            • P2 - normal priority level, must be included in the current development cycle
            • Closed
            is cloned by

            Umbrella - MDEXP-34 Export inventory instance record with underlying MARC Bib record in binary MARC format

            • P2 - normal priority level, must be included in the current development cycle
            • Closed

            Activity

              People

                energ1zr Dmytro Popov
                KVupp Kruthi Vuppala
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases