Uploaded image for project: 'mod-data-import'
  1. mod-data-import
  2. MODDATAIMP-567

SPIKE: Create a script for libraries to refresh Instances against an updated MARC-Instance map

    XMLWordPrintable

Details

    • Folijet Sprint 135
    • 5
    • Folijet
    • Lotus R1 2022

    Description

      Purpose: To provide a "refresh" script that a library can run on-demand whenever their MARC-to-Instance map has been updated. See more description here: https://wiki.folio.org/display/FOLIOtips/Notes+on+Customizing+Default+MARC-Inventory+Maps+and+Release+Updates

      As a staff person with responsibility for the library's SRS MARC Bib-to-Inventory Instance map
      I want to be able to update existing Instances based on the SRS MARC Bibs and the Library's current map
      So that I can be sure that the Inventory Instances are displaying/suppressing the appropriate data from the SRS MARC record

      Scenarios

      1. Scenario 1

      May be possible to adapt Ian Walls script, which takes 1) the current version of the SRS MARC linked to an instance and 2) the current version of the tenants' MARC-to-Instance default map, and refreshes all of the source = MARC instances.

      Some information from sekjal, who has created a script that does this:
      That code can be found at https://gist.github.com/sekjal/b1065f0483ee18c65b79d3d6560996ed. It runs in OpenFaas, but I'm sure it could be adapted to run as a regular ol' Python script. This function does one record at a time, so I have a separate parser take a list of UUIDs and feed it to the OpenFaas engine, asynchronously, max parallelism of 3 (any more, and SRS seems to fall over). it also assumes that a set of secrets is mounted to a specific directory, but I don't suppose that'd be a problem if it was integrated more closely into Data Import. The real problem is that it's one-at-a-time processing, so it's WICKED slow. Basically relying on SRS/SRM to do the mapping work

      Link to the meeting where Ian demonstrated it: https://vod.video.cornell.edu/media/Updating+Instances+Mapped+from+SRS/1_rm5wyw5t

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                Aivar Iusupov Aivar Iusupov
                abreaux Ann-Marie Breaux
                Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases