Details
-
New Feature
-
Status: Closed (View Workflow)
-
P2
-
Resolution: Done
-
None
-
None
-
customfield_11200 17552
-
Large < 10 days
-
Small < 3 days
-
XXL < 30 days
-
Low
-
-
Folijet
-
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
-
R1
Description
Q2 2019 Data Import Priority 1 of 8
Note: While UI input is preferred, this will only cover command line input to start, and using the standard MARC data mapper
Requirements:
- CLI ability to load MARC bibs to SRS (and some instructions)
- For now, use the existing MARC mapper for Instance. In
UXPROD-1577, will update that mapping to the newer default MARC bib-to-Instance mapping - Sort out the 001/003/035/999 handling for newly created SRS records?
- Move non-FOLIO 001 to 035 $a field (only if unique 035)
- Move non-FOLIO 003 to prefix on 035 $a field? e.g. 001 12345 and 003 OCoLC becomes 035 (OCoLC)12345 [A-M doublechecking with DI workgroup]
- Create 001 using the sequential HRID generator
- Create 003 using the tenant default (new MARC settings area, with tenant-level 003 and subfield preferences)
- Create 999 field with $s [SRS UUID] (will add 999 $i with Instance UUID and 999 $m with MARCcat UUID when they are created), so complete 999 field will look like: 999 $i [Instance UUID] $m [MARCcat UUID] $s [SRS UUID] (see
MODSOURMAN-95andMODSOURMAN-96)
- Figure out what happens with the old mod-data-loader - retire? repurpose?
Per Harry, aim for at least these performance metrics:
- 100 records/second
- or 1,000 records/second on empty system - turn off indexing, load, and then reindex
May need to review mod-data-loader and decide if it is replaced by the data-import-loader, or if the mod-data-loader mapping just needs updating or what
Note that MARCcat will not happen until SRS Integration with MARCcat (UXPROD-1595)
TestRail: Results
Attachments
Issue Links
- defines
-
UXPROD-47 Batch Importer (Bib/Acq)
-
- Analysis Complete
-
- is defined by
-
MODDATAIMP-105 SPIKE: Event payload container
-
- Closed
-
-
MODDATAIMP-106 SPIKE: Job processing engine
-
- Closed
-
-
MODDATAIMP-107 SPIKE: Create event handler
-
- Closed
-
-
MODDATAIMP-110 SPIKE: Find "MARC -> Inventory Instance" mapping source code.
-
- Closed
-
-
MODDATAIMP-111 Set status for upload definition as non draft once the file processing has started
-
- Closed
-
-
MODDATAIMP-112 Data Import to Inventory integration for Chalmers PoC
-
- Closed
-
-
MODDATAIMP-113 SPIKE: Investigate Inventory API (mod-inventory) to perform CRUD for Instances
-
- Closed
-
-
MODDATAIMP-114 SPIKE: Check Data Import performance.
-
- Closed
-
-
MODDATAIMP-115 SPIKE: Check Inventory performance.
-
- Closed
-
-
MODDATAIMP-116 Update fileDefinition status on upload fail
-
- Closed
-
-
MODDATAIMP-117 Finalize PoC with event approach and add examples of usage and integrations
-
- Closed
-
-
MODDATAIMP-126 Add readers for all files that can contain MARC data
-
- Closed
-
-
MODDICONV-11 Populate sample data
-
- Closed
-
-
MODSOURCE-40 Inventory instance’s data structure should be extended to hold a reference to a MARC record which has affected this instance.
-
- Closed
-
-
MODSOURMAN-93 Design and develop a bespoke processor to handle parsed MARC records, create instances and store them in the mod-inventory-storage
-
- Closed
-
-
MODSOURMAN-94 Integrate extracted logic from data-loader into the ChangeManager
-
- Closed
-
-
MODSOURMAN-95 SPIKE: Figure out 999 Instance and SRS UUID handling
-
- Closed
-
-
MODSOURMAN-99 MARC 999 field: Put SRS UUID
-
- Closed
-
-
UIDATIMP-185 Create temporary MARC Bib Load option on Choose jobs pane
-
- Closed
-
-
UIDATIMP-186 Landing page changes when temporary MARC Bib Load option button pushed
-
- Closed
-
-
UIDATIMP-187 Add Log button to log entries in second pane of landing page when temporary MARC Bib Load option button pushed
-
- Closed
-
-
UIDATIMP-198 Handle broken tests issue caused by stripes-components update
-
- Closed
-
-
UIDATIMP-204 MARC Bib load results in invalid date and no log
-
- Closed
-
-
UIDATIMP-209 Show all records in log including error ones
-
- Closed
-
- relates to
-
UXPROD-1479 Simple UI for edit of the default MARC mapping of bibliographic records
-
- Open
-
-
UXPROD-1805 SRS MARC-Inventory Instance relationship refinement
-
- Closed
-
-
UXPROD-2078 SRS MARC-Inventory Instance relationship refinement, part 2
-
- Closed
-
-
UXPROD-2207 SRS MARC-Inventory Instance relationship refinement, part 3
-
- Closed
-
-
MODSOURMAN-115 After Instances are created the field 999 does not appear in SRS
-
- Closed
-
-
UXPROD-1397 Generating a MARC bibliographic record from an Inventory Instance record
-
- Closed
-
-
UXPROD-1499 Accept files in JSON for intital migration for input and output
-
- Closed
-
-
UXPROD-1806 NFR: Data Import Pub-Sub (Event Driven) Infrastructure, part 1
-
- Closed
-
-
UXPROD-2012 NFR: Data Import Pub-Sub (Event Driven) Infrastructure, part 2
-
- Closed
-
-
UXPROD-2115 Define human readable identifiers (HRIDs) for SRS MARC Bib records
-
- Closed
-