[MODSOURCE-177] Change SRM-SRS interaction to use Kafka - FOLIO Issue Tracker

XML

Word

Printable

Details

Type: Story
Status: Closed (View Workflow)
Priority: P3
Resolution: Done
Affects Version/s: None
Fix Version/s: 5.0.0
Labels:
- data-import
- epam-folijet

Template:
Sprint:
Folijet Sprint 103
Story Points:
5
Development Team:
Folijet
Release:
R1 2021
Epic Link:
Batch Importer (Bib/Acq)
Front-End Confidence factor:
Medium

Description

Add consumers for initial records load(before processing) and save chunks in batch. (can be moved from PoC) https://github.com/folio-org/mod-source-record-storage/pull/214
Add support for exactly one delivery for each chunk with records. Add the new entity to track chunk duplications. On constraining violations - skip chunk processing and add logs.
Publish events related to data-import to Kafka using pubsub lib

TestRail: Results

Attachments

Issue Links

defines

UXPROD-2659 NFR: Refactor data-import flow to increase reliability

Closed

is blocked by

MODPUBSUB-118 Create sub-project in mod-pubsub for utility transport layer classes

Closed

Activity

People

Assignee:: Kateryna Senchenko

Reporter:: Kateryna Senchenko

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 21/Jul/20 10:46 AM

Updated:: 05/Mar/21 1:02 PM

Resolved:: 14/Dec/20 3:17 PM

Change SRM-SRS interaction to use Kafka