Details
-
Story
-
Status: Closed (View Workflow)
-
P2
-
Resolution: Done
-
None
-
-
Folijet Sprint 102, Folijet Sprint 103
-
5
-
Folijet
-
R1 2021
Description
Change chunk processing to Kafka approach(can be moved from PoC) https://github.com/folio-org/mod-source-record-manager/pull/315
Use pubsub lib to create Kafka consumer that would receive records sent for processing from mod-data-import.
Add support for exactly one delivery for each chunk. JobExecutionSourceChunk can be reused. UUID will be received from mod-data-import. On constraining violations - skip chunk processing and add logs.
Recieve answers from SRS and start processing in StoredMarcChunkConsumersVerticle and add exactly one delivery for each chunk.
TestRail: Results
Attachments
Issue Links
- defines
-
UXPROD-2659 NFR: Refactor data-import flow to increase reliability
-
- Closed
-
- is blocked by
-
MODPUBSUB-118 Create sub-project in mod-pubsub for utility transport layer classes
-
- Closed
-