Uploaded image for project: 'mod-source-record-manager'
  1. mod-source-record-manager
  2. MODSOURMAN-10

ChangeManager: Add functionality for saving chunks of raw data

    XMLWordPrintable

Details

    • Folijet

    Description

      ChangeManager component should provide functionality for saving chunks of raw data in the mod-source-record-storage. JobExecution and Snapshot statuses should be updated along the way.

      1. Add endpoint for receiving chunks of raw data.

      Method Resource
      POST /change-manager/records

      2. Saving chunks of raw data in the mod-source-record-storage should be done asynchronously.
      3. Upon receiving the request from mod-data-import that all the chunks are sent, ChangeManager should wait until the processing is finished and update statuses.
      4. Stub call to ChangeEngine to parse records.

      For more details refer to the technical design (Sequence diagram of receiving and saving raw records).

      Acceptance Criteria

      • Saving the chunks is a non-blocking process
      • ChangeManager interacts with MetadataService for getting and updating JobExecution statuses.
      • ChangeManager interacts with mod-source-record-storage via REST for updating Snapshot statuses.
      • New endpoint exists
      • API is covered with tests

      TestRail: Results

        Attachments

          Issue Links

            defines

            New Feature - New feature requests UXPROD-1656 Data Import (Batch Importer for Bib Acq) Q1 2019 Technical and NFR work

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed
            is blocked by

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-3 Create technical design for Change Manager component from mod-source-record-manager

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-7 MetadataRepository: Implement API for JobExecution entities

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-9 Create ChangeManager component, expose API for JobExecutions creation

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed
            relates to

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODDATAIMP-39 Create service for file chunking

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-19 ChangeManager: API for receiving chunks of raw (source) data with a stub implementation

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-20 @Deprecated. Will be closed. ChangeManager: implement API for saving raw (source) data

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-21 @Deprecated. Will be closed. Change Manager: Handle the completion of the source data save

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-69 Create JobExecutionSourceChunk & DB table

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-70 Implement JobExecutionSourceChunk processing routine.

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-11 Create ChangeEngine component for parsing raw records

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Story - Created by Jira Software - do not edit or delete. Issue type for a user story. MODSOURMAN-22 @Deprecated. Will be closed. ChangeManager: Create watcher to complete jobExecution

            • P3 - low priority level, item will be considered for inclusion in the next dev cycle
            • Closed

            Activity

              People

                Igor_Gorchakov Igor Gorchakov
                Kateryna Senchenko Kateryna Senchenko
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases