Uploaded image for project: 'mod-data-import'
  1. mod-data-import
  2. MODDATAIMP-548

Provide system properties to set chunk size for each marc record format

    XMLWordPrintable

Details

    • Folijet Sprint 123
    • 0.5
    • Folijet
    • R3 2021

    Description

      Provide system properties for SourceReaderBuilder to set records chunk size for each marc record format (raw, json, xml) correspondingly:

      •  "file.processing.marc.raw.buffer.chunk.size" property with 50 size value by default for marc raw format
      •  "file.processing.marc.json.buffer.chunk.size" property with 50 size value by default for marc json format
      •  "file.processing.marc.xml.buffer.chunk.size" property with 10 size value by default for marc xml format (since the xml format is more redundant the proposed default value has been selected to not exceed "max.request.size" producer parameter which is 1048576 bytes by default)

      Miscellaneous: delete payload zipping operation before publishing, update tests

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                ruslan_lavrov Ruslan Lavrov
                ruslan_lavrov Ruslan Lavrov
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases