Uploaded image for project: 'folio-kafka-wrapper-util'
  1. folio-kafka-wrapper-util
  2. KAFKAWRAP-34

Reduce default number of partitions from 50 to 1

    XMLWordPrintable

Details

    • Folijet Sprint 160
    • 0
    • Folijet
    • Orchid (R1 2023) Bug Fix
    • Incomplete/missing requirements

    Description

      https://github.com/folio-org/folio-kafka-wrapper/blob/v2.7.0/src/main/java/org/folio/kafka/services/KafkaTopic.java#L21-L26

      sets the default number of partitions for a topic to 50. No implementer runs 50 instances of a consuming module.

      If the administrator doesn't configure the partitions it is very likely a small system where only a single partition is needed.

      On bigger systems the administrator doesn't rely on modules to automatically create the partitions but makes use of Kafka admin APIs to create them.

      Having too many partitions can be expensive, for details see https://github.com/folio-org/rfcs/pull/6/files

      Therefore a default of 1 partition should be the default. Modules can overwrite it if needed.

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                julianladisch Julian Ladisch
                julianladisch Julian Ladisch
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases