Uploaded image for project: 'mod-source-record-manager'
  1. mod-source-record-manager
  2. MODSOURMAN-782

Resolve Corrupt GZIP trailer exception for local development

    XMLWordPrintable

Details

    • Folijet Sprint 138
    • 2
    • Folijet
    • Morning Glory (R2 2022)
    • Low

    Description

      During local development when using fresh versions of SRM from master during import of 100 rec file on local vagrant java.util.zip.ZipException: Corrupt GZIP trailer occurs.
      This exception reproduces only on Windows env, its not reproducible on Linux.
      Detailed logs:

      09:50:54.787 [vert.x-kafka-consumer-thread-63] ERROR KafkaConsumerWrapper [96201eqId] Error while KafkaConsumerWrapper is working:
      org.apache.kafka.common.KafkaException: Received exception when fetching the next record from FOLIO.Default.diku.DI_LOG_SRS_MARC_BIB_RECORD_CREATED-0. If needed, please seek past the record to continue consumption.
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.fetchRecords(Fetcher.java:1652) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.access$1900(Fetcher.java:1507) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher.fetchRecords(Fetcher.java:733) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:684) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1277) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1238) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1211) ~[mod-source-record-manager-server-fat.jar:?]
              at io.vertx.kafka.client.consumer.impl.KafkaReadStreamImpl.lambda$pollRecords$6(KafkaReadStreamImpl.java:154) ~[mod-source-record-manager-server-fat.jar:?]
              at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) [?:?]
              at java.util.concurrent.FutureTask.run(Unknown Source) [?:?]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:?]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:?]
              at java.lang.Thread.run(Unknown Source) [?:?]
      Caused by: org.apache.kafka.common.KafkaException: Error checking for remaining bytes after reading batch
              at org.apache.kafka.common.record.DefaultRecordBatch$StreamRecordIterator.ensureNoneRemaining(DefaultRecordBatch.java:654) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.common.record.DefaultRecordBatch$RecordIterator.next(DefaultRecordBatch.java:611) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.common.record.DefaultRecordBatch$RecordIterator.next(DefaultRecordBatch.java:575) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.nextFetchedRecord(Fetcher.java:1631) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.fetchRecords(Fetcher.java:1666) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.access$1900(Fetcher.java:1507) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher.fetchRecords(Fetcher.java:733) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:684) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1304) ~[mod-source-record-manager-server-fat.jar:?]
              ... 8 more
      Caused by: java.util.zip.ZipException: Corrupt GZIP trailer
              at java.util.zip.GZIPInputStream.readTrailer(Unknown Source) ~[?:?]
              at java.util.zip.GZIPInputStream.read(Unknown Source) ~[?:?]
              at java.io.BufferedInputStream.fill(Unknown Source) ~[?:?]
              at java.io.BufferedInputStream.read(Unknown Source) ~[?:?]
              at java.io.FilterInputStream.read(Unknown Source) ~[?:?]
              at org.apache.kafka.common.record.DefaultRecordBatch$StreamRecordIterator.ensureNoneRemaining(DefaultRecordBatch.java:652) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.common.record.DefaultRecordBatch$RecordIterator.next(DefaultRecordBatch.java:611) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.common.record.DefaultRecordBatch$RecordIterator.next(DefaultRecordBatch.java:575) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.nextFetchedRecord(Fetcher.java:1631) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.fetchRecords(Fetcher.java:1666) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.access$1900(Fetcher.java:1507) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher.fetchRecords(Fetcher.java:733) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:684) ~[mod-source-record-manager-server-fat.jar:?]
              at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1304) ~[mod-source-record-manager-server-fat.jar:?]
      

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                Nosko Serhii Nosko
                Nosko Serhii Nosko
                Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases