Details
-
Bug
-
Status: Closed (View Workflow)
-
P2
-
Resolution: Done
-
None
-
DevOps Sprint 138
-
FOLIO DevOps
-
Related dependency upgrade
Description
When using the latest Vagrant snapshot boxes I started to get java.util.zip.ZipException: Corrupt GZIP trailer exception during processing of Kafka messages. I observed it most often in module mod-source-record-manager, also in mod-inventory, mod-quick-marc.
For older snapshot boxes such as 'folio/snapshot' version '1.0.0-20220411.7616' I have not observed it.
Workaround for mod-source-record-manager is to downgrade the alpine-jre-openjdk11 version from 1.3.1 to 1.3.0 in Dockerfile:
FROM folioci/alpine-jre-openjdk11:1.3.0
Note: I'm using Windows, on Linux it seems not to be reproducible.
Full log:
Caused by: org.apache.kafka.common.KafkaException: Error checking for remaining bytes after reading batch
at org.apache.kafka.common.record.DefaultRecordBatch$StreamRecordIterator.ensureNoneRemaining(DefaultRecordBatch.java:654) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.common.record.DefaultRecordBatch$RecordIterator.next(DefaultRecordBatch.java:611) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.common.record.DefaultRecordBatch$RecordIterator.next(DefaultRecordBatch.java:575) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.nextFetchedRecord(Fetcher.java:1631) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.fetchRecords(Fetcher.java:1666) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.clients.consumer.internals.Fetcher$CompletedFetch.access$1900(Fetcher.java:1507) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.clients.consumer.internals.Fetcher.fetchRecords(Fetcher.java:733) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:684) ~[mod-source-record-manager.jar:?]
at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1304) ~[mod-source-record-manager.jar:?]
... 8 more
Caused by: java.util.zip.ZipException: Corrupt GZIP trailer
at java.util.zip.GZIPInputStream.readTrailer(Unknown Source) ~[?:?]
at java.util.zip.GZIPInputStream.read(Unknown Source) ~[?:?]
at java.io.BufferedInputStream.fill(Unknown Source) ~[?:?]
at java.io.BufferedInputStream.read(Unknown Source) ~[?:?]
at java.io.FilterInputStream.read(Unknown Source) ~[?:?]
TestRail: Results
Attachments
Issue Links
- blocks
-
MODSOURMAN-782 Resolve Corrupt GZIP trailer exception for local development
-
- Closed
-
- relates to
-
FOLIO-3483 Rebuild all alpine-jre-openjdk11 based containers fixing ZipException
-
- Closed
-
-
FOLIO-3484 Rebuild all released alpine-jre-openjdk11 containers fixing ZipException
-
- Closed
-
-
FOLIO-3487 folioci/alpine-jre-openjdk11: apk upgrade for zlib-1.2.12-r1 fixing ZipException
-
- Closed
-
-
FOLIO-3500 Remove folio-java-docker workarounds for zlib
-
- Closed
-
-
MODSOURCE-498 Rebuild container fixing zlib ZipException Corrupt GZIP trailer
-
- Closed
-
-
FOLIO-3463 Rebuild/upgrade folioci/alpine-jre-openjdk11 for OpenJDK 11.0.14
-
- Closed
-