Status: Closed (View Workflow)
Memory - 3600MB/3240MB hard/soft memory limit
mod-source-record-manager is failing with Out Of Memory error in idle state when no Data Import job is running.
Last week of memory usage graph
Container memory before the crash
After investigating further and taking a heap dump, I discovered that there are no memory leaks, but from the Thread Stack, it runs 200+ threads. That's a lot of threads, especially when Data Import is in an idle state. I checked for the last 4 hours before taking the heap dump, no Data Import jobs were running. There were few Data Import jobs run in past before it went into an idle state. I think that's where those 200+ threads were initially created, and it looks like they never terminated.
Please see attached list of threads running in idle - List-of-threads-running-idle.txt This Thread Stack is from JXRay Report. Here is the complete report mod-srm-lmch-memory-dump-2.html
Please see attached Thread dump report - Thread_Dump_HPROF_snapshot_mod-srm-lmch_hprof.html From the Thread Dump report, multiple copies of a single thread are running, is that expected?
Complete Heap dump is around 1GB and can be found - mod-srm-memory-dump-1.hprof
Steps to Reproduce:
This problem can be reproduced in Lotus hotfix-1. After running multiple runs of Data Import, when the Apps go into an idle state, the threads are still running, consuming resources.
mod-source-record-manager should not crash with Out Of Memory Error
mod-source-record-manager is crashing with Out Of Memory Error