Still Getting Collector OOM

[kim2yung]

Getting Collector OOM issue also after I have patched the old version Hertzbeat with bugfix -2aba779

see the logs-
2025-08-20 13:25:15.145 [545382994638592-tej_switch-system-3145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out
2025-08-20 13:25:15.145 [545382994638592-tej_switch-system-3145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12000ms, All 12000ms] Reason: SNMP Request timed out
2025-08-20 13:25:20.146 [545438373213952-tej_switch-system-8145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out
2025-08-20 13:25:20.146 [545438373213952-tej_switch-system-8145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12001ms, All 12001ms] Reason: SNMP Request timed out
2025-08-20 13:25:22.146 [545464218810112-tej_switch-system-0145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out
2025-08-20 13:25:22.146 [545427313678080-tej_switch-system-0145] WARN org.apache.hertzbeat.collector.collect.snmp.SnmpCollectImpl Line:245 - [snmp collect] error: SNMP Request timed out
2025-08-20 13:25:22.146 [545464218810112-tej_switch-system-0145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12001ms, All 12001ms] Reason: SNMP Request timed out
2025-08-20 13:25:22.146 [545427313678080-tej_switch-system-0145] INFO org.apache.hertzbeat.collector.dispatch.MetricsCollect Line:429 - [Collect Failed, Run 12001ms, All 12001ms] Reason: SNMP Request timed out
2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]:
org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@4d95aa77
2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]:
org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@71f58970
2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]:
org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@404d1680
2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]:
org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@134c7c77
2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]:
org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@73eaaa7b
2025-08-20 13:25:22.652 [metrics-task-timeout-monitor-0] ERROR org.apache.hertzbeat.collector.dispatch.CommonDispatcher Line:166 - [Collect Timeout]:
org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData@2e89137f

2025-08-20 13:32:30.788 [545469670758144-tej_switch-system-8145] ERROR org.apache.hertzbeat.collector.dispatch.WorkerPool Line:49 - Thread Name 545469670758144-tej_switch-system-8145 : Cannot reserve 4194304 bytes of direct buffer memory (allocated: 1608303404, limit: 1610612736)
java.lang.OutOfMemoryError: Cannot reserve 4194304 bytes of direct buffer memory (allocated: 1608303404, limit: 1610612736)
at java.base/java.nio.Bits.reserveMemory(Bits.java:178)
at java.base/java.nio.DirectByteBuffer.(DirectByteBuffer.java:121)
at java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:332)
at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:717)
at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:692)
at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:215)
at io.netty.buffer.PoolArena.tcacheAllocateNormal(PoolArena.java:197)
at io.netty.buffer.PoolArena.allocate(PoolArena.java:139)
at io.netty.buffer.PoolArena.allocate(PoolArena.java:129)
at io.netty.buffer.PooledByteBufAllocatorL$InnerAllocator.newDirectBufferL(PooledByteBufAllocatorL.java:173)
at io.netty.buffer.PooledByteBufAllocatorL$InnerAllocator.directBuffer(PooledByteBufAllocatorL.java:206)
at io.netty.buffer.PooledByteBufAllocatorL.allocate(PooledByteBufAllocatorL.java:53)
at org.apache.arrow.memory.netty.NettyAllocationManager.(NettyAllocationManager.java:74)
at org.apache.arrow.memory.netty.NettyAllocationManager.(NettyAllocationManager.java:81)
at org.apache.arrow.memory.netty.NettyAllocationManager$1.create(NettyAllocationManager.java:38)
at org.apache.arrow.memory.BaseAllocator.newAllocationManager(BaseAllocator.java:376)
at org.apache.arrow.memory.BaseAllocator.newAllocationManager(BaseAllocator.java:372)
at org.apache.arrow.memory.BaseAllocator.bufferWithoutReservation(BaseAllocator.java:357)
at org.apache.arrow.memory.BaseAllocator.buffer(BaseAllocator.java:336)
at org.apache.arrow.memory.RootAllocator.buffer(RootAllocator.java:27)
at org.apache.arrow.memory.BaseAllocator.buffer(BaseAllocator.java:298)
at org.apache.arrow.memory.RootAllocator.buffer(RootAllocator.java:27)
at org.apache.arrow.vector.BaseVariableWidthVector.allocateBytes(BaseVariableWidthVector.java:498)
at org.apache.arrow.vector.BaseVariableWidthVector.allocateNew(BaseVariableWidthVector.java:446)
at org.apache.arrow.vector.BaseVariableWidthVector.allocateNew(BaseVariableWidthVector.java:407)
at org.apache.arrow.vector.VectorSchemaRoot.allocateNew(VectorSchemaRoot.java:150)
at org.apache.hertzbeat.common.entity.message.CollectRep$MetricsData$Builder.build(CollectRep.java:432)
at org.apache.hertzbeat.collector.dispatch.MetricsCollect.validateResponse(MetricsCollect.java:433)
at org.apache.hertzbeat.collector.dispatch.MetricsCollect.run(MetricsCollect.java:185)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)

[kim2yung]

Actually I am adding 4k Simulators to hertzbeat for load testing only and we have 3 real devices only which gives real data. But 4k Simulators dont have any data and does not work on SNMP, Only real devices works with SNMP. I have made hertzbeat in such a way that when the device is added then it will follow SNMP protocol.

Can you please suggest how to handle this one without upgrading to v 1.7.2.?