Java Out of Memory exception in Ubuntu when using Flume/Hadoop Java Out of Memory exception in Ubuntu when using Flume/Hadoop hadoop hadoop

Java Out of Memory exception in Ubuntu when using Flume/Hadoop


java hadoop heap-memory flume

Set JAVA_OPTS value at flume-env.sh and start flume agent.

java hadoop heap-memory flume

It appears the problem had to do with the batch size and transactionCapacity. I changed them to the following:

TwitterAgent.sinks.HDFS.hdfs.batchSize = 100TwitterAgent.channels.MemChannel.transactionCapacity = 1000

This works without me even needing to change the JAVA_OPTS value.

Recent Posts
How can I color dots in a xy scatterplot according to column value?
How to update a claim in ASP.NET Identity?
What does {0} mean when initializing an object?
Accessing members of items in a JSONArray with Java
How to log SQL statements in Spring Boot?
Powershell Get-WebSite name parameter is ignored
How to detect scroll to bottom of html element
Java synchronized method
How to test controllers with CodeIgniter?
Detect Visual Composer
Matplotlib: Specify format of floats for tick labels
Rails join a list of strings with commas and "and" before the last