What does “complete event for unknown container id” mean in Java – hadoop logs?

What does “complete event for unknown container id” mean in Java – hadoop logs? … here is a solution to the problem.

What does “complete event for unknown container id” mean in Java – hadoop logs?

I’m trying to run a simple job (wordcount example) on multiple files in a cluster, but most maps fail. When I reference the task log, I only see an error like this:

ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container complete event for unknown container id container_1388066512888_ 0001_01_000026

Any ideas?

Update: I check the job several times, sometimes it fails due to a map failure, and sometimes it completes successfully in rare cases due to reduced failures. But in any case, the only error is the one above.

Solution

I’m getting the same error :

ERROR [RMCommunicator Allocator] 

org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container completion event for unknown container ID container_1406174606649_0001_01_000154

Probably related to the mapred.child.java.opts attribute in the mapred-site .xml.

I am like this:

<property>
   <name>mapred.child.java.opts</name>
   <value>
     -Xmx4096M
   </value>
 </property>

When I delete this attribute, the error is gone.

Related Problems and Solutions