Java – Error starting Hadoop cluster

Error starting Hadoop cluster… here is a solution to the problem.

Error starting Hadoop cluster

chown: changing ownership of `/usr/local/hadoop/libexec/.. /logs': Operation not permitted
 starting namenode, logging to /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-namenode-ayush-PC.out
/usr/local/hadoop/bin/hadoop-daemon.sh: line 135:     /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-namenode-ayush-PC.out: Permission denied
head: cannot open `/usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-namenode-ayush-    PC.out' for reading: No such file or directory
localhost: chown: changing ownership of `/usr/local/hadoop/libexec/.. /logs': Operation not permitted
localhost: starting datanode, logging to /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-datanode-ayush-PC.out
localhost: /usr/local/hadoop/bin/hadoop-daemon.sh: line 135:     /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-datanode-ayush-PC.out: Permission denied
localhost: head: cannot open `/usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-datanode-  ayush-PC.out' for reading: No such file or directory
localhost: chown: changing ownership of `/usr/local/hadoop/libexec/.. /logs': Operation not permitted
 localhost: starting secondarynamenode, logging to /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-secondarynamenode-ayush-PC.out
 localhost: /usr/local/hadoop/bin/hadoop-daemon.sh: line 135: /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-secondarynamenode-ayush-PC.out: Permission denied
 localhost: head: cannot open `/usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-secondarynamenode-ayush-PC.out' for reading: No such file or directory
chown: changing ownership of `/usr/local/hadoop/libexec/.. /logs': Operation not permitted
 starting jobtracker, logging to /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-jobtracker-ayush-PC.out
/usr/local/hadoop/bin/hadoop-daemon.sh: line 135: /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-jobtracker-ayush-PC.out: Permission denied
head: cannot open `/usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-jobtracker-ayush-PC.out' for reading: No such file or directory
 localhost: chown: changing ownership of `/usr/local/hadoop/libexec/.. /logs': Operation not permitted
localhost: starting tasktracker, logging to /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-tasktracker-ayush-PC.out
localhost: /usr/local/hadoop/bin/hadoop-daemon.sh: line 135: /usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-tasktracker-ayush-PC.out: Permission denied
localhost: head: cannot open `/usr/local/hadoop/libexec/.. /logs/hadoop-hadoop-tasktracker-ayush-PC.out' for reading: No such file or directory

I’m getting this error.
I read that a lot of people get this error, but I haven’t been able to find a solution. Can anyone help??

Solution

Create a separate user – hduser, always recommended

- do chown -R 755 /usr/local/hadoop
- when creating tmp paths like /app/hadoop/tmp, apply the same settings as above

Hope this solves the problem.

The problem has to do with permissions, not with Hadoop

Related Problems and Solutions