How to access hadoop cluster (unix) from client windows machine

Question

I have virtual hadoop cluster and client to hadoop is running on windows machine. When I am submitting mapred job I am getting org.apache.hadoop.security.AccessControlException: Permission denied access=EXECUTE, inode="":jakub:supergroup:rwx------- as it runs under windows user.

I tried to disabl those checks by setting dfs.permissions to false. Seems that didn't help.

When I try to submit the job under the user hadoop is runnig on cluster I get: User: XXX is not allowed to impersonate jakub.

This is related to user management on hadoop. Do I miss something important here? I is my development machine so the easest solution wins.

Thanks

Answer 1

Probably it is not the best solution but I figure it out:

1) created "windows" user on linux machine

2) add that user to usergroup under which hadoop is running

3) hdfs-site.xml add prperty for dfs.permissions.supergroup to usergroup hadoop is running under

That solved the problem for me. I do not claim that it is the best, definetevly not a propper user management.