Forum Stats

  • 3,784,358 Users
  • 2,254,928 Discussions
  • 7,880,790 Comments

Discussions

[HELP] "streaming JAR is not found" during MapReduce with R

822381
822381 Member Posts: 5
edited Jan 30, 2013 1:45AM in Big Data Connectors/Hadoop
After I upgrade my ORCH-1.1 to 2.0, I got an error like this when execute MapReduce via R:
DBG: 11:12:00 [ER] streaming JAR is not found at "/home/hadoop/hadoop-0.20.2/contrib/streaming/hadoop-0.20.2-streaming.jar"
Error: execution aborted
BTW, I have specified environment variable "*HADOOP_STREAMING_JAR*" and the file */home/hadoop/hadoop-0.20.2/contrib/streaming/hadoop-0.20.2-streaming.jar* exists.
Could you please give some advice?
Thanks.

Edited by: 819378 on 2013-1-29 下午9:49

Answers

  • 822381
    822381 Member Posts: 5
    After reading source code, I got a w/a. Using assign function to modify initial environment "streaming.lib": assign("streaming.lib", <PATH_JAR> , ORCHcore:::.orch.env)
    The difference between 1.1 and 2.0 is they have different variable names. In ORCH-1.1 the name is ORCH:::.orch.env. It changed to ORCHcore:::.orch.env in ORCH2.0.
    Maybe it's useful for people in the same situation like me.

    Sorry for bothering.
This discussion has been closed.