1 Reply Latest reply: Jan 30, 2013 12:45 AM by 822381 RSS

    [HELP] "streaming JAR is not found" during MapReduce with R

    822381
      After I upgrade my ORCH-1.1 to 2.0, I got an error like this when execute MapReduce via R:
      DBG: 11:12:00 [ER] streaming JAR is not found at "/home/hadoop/hadoop-0.20.2/contrib/streaming/hadoop-0.20.2-streaming.jar"
      Error: execution aborted
      BTW, I have specified environment variable "*HADOOP_STREAMING_JAR*" and the file */home/hadoop/hadoop-0.20.2/contrib/streaming/hadoop-0.20.2-streaming.jar* exists.
      Could you please give some advice?
      Thanks.

      Edited by: 819378 on 2013-1-29 下午9:49
        • 1. Re: [HELP] "streaming JAR is not found" during MapReduce with R
          822381
          After reading source code, I got a w/a. Using assign function to modify initial environment "streaming.lib": assign("streaming.lib", <PATH_JAR> , ORCHcore:::.orch.env)
          The difference between 1.1 and 2.0 is they have different variable names. In ORCH-1.1 the name is ORCH:::.orch.env. It changed to ORCHcore:::.orch.env in ORCH2.0.
          Maybe it's useful for people in the same situation like me.

          Sorry for bothering.