13 Replies Latest reply: Jan 25, 2013 9:40 AM by 987122 RSS

    Oracle NoSQL & Hadoop

    906230
      Hi all,

      Did some one experiment Oracle NoSQL with Hadoop want to share the results?

      Thanks
        • 1. Re: Oracle NoSQL & Hadoop
          Charles Lamb
          user962305 wrote:
          Hi all,

          Did some one experiment Oracle NoSQL with Hadoop want to share the results?
          This is a very broad question and therefore difficult to answer. Is there anything in particular you are asking about in terms of Hadoop and Oracle NoSQL Database?

          Oracle NoSQL Database is packaged with a Hadoop Input Stream. See the doc at:

          http://docs.oracle.com/cd/NOSQL/html/javadoc/oracle/kv/hadoop/package-summary.html

          There is also an example referenced in that javadoc.

          Charles Lamb
          • 2. Re: Oracle NoSQL & Hadoop
            906230
            Did Oracle realize a business test with map/reduce?
            To see how the usage of map/reduce with Oracle NoSQL database will improve performance on some jobs.
            • 3. Re: Oracle NoSQL & Hadoop
              Charles Lamb
              user962305 wrote:
              Did Oracle realize a business test with map/reduce?
              To see how the usage of map/reduce with Oracle NoSQL database will improve performance on some jobs.
              No.
              • 4. Re: Oracle NoSQL & Hadoop
                dvohra21
                Oracle NoSQL Database includes Hadoop based example \kv-1.2.123\examples\hadoop\CountMinorKeys.java.
                To test the example:
                1. Add the Hadoop related Jar files from the \hadoop-0.22.0\lib directory to classpath.
                2. Configure a Hadoop Cluster
                3. Start the Hadoop Cluster
                4. Run a Map/Reduce Job

                Edited by: dvohra16 on Apr 7, 2012 11:16 AM
                • 5. Re: Oracle NoSQL & Hadoop
                  Jean-Pierre Dijcks-Oracle
                  I'm wondering if the original question was trying to understand whether Map Reduce runs on NoSQL DB. E.g. NoSQL is a different storage under MapReduce. To ensure no confusion remains: you do not run Map Reduce on the NoSQL DB storage infrastucture. You use an input format and get data out of NoSQL and process on Hadoop...

                  JP
                  • 6. Re: Oracle NoSQL & Hadoop
                    dvohra21
                    To see how the usage of map/reduce with Oracle NoSQL database

                    Map/Reduce runs on Hadoop with Oracle NoSQL database data.
                    • 7. Re: Oracle NoSQL & Hadoop
                      987122
                      Thanks Charles

                      Is there anything you suggest at this point to get around this issue?

                      Based on the information found on the link below, the issue seems to have been fixed on Map/Reduce 0.21.0

                      https://issues.apache.org/jira/browse/MAPREDUCE-954

                      I can either wait till Cludera release next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 bug however It is not 100% clear to me how to apply it

                      Any detailed instructions how to apply this patch would be much appreciated.
                      • 8. Re: Oracle NoSQL & Hadoop
                        987122
                        Thans Charles

                        Is there anything you might suggest at this stage to get around this issue?

                        According to the link below, the bug fix has been included in Map/Reduce 0.21.0. Unfortunately the lastest CHD 4.1.2 includes Map/Reduce 0.20.0.

                        https://issues.apache.org/jira/browse/MAPREDUCE-954

                        I can either wait for the next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 link above.

                        However it is not entire clear to me how to apply the patch.

                        Any detailed instruction how to apply to make the "CountMinorKeys" sample work, would be appreciated.

                        Cheers
                        • 9. Re: Oracle NoSQL & Hadoop
                          987122
                          Thans Charles

                          Is there anything you might suggest at this stage to get around this issue?

                          According to the link below, the bug fix has been included in Map/Reduce 0.21.0. Unfortunately the lastest CHD 4.1.2 includes Map/Reduce 0.20.0.

                          https://issues.apache.org/jira/browse/MAPREDUCE-954

                          I can either wait for the next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 link above.

                          However it is not entire clear to me how to apply the patch.

                          Any detailed instruction how to apply to make the "CountMinorKeys" sample work, would be appreciated.

                          Cheers
                          • 10. Re: Oracle NoSQL & Hadoop
                            987122
                            Thans Charles

                            Is there anything you might suggest at this stage to get around this issue?

                            According to the link below, the bug fix has been included in Map/Reduce 0.21.0. Unfortunately the lastest CHD 4.1.2 includes Map/Reduce 0.20.0.

                            https://issues.apache.org/jira/browse/MAPREDUCE-954

                            I can either wait for the next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 link above.

                            However it is not entire clear to me how to apply the patch.

                            Any detailed instruction how to apply to make the "CountMinorKeys" sample work, would be appreciated.

                            Cheers
                            • 11. Re: Oracle NoSQL & Hadoop
                              987122
                              Thans Charles

                              Is there anything you might suggest at this stage to get around this issue?

                              According to the link below, the bug fix has been included in Map/Reduce 0.21.0. Unfortunately the lastest CHD 4.1.2 includes Map/Reduce 0.20.0.

                              https://issues.apache.org/jira/browse/MAPREDUCE-954

                              I can either wait for the next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 link above.

                              However it is not entire clear to me how to apply the patch.

                              Any detailed instruction how to apply to make the "CountMinorKeys" sample work, would be appreciated.

                              Cheers
                              • 12. Re: Oracle NoSQL & Hadoop
                                987122
                                Thans Charles

                                Is there anything you might suggest at this stage to get around this issue?

                                According to the link below, the bug fix has been included in Map/Reduce 0.21.0. Unfortunately the lastest CHD 4.1.2 includes Map/Reduce 0.20.0.

                                https://issues.apache.org/jira/browse/MAPREDUCE-954

                                I can either wait for the next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 link above.

                                However it is not entire clear to me how to apply the patch.

                                Any detailed instruction how to apply to make the "CountMinorKeys" sample work, would be appreciated.

                                Cheers
                                • 13. Re: Oracle NoSQL & Hadoop
                                  987122
                                  Thans Charles

                                  Is there anything you might suggest at this stage to get around this issue?

                                  According to the link below, the bug fix has been included in Map/Reduce 0.21.0. Unfortunately the lastest CHD 4.1.2 includes Map/Reduce 0.20.0.

                                  https://issues.apache.org/jira/browse/MAPREDUCE-954

                                  I can either wait for the next CDH version (hopefully will include the fix) or try to apply the patch that is attached to MAPREDUCE-954 link above.

                                  However it is not entire clear to me how to apply the patch.

                                  Any detailed instruction how to apply to make the "CountMinorKeys" sample work, would be appreciated.

                                  Cheers