1 2 Previous Next 25 Replies Latest reply: Dec 27, 2013 8:52 AM by jgarry Go to original post RSS
  • 15. Re: Split the data and call the Main SP
    936666 Newbie
    Currently Being Moderated

    What you are trying to say is that it is not possible to do so...!!

    my thoughts is

    800 MB splitted into 4 200MB

    so each new session is now 200MB.

    Every 200MB will be starting excatly what is first 200MB.

     

    Thanks!

  • 16. Re: Split the data and call the Main SP
    sb92075 Guru
    Currently Being Moderated

    so it was said, so let it be done.

    why are you here if you have a solution.

  • 17. Re: Split the data and call the Main SP
    936666 Newbie
    Currently Being Moderated

    Just want to know that it will be work as Multithreading in java

    In java where we split the data and process

    is there an option in Oracle to do as such...    

  • 18. Re: Split the data and call the Main SP
    sb92075 Guru
    Currently Being Moderated

    no

  • 19. Re: Split the data and call the Main SP
    jgarry Guru
    Currently Being Moderated

    There are some things I still haven't got:

     

    How do you know where to split blobs?  Is this XML?

     

    I would also point out that the version of Oracle and the blob chunk size might make a big difference.  For example, if you have 8K blocks and a 32K chunk size on 11gR2, you might get much larger and faster direct path reads for your split to work on, versus 4 parallel single block reads through a buffer pool.

     

    Disclaimer:  I may know nothing about this.  You may have to trace to see what is really happening.

  • 20. Re: Split the data and call the Main SP
    936666 Newbie
    Currently Being Moderated

    I am using Oracle 11g , but for processing some 5 MB of data is it taking nearly avg 22sec to insert 15k rows with 100 columns.

    I need to to improve my query thought of parallel execution might be an option to resolve.

    I have used sample of 5MB where as in real time i will be getting some 500-800 MB of data.

    To inside 15k records it is taking 20-24 sec on different cycle.

    mycode to convert the blob chunk to appropriate data type by looping

    dbms_lob.read(l_blob,bytelen,l_start,l_ouput);

    utl_raw.cast_to_binary_double /*8 byte */

    utl_raw.cast_to_binary_float /*4 byte */

    utl_raw.CAST_to_BINARY_INTEGER /*4 byte */

    Included sequence also to have row number in mytable.

    22 sec is not acceptable from client perspective for processing 15k records

    thats why i am looking alternative.

    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0

    OS: Win2k8 (32 bit)

     

    Thanks!

  • 21. Re: Split the data and call the Main SP
    sb92075 Guru
    Currently Being Moderated

    you are a slow learner.

  • 22. Re: Split the data and call the Main SP
    936666 Newbie
    Currently Being Moderated

    I am actually from SQL server background this is first time i got a requirement like this and good to know is that oracle is having the

    support of Packages like

    utl_raw.cast_to_binary_double /*8 byte */

    utl_raw.cast_to_binary_float /*4 byte */

    utl_raw.CAST_to_BINARY_INTEGER /*4 byte */

    where as in sql server there is no such things.

    comparing with SQL server and Oracle studying is a good go...right

    But are we having a solution....

  • 23. Re: Split the data and call the Main SP
    rp0428 Guru
    Currently Being Moderated

    Same with OPs other issue on this topic:

    https://community.oracle.com/thread/2605691

  • 24. Re: Split the data and call the Main SP
    rp0428 Guru
    Currently Being Moderated
    But are we having a solution....

    I doubt if you will be 'having a solution' until you provide the information that was ask for in your other thread

    https://community.oracle.com/thread/2605691

     

    It seems that YOU are the one concatenating all of these things together into a BLOB and now you want to know how to separate them all again.

     

    A month ago you were ask to explain what PROBLEM you are trying to solve and some of us warned you that you needed to use some sort of delimiter but you never responded to us.

     

    You don't need to be using BLOB to do this - you can just select the data from the database directly from Java.

     

    But if you don't explain what you are really trying to do and why you are first creating a BLOB and then trying to parse it we can't really help you.

  • 25. Re: Split the data and call the Main SP
    jgarry Guru
    Currently Being Moderated

    I second what rp said.  From what you've said so far it sounds like you are rewriting a record oriented hierarchical database in java inside the database, or some sort of puzzle wrapped in an enigma like that.

     

    The thing about parallel is it trades off multiuser scaling for single user process scaling.  In other words, it adds some overhead to allow a user to take over the machine.  A side effect is the scaling is not linear.  You can only use smaller data sets to make a proof of concept, not to tune performance.  Kind of like a four smokestack steamship; it doesn't go much faster with 5 people than with 1000 people, and if containers are too big you have to wait for stevedores to take more time loading and unloading.  And if you have a sailing regatta following the ship through a channel, all those other boats have to wait, even though they have the right of way.

     

    There are ways to make things go blazingly faster than SQL Server, but objective and details matter. 

1 2 Previous Next

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points