Forum Stats

  • 3,838,970 Users
  • 2,262,432 Discussions
  • 7,900,825 Comments

Discussions

Categories

Flat files loading in owb

655884
655884 Member Posts: 3
edited Aug 28, 2008 4:28AM in Warehouse Builder
Dear All,
I have to load more than 10 million flat files through OWB 10g. Can someone guide how I can automate this porcess in OWB or we have to use perl script to feed files into OWB.

Regards,
Imran
Tagged:
· Share on TwitterShare on Facebook

Answers

  • 292515
    292515 Member Posts: 821
    Hi,

    if they have the same structure you can do it like it described here: http://www.oracle.com/technology/products/warehouse/pdf/Cases/case7.pdf

    The external process is a little more complicated in your case.

    Regards,
    Detlef
    · Share on TwitterShare on Facebook
  • 655884
    655884 Member Posts: 3
    Thanks Detlef for an early reply.

    I am following the same technique. But problem (hitch) with this technique is that as all filename are changed to standard fix name the badfiles or errors log will overwrite with subsequent badfiles. Can you give me some clue to how to tackle.

    Regards.
    · Share on TwitterShare on Facebook
  • 292515
    292515 Member Posts: 821
    Hi,

    extend the external process to rename (e. g. with a timestamp extension) the log and discard files (like you do it for the data file) and put them into another directory before copying the new file.

    I think that will work.

    Regards,
    Detlef
    · Share on TwitterShare on Facebook
This discussion has been closed.