Categories
- All Categories
- 15 Oracle Analytics Sharing Center
- 14 Oracle Analytics Lounge
- 210 Oracle Analytics News
- 41 Oracle Analytics Videos
- 15.7K Oracle Analytics Forums
- 6.1K Oracle Analytics Idea Labs
- Oracle Analytics User Groups
- 77 Oracle Analytics Trainings
- 14 Oracle Analytics Data Visualizations Challenge
- Find Partners
- For Partners
ETL taking too much of table space that it crashes on running full load.
Hi All,
I have a fact table named viewership. It contains about 130 million records. I have written ETL such that first I import the data from the external database server to BI database server in a stage table, then I have created a mapping which puts the data into the actual fact table.
The problem that I am facing is that when i run the ETL for full load, it crashes as it consumes too much of TEMP table space. I am looking for a way through which I can solve this issue of some way through which I could write several mapping that load the data in smaller chunks.
Your help will be great.
Regards,
Farrukh Nasir Siddiqui
Answers
-
-
+1 to Robert. This is a question concerning your ETL solution which has nothing at all to do with OBI. You aren't saying anything about WHAT kind of "ETL" are doing so we can't know what's the exact place. ODI, Informatica, Talend, pure PL/SQL, carrier pigeons,...
0 -
Full load ETL with carrier pigeons: https://www.youtube.com/watch?v=GDtA6pO0u9o
0 -
@Andris Perkons-Oracle Hahahah wow that IS a full load!
0 -
@984465 Are you marking answers as "correct" at random? because I seriously doubt that you are doing "ETL by carrier pigeon"
0 -
Hence the seriousness of the community should be know to the world.
0 -
984465 wrote:Hence the seriousness of the community should be know to the world.
With all the respect ... What kind of answer did you expect? You didn't even named if you are using a tool (and which one) or you wrote your ETL in PL/SQL, java, python or any other language existing. You just said you wrote an ETL but you had issues because of too much temp. Why didn't you increase the temp tablespace? Why didn't you perform loading by packets instead of one single operation?
Have a look at , asking things keeping in mind that page and providing more info lead to better answers.
PS: a community, a place where nobody is paid to be part of, also works because of humor. If you want a seriousness then open an SR, you paid for it, they aren't supposed to have humor there ...
0 -
Well I had told this earlier that why cant I increase my Temp Size, but if you are not reading it I cant do anything in that regard.
And I marked this question correct in humor as well as I completely understand that we are working here as a community, I dont see why you took it so negatively. Maybe you dont get humor without the use of smileys and emoticons.
If you dont want to respond to my question you are free to ignore them, dont try to be an over-smart person lecturing me over how to use the community,
0 -
984465 wrote:Well I had told this earlier that why cant I increase my Temp Size, but if you are not reading it I cant do anything in that regard.
Really? I can read your thread 10 times there isn't a single mention on the fact you can't increase temp size. You are maybe mixing things on your side? (this is your only post in this thread).
984465 wrote:Hi All,I have a fact table named viewership. It contains about 130 million records. I have written ETL such that first I import the data from the external database server to BI database server in a stage table, then I have created a mapping which puts the data into the actual fact table.The problem that I am facing is that when i run the ETL for full load, it crashes as it consumes too much of TEMP table space. I am looking for a way through which I can solve this issue of some way through which I could write several mapping that load the data in smaller chunks.Your help will be great.Regards,Farrukh Nasir Siddiqui
It isn't me lecturing you on how to use the community, it's the community itself. (I'm not the author of that document, it's written and edited by a community mod and admin)
I'm going to leave it here as we clearly don't understand each other and there is no need to keep escalating this thing as it will anyway not answer your question.
0
