Skip to Main Content
Forums

Analytics Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Interested in getting your voice heard by members of the Developer Marketing team at Oracle? Check out this post for AppDev or this post for AI focus group information.

Can't upload data via Outline Load Utility command line

JanGLiNov 11 2016 — edited Dec 1 2016

Hi,

Version: 11.1.2.4.004

I am trying to load data into hyperion planning using command line of Outline load utility.

My data form:

pastedImage_5.png

This is my file 1:

Value,Driver Member,Point-of-View,Data Load Cube Name

1111,Employee Count,"Jan, No Line Item,Actual,First Draft,Local,No Entity,No Asset Class,Common Cost Centre,No Future 1,No Product,Common requsition cost center,Employee Count,Common Employees,FY16",Plan2

I have also tried to load the below file.

This is my file 2:

Value,Driver Member,Point-of-View,Data Load Cube Name

1111,Jan,"No Line Item,Actual,First Draft,Local,No Entity,No Asset Class,Common Cost Centre,No Future 1,No Product,Common requsition cost center,Employee Count,Common Employees,Employee Count,FY16",Plan2

My command:

./OutlineLoad.sh /A:HypUAT1 /U:admin /M /I:/u01/hyperion/fdmee_custom/WF/WF_AUG-16.csv /TR /X:/u01/hyperion/fdmee_custom/WF/WF_AUG-16.exc /L:/u01/hyperion/fdmee_custom/WF/WF_AUG-16.log

My log file:

[Fri Nov 11 16:46:25 PKT 2016]Planning Outline data store load process finished. 1 data record was read, 2 data records were processed, 2 were accepted for loading (verify actual load with Essbase log files), 0 were rejected.

My exception file:

\ufeff[Fri Nov 11 16:46:24 PKT 2016]Parent-child ordering option (/H switch) will not be performed: this option is not available for the "OFADataLoadDimension" dimension.

[Fri Nov 11 16:46:24 PKT 2016]Input file member load ordering option (/O switch) will not be performed: this option is only available for (non /IE) import operations.

I have also checked the essbase log file. I can't see anything related to data loading or file creation for data loading.

I know that all the members are correct, because i have copy/paste these members in GUI version of OLU and i was able to load data from there.

Kindly help.

Regads
This post has been answered by JanGLi on Dec 1 2016
Jump to Answer

Comments

Andris Perkons-Oracle

Hi,

make sure you are comparing apples with apples. Did the T4-4 use the same storage? Same disks with the same disk layout? Same filesystem with exactly the same mount options?

What happens to the run times if you leave out the "sync" command?

Andris

Andris Perkons-Oracle

And when running this from within guest domains:

Is the storage attached the same way on both the T4-4 and the T5? How is it attached - does the domain access the storage directly or is the storage virtualized (vdisk or vhba)?

Are the control domains sized equally (CPU, RAM)?

3260775

Hi Andris

Thank you for your return.

I will return with the answers as soon as possible

3260775

Sorry for delay

below the specification of the two platforms

T4-4

T5-4

File System

vxfs

zfs

Storage array

Oracle  STK 2540 M2

Oracle FS1-2

Connection type between storage array and server

Directly

Via switch Brocade

                      

T4-4

T5-4

File System

vxfs

zfs

Storage array

Oracle    STK 2540 M2

Oracle FS1-2

Connection type between storage array and server

Directly

Via switch Brocade

Andris Perkons-Oracle

Hi,

well, apples and oranges...

Unless your primary use case is to copy data with "dd", your comparison is useless.

I would bet that the vxfs has no mountoptions, which translates to "delaylog", meaning that you have a –3 second window where your data is not necessarily persistent. Try setting your mountoptions to "log,convosync=direct" and you'll see that your vxfs performance will drop dramatically.

Then, your workload is just small enough (800 MB resp 1,2GB) to fit into the STK 2540's cache. I don't know how large the cache for the FS1-2 is, but I guess that with larger workloads, the performance differences will level out.

The STK uses 15k RPM disks. How fast are the disks inside the FS1? Then, you don't mention how many disks make up your file systems.

The connection of the storage arrays also has different latencies. A direct connection should be slightly faster than a connection via a switch. Not much faster, but "100000 x not much faster" adds up.

Then on the topic of ZFS: What recordsize are you using? How is the zpool set up? Mirrored or Raid-Z-something? How full is the file system?

Andris

1 person found this helpful
Nik

Hi.

For compare need select base. This can allow say that some feature or hardware is better or not.

You have whole different.

Different  servers, different arrays ( with different disks), different FS.

Any from this can be point of the problem.

You test:

root@T5_ldm_app:/# time sh -c " dd if=/dev/zero of=test.img bs=8k count=100000 && sync"

You copy 8k * 100 000 ~ 800 MB   Speed ~ 41 MB/s

root@T5_ldm_app:/# time sh -c " dd if=/dev/zero of=test.img bs=128k count=10000 && sync"

You copy 128k * 10 000  ~1280 MB Speed ~ 32 MB/s

But you sync all file systems. So it's not clear do you have any other activity on other file systems.

According  man:

     Unlike fsync(3C), which  completes  the  writing  before  it

     returns,  sync() schedules but does not necessarily complete

     the writing before returning.

So when you run only one sync, you can not be sure that buffers is real  flushed.

Regards,

Nik.

1 person found this helpful
3260775

Hi All,

We use a delaylog mount option and raid 10 for T4-4.

disk used on STK 2540 ( 7200 rpm)

Regards.

1 - 7
Locked Post
New comments cannot be posted to this locked post.

Post Details

Locked on Dec 29 2016
Added on Nov 11 2016
#business-intelligence-applications, #data, #hyperion, #load, #performance-management-applications, #planning, #planning-and-budgeting
7 comments
1,389 views