Data missing in random columns in Analyses (12c 12.2.1.2)

Gianni Ceresa

The good thing is we never heard about that and also don't remember I saw somebody else asking for that on here.

So it smells a lot like a one-time issue (so only on one server for ... no idea which reason).

As you explored quite few options around RPD etc. I would leave that one as possible source of problems as secondary thing (of course not excluded it can still come from there).

An better not to comment about how easy the migration is

It actually is really simple if your 11g was a perfectly clean state of the art model, if it was a normal setup used for read ... it's always a bit different

You are on linux, right? Which version? (not that it's supposed to matter but never know)

Christian Berg-0racle

Just out of curiosity: Have you already run a vanilla RPD on that server to see whether you get the same beahviour? I.e. eliminating "the RPD" as a problem source or confirming it. One step after the other with webcat next etc etc

JustTheFacts

Our 12c is on Red Hat 6.8. 11g is on Windows so we're changing OS along with the upgrade. To keep things simple, you see. <rolleyes> (not my decision)

I tested the logical SQL using a direct ODBC tool. The empty column comes back "" (empty string) in the raw results. So, that's significant.

I tried comparing byte count, but the reported row width in the session log is 3x larger than even the maximum width of the columns, nevermind the actual data width. So I'm not sure how to validate those numbers.

If I add a filter to the query on the "missing" column, the filter is applied correctly, which makes sense since the physical SQL is correct.

JustTheFacts

Just out of curiosity: Have you already run a vanilla RPD on that server to see whether you get the same beahviour?

Well, the RPD was created using File -> New Repository from the 12c Admin tool. I then uploaded that RPD (after much difficulty getting the upload to work due to my own stupidity) and created my test model in it in online mode. Is there a more-vanilla RPD that I can use? I know that I can somehow "reset" the service instance, which is supposed to put everything at some kind of default state. Is that what you're referring to?

Christian Berg-0racle

Yes and no. I was proposing you take a simple SampleAppLite and the use the datamodel command to upload the RPD.

But since you mention it - you can also import one of the BAR files which come with any base install. Like the SampeLite BAR which contains the RPD from my above use case. For that you'd use importServiceInstance.

Mind you that will switch out RPD, webcat and the system-jazn, so your roles and responsibilities.

Gianni Ceresa

Moving to RHEL is a good move (lately all the people having a Windows server in front of them doing an 11g to 12c upgrade are really thinking to install a linux VM hidden somewhere ).

Good thing you could test the LSQL directly : so Presentation service is out of the loop, the issue is between BI Server and the data source, but because the physical query works fine ....

I would really point on a different server to test, last "quick" test to see if it's just this single install which has an issue.

Just a random thing : would it be possible that your source is loading so frequently that tables or columns are empty because reloaded (or views rebuilt or something) ?

And that, no luck, when you test the physical query everything was loaded and so the query is fine?

For the test importing SampleLite BAR, as Christian said it will wipe everything, so make backups and also export your current instance first.

JustTheFacts

Thanks again both of you for helping work through this. Our product manager just finished a fresh migration of our 11g production RPD/Webcat/Jazn to a different 12c environment (still RedHat) and I tested that installation with the same results - random this or that column is blank.

The subject areas I'm using to test are either daily or monthly loads, so it's not a data load issue. Caching is turned off in the RPD physical layer.

We're going to put in an SR to Oracle, but as I mentioned at the start...not looking forward to that experience.

I also have loaded up SampleAppLite.bar, but the XML data sources aren't set up correctly yet. Once I get that sorted out I'll do another test.

Gianni Ceresa

No luck ...

Also because it's a kind of really annoying issue as you can't really find out a pattern

Would be nice if you can come back with an update once you heard something (I hope) from Oracle.

In case you have time/resources you can maybe also try a 12.2.1.1.0 ? (as you are now on 12.2.1.2.0)

JustTheFacts

So, sort of related because I'm trying to get SampleApp working - when I import the BAR file, everything seems to work, but the RPD is not updated. The command I am running in WLST is:

     importServiceInstance('/software/obiee/enterprise/user_projects/domains/bi','ssi','/software/obiee/enterprise/bi/bifoundation/samples/sampleapplite/SampleAppLite.bar')

And amongst all of the logging output I see:

     INFO: Successfully run importServiceInstance for RPD plugin oracle.bi.bar.si.framework.plugin.RpdMetadataManagerPlugin

I have tried this both while services were up and running (restarting using stop.sh/start.sh after the import) and while services were stopped (after stop.sh). Either way, the webcat and JAZN are successfully "updated" to SampleApp, but I'm not getting the SampleApp RPD. My little test RPD is always left behind.

I haven't yet wrapped my head around how RPDs are handled in 12c, but for what it's worth, "liverpd.rpd" (at ssi/metadata/datamodel/customizations) does not have the current timestamp on it; seems to be from the last time I did "uploadrpd". However, the "default_diff.xml" file (in the /default subdirectory of the above directory) has been touched and has a current timestamp.

What am I doing wrong?

MattT-Oracle

Have you tried replacing the logical column with a constant value (just edit the column definition) to see if that displays?