@Gabby Rubin-Oracle @Bret Grinslade - Oracle Analytics-Oracle @Alan Lee - Oracle-Oracle One of quite overlooked area in term of improvements (whatever with great importance if you take care of governance and good practices) are tools/support for incremental DEV2PROD deployment of DV objects between OAC/OAS environments (mainly connections and data sets, workbooks are part of BI catalog and thus can be transferred by old good and mature tools for BI catalog). But for DV this is simply disaster (I cannot find other more polite words for it), we are fighting with this process since we "jumped" into usage of Data Visualization in our institution.
I have created couple of Ideas on this topic (or up voted for Ideas, which resonates similar needs ) so far without much attention by Product Mgmt/Developemt (or without clear plan, that it will be implemented in some near future):
What are the possibilities now :
1) Snapshots
Not usable for incremental deployments (deploy from DEV to PROD just data sets which has been changed on DEV environment) and beside this (at least this is valid for OAS) files (Excel/CSV) for file-based data sets are not part of snapshots
2) DVA package export/import
So far the only option how to incrementally transfer definitions of data sets/connections from one environment to other (DEV2PROD) , but very poor (and very clumsy) functionality - I will list all "issues" we are strongly fighting with:
a)
DVA package always overwrites (or create new one) connection objects bounded to data sets included in DVA package.
This is unwanted behavior in majority of imports, since we already have connection object in place on target environment for data set (we want to transfer just changes in data set definition) and connection object (with same Object ID as on source environment is usually pointing to different database - on source DEV OAS environment connection is pointing to DEV database, while on target PROD OAS environment connection is pointing to PROD database).
There should be ability to transfer just definition of data sets between environments (without a need to import/replace connection definition from source environment - if connection already exists on target environment)
b)
DVA package is modifying (while importing to target environment) so called namespace (User Id of creator of object) which is part of unique identifier of object (data set, connection....) to User ID of user, who is executing import (without taking into consideration, what namespace was on source environment).
Again this is unwanted "feature" - I will explain why:
In our setup, person, doing import of DVA package is Administrator of OAS environment (and this is different user than the user who has created DV objects on source environment and who is requesting deployment of "his" objects to PROD).
And this leads to change of Namespace (part of Object unique identifier used for referencing DV object - for example referencing data set in DV workbook, analysis definitions).
DVA import "handles" this situation for DV workbooks which are part of the same DVA package as corresponding data sets (it changes the reference to data set to new namespace).
But our authors are using often "mixed" setup - they create data sets in DV (because it is convenient for them, no need to model simplier structures in RPD) and then they use Answers/Dashboards (on top of DS) - since Answers/Dashboards are more mature for complex reporting then DV (so far).
And when Admin deploys data sets on PROD, unique identifier of data sets changes (since namespace "converts" to Admin username) and thus their reports in Answers on PROD (deployed on PROD via Archive/Unarchive operations in BI catalog) are broken, since they refer data set with original namespace from DEV environment.
Pretty tricky situation....
So we need a option during DVA import of DS to preserve original namespace (part of DS unique identifier) from source environment (not to be overwritten by importer's namespace on target environment).
I would like to ask all involved people from Product Mgmt/Development to put more effort in this area - to achieve the same level of flexibility for DEV2PROD processes as which are in place for DEV2PROD processes for classics (BI catalog objects along with RPD deployment from DEV2PROD). This area really deserves more effort and attention.
Thanks
Michal
Categories
- All Categories
- 118 Oracle Analytics News
- 21 Oracle Analytics Videos
- 14.4K Oracle Analytics Forums
- 5.5K Oracle Analytics Idea Labs
- Oracle Analytics User Groups
- 48 Oracle Analytics Trainings
- 6 Oracle Analytics Data Visualizations Challenge
- 4 Oracle Analytics Career
- 7 Oracle Analytics Industry
- Find Partners
- For Partners
Automate transfer/migration of file-based data set content (Excel/CSV) between OAS environments
Organization Name (Required - If you are an Oracle Partner, please provide the organization you are logging the idea on behalf of):
Czech National Bank
Description (Required):
We are fighting in ourExported BAR Files Don't Include Data Files OAS environments with quite strict restriction of BAR/snhot content (which does not pay for OAC) - Exported BAR Files Don't Include Data Files (see https://docs.oracle.com/en/middleware/bi/analytics-server/known-issues-oas/index.html#OASKB-GUID-147FF502-A8A2-4DFF-9DBF-B597720E1F19).
This represents really quite big pain for us, since we need to "handle" transfer of file-based data set content (Excel/CSV files) manually (from DV UI - upload) in following scenario:
- transfer "content" from environments (DEV to PROD or vice versa) using BAR archive/snapshot
I have already created following Idea: OAS - inclusion of "File-based Data" into snapshot: https://community.oracle.com/customerconnect/discussion/586916/, but without any attention from Oracle so far.
If it is not feasible to implement this within snapshot/BAR export functionality, would it be at least possible to think about making upload/download functionality available for file-based data sets in DV UI as part of planned API for DV ?
At least this would allow us to automate transfers of file-based data sets.
Use Case and Business Need (Required):
Streamline/automate deployment processes within DV part of OAS
Enhancement Request / Service Request:
Comments
-
We have the exact same issue. We have had Users develop several DV's in OAS 6.4 environment and we have to do an out of place upgrade to 2024 (Ver 7.6). The snapshot restore process is good for most catalog items but does not bring over datasets that were originally created using file based sources such as excel. If Oracle can update the snapshot to include datasets that were created using file based sources it would make it easier for out of place migration. Currently we are left with no choice other than to migrate each of the DV or dataset manually. We have 100+ DV projects. Thanks!
1 -
@Narayanan Ramachandran You exactly hit hit the nail on the head. Generally area of Dev2Prod processes (also incremental) , automation, governance has huge gap in product (and in OAS it is even more evident with comparison to OAC). I am trying to point/bring attention of responsible people in Oracle Analytics Dev/Mgmt - see links:
But so far without much success (nothing has changed - no signs of change in recent Product roadmap). The only chance is to collect more votes for corresponding Ideas (including this one).
Rgds
Michal
1 -
This has been a real challenge trying to keep the environments in sync during our upgrade. It is really surprising and has made maintaining our upgrade schedule difficult. I hope Oracle notes this and automates this.
0 -
Even we are facing the exact same issue. We need to reinstall and setup all our OAS 7.6 environments as part of a hardware upgrade. This whole datafiles issue is a real concern. We have over 1000+ datasets in file format and some of them are private (non visible to admin). This bar file limitation has put all our upgrade/migration plans in jeopardy.
0 -
Much needed feature which will add so much values. Upvoted.
0 -
This would be useful. Thanks Michal, upvoted.
0
