Discussions
Categories
- 17.9K All Categories
- 3.4K Industry Applications
- 3.4K Intelligent Advisor
- 72 Insurance
- 537.2K On-Premises Infrastructure
- 138.6K Analytics Software
- 38.6K Application Development Software
- 6K Cloud Platform
- 109.6K Database Software
- 17.6K Enterprise Manager
- 8.8K Hardware
- 71.2K Infrastructure Software
- 105.3K Integration
- 41.6K Security Software
Athena table Reverse Engineer in ODI
Has anyone tried Reverse Engineering AWS Athena tables into ODI?
We have successfully created a JDBC connection which is working fine.
We have created the resepctive technology, Data Server, Physical Server and Logical Servwer as well.
We are even able to see the Athena schemas in the Physical server "Schema" dropdown box as well.
The only thing we are not able to do is do the Selective Standard or Customized Reverse Engineering of Athena table in ODI.
If any one has done this, please let me know.
Thank you.
Answers
-
Hi,
ODI is not certified with AWS Athena.
Based on what technology have you created the technology for Athena ?
Since you have a JDBC driver, it is OK.
Now you have to check if the data type defined in the tecnology applies to Athena.
Adrian
-
Thanks Adrian.
Yes you are right. Well, there is no technology base we can refer. We just referred the oracle one as Athena is based on similar lines. Below are some screenshots.
Well, no luck so far.
Anything you think we are missing here?
Thanks.
-
Expand "Data Types" entry - you need to be sure the types applies to Athena
-
Hmm I have added the required datatypes which were not present in this new technology folder.
Just for info, my Athena table looks like this:
CREATE EXTERNAL TABLE `test2`(
`created` timestamp COMMENT 'from deserializer',
`email` string COMMENT 'from deserializer',
`enabled` string COMMENT 'from deserializer',
`goods` string COMMENT 'from deserializer',
`id` int COMMENT 'from deserializer',
`kind` string COMMENT 'from deserializer',
`amount` double COMMENT 'from deserializer',
`name` string COMMENT 'from deserializer',
`phone` string COMMENT 'from deserializer',
`table_name` string COMMENT 'from deserializer',
`updated` string COMMENT 'from deserializer')
ROW FORMAT SERDE
'org.openx.data.jsonserde.JsonSerDe'
WITH SERDEPROPERTIES (
'ignore.malformed.json'='true')
LOCATION
's3://test2'
Still not able to do the Reverse engineer of this table.
Thanks.
-
Add RKM SQL (JYTHON) in your project and use it to do a customized reverse engineering.
With this method at least you can see if there are any errors.
-
Yes. I tried with RKM Cloud Applications (JYTHON) last week. I think you are talking about the same one?
Because in its description it is mentioned COMPONENT NAME: RKM SQL (JYTHON).
Anyways, I tried customized reverse engineering with this once again now.
This one gives me no error. And it doesn't imports any table either from Athena unfortunately.
Thanks.
-
Use "RKM SQL (JYTHON)" though.
-
Its the same. Just renamed I think(although the description is still old). Please see below link and screenshot. Thanks.
-
RKM SQL (JYTHON) is a standard KM shipped with ODI installation kit.
It is located here:
ODI_HOME\odi\sdk\xml-reference\KM_RKM SQL (JYTHON).xml
RKM Cloud Applications (JYTHON) is a different RKM.
Adrian
-
Also, do you have any filter in the "Mask"field ?
Try to remove any filter in order to reverse engineer everything in that schema