New Improved Oracle Analytics AI Assistant with option to use third-party LLM - Page 4 — Oracle Analytics

Oracle Analytics News

Welcome to the Oracle Analytics Community: Please complete your User Profile and upload your Profile Picture

New Improved Oracle Analytics AI Assistant with option to use third-party LLM

867
Views
33
Comments
124»

Comments

  • Kirk Li
    Kirk Li Rank 5 - Community Champion

    Hi @Jacques V.-Oracle ,

    I have successfully registered for an OpenAI API key and can use the AI Assistant.

    My question is, if I perform fine-tuning on the OpenAI API, will it affect the results provided by OAC?Is there a place where I can set which model to use when making an API call?

    Thanks!

    Kirk

  • No, we don't support that use case yet.

    We are re-working how we work with 3rd party LLMs and the Open AI option in the current release will be deprecated this fall so I recommend switching to the Oracle default model. Our benchmarks have shown that using the Oracle Default yields better results than the 3rd party option starting in the current release.

    Cheers

    Jacques

  • Syamantak Saha
    Syamantak Saha Rank 5 - Community Champion

    The issue I found with third party LLM software is there are limitations per hardware resource requirements, sometimes giving erroneous results due to this.