Oracle Analytics and AI

Kunal Mankad

We installed the Oracle AI Agent Private Factory solution, launched by Oracle this year. While configuring LLMs, it's provided few options to connect different end point, including Oracle Gen AI service too. But, in configuration screen, that's required to add End Point URL, and to create End Point URL on OCI, it's mandates to have dedicated cluster used with one base LLM model. That requires commitment to use 744 hours billing.

Actual customer cannot effort to pay these high prices when Open AI and other LLM provides in cheaper cost.

1. Does anyone know how to configure pay-as-use OCI Gen AI service (models) with Oracle AI Private Agent Factory?
2. There is no way it's allowing to create another user from frontend. It only supports to configure SSO with IDCS, Google and other Authentication method. Any idea if we can create new user from Oracle AI Private Agent Factory tool

Regards,

Kunal Mankad.

Gianni Ceresa

Hi,

Welcome to the Oracle Analytics and AI community.

First of all, this forum doesn't cover Oracle AI Database Private Agent Factory because it isn't an Oracle Analytics product. Oracle AI Data Platform is a very different product that doesn't share much (anything) with the Private Agent Factory product.

The Private Agent Factory supports and works with OCI GenAI on-demand models ( https://docs.oracle.com/en-us/iaas/Content/generative-ai/model-endpoint-regions.htm ), the endpoints are documented in the OCI API documentation: https://docs.oracle.com/en-us/iaas/api/#/en/generative-ai-inference/20231130/

The configuration is very straightforward: you just enter the request values. It isn't any different than when wanting to use the OCI API (or the SDK) for the GenAI inference services.