You're almost there! Please answer a few more questions for access to the Applications content. Complete registration
Interested in joining? Complete your registration by providing Areas of Interest here. Register

Error while testing LLM Service from ODA

Summary: We are trying to configure LLM service from our Fusion ODA .

We have a Fusion SaaS paired digital assistant (the source service) to invoke generative AI service (the target service) hosted in a separate tenancy, e.g a PaaS tenancy.we have done the request forwarding configuration for this as per Oracle Document.

URL : https://asdasdasdad.apigateway.eu-frankfurt-1.oci.customer-oci.com/forwardfn/app/20240531/actions/chat

Authentication : API Key .

Is the URL correct

Payload :

{
"compartmentId": "ocid1.dasdasda",
"servingMode": {
"servingType": "ON_DEMAND",
"modelId": "cohere.command-r-08-2024"
},
"chatRequest": {
"apiFormat": "COHERE",
"message": "Give me the current year",
"maxTokens": 1000,
"isStream": true,
"frequencyPenalty": 0,
"topP": 0.75,
"temperature": 1

Howdy, Stranger!

Log In

To view full details, sign in.

Register

Don't have an account? Click here to get started!