Error while testing LLM Service from ODA
Summary: We are trying to configure LLM service from our Fusion ODA .
We have a Fusion SaaS paired digital assistant (the source service) to invoke generative AI service (the target service) hosted in a separate tenancy, e.g a PaaS tenancy.we have done the request forwarding configuration for this as per Oracle Document.
Authentication : API Key .
Is the URL correct
Payload :
{
"compartmentId": "ocid1.dasdasda",
"servingMode": {
"servingType": "ON_DEMAND",
"modelId": "cohere.command-r-08-2024"
},
"chatRequest": {
"apiFormat": "COHERE",
"message": "Give me the current year",
"maxTokens": 1000,
"isStream": true,
"frequencyPenalty": 0,
"topP": 0.75,
"temperature": 1
Tagged:
0