You're almost there! Please answer a few more questions for access to the Applications content. Complete registration
Interested in joining? Complete your registration by providing Areas of Interest here. Register

LLM Handler not working while deploying on OKE

Hello,

We are trying to do some experimentation around ODA LLM Block. While we managed to migrate from /generate to /chat model by altering the request payload, we encounered a small issue.

1) We executed LLM Transformation Handler via Local Tunneling (ngrok) as well as Embedded Container (.tgz file).
2) When we try to push the same code on OKE (Oracle Kubernetes Engine), even though we are able to access the Handler in ODA interface, while executing it, we are facing the following error. "An exception occurred while invoking component System.LLM: Error invoking event handler Cohere_Command_Chat_V2.transformRequestPayload: httpError:404."

Howdy, Stranger!

Log In

To view full details, sign in.

Register

Don't have an account? Click here to get started!