LLM Handler not working while deploying on OKE
Hello,
We are trying to do some experimentation around ODA LLM Block. While we managed to migrate from /generate to /chat model by altering the request payload, we encounered a small issue.
1) We executed LLM Transformation Handler via Local Tunneling (ngrok) as well as Embedded Container (.tgz file).
2) When we try to push the same code on OKE (Oracle Kubernetes Engine), even though we are able to access the Handler in ODA interface, while executing it, we are facing the following error. "An exception occurred while invoking component System.LLM: Error invoking event handler Cohere_Command_Chat_V2.transformRequestPayload: httpError:404."
Tagged:
0