Structured Outputs OpenAI

Langfuse doesn't seem to support the new "Structured Outputs" feature from openai. just throws up lots of errors. are there plans to do so? https://openai.com/index/introducing-structured-outputs-in-the-api/

Solution:

Do you run the latest langfuse python sdk? As the apis use chat completion under the hood, you'll get some default traces without any changes as long as you update the langfuse sdk More on our support of the beta apis here: https://langfuse.com/docs/integrations/openai/python/get-started#openai-beta-apis...

Drop-in replacement of OpenAI SDK (Python) to get full observability in Langfuse by changing only the import.

3 Replies

Solution

Marc•2mo ago

Drop-in replacement of OpenAI SDK (Python) to get full observability in Langfuse by changing only the import.

thanks this has fixed it!

Marc•2mo ago

Thanks for confirming, s/o to @hassiebp who quickly added support across the Langfuse sdks