hassiebp
LLangfuse
•Created by AJ Ram on 8/12/2024 in #get-support
AJ Ram - @Marc is langfuse down?
Hi @AJ Ram - can you confirm whether this was an exception raised or simply an exception logged? The version you are on should already gracefully handle failed fetches on the prompt routes by returning the cache. Only in case there's no cache available on the first fetch, an exception would be raised. For that case, you may upgrade your SDK version to latest and make use of the
fallback kwarg to mitigate these exceptions on first fetch. See docs here: https://langfuse.com/docs/prompts/get-started#fallback9 replies
Issue with prompt search
Hi @sasha97 - thanks for the report. This is fixed in https://github.com/langfuse/langfuse/pull/2911 and will be soon released
4 replies
LLangfuse
•Created by Tosh Velaga on 5/30/2024 in #get-support
Demo of JS SDK Issue
Hi @Tosh Velaga - that is likely due to a missing flush. Please note that in short-lived environments you'll need to call
await openai.flushAsync() (where openai is the wrapped openai client) before shutdown to send the events. Could you check this out and let us know if that solves it for you? 🙂
https://langfuse.com/docs/sdk/typescript/guide#lambda2 replies
Hi there, I think there is a tiny
Thanks for the report, @humbertaco ! We have added a backlog task to narrow the types here.
Background: Since all keys in
KeyParams are optional, having { root: undefined } is interpreted as a valid value for that side of the type union.2 replies
LLangfuse
•Created by paull on 4/22/2024 in #get-support
Hi here. I'm trying to use langfuse with
Hi Paul, this is a known issue with LlamaIndex when run in concurrent environments. The LlamaIndex callbacks implementation we're depending on is not entirely concurrency-safe which leads to errors and incomplete/incorrect traces that mix up the events from the parallel executions.
We have plans to move to the new LlamaIndex instrumentation module to support our integration soon, which hopefully addresses the concurrency issues as well.
1 replies
LLangfuse
•Created by AdrianC on 3/22/2024 in #get-support
Thread
Hi Adrian, could you share a minimum code example for us to reproduce? This will help debugging the issue and see where the LLM event is getting lost 🙂
1 replies