CanaDoug
CanaDoug
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
The team I run for this current assistant project is small and not really skilled for it. So this takes a lot of effort out especially when using tools and augmenting RAG. Then of course we want to dig into the data. I assume openai will soon enough have their own equivalent to this but I needed something now.
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
Ease of implementation
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
I’ll put some thought into it. Good to know that it’s a very small user base though
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
Yeah I guess you’d have to save the thread ids and assistant ids then in the langfuse app make the calls to fetch the data. It would require an api key be kept in langfuse but that’s not crazy
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
I don’t see langsmith having an answer to this either
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
It seems like we can instrument some things but don’t have easy access to all the messages for example because the thread state is held server side
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
Ok thanks, at least I’m not missing something. I will take a look at this. Is there a big hurdle to this you are already aware of or just not had time? I can possibly contribute here if I have some time.
21 replies
LLangfuse
Created by CanaDoug on 6/14/2024 in #get-support
Hi all, I'm just looking into langfuse
I poked into the source and it seems a lot of info is pulled from parsing the first argument on calls and it expects that object ot be an openai object. I can prevent the parsing error from happing but it seems I would need to rewrite the whole thing to get all that metadata from somewhere else for these beta methods. Hopefully this already exists somewhere? Or maybe is in the works?
21 replies