Shezan Baig

PostsComments

LLangfuse

•Created by Shezan Baig on 1/30/2024 in #feedback

missing token counts

Also @Clemo - Sorry I dont have the token counts now but if you can tell what exact details you needs respect to tokens, I can have it available?

5 replies

LLangfuse

•Created by Shezan Baig on 1/30/2024 in #feedback

missing token counts

Hey @Marc / @Clemo - Thanks for the reply. So our setup is, we have trained the opensource models like mistral and llama2 and hosted these models using TGI which is huggingface's Text Generation Interface using a docker container. And I am hitting this TGI endpoint, so I need langfuse dashboard for these models.

5 replies