I have some flows on Flowise that I am
I have some flows on Flowise that I am monitoring on Langfuse (and langsmith) and I'm trying to track the token costs. As far as I can tell whether I'm working with Open AI or Anthropic the token usage I'm seeing in Langfuse is at least half of what I'm being charged in Open AI or Anthropic dashboards.
Am I going insane or is there likely something obvious I would be missing?
I've tested this so far with assistants (this seems very problematic for costing anyway), agent flows and for normal conversation chains.
There is very little detailed data available in the Open AI dashboard to figure out exactly whats happening, so I'm doing short tests and then downloading the CSVs to try and pick through things.
Any advice on debugging this or general feedback on approaching tracking costs is appreciated!
Right now it really is hard to think I'm not just being scammed in some way 🙂
1 Reply
did you ever figure this out? @pw I'm seeing some major differences between openai token usage and anthropic major usage for the same api calls