gokusan Comments - Langfuse

With that said, the point is more about having cost always being in the same place in the DB. whether user provides actual cost, or the $/token and you calculate it im indifferent

17 replies

LLangfuse

•Created by gokusan on 12/24/2023 in #feature-suggestion

Flexible cost calculation

If user provides it, then just use that. If user doesnt provide it, then try to auto calculate cost using YOUR formulas

17 replies

LLangfuse

•Created by gokusan on 12/24/2023 in #feature-suggestion

Flexible cost calculation

I think it wld make more sense to allow users to add a "prompt_cost" and "completion_cost" to the Usage object (or Cost object or something)

17 replies

LLangfuse

•Created by gokusan on 12/24/2023 in #feature-suggestion

Flexible cost calculation

your auto cost calculation should only happen if the user doesn't already provide a cost.

17 replies

LLangfuse

•Created by gokusan on 12/24/2023 in #feature-suggestion

Flexible cost calculation

hope that clarifies it

17 replies

LLangfuse

•Created by gokusan on 12/24/2023 in #feature-suggestion

Flexible cost calculation

In 1 year, I want to be able to easily do something like "select sum(cost) from generations" or something like that, whether YOU calculated the cost or I did. I don't want to have to pull cost data wherever YOU stored it for your known models,. and have a different pull like "select sum(metadata['custom_cost_calculation) from generations"

17 replies

LLangfuse

•Created by gokusan on 12/24/2023 in #feature-suggestion

Flexible cost calculation

I think my pain is more to have 1 single place in your data model to store the costs, whether YOU calculate it, or the user does

17 replies