paull•6mo ago

Hi here. I'm trying to use langfuse with

Hi here. I'm trying to use langfuse with llamaindex but keep having this error as soon as I use parallelism (whereas all is good if I just have my query pipeline once at a time):

server  | An error occurred in _handle_span_events: not enough values to unpack (expected 2, got 1)
server  | Traceback (most recent call last):
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/utils/error_logging.py", line 14, in wrapper
server  |     return func(*args, **kwargs)
server  |            ^^^^^^^^^^^^^^^^^^^^^
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/llama_index/llama_index.py", line 498, in _handle_span_events
server  |     start_event, end_event = self.event_map[event_id]
server  |     ^^^^^^^^^^^^^^^^^^^^^^
server  | ValueError: not enough values to unpack (expected 2, got 1)
server  | An error occurred in _handle_span_events: 'NoneType' object has no attribute 'span'
server  | Traceback (most recent call last):
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/utils/error_logging.py", line 14, in wrapper
server  |     return func(*args, **kwargs)
server  |            ^^^^^^^^^^^^^^^^^^^^^
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/llama_index/llama_index.py", line 508, in _handle_span_events
server  |     span = parent.span(
server  |            ^^^^^^^^^^^
server  | AttributeError: 'NoneType' object has no attribute 'span'

server  | An error occurred in _handle_span_events: not enough values to unpack (expected 2, got 1)
server  | Traceback (most recent call last):
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/utils/error_logging.py", line 14, in wrapper
server  |     return func(*args, **kwargs)
server  |            ^^^^^^^^^^^^^^^^^^^^^
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/llama_index/llama_index.py", line 498, in _handle_span_events
server  |     start_event, end_event = self.event_map[event_id]
server  |     ^^^^^^^^^^^^^^^^^^^^^^
server  | ValueError: not enough values to unpack (expected 2, got 1)
server  | An error occurred in _handle_span_events: 'NoneType' object has no attribute 'span'
server  | Traceback (most recent call last):
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/utils/error_logging.py", line 14, in wrapper
server  |     return func(*args, **kwargs)
server  |            ^^^^^^^^^^^^^^^^^^^^^
server  |   File "/usr/local/lib/python3.11/site-packages/langfuse/llama_index/llama_index.py", line 508, in _handle_span_events
server  |     span = parent.span(
server  |            ^^^^^^^^^^^
server  | AttributeError: 'NoneType' object has no attribute 'span'

Does anyone have an idea? Thanks

1 Reply

hassiebp•6mo ago

Hi Paul, this is a known issue with LlamaIndex when run in concurrent environments. The LlamaIndex callbacks implementation we're depending on is not entirely concurrency-safe which leads to errors and incomplete/incorrect traces that mix up the events from the parallel executions. We have plans to move to the new LlamaIndex instrumentation module to support our integration soon, which hopefully addresses the concurrency issues as well.