kanundrum•8mo ago

Any pointers as to what could cause this

Any pointers as to what could cause this odd behaviour? (it's happening when I point to the hosted solution or self hosted)

3 Replies

Marc•8mo ago

can you share some example payload?

kanundrum•8mo ago

sure one sec apologies for the delay, I was making sure nothign sensitive was there then I noticed what pay be the issue but here is the payload

{
  "batch": [
    {
      "body": {
        "id": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x",
        "metadata": {
          "assistantId": "andbox",
          "assistantName": "test"
        },
        "public": false,
        "release": "",
        "sessionId": "",
        "tags": [
          "finance"
        ],
        "userId": "someid",
        "version": ""
      },
      "id": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x",
      "timestamp": "2024-01-26T17:16:36Z",
      "type": "trace-create"
    },
    {
      "body": {
        "id": "2bV9UoBDrBNGC26Olh29DQob9Qu",
        "parentObservationId": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x",
        "startTime": "2024-01-26T13:16:36.746526-04:00",
        "traceId": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x"
      },
      "id": "2bV9UoBDrBNGC26Olh29DQob9Qu",
      "timestamp": "2024-01-26T17:16:36Z",
      "type": "span-create"
    },
    {
      "body": {
        "completionStartTime": "2024-01-26T13:16:36.746581-04:00",
        "id": "2bV9UlbjpX4BTTSdYYo0R22hFSt",
        "input": [
          {
            "content": "some content",
            "role": "system"
          },
          {
            "content": "somequery",
            "role": "user"
          }
        ],
        "model": "gpt-3.5-turbo",
        "modelParameters": {
          "frequency_penalty": 0,
          "presence_penalty": 0,
          "temperature": 0,
          "top_p": 1
        },
        "parentObservationId": "2bV9UoBDrBNGC26Olh29DQob9Qu",
        "startTime": "2024-01-26T13:16:36.746581-04:00",
        "traceId": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x"
      },
      "id": "2bV9UlbjpX4BTTSdYYo0R22hFSt",
      "timestamp": "2024-01-26T17:16:36Z",
      "type": "generation-create"
    }
  ]
}

{
  "batch": [
    {
      "body": {
        "id": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x",
        "metadata": {
          "assistantId": "andbox",
          "assistantName": "test"
        },
        "public": false,
        "release": "",
        "sessionId": "",
        "tags": [
          "finance"
        ],
        "userId": "someid",
        "version": ""
      },
      "id": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x",
      "timestamp": "2024-01-26T17:16:36Z",
      "type": "trace-create"
    },
    {
      "body": {
        "id": "2bV9UoBDrBNGC26Olh29DQob9Qu",
        "parentObservationId": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x",
        "startTime": "2024-01-26T13:16:36.746526-04:00",
        "traceId": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x"
      },
      "id": "2bV9UoBDrBNGC26Olh29DQob9Qu",
      "timestamp": "2024-01-26T17:16:36Z",
      "type": "span-create"
    },
    {
      "body": {
        "completionStartTime": "2024-01-26T13:16:36.746581-04:00",
        "id": "2bV9UlbjpX4BTTSdYYo0R22hFSt",
        "input": [
          {
            "content": "some content",
            "role": "system"
          },
          {
            "content": "somequery",
            "role": "user"
          }
        ],
        "model": "gpt-3.5-turbo",
        "modelParameters": {
          "frequency_penalty": 0,
          "presence_penalty": 0,
          "temperature": 0,
          "top_p": 1
        },
        "parentObservationId": "2bV9UoBDrBNGC26Olh29DQob9Qu",
        "startTime": "2024-01-26T13:16:36.746581-04:00",
        "traceId": "2bV9Ua0eUVbNmJOFa5tGKvV2m4x"
      },
      "id": "2bV9UlbjpX4BTTSdYYo0R22hFSt",
      "timestamp": "2024-01-26T17:16:36Z",
      "type": "generation-create"
    }
  ]
}

This request is generated using the SDK generated by fern and I am seeing logs on docker "handling single event" etc so it seems like it works @Marc so I figured out the issue. I was setting the trace id as the parent observation id on the first level observations but this caused it not to show up in the hierarchy (it was saving it fine)

Marc•8mo ago

Awesome, glad that you figured this out and sorry for the slow response, the last days were a bit hectic to get the new release out Curious if you have any other feedback/ideas