Skip to content

'NoneType' object has no attribute 'tool_calls' #662

@arty-hlr

Description

@arty-hlr

Using open-webui as backend, this is my config file:

CHAT_CACHE_PATH=/tmp/chat_cache
CACHE_PATH=/tmp/cache
CHAT_CACHE_LENGTH=100
CACHE_LENGTH=100
REQUEST_TIMEOUT=60
DEFAULT_MODEL=llama3.1:latest
DEFAULT_COLOR=magenta
ROLE_STORAGE_PATH=/home/peng/.config/shell_gpt/roles
DEFAULT_EXECUTE_SHELL_CMD=false
DISABLE_STREAMING=false
CODE_THEME=dracula
OPENAI_FUNCTIONS_PATH=/home/peng/.config/shell_gpt/functions
OPENAI_USE_FUNCTIONS=false
SHOW_FUNCTIONS_OUTPUT=false
API_BASE_URL=http://XX.XX.XX.XX:3000/api
PRETTIFY_MARKDOWN=true
USE_LITELLM=false
SHELL_INTERACTION=true
OS_NAME=auto
SHELL_NAME=auto
OPENAI_API_KEY=sk-XXXXXXXXXXXXXXXX

Running a simple command I get this error:
image

It seems to come from this script:

delta.get("tool_calls") if use_litellm else delta.tool_calls

This sounds related and could be a fix as somehow open webui's responses don't have a delta:

run-llama/llama_index#16570 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions