So i kind of took a look at the code and if i am not mistaken, are you not sending the tool list when using a local llm?
are you sending the tools as
messages=[{"role": "user", "content": "What is the weather like in Paris today?"}], tools=tools or is the tools like this?
messages=[{"role": "user", "content": "What is the weather like in Paris today?", "role": "tools", "content":"{{tool_list}}"}]