-
Notifications
You must be signed in to change notification settings - Fork 4.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: APIError: litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable #6124
Comments
Could you please add |
sure,I'm just a student and a bit stupid. I hope I haven't bothered you. log:
When things are working, initialize a github repo, create ============== 17:21:42 - openhands:DEBUG: logger.py:332 - Logging to /app/logs/llm/25-01-07_17-21/prompt_001.log Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:21:42 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #1 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:21:57 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #2 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:22:12 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #3 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:22:27 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #4 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:22:43 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #5 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:23:15 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #6 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:24:19 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #7 | You can customize retry values in the configuration. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new Traceback (most recent call last): During handling of the above exception, another exception occurred: Traceback (most recent call last): During handling of the above exception, another exception occurred: Traceback (most recent call last): |
From the log:
Also, the model you chose in the web settings is Claude Sonnet? I wasn't aware Azure hosted Sonnet, but it makes some sense. 😅 So please confirm: you're trying to use Azure, and on your Azure account, you want to use Claude Sonnet? |
I've already switched to GPT-o1-preview-0912, but it still shows Claude-3-5-Sonnet-20241022. You can see that both of them appear in my logs.:( log: Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new 17:58:56 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #3 | You can customize retry values in the configuration. , obs=IPythonRunCellObservation
|
Oh okay, that use of two models must be a bug on our side. It seems it's happening after the main LLM got an error. That might help us right now, so we can make it work for you first. 🤔 About making Azure work: please take a look at https://docs.all-hands.dev/modules/usage/llms/azure-llms The relevant part is: please use Advanced Options in the settings window, and set as model name, the deployment name, and also add a base URL, your Azure URL. |
i am a stupid dog.i should go to the bed.i am so sorry,i will confirm it as you say when i am awake.i am so sorry,my english is so bad.:( |
Is there an existing issue for the same bug?
Describe the bug and reproduction steps
docker pull docker.all-hands.dev/all-hands-ai/runtime:0.17-nikolaik
docker run -it --rm --pull=always
-e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:0.17-nikolaik
-e LOG_ALL_EVENTS=true
-v /var/run/docker.sock:/var/run/docker.sock
-v ~/.openhands-state:/.openhands-state
-p 3000:3000
--add-host host.docker.internal:host-gateway
--name openhands-app
docker.all-hands.dev/all-hands-ai/openhands:0.17
OpenHands Installation
Docker command in README
OpenHands Version
0.17
Operating System
MacOS
Logs, Errors, Screenshots, and Additional Context
screenshots:
![image](https://private-user-images.githubusercontent.com/135600783/400855915-d0803995-a41e-4853-bcd9-2ccf778c5534.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzYzNTkxNTUsIm5iZiI6MTczNjM1ODg1NSwicGF0aCI6Ii8xMzU2MDA3ODMvNDAwODU1OTE1LWQwODAzOTk1LWE0MWUtNDg1My1iY2Q5LTJjY2Y3NzhjNTUzNC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMTA4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDEwOFQxNzU0MTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hODBlNzA1ODI2ZWQ3YjMwNGMwMmIzOGE3MDk0Nzg3YzlhNDlmMWFkNTA3MjIwZGQ5YTE3OWY4MDM1YTBlNjg0JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.BiQhZipJFqvpJQBghXgajHpsylMfLkUdypYl2r2-rfM)
logs:
17:02:51 - openhands:INFO: manager.py:395 - _cleanup_session:707b2463b1f54e3cb6cffaeb3a9915bc
17:02:51 - openhands:INFO: manager.py:419 - _close_session:707b2463b1f54e3cb6cffaeb3a9915bc
17:02:51 - openhands:INFO: manager.py:427 - removing connections: []
17:02:51 - openhands:INFO: manager.py:436 - closing_session:707b2463b1f54e3cb6cffaeb3a9915bc
17:02:51 - openhands:INFO: agent_controller.py:347 - [Agent Controller 707b2463b1f54e3cb6cffaeb3a9915bc] Setting agent(CodeActAgent) state from AgentState.ERROR to AgentState.STOPPED
17:02:56 - openhands:INFO: manager.py:446 - closed_session:707b2463b1f54e3cb6cffaeb3a9915bc
17:02:59 - openhands:INFO: eventstream_runtime.py:200 - [runtime f96b1af5391d41c89adef490bde25416] Runtime is ready.
17:02:59 - openhands:ERROR: base.py:231 - [runtime f96b1af5391d41c89adef490bde25416] Failed to read openhands_instructions
17:02:59 - openhands:INFO: base.py:239 - [runtime f96b1af5391d41c89adef490bde25416] Found 0 custom microagents.
17:02:59 - openhands:INFO: agent_controller.py:204 - [Agent Controller f96b1af5391d41c89adef490bde25416] Starting step loop...
17:02:59 - openhands:INFO: agent_controller.py:347 - [Agent Controller f96b1af5391d41c89adef490bde25416] Setting agent(CodeActAgent) state from AgentState.LOADING to AgentState.INIT
17:02:59 - OBSERVATION
[Agent Controller f96b1af5391d41c89adef490bde25416] AgentStateChangedObservation(content='', agent_state=<AgentState.INIT: 'init'>, observation='agent_state_changed')
17:02:59 - OBSERVATION
[Agent Controller f96b1af5391d41c89adef490bde25416] NullObservation(content='', observation='null')
17:02:59 - USER_ACTION
[Agent Controller f96b1af5391d41c89adef490bde25416] MessageAction (source=EventSource.USER)
CONTENT: I want to create a VueJS app that allows me to:
This should be a client-only app with no backend. The list should persist in localStorage.
Please add tests for all of the above and make sure they pass
17:02:59 - openhands:INFO: agent_controller.py:347 - [Agent Controller f96b1af5391d41c89adef490bde25416] Setting agent(CodeActAgent) state from AgentState.INIT to AgentState.RUNNING
17:02:59 - OBSERVATION
[Agent Controller f96b1af5391d41c89adef490bde25416] AgentStateChangedObservation(content='', agent_state=<AgentState.RUNNING: 'running'>, observation='agent_state_changed')
17:02:59 - OBSERVATION
[Agent Controller f96b1af5391d41c89adef490bde25416] NullObservation(content='', observation='null')
17:02:59 - openhands:INFO: manager.py:175 - Conversation f96b1af5391d41c89adef490bde25416 connected in 0.07944011688232422 seconds
17:02:59 - openhands:INFO: manager.py:157 - Reusing active conversation f96b1af5391d41c89adef490bde25416
INFO: 172.17.0.1:58802 - "GET /api/conversations/f96b1af5391d41c89adef490bde25416/vscode-url HTTP/1.1" 200 OK
INFO: 172.17.0.1:58810 - "GET /api/conversations/f96b1af5391d41c89adef490bde25416/list-files HTTP/1.1" 200 OK
==============
[Agent Controller f96b1af5391d41c89adef490bde25416] LEVEL 0 LOCAL STEP 0 GLOBAL STEP 0
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
17:03:00 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #1 | You can customize retry values in the configuration.
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
17:03:15 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #2 | You can customize retry values in the configuration.
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
17:03:30 - openhands:ERROR: retry_mixin.py:47 - litellm.APIError: AzureException APIError - argument of type 'NoneType' is not iterable. Attempt #3 | You can customize retry values in the configuration.
The text was updated successfully, but these errors were encountered: