Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openai.InternalServerError: Error code: 500 - {'error': "'NoneType' object is not iterable"} #182

Open
HAOYON-666 opened this issue Jan 10, 2025 · 2 comments

Comments

@HAOYON-666
Copy link

HAOYON-666 commented Jan 10, 2025

image
image

I used the official code provided above and encountered this error on the client side:
Traceback (most recent call last):
File "/data/workspace/zhaoyong/model/VILA/infer.py", line 12, in
response = client.chat.completions.create(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_utils/_utils.py", line 271, in wrapper
return func(*args, **kwargs)
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/resources/chat/completions.py", line 648, in create
return self._post(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 1167, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 856, in request
return self._request(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 932, in _request
return self._retry_request(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 980, in _retry_request
return self._request(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 932, in _request
return self._retry_request(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 980, in _retry_request
return self._request(
File "/home/user/miniconda3/envs/VILA/lib/python3.10/site-packages/openai/_base_client.py", line 947, in _request
raise self._make_status_error_from_response(err.response) from None
openai.InternalServerError: Error code: 500 - {'error': "'NoneType' object is not iterable"}

May I ask where the problem lies? Is there a solution? Urgent, urgent! thank you!

@HAOYON-666 HAOYON-666 changed the title openai.InternalServerError: Error code: 500 - {'error': 'Invalid style: SeparatorStyle.AUTO'} openai.InternalServerError: Error code: 500 - {'error': "'NoneType' object is not iterable"} Jan 10, 2025
@Lyken17
Copy link
Collaborator

Lyken17 commented Jan 11, 2025

NVILA the docker image and serving scripts is not updated to support yet. Please stay tuned

@HAOYON-666
Copy link
Author

HAOYON-666 commented Jan 14, 2025

NVILA the docker image and serving scripts is not updated to support yet. Please stay tuned

I debugged some of the code and found that the function in the code /VILA/llava/model/lava_arch.py passed an empty value during iteration. How can I modify it?
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants