[Bug] 对话中使用图片报错

[CaffeineCM]

📦 部署环境

Docker

📌 软件版本

v1.22.26

💻 系统环境

Other Linux

🌐 浏览器

Edge

🐛 问题描述

当我在对话中使用图片得到以下报错
{
"error": {
"code": "invalid_image_url",
"type": "invalid_request_error",
"param": "",
"message": "Error while downloading http://192.168.x.xxx:9000/lobe/files/480463/c5f2ac82-953c-4594-830e-6f9cefca02b8.png. (request id: 2024102307175920149166410055977) (request id: 2024102307172919437048602547446)"
},
"endpoint": "https://ai****ix.com/v1",
"provider": "openai"
}

当我使用浏览器,根据错误信息中的url去访问时,图片能够正常访问

📷 复现步骤

No response

🚦 期望结果

No response

📝 补充信息

No response

[lobehubbot]

👀 @CaffeineCM

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

📦 Deployment environment

Docker

📌 Software version

1.22.17

💻 System environment

Other Linux

🌐 Browser

Edge

🐛 Problem description

When I use an image in a conversation I get the following error
{
"error": {
"code": "invalid_image_url",
"type": "invalid_request_error",
"param": "",
"message": "Error while downloading http://192.168.x.xxx:9000/lobe/files/480463/c5f2ac82-953c-4594-830e-6f9cefca02b8.png. (request id: 2024102307175920149166410055977) (request id: 2024102307172919437048602547446) "
},
"endpoint": "https://ai****ix.com/v1",
"provider": "openai"
}

When I use the browser to access according to the URL in the error message, the image can be accessed normally.

📷 Steps to reproduce

No response

🚦 Expected results

No response

📝 Supplementary information

No response

[dosubot]

@CaffeineCM 你好！我是 Dosu，一个可以帮助你解决 bug、回答问题并成为贡献者的机器人。我会在等待人类维护者处理你的问题时提供帮助。

I found a similar issue related to handling image URLs in the lobe-chat framework. The framework converts image URLs to base64 format internally, and an 'invalid_image_url' error can occur if the URL does not conform to expected formats or cannot be processed correctly. This might happen if the URL does not result in a valid base64 conversion or if the URL type is not recognized ^[1].

To resolve a similar issue, it was suggested to add an environment variable LLM_VISION_IMAGE_USE_BASE64=1. This might help in resolving the "invalid image" problem ^[2].

To continue talking to Dosu, mention @dosu.

[CaffeineCM]

我的部署参考该文档https://lobehub.com/zh/docs/self-hosting/server-database/docker-compose
后续使用的发布到生产（IP 模式）步骤进行,仅仅只替换了局域网ip

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

My deployment refers to this document https://lobehub.com/zh/docs/self-hosting/server-database/docker-compose
The subsequent steps of publishing to production (IP mode) are carried out, only the LAN IP is replaced.

[arvinxx]

试试 LLM_VISION_IMAGE_USE_BASE64=1

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Try LLM_VISION_IMAGE_USE_BASE64=1

[CaffeineCM]

试试LLM_VISION_IMAGE_USE_BASE64=1

我在排查问题的时候看到了这个解决方案,然后确认了一下配置文件,发现本来就是存在这个参数的

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Try LLM_VISION_IMAGE_USE_BASE64=1

I saw this solution when I was troubleshooting the problem, and then I checked the configuration file and found that this parameter already existed.

[CaffeineCM]

更新到最新版本 v1.22.26仍然存在该问题

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Updated to the latest version v1.22.26 and the problem still exists

[SpeedupMaster]

MINIO_LOBE_BUCKET=lobe 改成MINIO_LOBE_BUCKET=casdoor 试试

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Change MINIO_LOBE_BUCKET=lobe to MINIO_LOBE_BUCKET=casdoor and try

[CaffeineCM]

MINIO_LOBE_BUCKET=lobe 改成MINIO_LOBE_BUCKET=casdoor 试试

感觉你提供的方法,但是刚刚我尝试过了,这样修改不行,并且用报错的信息去访问无法访问到图片,需要将url中的casdoor改为lobe才能访问到

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Change MINIO_LOBE_BUCKET=lobe to MINIO_LOBE_BUCKET=casdoor and try

I feel like the method you provided, but I just tried it. This modification does not work, and the image cannot be accessed using the error message. You need to change the casdoor in the URL to lobe to access it.

[SpeedupMaster]

新的Access Key 和 Secret Key有在.env里面更改吗？

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Have the new Access Key and Secret Key been changed in .env?

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

lobe

No changes, I just replaced the IP

[CaffeineCM]

新的Access Key 和 Secret Key有在.env里面更改吗？

没有改,我就只替换了ip

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

新的Access Key 和Has the Secret Key been changed in .env?

No changes, I just replaced the IP

[CaffeineCM]

新的Access Key 和 Secret Key有在.env里面更改吗？

我看文档中的意思,理解成了:如果不需要用户自行修改头像,后续步骤就不用管了

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

 New Access Have the Key and Secret Key been changed in .env?

I read the meaning in the document and understood it to be: If the user does not need to modify the avatar by himself, there is no need to worry about the subsequent steps.

[CaffeineCM]

新的Access Key 和 Secret Key有在.env里面更改吗？

按照教程配置了,.env里也替换了新的Access Key 和 Secret Key,桶名在.env和casdoor中都配置为lobe,仍然有同样的问题

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

 Have the new Access Key and Secret Key been changed in .env?

I configured it according to the tutorial, and replaced the new Access Key and Secret Key in .env. The bucket name was configured as lobe in both .env and casdoor, but I still have the same problem.

[SpeedupMaster]

新的Access Key 和 Secret Key有在.env里面更改吗？

按照教程配置了,.env里也替换了新的Access Key 和 Secret Key,桶名在.env和casdoor中都配置为lobe,仍然有同样的问题

直接用localhost有没有问题？

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

! [Image] (https://private- user-images.githubuserContent.com/130642629/379697158-889259ee-2C53-4263-73D29B5Ca8ef.png?jwt=ey JHBGCIOJIUZIISINR5CCI6IKPXVCJ9.EYJPC3MIOIJNAXRODWIUY29TIIWIY XVKIJOICMF3LMDPDGH1YNVZZZCCIIJNAXRODWIUY29TIIGH1YNLMNVBSVBSIMTLETUILCJLE Haioje3mjk3nji1ndusim5izii6MTCyotc2MJI0NSWICGF0ACI6II8XMZA2NDI 2MJKVMZC5NJK3MTG4OTG4oti1VlltjNDM2Ltczzdi5yjvjy Thlzi5WBMC_WC_WC_WC_WCQWXNB3JPDGHTGHTPUFXUZQTSE1BQY1TSEEYMWC1BBXOTQ3JLZGLHBD1BS0LBVKNPRFLMUYRJQXMDI0jtjg DXMTZWFZDC0XJGCZMLMKZHD3M0X3JLCXVLC3QMWC1BBXOTRGF0ZT0YMDI0MT AynfQWOTMWNDVAJLGTQW16CGLYZXM9MZAW16LVNPZ25HDHVYZT1L Yjblmdkzzja1zwq3mjfkzthinTiwzte3nMu0ymvin2u3mdzmzjjkmmm3y2jintbi IWizrmhwmqlr-Oooskc-RXXFE4312GZ- p_0) Have the new Access Key and Secret Key been changed in .env?

Configured according to the tutorial, replaced the new Access Key and Secret Key in .env, and configured the bucket name as lobe in both .env and casdoor, but still have the same problem

Is there any problem using localhost directly?

[SpeedupMaster]

我在VPS上用IP试了下没问题

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I tried using IP on VPS and it worked fine.

[CaffeineCM]

我在VPS上用IP试了下没问题

我全部重新部署试一下，感谢您的解答

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I tried using IP on VPS and it worked fine.

I'll redeploy everything and give it a try. Thank you for your answer.

[CaffeineCM]

我在VPS上用IP试了下没问题

请问一下是否需要ip为公网ip呢，我是局域网部署的，刚刚重新部署了一下，发现仍然存在这个问题。哪怕我将桶设置为public都不行

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I tried using IP on VPS and it worked fine.

I would like to ask if the IP needs to be a public IP. I deployed it on the LAN. I just redeployed it and found that this problem still exists. It doesn't work even if I set the bucket to public

[SpeedupMaster]

我在VPS上用IP试了下没问题

请问一下是否需要ip为公网ip呢，我是局域网部署的，刚刚重新部署了一下，发现仍然存在这个问题。哪怕我将桶设置为public都不行

局域网就不太清楚了，没试过

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I tried using IP on VPS and it worked fine.

I would like to ask if the IP needs to be a public IP. I deployed it on the LAN. I just redeployed it and found that this problem still exists. It doesn't work even if I set the bucket to public

I'm not sure about the LAN, I haven't tried it yet.

[CaffeineCM]

我在VPS上用IP试了下没问题

请问一下是否需要ip为公网ip呢，我是局域网部署的，刚刚重新部署了一下，发现仍然存在这个问题。哪怕我将桶设置为public都不行

局域网就不太清楚了，没试过

您好，我刚试了一下，确实是局域网的问题，我将minio的端口开公网，docker-compose.yml中的lobe.environment中minio相关的ip改为域名，casdoor也改为域名，再次尝试对话，能够成功解析。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I tried using IP on VPS and it worked fine.

I would like to ask if the IP needs to be a public IP. I deployed it on the LAN. I just redeployed it and found that this problem still exists. It doesn't work even if I set the bucket to public

I’m not sure about LAN, I haven’t tried it yet

Hello, I just tried it, and it is indeed a LAN problem. I opened the minio port to the public network, changed the minio-related IP in lobe.environment in docker-compose.yml to the domain name, and changed the casdoor to the domain name. Again Try the conversation and it can be parsed successfully.

[lobehubbot]

✅ @CaffeineCM

This issue is closed, If you have any questions, you can comment and reply.
此问题已经关闭。如果您有任何问题，可以留言并回复。

[CaffeineCM]

@arvinxx 您好，这个问题已经找到解决方案，但是对没有公网ip的小伙伴来说，明显不是很友好，辛苦看下能否优化一下这个问题

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

@arvinxx Hello, a solution has been found for this problem, but it is obviously not very friendly to friends who do not have a public IP address. Let’s see if we can optimize this problem.

[arvinxx]

LLM_VISION_IMAGE_USE_BASE64=1 这个应该有用的吧，你是不是开启了客户端请求额

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

LLM_VISION_IMAGE_USE_BASE64=1 This should be useful. Have you enabled the client request amount?

[arvinxx]

相关参考：#3888

[CaffeineCM]

LLM_VISION_IMAGE_USE_BASE64=1 这个应该有用的吧，你是不是开启了客户端请求额

是开了,我试一下关掉公网ip映射,关掉客户端请求试试看

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

LLM_VISION_IMAGE_USE_BASE64=1 This should be useful. Have you enabled the client request amount?

It is enabled. Let me try turning off the public IP mapping and turning off client requests.

[CaffeineCM]

LLM_VISION_IMAGE_USE_BASE64=1 这个应该有用的吧，你是不是开启了客户端请求额

确实,是客户端请求的问题,感谢

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

LLM_VISION_IMAGE_USE_BASE64=1 This should be useful. Have you enabled the client request amount?

Indeed, it is a problem with the client request, thank you