You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is already possible to integrate Cloudflare Workers AI with LibreChat by configuring a custom AI provider through the LiteLLM proxy. This translates the OpenAI style calls into something the Workers AI API can understand.
Cloudflare worker AI has official OpenAI compatible API support.
However, I always encounter the problem The response is incomplete; it's either still processing, was cancelled, or censored. Refresh or try a different prompt.
I dont's know what's wrong.
Here's my librechat.yaml config
- name: 'WorkerAI'apiKey: '${WORKERAI_KEY}'baseURL: 'https://api.cloudflare.com/client/v4/accounts/{my account id}/ai/v1'models:
default: ["@cf/qwen/qwen1.5-14b-chat-awq","@hf/meta-llama/meta-llama-3-8b-instruct",]fetch: falsetitleConvo: truetitleModel: 'cf/qwen/qwen1.5-14b-chat-awq'# Recommended: Drop the stop parameter from the request as Openrouter models use a variety of stop tokens.dropParams: ['stop']modelDisplayLabel: 'Worker AI'
What features would you like to see added?
Add support for chat models, but also embedding, image-generating, tts, etc. via plugin for Cloudflare Workers AI
More details
Cloudflare provides various AI models as well as generous free allocation.
Which components are impacted by your request?
Endpoints
Pictures
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: