Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to control start of response to generate api #4518

Open
notasquid1938 opened this issue May 19, 2024 · 0 comments
Open

Add option to control start of response to generate api #4518

notasquid1938 opened this issue May 19, 2024 · 0 comments
Labels
feature request New feature or request

Comments

@notasquid1938
Copy link

Using openwebui for ollama or textgenwebui. you can control what the model's response begins with to steer it in a certain direction. It would be very helpful to have this built-in to the api. I have struggled to recreate this effect with the api by trying to include the model's response portion of the template in my initial prompt but have been unsuccessful so far.

@notasquid1938 notasquid1938 added the feature request New feature or request label May 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant