Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I'm unable to use the pdf_bot using AWS claudev2 #145

Open
SAGE-Rebirth opened this issue Mar 21, 2024 · 0 comments
Open

I'm unable to use the pdf_bot using AWS claudev2 #145

SAGE-Rebirth opened this issue Mar 21, 2024 · 0 comments

Comments

@SAGE-Rebirth
Copy link

SAGE-Rebirth commented Mar 21, 2024

ValueError: Error raised by inference endpoint: An error occurred (AccessDeniedException) when calling the InvokeModel operation: You don't have access to the model with the specified model ID

File "/usr/local/lib/python3.11/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 535, in _run_script
exec(code, module.dict)
File "/app/pdf_bot.py", line 95, in
main()
File "/app/pdf_bot.py", line 72, in main
vectorstore = Neo4jVector.from_texts(
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/langchain_community/vectorstores/neo4j_vector.py", line 679, in from_texts
embeddings = embedding.embed_documents(list(texts))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/langchain_community/embeddings/bedrock.py", line 169, in embed_documents
response = self._embedding_func(text)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/langchain_community/embeddings/bedrock.py", line 150, in _embedding_func
raise ValueError(f"Error raised by inference endpoint: {e}")

I'm facing this error when I'm running the pdf_bot app. I've got the access to the claudev2 model from AWS still it's showing the above mentioned error.

[P.S I'm using Windows, and as discussed in #123 I've made some changes in my docker-compose.yml]

Here's the copy of the .env file -

OLLAMA_BASE_URL=http://host.docker.internal:11434
NEO4J_URI=neo4j://database:7687
NEO4J_USERNAME=neo4j
NEO4J_PASSWORD=password
LLM=claudev2
EMBEDDING_MODEL=aws
AWS_ACCESS_KEY_ID=[I've have provided it but I can't share this]
AWS_SECRET_ACCESS_KEY=[I've have provided it but I can't share this]
AWS_DEFAULT_REGION=us-east-1

image

@SAGE-Rebirth SAGE-Rebirth changed the title I'm unable to use the pdf_bot. I'm unable to use the pdf_bot using AWS claudev2 Mar 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant