Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pulling manifest...... #114

Open
Kannan665 opened this issue Jan 10, 2024 · 2 comments
Open

Pulling manifest...... #114

Kannan665 opened this issue Jan 10, 2024 · 2 comments

Comments

@Kannan665
Copy link

Every time, when I start the genai-stack using "docker compose --profile linux-gpu up", I am able to see the following stack of containers fired-up....

docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
a25d59ab30b3 ollama/ollama:latest "/bin/ollama serve" 8 minutes ago Up 8 minutes 11434/tcp genai-stack-llm-gpu-1
961a9c47f33f genai-stack-front-end "npm run dev" 10 minutes ago Up 54 seconds 0.0.0.0:8505->8505/tcp, :::8505->8505/tcp genai-stack-front-end-1
9f79929d20ca genai-stack-bot "streamlit run bot.p…" 10 minutes ago Up About a minute (healthy) 0.0.0.0:8501->8501/tcp, :::8501->8501/tcp genai-stack-bot-1
640e183a4b1f genai-stack-api "uvicorn api:app --h…" 10 minutes ago Up About a minute (healthy) 0.0.0.0:8504->8504/tcp, :::8504->8504/tcp genai-stack-api-1
e8c060ee60a1 genai-stack-loader "streamlit run loade…" 10 minutes ago Up About a minute (health: starting) 0.0.0.0:8502->8502/tcp, :::8502->8502/tcp, 0.0.0.0:8081->8080/tcp, :::8081->8080/tcp genai-stack-loader-1
9966fe097a20 genai-stack-pdf_bot "streamlit run pdf_b…" 10 minutes ago Up About a minute (healthy) 0.0.0.0:8503->8503/tcp, :::8503->8503/tcp genai-stack-pdf_bot-1
86e9733bb4ba genai-stack/pull-model:1.0 "bb -f pull_model.clj" 10 minutes ago Exited (0) About a minute ago genai-stack-pull-model-1
ea48c6568915 neo4j:5.11 "tini -g -- /startup…" 10 minutes ago Up 8 minutes (healthy) 0.0.0.0:7474->7474/tcp, :::7474->7474/tcp, 7473/tcp, 0.0.0.0:7687->7687/tcp, :::7687->7687/tcp genai-stack-database-1
f23d832a09e8 ollama/ollama:latest "/bin/ollama serve" 10 minutes ago Exited (0) 9 minutes ago 11434/tcp genai-stack-llm-1

But it repeats "pulling manifest" everytime.....
Am I missing something here?
Once the Pull model is completed in a running docker stack instance, should I commit any of the running docker containers?

Warm Regards............Kannan Rama

@matthieuml
Copy link
Contributor

You mean the download restart from zero at each startup?

It shouldn't do that, are you using docker compose down instead of docker compose stop by any chance, that would delete the container (and the model with it)?

If it is something else, I would add a mount volume, but it shouldn't be necessary... Are you still experiencing the issue?

@Kannan665
Copy link
Author

You mean the download restart from zero at each startup?

It shouldn't do that, are you using docker compose down instead of docker compose stop by any chance, that would delete the container (and the model with it)?

If it is something else, I would add a mount volume, but it shouldn't be necessary... Are you still experiencing the issue?

Thanks for your response, but I did not see it for almost 2 weeks......Today, I am trying the docker gen-ai stack again......Will check based on the inputs, given by you......

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants