-
Notifications
You must be signed in to change notification settings - Fork 72
Open
Description
hello??
im trying to run kimi-k2-thinking model at our local server.
but now 'docker model pull' is not working in my server.
as you can see, 'docker pull' works well. so i think 'model pull' does not use docker proxy.
how to solve this problem?
hellokang@localhost:~$ sudo docker model pull ai/kimi-k2-vllm:1T-thinking
Retrying download (attempt 1/3) in 1s...
Retrying download (attempt 2/3) in 2s...
Retrying download (attempt 3/3) in 4s...
Failed to pull model: failed to download after 3 retries: pulling ai/kimi-k2-vllm:1T-thinking failed with status 500 Internal Server Error: error while pulling model: reading model from registry: failed to pull model "ai/kimi-k2-vllm:1T-thinking": UNKNOWN - Get "https://index.docker.io/v2/": tls: failed to verify certificate: x509: certificate signed by unknown authority
hellokang@localhost:~$ sudo docker pull ai/kimi-k2-vllm:1T-thinking
1T-thinking: Pulling from ai/kimi-k2-vllm
WARNING: AI models are not supported by the Engine yet, did you mean to use "docker model pull/run" instead?
3735102c0af0: Downloading [> ] 2.097MB/9.809GB
fa2dd8ae5b5f: Already exists
e411c8ba5b11: Downloading [> ] 1.049MB/9.809GB
10ef5c61dacb: Downloading [> ] 2.097MB/9.809GB
1fc5a6c15aaa: Downloading [> ] 1.049MB/9.809GB
055b814232e4: Downloading [> ] 1.049MB/9.809GB
590d7f85ea05: Downloading [> ] 6.291MB/9.809GB
4cd98998e237: Downloading [> ] 2.097MB/9.809GB
50ddec1ca9f1: Downloading [> ] 1.049MB/9.809GB
562593af7257: Downloading [> ] 1.049MB/9.809GB
f694289ad0f5: Downloading [> ] 1.049MB/9.809GB
1cda7176b565: Downloading [> ] 6.291MB/9.809GB
ca1661d98434: Downloading [> ] 2.097MB/9.809GB
a537d379ca03: Downloading [> ] 3.146MB/9.809GB
bdc950d90d49: Downloading [> ] 1.049MB/9.809GB
a16fe7a9816d: Downloading [> ] 2.097MB/9.809GB
1a71d4bd3a73: Downloading [> ] 1.049MB/9.809GB
b1b7ebfe9ae0: Downloading [> ] 1.049MB/4.698GB
eace8de10915: Downloading [> ] 2.097MB/9.809GB
5ede8d1839e1: Downloading [> ] 2.097MB/9.809GB
1fb5ef3388d0: Downloading [> ] 3.146MB/9.809GB
cb792b1d2591: Downloading [> ] 2.097MB/9.809GB
710790827236: Downloading [> ] 2.097MB/9.809GB
bd56556b5d58: Downloading [> ] 3.146MB/9.809GB
c10121535372: Downloading [> ] 1.049MB/9.809GB
af87dadc5413: Downloading [> ] 1.049MB/9.809GB
8955c84469fe: Downloading [> ] 1.049MB/9.809GB
91c07e51cf58: Downloading [> ] 2.097MB/9.809GB
b09203a76184: Downloading [> ] 1.049MB/9.809GB
3478d49b25e9: Downloading [> ] 2.097MB/9.809GB
96ce2ddc9ff8: Downloading [> ] 2.097MB/9.809GB
b0d2c8ab656a: Downloading [> ] 2.097MB/9.809GB
e84f956e805f: Downloading [> ] 2.097MB/9.809GB
f3885c59a406: Downloading [> ] 1.049MB/9.809GB
2c7418ac88ff: Downloading [> ] 1.049MB/9.809GB
2f84512dd980: Downloading [> ] 1.049MB/9.809GB
ca84d3d21a5f: Downloading [> ] 2.097MB/9.809GB
08fe214f9a45: Already exists
f61221415ada: Downloading [> ] 2.097MB/9.809GB
855acdcee579: Downloading [> ] 5.243MB/9.809GB
766eb3b51f5b: Downloading [> ] 2.097MB/9.809GB
3a2fef1f7794: Downloading [> ] 7.34MB/9.809GB
031eabe44838: Downloading [> ] 2.097MB/9.809GB
149b930f77ca: Downloading [> ] 1.049MB/9.809GB
45a2dcd2e1ff: Downloading [> ] 1.049MB/9.809GB
bc62e7fcd818: Downloading [> ] 3.146MB/9.809GB
0bbecfe40a4e: Downloading [> ] 1.049MB/9.809GB
6695243bd3ce: Downloading [> ] 2.097MB/9.809GB
eb7591448d50: Downloading [> ] 2.097MB/9.809GB
be21402538fc: Downloading [> ] 1.049MB/9.809GB
bdbda5bb8ff9: Downloading [> ] 1.049MB/9.809GB
d9bae33588df: Downloading [> ] 1.049MB/9.809GB
3180accd136c: Downloading [> ] 1.049MB/9.809GB
a5188a70ebf7: Downloading [> ] 1.049MB/9.809GB
a777480170ce: Already exists
1b95d261d31f: Downloading [=> ] 20.97MB/995MB
8ed0c3abc189: Downloading [> ] 1.049MB/9.809GB
^Chellokang@localhost:~$
hellokang@localhost:~$ ^C
hellokang@localhost:~$
this is my server status (ubuntu 24.04)
hellokang@localhost:~$ sudo docker model version
Docker Model Runner version v1.0.3
Docker Engine Kind: Docker Engine
hellokang@localhost:~$ sudo docker version
Client: Docker Engine - Community
Version: 29.1.2
API version: 1.52
Go version: go1.25.5
Git commit: 890dcca
Built: Tue Dec 2 21:55:14 2025
OS/Arch: linux/amd64
Context: default
Server: Docker Engine - Community
Engine:
Version: 29.1.2
API version: 1.52 (minimum version 1.44)
Go version: go1.25.5
Git commit: de45c2a
Built: Tue Dec 2 21:55:14 2025
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: v2.2.0
GitCommit: 1c4457e00facac03ce1d75f7b6777a7a851e5c41
runc:
Version: 1.3.4
GitCommit: v1.3.4-0-gd6d73eb8
docker-init:
Version: 0.19.0
GitCommit: de40ad0
hellokang@localhost:~$ sudo docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
ad9005bf3833 docker/model-runner:latest-cuda "/app/model-runner" 2 hours ago Up 2 hours 127.0.0.1:12434->12434/tcp, 172.17.0.1:12434->12434/tcp docker-model-runner
hellokang@localhost:~$ sudo systemctl show --property=Environment docker
Environment=HTTP_PROXY=http://168.219.61.252:8080/ HTTPS_PROXY=http://168.219.61.252:8080/ "NO_PROXY=127.0.0.1,localhost,10.*.*.*, 165.213.*.*, 168.219.*.*, 202.20.*.*, 113.107.220.*"
hellokang@localhost:~$
Metadata
Metadata
Assignees
Labels
No labels