Skip to content

Unable to use 'docker model pull' #500

@s2473g

Description

@s2473g

hello??

im trying to run kimi-k2-thinking model at our local server.
but now 'docker model pull' is not working in my server.
as you can see, 'docker pull' works well. so i think 'model pull' does not use docker proxy.
how to solve this problem?

hellokang@localhost:~$ sudo docker model pull ai/kimi-k2-vllm:1T-thinking
Retrying download (attempt 1/3) in 1s...
Retrying download (attempt 2/3) in 2s...
Retrying download (attempt 3/3) in 4s...
Failed to pull model: failed to download after 3 retries: pulling ai/kimi-k2-vllm:1T-thinking failed with status 500 Internal Server Error: error while pulling model: reading model from registry: failed to pull model "ai/kimi-k2-vllm:1T-thinking": UNKNOWN - Get "https://index.docker.io/v2/": tls: failed to verify certificate: x509: certificate signed by unknown authority

hellokang@localhost:~$ sudo docker pull ai/kimi-k2-vllm:1T-thinking
1T-thinking: Pulling from ai/kimi-k2-vllm
WARNING: AI models are not supported by the Engine yet, did you mean to use "docker model pull/run" instead?
3735102c0af0: Downloading [>                                                  ]  2.097MB/9.809GB
fa2dd8ae5b5f: Already exists
e411c8ba5b11: Downloading [>                                                  ]  1.049MB/9.809GB
10ef5c61dacb: Downloading [>                                                  ]  2.097MB/9.809GB
1fc5a6c15aaa: Downloading [>                                                  ]  1.049MB/9.809GB
055b814232e4: Downloading [>                                                  ]  1.049MB/9.809GB
590d7f85ea05: Downloading [>                                                  ]  6.291MB/9.809GB
4cd98998e237: Downloading [>                                                  ]  2.097MB/9.809GB
50ddec1ca9f1: Downloading [>                                                  ]  1.049MB/9.809GB
562593af7257: Downloading [>                                                  ]  1.049MB/9.809GB
f694289ad0f5: Downloading [>                                                  ]  1.049MB/9.809GB
1cda7176b565: Downloading [>                                                  ]  6.291MB/9.809GB
ca1661d98434: Downloading [>                                                  ]  2.097MB/9.809GB
a537d379ca03: Downloading [>                                                  ]  3.146MB/9.809GB
bdc950d90d49: Downloading [>                                                  ]  1.049MB/9.809GB
a16fe7a9816d: Downloading [>                                                  ]  2.097MB/9.809GB
1a71d4bd3a73: Downloading [>                                                  ]  1.049MB/9.809GB
b1b7ebfe9ae0: Downloading [>                                                  ]  1.049MB/4.698GB
eace8de10915: Downloading [>                                                  ]  2.097MB/9.809GB
5ede8d1839e1: Downloading [>                                                  ]  2.097MB/9.809GB
1fb5ef3388d0: Downloading [>                                                  ]  3.146MB/9.809GB
cb792b1d2591: Downloading [>                                                  ]  2.097MB/9.809GB
710790827236: Downloading [>                                                  ]  2.097MB/9.809GB
bd56556b5d58: Downloading [>                                                  ]  3.146MB/9.809GB
c10121535372: Downloading [>                                                  ]  1.049MB/9.809GB
af87dadc5413: Downloading [>                                                  ]  1.049MB/9.809GB
8955c84469fe: Downloading [>                                                  ]  1.049MB/9.809GB
91c07e51cf58: Downloading [>                                                  ]  2.097MB/9.809GB
b09203a76184: Downloading [>                                                  ]  1.049MB/9.809GB
3478d49b25e9: Downloading [>                                                  ]  2.097MB/9.809GB
96ce2ddc9ff8: Downloading [>                                                  ]  2.097MB/9.809GB
b0d2c8ab656a: Downloading [>                                                  ]  2.097MB/9.809GB
e84f956e805f: Downloading [>                                                  ]  2.097MB/9.809GB
f3885c59a406: Downloading [>                                                  ]  1.049MB/9.809GB
2c7418ac88ff: Downloading [>                                                  ]  1.049MB/9.809GB
2f84512dd980: Downloading [>                                                  ]  1.049MB/9.809GB
ca84d3d21a5f: Downloading [>                                                  ]  2.097MB/9.809GB
08fe214f9a45: Already exists
f61221415ada: Downloading [>                                                  ]  2.097MB/9.809GB
855acdcee579: Downloading [>                                                  ]  5.243MB/9.809GB
766eb3b51f5b: Downloading [>                                                  ]  2.097MB/9.809GB
3a2fef1f7794: Downloading [>                                                  ]   7.34MB/9.809GB
031eabe44838: Downloading [>                                                  ]  2.097MB/9.809GB
149b930f77ca: Downloading [>                                                  ]  1.049MB/9.809GB
45a2dcd2e1ff: Downloading [>                                                  ]  1.049MB/9.809GB
bc62e7fcd818: Downloading [>                                                  ]  3.146MB/9.809GB
0bbecfe40a4e: Downloading [>                                                  ]  1.049MB/9.809GB
6695243bd3ce: Downloading [>                                                  ]  2.097MB/9.809GB
eb7591448d50: Downloading [>                                                  ]  2.097MB/9.809GB
be21402538fc: Downloading [>                                                  ]  1.049MB/9.809GB
bdbda5bb8ff9: Downloading [>                                                  ]  1.049MB/9.809GB
d9bae33588df: Downloading [>                                                  ]  1.049MB/9.809GB
3180accd136c: Downloading [>                                                  ]  1.049MB/9.809GB
a5188a70ebf7: Downloading [>                                                  ]  1.049MB/9.809GB
a777480170ce: Already exists
1b95d261d31f: Downloading [=>                                                 ]  20.97MB/995MB
8ed0c3abc189: Downloading [>                                                  ]  1.049MB/9.809GB
^Chellokang@localhost:~$
hellokang@localhost:~$ ^C
hellokang@localhost:~$

this is my server status (ubuntu 24.04)

hellokang@localhost:~$ sudo docker model version
Docker Model Runner version v1.0.3
Docker Engine Kind: Docker Engine
hellokang@localhost:~$ sudo docker version
Client: Docker Engine - Community
 Version:           29.1.2
 API version:       1.52
 Go version:        go1.25.5
 Git commit:        890dcca
 Built:             Tue Dec  2 21:55:14 2025
 OS/Arch:           linux/amd64
 Context:           default

Server: Docker Engine - Community
 Engine:
  Version:          29.1.2
  API version:      1.52 (minimum version 1.44)
  Go version:       go1.25.5
  Git commit:       de45c2a
  Built:            Tue Dec  2 21:55:14 2025
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          v2.2.0
  GitCommit:        1c4457e00facac03ce1d75f7b6777a7a851e5c41
 runc:
  Version:          1.3.4
  GitCommit:        v1.3.4-0-gd6d73eb8
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
hellokang@localhost:~$ sudo docker ps
CONTAINER ID   IMAGE                             COMMAND               CREATED       STATUS       PORTS                                                     NAMES
ad9005bf3833   docker/model-runner:latest-cuda   "/app/model-runner"   2 hours ago   Up 2 hours   127.0.0.1:12434->12434/tcp, 172.17.0.1:12434->12434/tcp   docker-model-runner
hellokang@localhost:~$ sudo systemctl show --property=Environment docker
Environment=HTTP_PROXY=http://168.219.61.252:8080/ HTTPS_PROXY=http://168.219.61.252:8080/ "NO_PROXY=127.0.0.1,localhost,10.*.*.*, 165.213.*.*, 168.219.*.*, 202.20.*.*, 113.107.220.*"
hellokang@localhost:~$

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions