Skip to content

Conversation

@alosslessdev
Copy link
Contributor

Specify that it's for pre sycl hardware

Specify that it's for pre sycl hardware
@github-actions github-actions bot added the documentation Improvements or additions to documentation label Dec 14, 2025
@alosslessdev alosslessdev changed the title added note for pre SYCL Intel hardware on opencl added note for pre SYCL Intel hardware Dec 14, 2025
@taronaeo taronaeo added the OpenCL Issues specific to the OpenCL backend label Dec 14, 2025
Copy link
Collaborator

@NeoZhangJianyu NeoZhangJianyu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In OpenCL.md, the target hardware is Qualcomm GPU. No other GPUs in the scope and verified list, why you could say it supports Intel GPU?

I know OpenCL backend has supported some Intel GPU, but now you have removed it from the support list.

After you promise it, then update the doc. Instead of revert.

@savvadesogle
Copy link

I know OpenCL backend has supported some Intel GPU

изображение

C:\dev\llama_opencl\llama.cpp\build\bin\Release>llama-bench -m T:\models\lmstudio-community\gpt-oss-20b-GGUF\gpt-oss-20b-MXFP4.gguf -ngl 100 -fa 0,1
ggml_opencl: selected platform: 'Intel(R) OpenCL Graphics'

ggml_opencl: device: 'Intel(R) Arc(TM) A770 Graphics (OpenCL 3.0 NEO )'
ggml_opencl: OpenCL driver: 32.0.101.8136
ggml_opencl: vector subgroup broadcast support: false
ggml_opencl: device FP16 support: true
ggml_opencl: mem base addr align: 128
ggml_opencl: max mem alloc size: 4095 MB
ggml_opencl: device max workgroup size: 1024
ggml_opencl: SVM coarse grain buffer support: true
ggml_opencl: SVM fine grain buffer support: false
ggml_opencl: SVM fine grain system support: false
ggml_opencl: SVM atomics support: false
ggml_opencl: flattening quantized weights representation as struct of arrays (GGML_OPENCL_SOA_Q)
ggml_opencl: loading OpenCL kernels....................................................................
ggml_opencl: default device: 'Intel(R) Arc(TM) A770 Graphics (OpenCL 3.0 NEO )'

model size params backend ngl fa test t/s
gpt-oss 20B MXFP4 MoE 11.27 GiB 20.91 B OpenCL 100 0 pp512 294.04 + 1.05
gpt-oss 20B MXFP4 MoE 11.27 GiB 20.91 B OpenCL 100 0 tg128 39.73 + 0.11
gpt-oss 20B MXFP4 MoE 11.27 GiB 20.91 B OpenCL 100 1 pp512 290.66 + 0.49
gpt-oss 20B MXFP4 MoE 11.27 GiB 20.91 B OpenCL 100 1 tg128 39.71 + 0.19

build: 4a4f7e6 (7409)

@NeoZhangJianyu
Copy link
Collaborator

Yes, I see.

I wonder why OpenCL.md mention to focus on Qualcomm Adreno GPU.
Will OpenCL backend include Intel GPU in it's scope?

I'm not the maintainer of OpenCL backend.
This comment is just a question.

Copy link
Collaborator

@NeoZhangJianyu NeoZhangJianyu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's OK!
Provide more choice to Intel GPU users.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation OpenCL Issues specific to the OpenCL backend

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants