Mixing GPUs that support rebar and ones that do not does not work with this driver #1261
vektorprime
started this conversation in
Ideas
Replies: 1 comment
|
I ended up just having an LLM write a small patch for this and it worked: |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I have 2x RTX 3090 with rebar and 2x RTX 3080 (20GB) modded that do not support rebar. The P2P driver says thatt even the 3080 support P2P so it causes crashes in llama cpp when I enable P2P. The firmware on the 3080 is locked so I can never update it to use get rebar. Could we only enable this for GPUs that actually support it?
All reactions