Skip to content

Lack of Multi-GPU Selection in Extension #4119

Description

@rohitkkrana

Before submitting your bug report

Relevant environment info

- OS: Windows 10
- Continue version: 11
- IDE version:
- Model: deepseek-coder-v2:16b
- config.json:
  
{
  "models": [
    {
      "title":"DeepSeek Coder",
      "model":"deepseek-coder-v2:16b",
      "provider":"ollama",
      "apiBase": "http://localhost:11434",
      "systemMessage": "Hello Rohit How can i Help you?"
    },
    {
      "model": "claude-3-5-sonnet-latest",
      "provider": "anthropic",
      "apiKey": "",
      "title": "Claude 3.5 Sonnet"
    },
    {
      "model": "gpt-4o",
      "title": "GPT-4o",
      "systemMessage": "You are an expert software developer. You give helpful and concise responses.",
      "apiKey": "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",
      "provider": "openai"
    },
    {
      "model": "gpt-4-turbo",
      "title": "GPT-4 Turbo",
      "apiKey": "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",
      "provider": "openai"
    },
    {
      "model": "gpt-3.5-turbo",
      "title": "GPT-3.5-Turbo",
      "apiKey": "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",
      "provider": "openai"
    }
  ],
  "tabAutocompleteModel": {
    "title": "DeepSeek Coder",
    "provider": "ollama",
    "model": "deepseek-coder-v2:16b",
    "apiBase": "http://localhost:11434"
  },
  "contextProviders": [
    {
      "name": "code",
      "params": {}
    },
    {
      "name": "docs",
      "params": {}
    },
    {
      "name": "diff",
      "params": {}
    },
    {
      "name": "terminal",
      "params": {}
    },
    {
      "name": "problems",
      "params": {}
    },
    {
      "name": "folder",
      "params": {}
    },
    {
      "name": "codebase",
      "params": {}
    }
  ],
  "slashCommands": [
    {
      "name": "share",
      "description": "Export the current chat session to markdown"
    },
    {
      "name": "cmd",
      "description": "Generate a shell command"
    },
    {
      "name": "commit",
      "description": "Generate a git commit message"
    }
  ]
}

Description

The Continue Extension for Visual Basic currently defaults to using only a single GPU, without providing an option to select a specific GPU in systems with multiple GPUs. This limitation affects users who want to leverage multiple GPUs for enhanced performance or prefer using a dedicated GPU instead of an integrated one. Adding a GPU selection feature would allow better utilization of system resources and improve overall performance.

Image

To reproduce

No response

Log output

Metadata

Metadata

Labels

area:configurationRelates to configuration optionskind:bugIndicates an unexpected problem or unintended behavioros:windowsHappening specifically on Windowspriority:mediumIndicates medium prioritystale

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions