Error running in LM Studio

#16
by unixist - opened

Error:

(Exit code: 11). Please check settings and try loading the model again.

I'm running macbook M3 Max Pro (128GB).

Details below:

{
  "cause": "(Exit code: 11). Please check settings and try loading the model again. ",
  "suggestion": "",
  "data": {
    "memory": {
      "ram_capacity": "128.00 GB",
      "ram_unused": "10.00 GB"
    },
    "gpu": {
      "type": "AppleMetal",
      "vram_recommended_capacity": "96.00 GB",
      "vram_unused": "8.14 GB"
    },
    "os": {
      "platform": "darwin",
      "version": "14.3.1"
    },
    "app": {
      "version": "0.2.16",
      "downloadsDir": "/Users/seanw/.cache/lm-studio/models/"
    },
    "model": {}
  },
  "title": "Model error"
}```
Owner

Probably best to ask the LM Studio people. AFAIK it's closed source so nothing I can do about it anyways.
I'm guessing they haven't added support for Grok yet.

Thanks, will do.

Interestingly, split 2 gets inferred as Llama architecture, but not part 1.

image.png

Owner

Only the first Split contains any metadata, all others are just a bunch of weights (and the split number). I'm guessing Llama is their default value.

Sign up or log in to comment