This app tries model candidates in order and keeps the first that loads.
Loaded model: none
none
Candidates: cyankiwi/nomos-1-AWQ-8bit, cyankiwi/nomos-1-AWQ-4bit
cyankiwi/nomos-1-AWQ-8bit, cyankiwi/nomos-1-AWQ-4bit
GPU duration: 180s | Max input tokens: 2048
180s
2048