Search results

Poor mans parallelism: ~1.6× from 2 processes

Status: Open.

#314 In antirez/ds4;

· tdamsma opened on May 31, 2026

Onboarding skill for DS4: a docs-grounded agent skill tutor

Status: Open.

#309 In antirez/ds4;

· maeste opened on May 31, 2026

Offload prefill entirely to CUDA and use Apple Silicon for generation

Status: Open.

#304 In antirez/ds4;

· lobanov opened on May 30, 2026

How to choose between models for the 512GB max m3ultra

Status: Open.

#303 In antirez/ds4;

· a12one opened on May 30, 2026

Distributed CUDA worker host-registers the whole GGUF, not just its layer slice → Q4 OOM on 128GB DGX Spark

Status: Open.

#293 In antirez/ds4;

· ngt1999 opened on May 30, 2026

Attach file from open-webui does not work

Status: Open.

#291 In antirez/ds4;

· rmunad opened on May 30, 2026

on naming

Status: Open.

#288 In antirez/ds4;

· unship opened on May 29, 2026

cuda prefill failed on NVIDIA A100-SXM4-80GB during both inference and bench

Status: Open.

#284 In antirez/ds4;

· RedHeartSecretMan opened on May 29, 2026

Support for 2 GX10s cluster with 128GB each - support tensor parallelism

Status: Open.

#262 In antirez/ds4;

· rmunad opened on May 26, 2026

download_model.sh pro-imatrix --> error 400

Status: Open.

#249 In antirez/ds4;

· ivanfioravanti opened on May 25, 2026

ds4 / DGX Spark / MTP and Performance Improvements

cuda

speed

Status: Open.

#244 In antirez/ds4;

· TrevorS opened on May 25, 2026

ds4-agent: separate runtime asset root from workspace cwd

Status: Open.

#240 In antirez/ds4;

· dbader opened on May 24, 2026