CUDA + CUDA Llm Inference using RPC

Posted on 3rd Aug 2026

Introduction: Previously, we tested combining two GPUs running CUDA and SYCL over RPC. After that experiment, I wondered what kind of results I could get if I went with CUDA + CUDA instead. For that reason, I decided to throw the 4080 Mobile GPU on my laptop into the equation. So, out with the In...

• Read more

CUDA + SYCL Llm Inference using RPC

Posted on 29th Jul 2026

Introduction: I use my old desktop PC for experiments like virtualization and such. It’s kind of a sandbox pit where I can just mess around with whatever comes to mind; it accepts whatever workloads you throw at it and runs them, for better or worse. Thanks to a friend handing over a CPU they had...

• Read more

OpenStack Magnum Cinder CSI Plugin Problem

Posted on 21st Jul 2026

Introduction: As you know, spinning up a Kubernetes cluster on OpenStack with Magnum is super easy. The speed and scaling features it offers are pretty great: Master scaling Worker scaling / Worker auto-scaling (ability to scaling up to a number you specify) Self-healing (autohealing) W...

• Read more