Blog

Posts with Tag: Cuda

CUDA + CUDA Llm Inference using RPC

CUDA + CUDA Llm Inference using RPC

Posted on 3rd Aug 2026

Introduction: Previously, we tested combining two GPUs running CUDA and SYCL over RPC. After that experiment, I wondered what kind of results I could get if I went with CUDA + CUDA instead. For that reason, I decided to throw the 4080 Mobile GPU on my laptop into the equation. So, out with the In...

CUDA + SYCL Llm Inference using RPC

CUDA + SYCL Llm Inference using RPC

Posted on 29th Jul 2026

Introduction: I use my old desktop PC for experiments like virtualization and such. It’s kind of a sandbox pit where I can just mess around with whatever comes to mind; it accepts whatever workloads you throw at it and runs them, for better or worse. Thanks to a friend handing over a CPU they had...