Blog

Posts with Tag: Docker

CUDA + CUDA Llm Inference using RPC

CUDA + CUDA Llm Inference using RPC

Posted on 3rd Aug 2026

Introduction: Previously, we tested combining two GPUs running CUDA and SYCL over RPC. After that experiment, I wondered what kind of results I could get if I went with CUDA + CUDA instead. For that reason, I decided to throw the 4080 Mobile GPU on my laptop into the equation. So, out with the In...

Using Kata Containers with Docker

Using Kata Containers with Docker

Posted on 7th Jul 2026

Introduction: Containers aren't actually some kind of magic; they are simply an isolation layer that utilizes the namespaces and cgroups features built right into the Linux kernel. Thanks to this, they isolate the container you are running and the processes executing inside it from the host system...