Posts

Showing posts from June, 2026
Yes. NATS works very well with Vast.ai because you can use it as a message bus between your GPU instances, APIs, workers, and applications. Architecture   Internet │ ┌──────────┴──────────┐ │ NATS Server │ │ (small CPU instance)│ └──────────┬──────────┘ │ ┌─────────────┼─────────────┐ │ │ │ ┌──────────┐ ┌──────────┐ ┌──────────┐ │ Vast GPU │ │ Vast GPU │ │ Vast GPU │ │ Worker 1 │ │ Worker 2 │ │ Worker 3 │ └──────────┘ └──────────┘ └──────────┘ │ │ │ └─────────────┴─────────────┘ Results   1. Start a NATS server On a cheap VPS or one Vast.ai instance:   docker run -d --name nats \ -p 4222 :4222 \ -p 8222 :8222 \ nats   Ports: 4222 → clients 8222 → monitoring 6222 → clustering (optional) The official Docker image and ports are documented by NATS. 2. Launch workers on Vast.ai Inst...