GPU slots
Check GPU occupancy, idle and waiting slots, and set up wiring as shared pool, dedicated or unwired
Required permission: Global admin
The GPU slots screen answers two questions. The top part answers "is there a free slot now, and if not, who is holding them?", and the Wiring (배선) part below answers "which tenant can use how many slots?" It reloads automatically every 10 seconds.
Reading the current state
| Card | Meaning |
|---|---|
| Total slots (총 슬롯) | The sum of the GPU resources (nvidia.com/gpu) advertised by the nodes |
| In use (사용 중) | Slots held by scheduled pods |
| Idle (유휴) | Slots that can be scheduled right now |
| Waiting (대기 중) | Number of pods waiting because they could not get a slot. Waiting (Pending) is not a failure — when a slot frees up, the scheduler starts them on its own |
Below that, the device plugin card tells you whether the plugin that advertises GPUs is alive and whether time-slicing is on. Without the plugin, GPUs are not advertised as a resource, so every pod that requests a GPU stays waiting. For installation, see the Installation chapter.
Wiring — three modes
Wiring is the ledger that sets how many GPUs are promised to each tenant. The ledger lives in the DB, but who actually holds a slot is always read from the cluster's live values.
| Mode | Meaning | Use when |
|---|---|---|
| Unwired (미배선) (default) | The tenant has no slots at all. Training and serving screens cannot select a GPU, and if one is requested anyway the submission is rejected (CPU still works) | The tenant does not need GPUs |
| Shared (공유) | Bound to a named shared pool. If the total occupancy of all tenants bound to the pool exceeds the pool's slot count, new submissions are rejected | Several teams take turns on a few cards |
| Dedicated (전용) | Reserves a set number of slots permanently. Other tenants cannot use that many | There is serving that must always run |
Divide the slots while watching Wired (배선됨) (promised slots), Spare slots (남는 슬롯) and Advertised total (광고 총량) in the totals row at the top. Waiting pods and queued training whose pods have not started yet also count as occupancy — otherwise the same slot would be promised twice.
Create a shared pool
- Press Register pool (풀 등록).
- Enter the Pool name (풀 이름) (lower-case letters, digits and hyphens; cannot be changed later), the Slot count (슬롯 수) and a description, then press Register (등록).
Register a shared pool
Wire a tenant
- In the tenant table, press Settings (설정) on the tenant's row.
- Choose a mode. For Shared (공유), choose the pool; for Dedicated (전용), set the number of Always-allocated slots (상시 할당 슬롯).
Tenant GPU wiring — unwired / shared / dedicated (dedicated selected) - Press Save (저장). From then on, that tenant's training and serving screens can select GPU resources.