Super Inu finds, scores and routes AI workloads to the best GPUs available, and explains every call.
Route a jobRead the docsSoftware that launches its own training, inference and batch jobs makes the human choosing an instance type the bottleneck. Whoever serves that buyer first sets the standard.
Open GPU telemetry in, scored and justified recommendations out. v0.1 is built, tested and runs on mock data. Real execution is the next milestone.
Routing data compounds: which providers delivered, which GPUs held up, what actually ran fast. That history is what pricing, reputation and trust get built on.
If compute becomes a programmable commodity, the router that sits between agents and every provider becomes the default interface to it.
One provider interface covers local clusters, clouds and marketplaces. No single supplier owns the customer.
No token and no speculation in the core. Settlement arrives only after routing and verification are proven.
Pulls GPU metrics from NVIDIA DCGM through dcgm-exporter and normalizes them into one GPU model.
One live list of every GPU across providers: model, VRAM, utilization, temperature, power and health.
A deterministic 100-point score behind hard filters. Same inputs, same answer, no black box.
Every recommendation says why: free VRAM, utilization, temperature, XID status, hardware match and warnings.
One contract (reserve, launch, status, release) so local clusters, clouds and marketplaces plug in alike.
Turns a recommendation into ordered steps. Plans only in v0.1; real execution is next.
Agents submit jobs in real time. Super Inu scores the fleet, routes each job and streams the flow into the GPUs while telemetry drifts every second. The stream is simulated in your browser; the scoring matches the v0.1 code.
Super Inu reads open DCGM telemetry for H100, H200, A100, L40S, L4 and RTX-class GPUs wherever the metrics are exposed. Five signals drive v0.1. Four more unlock smarter routing next.
How busy the compute engines are.
DCGM_FI_DEV_GPU_UTIL
Free VRAM decides whether a job fits.
DCGM_FI_DEV_FB_USED / FB_FREE
Thermal headroom and health.
DCGM_FI_DEV_GPU_TEMP
Enforces per-GPU power limits.
DCGM_FI_DEV_POWER_USAGE
Driver-reported faults mark a GPU degraded.
DCGM_FI_DEV_XID_ERRORS
Real AI-math load, not just 'busy'.
DCGM_FI_PROF_PIPE_TENSOR_ACTIVE
Multi-GPU jobs need fast links.
DCGM_FI_PROF_NVLINK_TX_BYTES
Memory reliability for long runs.
DCGM_FI_DEV_ECC_DBE_VOL_TOTAL
Spot GPUs slowing themselves down.
DCGM_FI_DEV_SM_CLOCK
Field names come from NVIDIA DCGM; confirm them against the docs and NVIDIA's repos before relying on them.
GPUs visible through a dcgm-exporter endpoint.
First public-cloud provider behind the same interface.
A second cloud, so routing has real choices.
Open markets of rentable compute, scored like any other source.
There is no token in the core. Every run adds data about which providers delivered, so the next decision is better.
Super Inu turns GPU telemetry into explainable placement decisions. This page covers setup, the data it reads, the API and the NVIDIA open-source projects it builds on.
git clone <your-repo> && cd super-inu-compute docker compose up # API on :8000, mock GPU data, no GPU needed curl -X POST localhost:8000/recommend \ -H 'content-type: application/json' -d @examples/workload.json
| DCGM field | Super Inu field | Used for |
|---|---|---|
DCGM_FI_DEV_GPU_UTIL | gpu_utilization | Compute headroom (25 pts) |
DCGM_FI_DEV_FB_USED / FB_FREE | memory_gb, memory_used_gb | VRAM fit filter, memory headroom (20 pts) |
DCGM_FI_DEV_GPU_TEMP | temperature_c | Thermal score (10 pts), health |
DCGM_FI_DEV_POWER_USAGE | power_w | Per-GPU power limit filter |
DCGM_FI_DEV_XID_ERRORS | xid_errors | Nonzero marks the GPU degraded |
The rest of the 100-point score: 20 for meeting hard requirements, 15 for health, 10 for matching a preferred model. GPUs that are reserved, unhealthy, short on free VRAM or over the power limit are filtered out first. Multi-GPU jobs are placed on a single node.
| Endpoint | Purpose |
|---|---|
GET /health | Liveness check |
GET /inventory | Normalized GPU inventory |
POST /recommend | Best node, GPU ids, score, reasons and warnings. Returns 404 with per-GPU rejection reasons if nothing fits. |
POST /plan | Execution plan steps (not executed in v0.1) |
| Variable | Meaning |
|---|---|
SUPER_INU_METRICS_URL | dcgm-exporter endpoint, e.g. http://host:9400/metrics |
SUPER_INU_METRICS_FILE | Saved or mock Prometheus text file |
SUPER_INU_PROVIDER_ID, SUPER_INU_NODE_ID | Provider label, and node fallback when metrics have no Hostname |
Data Center GPU Manager: GPU telemetry, health and management. The source of truth for every metric above.
Serves DCGM metrics in Prometheus format. Super Inu's primary telemetry interface.
Manages GPUs on Kubernetes. The planned execution layer for v0.2.
Super Inu reads these through the exporter's HTTP endpoint and includes none of their source code. See each repository's README for installation and the current list of metrics.