PlugMyPlugin
← Browse

inference-builder

NVIDIA-AI-IOT ★ 83

Inference Builder automatically generates GPU-accelerated Vision AI inference pipelines for NVIDIA hardware, supporting multiple backends (DeepStream, Triton, vLLM, TensorRT-LLM, PyTorch) and producing deployable Python packages with containerized microservices. It standardizes data flow across backends, handles streaming protocols like RTSP, and generates test cases while enabling developers to switch inference engines without rewriting code.

DevOps Code Review No API key detected prompt pack

Install

> /plugin marketplace add NVIDIA-AI-IOT/inference_builder
> /plugin install inference-builder

Source: https://github.com/NVIDIA-AI-IOT/inference_builder

What it's made of

1 skill

Commands
0
Agents
0
Skills
1
MCP servers
0
Hooks
0

What it needs & plugs into

API keys
none
Paid services
none detected
External tools
none
Talks to
nothing external detected

Analyzed . Facts extracted from the plugin's files. Prose generated by claude-haiku-4-5-20251001.

Is this your plugin?

Claim it to keep the card accurate and enter the weekly contest. Requires signing in as the GitHub owner (NVIDIA-AI-IOT).