Nemotron-3-Ultra tool use · V1

Model observation

Sigma5C observed Nemotron-3-Ultra using external tools and agent interfaces through a cloud route. The records include completed processes, a tool-task timeout and interface failures; elapsed time and captured output qualify those outcomes.

Tool tasks: 12
Task classes: 5
Agent interfaces: 7

What was observed

Completed statuses appeared across both tracks. One tool-task record timed out, and several interface attempts ended with nonzero exits.

Tool execution and elapsed time were recorded separately. Delayed or missing output limits what can be inferred about a completed process.

What we observed

Area	Recorded scope
Model	nemotron-3-ultra:cloud by NVIDIA
Tool tasks	Search, browsing, file access and code execution
Agent interfaces	Coding, editing, execution and review prompts
Measures	Recorded process status and elapsed time

Reading the records

These records can support examination of the gap between process completion, observed tool execution and the requested outcome. The surrounding agent software is part of the observation.

Declared limitations

These are bounded observations of one model configuration in each version. Process status is not a task-satisfaction score, and tool access differed between agent interfaces. Timing includes the surrounding software and any retries; it does not isolate model inference time.

Tool-task status

Recorded tool-task outcomes

Completed: 11
Call timeout: 1

Counts cover all 12 tool-task records. Completed is a process label; it does not establish task satisfaction. Each bar is scaled to the full task count.

Time by task class

Mean elapsed time by task class

Web search: 65.5 s
Search and browse: 14.4 s
File tools: 27.3 s
Python: 18.1 s
Multiple tools: 258.8 s

Arithmetic mean of recorded elapsed seconds in each class, including incomplete tasks. Bars share a zero baseline and scale to the largest mean on this page.

Companies

NVIDIA