hermes · spark · shootout

← all models · full run →

qwen3-next

Qwen3-Next MoE, 3 B active / 80 B total. Community default for reliable tool-calling; NVIDIA's NVFP4 quant is Blackwell-native.

nvidia/Qwen3-Next-80B-A3B-Instruct-NVFP4 NVFP4 45 GB 3B active 80B total parser · hermes

Transcripts

simple

Reply with exactly the five words: hello from hermes on spark.
hello from hermes on spark
category · trivial elapsed · 64.57s exit · 0 note · Exact five-word reply.

math

What is 127 times 49? Answer with just the number.
6223
category · reasoning elapsed · 10.22s exit · 0 note · Just 6223.

reasoning

A farmer has 17 sheep. All but 9 die. How many remain? Answer with one short sentence.
Nine sheep remain.
category · reasoning elapsed · 7.04s exit · 0 note · Caught the trick — 'Nine sheep remain.'

tool_ls

Use the shell tool to list files in /tmp. Tell me only how many there are.
There are 572 files in /tmp.
category · tool-use elapsed · 18.76s exit · 0 note · Called the shell tool, counted, returned one clean sentence.

code

Write a one-line Python expression that returns the sum of squares from 1 to 10.
sum(x**2 for x in range(1, 11))
category · coding elapsed · 7.53s exit · 0 note · Correct generator-expression one-liner.