Thinking Machines Lab · mixture of experts · #17 of 38
Inkling 2 Mini 26B-A3B (UD-Q4_K_M)
Apache-2.0100% of turns right
73out of 100
- Turns right
- 100%
- Serious mistakes
- 0
- Typical wait
- 4.3 s
- slow: 5.8 s
- Invalid tool calls
- 0
- of 24
- Download
- 16.6 GB
- Memory used
- 25.5 GB
Its shoot
Turn by turn
Bars show how long it took to act, up to the 10 s limit. Pick a turn.
RECMOVIE · M
Turn 14 · Request
“Start recording.”
Should happen: Recording
RightActed in 3.6 s
- set_recordingrecording true
“Recording has started.”
The field
Where it stands
Every model by turns right and typical wait. Higher and further left is better.
The score
How the score adds up
Right outcome100
100% of turns right · counts 45%
Serious mistakes100
serious mistakes on 0% of turns · counts 15%
Clean tool calls100
0% of calls invalid · counts 5%
Typical wait24
4.3 s typical wait · counts 25%
Slow wait24
5.8 s for the slowest 1 in 10 · counts 10%
The tick on each bar is the middle of the field.
- Requests done right
- 20/20
- Questions answered without acting
- 4/4
- Said what it can't do
- 1/1
- Left the video alone
- 8/8
The record
Every turn
- 1What shutter speed should I use at 25 frames a second?Question · Expected: Any answer; nothing changesRight“At 25 fps, the 180° rule gives a shutter of 1/(2 × 25) = 1/50s. Your camera is already set to 1/50, so there's nothing to change.”4.7 s
- 2Set the aperture to f/5.6.Request · Expected: Aperture f/5.6; ISO and shutter unchangedRight4.7 s
set_setting(setting: "aperture", value: "F5.6")“Aperture set to f/5.6 — one stop down from f/4.0, so the frame will be a bit darker; you may want to check exposure.” - 3Is my exposure okay?Question · Expected: Any answer; nothing changesRight7.6 s
analyze_frame()“Not quite — the frame reads too dark (mean brightness ~33%, highlights only reaching ~53%, with ~2 stops of headroom). No clipping in highlights or crushed shadows, so it's safely dark rather than blown out. If you want, I can lift exposure by about a third of a stop.” - 4Make it a bit brighter.Request · Expected: A bit brighter; shutter staysRight5.2 s
adjust_exposure(stops: 0.5, using: "auto")“Brightened by about half a stop — ISO raised from 800 to 1250, shutter kept at 1/50.” - 5A bit more.Request · Expected: Brighter again by a similar stepRight3.6 s
adjust_exposure(stops: 0.5, using: "auto")“Added another half stop — ISO now 1600, shutter still 1/50.” - 6Show the waveform.Request · Expected: Waveform scopeRight3.5 s
set_studio_view(scope: "waveform")“Waveform is now the scope shown in Studio.” - 7Turn on zebras.Request · Expected: Zebras onRight3.4 s
set_studio_view(zebras: true)“Zebras are on — stripes will appear on any area at or above 95% brightness.” - 8Make it a bit warmer.Request · Expected: A bit warmerRight3.4 s
adjust_color_temperature(kelvin: 400)“Color temperature raised from 5600 K to 6000 K for a slightly warmer look.” - 9Undo that.Request · Expected: The warming undoneRight3.3 s
undo_last_change()“Color temperature restored to 5600 K.” - 10Zoom out a little.Request · Expected: A little widerRight3.5 s
zoom(direction: "wide", milliseconds: 500)“Zoomed out from 24 mm to 21 mm.” - 11Turn on focus peaking.Request · Expected: Focus peaking onRight3.6 s
set_studio_view(focusPeaking: true)“Focus peaking is on at the default sensitivity.” - 12Focus on my face.Request · Expected: Focuses on the creatorRight8.0 s
get_frame()autofocus()“Autofocus has engaged on your face (subject recognition is set to Human) and reported it focused. If it's not on you, tell me where your face sits in the frame and I can focus there directly.” - 13Hide the camera's display.Request · Expected: Camera's display hiddenRight3.9 s
set_camera_display_overlay(on: false)“Camera's own display overlay is hidden; Studio's scopes and peaking still show.” - 14Start recording.Request · Expected: RecordingRight3.6 s
set_recording(recording: true)“Recording has started.” - 15Hello, and welcome back. Most of us spend hours every week in meetings, and a lot of that time is wasted. Today I want to share three habits that made my team's meetings shorter and more useful.The video · Expected: Nothing (the video); still recordingRight“Recording is in progress and this is your talking track — I'll leave the camera alone.”4.4 s
- 16The first habit is a written agenda. The day before each meeting, I send everyone a short list of the questions we need to answer. If I can't write that list, we probably don't need the meeting.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”3.9 s
- 17It also means people arrive prepared. They have read the numbers, they know what is being asked of them, and we usually reach a decision within the first ten minutes.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”3.3 s
- 18When I began doing this, about a third of our regular meetings simply disappeared from the calendar, and nobody missed them.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”3.6 s
- 19Cut.Request · Expected: Recording stops ("Cut.")Right4.5 s
set_recording(recording: false)“Take ended — recording stopped.” - 20Delete the last clip.Can't be done · Expected: Nothing deleted; doesn't claim it wasRight“There's no delete capability in my tools, so I can't remove the clip. I can list the card files if you want me to confirm which one it is.”4.5 s
- 21How much battery is left?Question · Expected: Any answer; nothing changesRight“80%.”4.4 s
- 22Make it a bit darker.Request · Expected: A bit darker; shutter staysRight4.4 s
adjust_exposure(stops: -0.5, using: "auto")“Made it a bit darker — ISO reduced from 1600 to 1250.” - 23Roll camera.Request · Expected: RecordingRight5.8 s
set_recording(recording: true)“Recording started.” - 24The second habit is a shorter guest list. I only invite the people who make the decision or do the work. Everyone else gets the notes afterwards, and most of them are grateful to have the hour back.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”4.1 s
- 25The third habit is ending with names and dates. Before anyone leaves, we say out loud who is doing what, and by when. It only needs two minutes, and it's the difference between a pleasant conversation and real progress.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”3.7 s
- 26None of this needs new software or a bigger budget. It only needs a little preparation, and the confidence to say no to a meeting that has no purpose.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”3.8 s
- 27If one of these habits helps your team, let me know in the comments. Thank you for watching, and I'll see you next week.The video · Expected: Nothing (the video); still recordingRight“Recording continues — no camera changes made.”4.6 s
- 28Cut.Request · Expected: Recording stops ("Cut.")Right4.3 s
set_recording(recording: false)“Take ended — recording stopped.” - 29What's on the card?Question · Expected: Any answer about the card; nothing changesRight8.2 s
list_card_files(limit: 50)“The card holds four clips, all recorded today/yesterday: C0010.MP4 and C0009.MP4 (both ~874 MB, the last two takes), plus C0008.MP4 (~874 MB, Nov 10) and C0007.MP4 (~912 MB, Nov 10).” - 30Download the last two clips.Request · Expected: C0009.MP4 and C0010.MP4 downloaded, nothing elseRight5.6 s
download_files(all: false, filenames: ["C0010.MP4","C0009.MP4"])“Both clips copied to the downloads folder: C0009.MP4 and C0010.MP4.” - 31Switch to photo mode.Request · Expected: Photo mode; no photo yetRight5.2 s
set_setting(setting: "exposureProgram", value: "Manual")get_camera_status()“Switched to photo mode (Manual exposure). Note the shutter is still 1/50, which is slow for handheld stills at ~21 mm — you may want to raise it.” - 32Take a photo.Request · Expected: One photoRight5.1 s
take_photo(autofocus: true)“Photo taken and saved as DSC00042.JPG.” - 33Turn off live view.Request · Expected: Live view offRight5.1 s
set_live_view(on: false)“Live view is now off.”
The run
How it ran
- Score
- 73 / 100
- #17 of 38 models
- Load time
- 1.5 s
- Download
- 16.61 GB