Hangar Harness / Model Tests

✨ Explore this insightful post from Hacker News 📖

📂 **Category**:

✅ **What You’ll Learn**:




Hangar Harness / Model Tests



I’ve been testing a simple prompt with different model and harness combinations to work out which one produces best results. I do this in /goal mode.

Prompt: Build a single-page Three.js sci-fi hangar with hovering drones, animated warning lights, emissive runway strips, and subtle volumetric-style fog planes. Include drone formation toggle and cinematic camera path. Output one self-contained HTML file with inline JavaScript.

GLM 5.3 Flash Max Codex Open 9m 0.232s 9.344s 457,685 17,458 7,694 475,143 85.26% 14 1 Blocked No
Luna 5.6 Max Codex Open 9m 13.098s 6.199s 1,146,755 25,512 6,879 1,172,267 92.76% 32 2 Yes Yes
SOL 5.6 Max Codex Open 10m 48.765s 8.460s 1,069,163 28,278 7,515 1,097,441 94.60% 21 5 No No
Astra 6.0 Max Codex Open 37m 29.705s 3.589s 1,292,366 43,129 15,271 1,335,495 94.93% 20 5 Yes No
GLM 5.3 Flash Max OMP Open 30m 14.979s 6.596s 1,678,509 63,405 1,741,914 78.54% 57 0 Yes Yes
Qwen 3.8 27B x-high OMP Open 41m 25.836s 15.275s 3,407,451 71,935 49,131 3,479,386 86.92% 89 0 Yes Yes
GLM 5.3 Flash Max OpenCode Open 20m 28.948s 6.284s 4,305,447 50,468 33,414 4,355,915 96.89% 67 0 Yes Yes
Qwen 3.8 27B x-high OpenCode Open 8m 48.470s 10.182s 665,490 41,817 28,788 707,307 95.64% 13 0 Yes Yes
Qwen 3.8 27B x-high DSH / PTC Open 24m 32.929s 7.724s 1,012,499 89,894 1,102,393 91.69% 23 5 Yes Yes
Qwen 3.8 27B x-high DSH Open 18m 15.239s 6.755s 2,654,457 78,232 2,732,689 95.48% 42 2 No No

All GLM runs are labelled GLM 5.3 Flash Max; input tokens include cached input. Output tokens are the generated total, including reasoning; when a harness reports reasoning separately, the reasoning column shows that subset. The DSH adapter does not report a separate reasoning count. DSH durations sum active turn time across both turns, excluding the pause between turns. Tool errors are recorded failed tool events. A dash means unavailable or not reported.

💬 **What’s your take?**
Share your thoughts in the comments below!

#️⃣ **#Hangar #Harness #Model #Tests**

🕒 **Posted on**: 1788868976

🌟 **Want more?** Click here for more info! 🌟

By

Leave a Reply

Your email address will not be published. Required fields are marked *