benchpack registry snapshot

Generated 2026-09-02T07:11:03+00:00 from llm-benchpacks.sqlite. Static, read-only export over indexed compact rows.

Machine-readable snapshot: snapshot.json.

Browse Filters

Runs

idlabelimportedrowspacksadaptersmodelsendpointsruntimemodel metadataquantizationmodel artifactmodel revisionmodel sha256hostcomparisonrepo commitoperatingrun.jsonl sha256
12026-04-28-mlx-lm-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatmlx-community/Qwen2.5-0.5B-Instruct-4bithttp://localhost:8080/v1/chat/completions——————atlas.local; darwin———1a75463cc086d35787b2957d0a3b3d52499ce99536dd58bedee1b115ce374cf2
22026-04-28-mlx-lm-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatmlx-community/Qwen2.5-0.5B-Instruct-4bithttp://localhost:8080/v1/chat/completions——————atlas.local; darwin———868121e67c2b7a5f2a169661414c0de8bbbf4a68f0133e8c143b28a3ec311e7f
32026-04-29-llama-server-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————atlas.local; darwin———8a23c8f3e0e2ebb1490822f4571cc18f6524870e4a2dabe57a4e5880f9a45d69
42026-04-29-llama-server-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————atlas.local; darwin———ed795551960a1e4c88f1c6c66c163640dc923abfd5fe7a085f00d707b8ca5cd8
52026-04-30-llama-server-desktop-django-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————atlas.local; darwin———2ca61c497e8ba76cb9c94369d49485cbc069db11268eeeae95951e0e571b8523
62026-05-03-m4-max-llama-qwen25-05b-190636-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————studio; darwin———bfff2514d5534c33dc494f5fed80b4599e4c78169c6178dfd230ead9023a59e5
72026-05-03-m4-max-llama-qwen25-05b-190636-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————studio; darwin———bee931cf81a26acac8440288568153dbc7d1a69ca8dcc5aa3849af31ea3793cf
82026-05-03-m4-max-llama-qwen25-05b-190636-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————studio; darwin———542511f03d4cc6a2373fc868d19a7563d281e8d006ab63dcc217ad3cf8e4a262
92026-05-03-m4-max-llama-qwen25-05b-190636-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatqwen2.5-0.5b-instruct-q4_k_mhttp://127.0.0.1:8081/v1/chat/completions——————studio; darwin———98dee1608317ea389a6c0e315bb330f56a934debbd08d150d9f0a2b77f65f8c6
102026-05-03-m4-max-mlx-qwen25-05b-185824-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatmlx-community/Qwen2.5-0.5B-Instruct-4bithttp://127.0.0.1:8080/v1/chat/completions——————studio; darwin———1e6e1caa89e527865c7b40913edf91063549b36794d143dd537d285ed778c213
112026-05-03-m4-max-mlx-qwen25-05b-185824-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatmlx-community/Qwen2.5-0.5B-Instruct-4bithttp://127.0.0.1:8080/v1/chat/completions——————studio; darwin———d7c1489b282bd86892cbb20b721949ed691eb59e887e944275215ae5d827a7a6
122026-05-03-m4-max-mlx-qwen25-05b-185824-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatmlx-community/Qwen2.5-0.5B-Instruct-4bithttp://127.0.0.1:8080/v1/chat/completions——————studio; darwin———5ebcf409eb4c686cc31939567cac3b43591693e119929920fca3f36ff3407e2b
132026-05-03-m4-max-mlx-qwen25-05b-185824-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatmlx-community/Qwen2.5-0.5B-Instruct-4bithttp://127.0.0.1:8080/v1/chat/completions——————studio; darwin———5cf5c75cc27f057f549c7e5b8b8acebecf7465d5855b02651b4750ba06491d15
142026-05-03-m4-max-qwen3coder-184938-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——————studio; darwin———b6dec7420aab1c0accf65e1950225811d223c246aaaf831ecb61ec1acb74225e
152026-05-03-m4-max-qwen3coder-184938-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——————studio; darwin———27865294ce16ff9ea1975f48e2c51daee97faafe86eeac3293e81df0fbdcbdde
162026-05-03-m4-max-qwen3coder-184938-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——————studio; darwin———3e5d2b25b70c8d63877781195bfc8941ed12dcd0d255ac465414955f822a061d
172026-05-03-m4-max-qwen3coder-184938-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——————studio; darwin———bd9728b4bba8ad01eb74f1c2f2183b5d31f57ea89f564b7935619744687f0d15
182026-05-05-m4-qwen36-dense-llamacpp-154321-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:8083/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-27b-q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled2bdacdc23b40e2c9db1d649c4169b247992362c0b667de7f95f191ec4dfd63f4
192026-05-05-m4-qwen36-dense-llamacpp-154321-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:8083/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-27b-q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled53b99d66b44236a2dba662de7513afac4bdd6cd89c7218a3d70864d7bac90383
202026-05-05-m4-qwen36-dense-llamacpp-154321-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:8083/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-27b-q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controllede4397caed9ab98638e4e01b140c9e17116fbe64705720d2925ee0d964dc7422d
212026-05-05-m4-qwen36-dense-llamacpp-154321-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatqwen36-27b-q4kmhttp://127.0.0.1:8083/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-27b-q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled14cfe8d6f64f2cab901d5e4e859f050b00f97e8450f9b68f34e803277631ec2c
222026-05-05-m4-qwen36-dense-llamacpp-smoke-1542552026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:8083/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-27b-q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled50bd4db36ab7d5cf84bc811ffd796979907902c86b9e21249355ad19d4edc18c
232026-05-05-m4-qwen36-dense-mlx-155943-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-27B-4bithttp://127.0.0.1:8085/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit———studio; darwin——not captured; not captured; not intentionally controlled54d59baf80e90c374eb8a369864c3b0264eb085e87df6267a89a54b95c1b148e
242026-05-05-m4-qwen36-dense-mlx-155943-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-27B-4bithttp://127.0.0.1:8085/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit———studio; darwin——not captured; not captured; not intentionally controlledaa0602642dbf3fd0829e61be616eadd3faa29f40c5147932849582609378ab6d
252026-05-05-m4-qwen36-dense-mlx-155943-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-27B-4bithttp://127.0.0.1:8085/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit———studio; darwin——not captured; not captured; not intentionally controlled9ffbeb873f7441f0c8ad0e7033cb1bc749918a9b2af3b788256480126358c60e
262026-05-05-m4-qwen36-dense-mlx-155943-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chat/Users/jochen/models/mlx/Qwen3.6-27B-4bithttp://127.0.0.1:8085/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit———studio; darwin——not captured; not captured; not intentionally controlledb3c8b5da25d632e4a30896286548a26bf84de7fd93fc709fc68b2d8997f3ce0c
272026-05-05-m4-qwen36-dense-mlx-smoke-1559162026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-27B-4bithttp://127.0.0.1:8085/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit———studio; darwin——not captured; not captured; not intentionally controlled6c2ce10ddec0d2460fa60a76baf45765a96bca5d29e9f67b8aa141e8d30bc5cd
282026-05-05-m4-qwen36-dense-ollama-155051-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0ollama-generateqwen36-27b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-27b-gguf:q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled90ad79e13be51f0a006fe3640081adfc77b2a40e5f5856754aceb0d0a24fd724
292026-05-05-m4-qwen36-dense-ollama-155051-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0ollama-generateqwen36-27b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-27b-gguf:q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled026b15e71216fc30839332bd3830d60b02a7d7b73840d8a869ecfb8e128c4895
302026-05-05-m4-qwen36-dense-ollama-155051-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0ollama-generateqwen36-27b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-27b-gguf:q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled91e4cf517ae21103651c30c72bd6269a46c66a391910075e523aa11dbd04b6f0
312026-05-05-m4-qwen36-dense-ollama-155051-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5ollama-generateqwen36-27b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-27b-gguf:q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled80e8f160825ccab575109815fb17a2c1b3099192514b862b0ef4ed739f2d70d7
322026-05-05-m4-qwen36-dense-ollama-smoke-1548082026-06-23T13:08:32+00:001smoke-chat 0.1.0ollama-generateqwen36-27b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-27b-gguf:q4kmQ4_K_M———studio; darwin——not captured; not captured; not intentionally controlled49e90ace6ec080cebe40afc29f9fe6234503a44c73f4c72d759e76bbcca85890
332026-05-05-m4-qwen36-moe-llamacpp-153657-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatqwen36-35b-a3b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-35b-a3b-q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled7211cd7b8b961809e21be8aa2fd0f0795b60b5fdc4ca311b25a5d050ef15b919
342026-05-05-m4-qwen36-moe-llamacpp-153657-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatqwen36-35b-a3b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-35b-a3b-q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlleddf24db7e293761efa0727c27243691cefcdf9302c72ceec5a928f7410fe4338e
352026-05-05-m4-qwen36-moe-llamacpp-153657-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-35b-a3b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-35b-a3b-q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled580935de10ef745e30bd192e688bc6b17ad4c8019e8ae8f844cc4160e437aa04
362026-05-05-m4-qwen36-moe-llamacpp-153657-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatqwen36-35b-a3b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-35b-a3b-q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled9236044cfc59cd87955da876a9f566f4e9bdd2e6b88959bd61de402e3c4af626
372026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-1536342026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-35b-a3b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-35b-a3b-q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled68d40ce43d482210491dfdc3c2eb3c85c4d19f1bc248e44a543c5f5593bec5cf
382026-05-05-m4-qwen36-moe-llamacpp-smoke-1531592026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-35b-a3b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; 9020 (a4701c98f)qwen36-35b-a3b-q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled8bff4f37e6ba08d69594af9718d6f29c5b4b492a29b33fb0dacf79f0457e5d28
392026-05-05-m4-qwen36-moe-mlx-155645-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4http://127.0.0.1:8084/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4———studio; darwin——not captured; not captured; not intentionally controlledbed80bfd65eeba7726c474d9b13531c9bed9185d00e421f2f7390dd67da257b0
402026-05-05-m4-qwen36-moe-mlx-155645-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4http://127.0.0.1:8084/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4———studio; darwin——not captured; not captured; not intentionally controlledf0506fad86fc7d9110b41f1f0b76609fa5f9b513ff5f221fa68e126c85ae5ab7
412026-05-05-m4-qwen36-moe-mlx-155645-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4http://127.0.0.1:8084/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4———studio; darwin——not captured; not captured; not intentionally controlledd07c1c550bd141c596e7dd189cc672c935bf928daacbf2e66e9bdba3ab093cae
422026-05-05-m4-qwen36-moe-mlx-155645-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chat/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4http://127.0.0.1:8084/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4———studio; darwin——not captured; not captured; not intentionally controlled89e7fe52de3d91a6ab0a61320f5f0ea7ac3a71683fe2c41b7a040b15d99d81b9
432026-05-05-m4-qwen36-moe-mlx-smoke-1556192026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chat/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4http://127.0.0.1:8084/v1/chat/completionsmlx-lm server; 0.31.3/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4———studio; darwin——not captured; not captured; not intentionally controlled2aa0eba95785bc47b2fa875e2f4bdb793df4f7e96408d0bf905ad01109b25142
442026-05-05-m4-qwen36-moe-ollama-154846-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0ollama-generateqwen36-35b-a3b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-35b-a3b-gguf:q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlledd3e86295d7d842b4c96d8e627af3bce80fdf4cf4ee2f4fb101cffdf0e42621cd
452026-05-05-m4-qwen36-moe-ollama-154846-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0ollama-generateqwen36-35b-a3b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-35b-a3b-gguf:q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled743de0b33cd443a29be1d771425a15f60370c7622af2e504cc2d89415115f787
462026-05-05-m4-qwen36-moe-ollama-154846-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0ollama-generateqwen36-35b-a3b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-35b-a3b-gguf:q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlled328b12888209d930071aa141c5c4c24c3842ca987a6bef4ad41e3b3d2fce15cf
472026-05-05-m4-qwen36-moe-ollama-154846-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5ollama-generateqwen36-35b-a3b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-35b-a3b-gguf:q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlledfad0ff56345ef618f6af7e9d51f11491feb09f31571ec55f04c32d34de82b560
482026-05-05-m4-qwen36-moe-ollama-smoke-1547472026-06-23T13:08:32+00:001smoke-chat 0.1.0ollama-generateqwen36-35b-a3b-gguf:q4kmhttp://localhost:11434/api/generateollama; server 0.20.5; client 0.23.0qwen36-35b-a3b-gguf:q4kmUD-Q4_K_M———studio; darwin——not captured; not captured; not intentionally controlledfac9f37161c20ba207a1735689d363494e2e076a4d8a12d8cccede2159e2c3c8
492026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-servera82fb3fnot captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled2b036d49a5e9d6a4803bfed19bfa2177ebd1c161b7703c719870f93f3d511c8b
502026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-servera82fb3fnot captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled9a7a841b225dcc6730182be72572aebf9f0efe1e9869636954696889c999efaa
512026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-servera82fb3fnot captured; not captured; no intentional benchmark load; existing host background state not otherwise controlledcab70fecc1304a84cf8ef614fe58df90df7609cf4f38e68bb1a70c6e4b28ee22
522026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-servera82fb3fnot captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled727e46e9f5053eedb541ef2140b12db9622bb19c702f3b1120ef9535ef291516
532026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-server2acd1b3not captured; not captured; no intentional benchmark load; existing host background state not otherwise controlledde3de00b332e27ae95daeea0e58aa39fc9f3f9e00b2f5a1768517baac4bb7f7a
542026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-server2acd1b3not captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled4d0dff2fa49c393a80cb44dcf25b7128158d1117eccffa26e81380639dee0e46
552026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-server2acd1b3not captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled22433417300a34eac6de9e7e1dd0c71765898db2ebf465591308de1c6735cb7f
562026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-server2acd1b3not captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled9eaaf591d1b198c2db991ad03faa619418428270bfdfbd36c0f72f11eeec5fd6
572026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-1039282026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-servera82fb3fnot captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled66ded72dd97702092ce901aa22b1c622174b3cd0cf85d2d10674a0a977ae1306
582026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-1038562026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatgemma4-e2b-q4kmhttp://127.0.0.1:8081/v1/chat/completionsllama-server; version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64; http://127.0.0.1:8081/v1google/gemma-4-E2B-itQ4_K_Mbartowski/google_gemma-4-E2B-it-GGUF; google_gemma-4-E2B-it-Q4_K_M.ggufb5e99bd964eaacc27ba484bb2eb3e9f6160b9143b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705m4-max; studio; darwinstrict-same-gguf-llama-servera82fb3fnot captured; not captured; no intentional benchmark load; existing host background state not otherwise controlled2b2ccf37b7568ff154e1935ffc11e1dfa310e7bfbc7f4a6eed09ead04f47c94c
592026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent2026-06-23T13:08:32+00:001django-dashboard-regression-fix-external-agent 0.1.1ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——Q4_K_M———m4-max; studio; darwinexploratory-direct-edit-external-agent86d3194 docs: record endpoint correctness v020 validationnot intentionally controlled; not intentionally controlled; no intentional benchmark load besides local Ollama/Codex workflow83cd20917322de9ee3db923f2cb9f38038970b55a77995dacd646a2c668071a5
602026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent2026-06-23T13:08:32+00:001patch-from-failure-external-agent 0.1.1ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——Q4_K_M———m4-max; studio; darwinexploratory-direct-edit-external-agent86d3194 docs: record endpoint correctness v020 validationnot intentionally controlled; not intentionally controlled; no intentional benchmark load besides local Ollama/Codex workflowd0244bd1751bfc077a48a2a00165d05364cad35809fa76a6a888354bb6eb147b
612026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent2026-06-23T13:08:32+00:001python-regression-fix-external-agent 0.1.1ollama-generateqwen3-coder:30b-a3b-q4_K_Mhttp://localhost:11434/api/generate——Q4_K_M———m4-max; studio; darwinexploratory-direct-edit-external-agent86d3194 docs: record endpoint correctness v020 validationnot intentionally controlled; not intentionally controlled; no intentional benchmark load besides local Ollama/Codex workflow1310606d40d1045fccc217584d90d4ba214e5c11bb486c52c62db8381f9718e5
622026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness2026-06-23T13:08:32+00:001endpoint-python-correctness 0.2.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:18082/v1/chat/completionsllama-server; 9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64; http://127.0.0.1:18082/v1Qwen/Qwen3.6-27BQ4_K_Munsloth/Qwen3.6-27B-GGUF; Qwen3.6-27B-Q4_K_M.gguf—5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0m4-max; studio; darwinstrict-same-gguf-llama-server38f2017not explicitly controlled; not explicitly captured; no intentional benchmark load besides llama-server and benchpack11e6273fd238f4982423c68573a2055bcf368ad41658b0da763637c722d907f6
632026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:18082/v1/chat/completionsllama-server; 9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64; http://127.0.0.1:18082/v1Qwen/Qwen3.6-27BQ4_K_Munsloth/Qwen3.6-27B-GGUF; Qwen3.6-27B-Q4_K_M.gguf—5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0m4-max; studio; darwinstrict-same-gguf-llama-server38f2017not explicitly controlled; not explicitly captured; no intentional benchmark load besides llama-server and benchpackd608b1a3fec1ba5261f492b9cf076c75a24f07cf427579cc42a4278c429e248e
642026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:18082/v1/chat/completionsllama-server; 9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64; http://127.0.0.1:18082/v1Qwen/Qwen3.6-27BQ4_K_Munsloth/Qwen3.6-27B-GGUF; Qwen3.6-27B-Q4_K_M.gguf—5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0m4-max; studio; darwinstrict-same-gguf-llama-server38f2017not explicitly controlled; not explicitly captured; no intentional benchmark load besides llama-server and benchpack092881ce190eb716e92c967580bda824df322e9f896f9b5b5b838cf5f0ef16d6
652026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:18082/v1/chat/completionsllama-server; 9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64; http://127.0.0.1:18082/v1Qwen/Qwen3.6-27BQ4_K_Munsloth/Qwen3.6-27B-GGUF; Qwen3.6-27B-Q4_K_M.gguf—5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0m4-max; studio; darwinstrict-same-gguf-llama-server38f2017not explicitly controlled; not explicitly captured; no intentional benchmark load besides llama-server and benchpack236c343a41303208679df25b6be2db309312652757fb15a05633ba7e74364812
662026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatqwen36-27b-q4kmhttp://127.0.0.1:18082/v1/chat/completionsllama-server; 9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64; http://127.0.0.1:18082/v1Qwen/Qwen3.6-27BQ4_K_Munsloth/Qwen3.6-27B-GGUF; Qwen3.6-27B-Q4_K_M.gguf—5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0m4-max; studio; darwinstrict-same-gguf-llama-server38f2017not explicitly controlled; not explicitly captured; no intentional benchmark load besides llama-server and benchpack3d80ccdf204feffd68b94f25dd97a448cd9abf26ad8905f052fd087ec3745a61
672026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatqwen36-27b-q4kmhttp://127.0.0.1:18082/v1/chat/completionsllama-server; 9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64; http://127.0.0.1:18082/v1Qwen/Qwen3.6-27BQ4_K_Munsloth/Qwen3.6-27B-GGUF; Qwen3.6-27B-Q4_K_M.gguf—5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0m4-max; studio; darwinstrict-same-gguf-llama-server38f2017not explicitly controlled; not explicitly captured; no intentional benchmark load besides llama-server and benchpack56dab960eb9565548bae5eaaec775f8ca1c1946e39ce970a2230116ae8efd88e
682026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch2026-06-23T13:08:32+00:001patch-from-failure 0.1.0openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——d8cd7376ad41d0eb369f6d8edbbca0bc27f1df61ed5769d153820b5b3471bd3d
692026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——b9efa76bb23233a37bc2cc977fea86af373e35532834c464c799635174c1680e
702026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——d888d85a7c9df68378e267eabaafef3ffabd25bdac9dd38b0c1fa7b19f8ee781
712026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap2026-06-23T13:08:32+00:002desktop-django-wrap 0.1.5openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——25f76672c7e40e4c2f86629f3754e0bbd8cd1cc7469c5885f46f557d0ef3c761
722026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness2026-06-23T13:08:32+00:001endpoint-python-correctness 0.2.0openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——cf6953b31b421101e5649378914471a8b097e563e97e31f03f52fa00f7f58a69
732026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime2026-06-23T13:08:32+00:009runtime-sweep 0.1.0openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——6e838b3042e170c907296380debf890d568eeec5296e31a0ff4a8a04e03c13f1
742026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke2026-06-23T13:08:32+00:001smoke-chat 0.1.0openai-chatgemma4-26b-a4b-q4kmhttp://127.0.0.1:18083/v1/chat/completionsllama-server; 9110 (ef22b3e4a); http://127.0.0.1:18083/v1—Q4_K_Mggml-org/gemma-4-26B-A4B-it-GGUF; gemma-4-26B-A4B-it-Q4_K_M.gguf—88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abcstudio; darwinstrict-same-gguf-llama-server——15e0c9bf6abc70f6314988f77c0e949decc39c027becf981bb397f69af1cee8d

Comparison Matrix

runpackcasehostruntimemodelquantizationrowsokscoring passedwall med sTTFT med sdecode TPS medtotal TPS medprompt tok medcached tok medoutput tok med
2026-04-28-mlx-lm-runtimeruntime-sweep 0.1.0longdarwin———33—0.370.06406.38345.01811.00—128.00
2026-04-28-mlx-lm-runtimeruntime-sweep 0.1.0mediumdarwin———33—0.350.06419.80347.09376.00—120.00
2026-04-28-mlx-lm-runtimeruntime-sweep 0.1.0shortdarwin———33—0.260.06436.67299.11104.00—77.00
2026-04-28-mlx-lm-smokesmoke-chat 0.1.0capitaldarwin———111/10.68——11.6841.00—8.00
2026-04-29-llama-server-runtimeruntime-sweep 0.1.0longdarwin———33—0.200.01411.57398.54811.00—81.00
2026-04-29-llama-server-runtimeruntime-sweep 0.1.0mediumdarwin———33—0.300.01410.07402.01376.00—119.00
2026-04-29-llama-server-runtimeruntime-sweep 0.1.0shortdarwin———33—0.280.01411.82403.76104.00—114.00
2026-04-29-llama-server-smokesmoke-chat 0.1.0capitaldarwin———111/10.26——30.8741.00—8.00
2026-04-30-llama-server-desktop-django-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwin———110/10.880.03402.68386.97648.000.00342.00
2026-04-30-llama-server-desktop-django-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwin———110/11.230.27402.87312.83569.000.00384.00
2026-05-03-m4-max-llama-qwen25-05b-190636-patchpatch-from-failure 0.1.0fix-greetingdarwin———110/10.51——318.40199.0023.00161.00
2026-05-03-m4-max-llama-qwen25-05b-190636-runtimeruntime-sweep 0.1.0longdarwin———33—0.250.01335.28325.92811.00810.0081.00
2026-05-03-m4-max-llama-qwen25-05b-190636-runtimeruntime-sweep 0.1.0mediumdarwin———33—0.360.01334.90329.17376.00375.00119.00
2026-05-03-m4-max-llama-qwen25-05b-190636-runtimeruntime-sweep 0.1.0shortdarwin———33—0.350.01333.66327.85104.00103.00114.00
2026-05-03-m4-max-llama-qwen25-05b-190636-smokesmoke-chat 0.1.0capitaldarwin———111/10.20——40.8141.000.008.00
2026-05-03-m4-max-llama-qwen25-05b-190636-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwin———110/11.080.06334.33315.99648.000.00342.00
2026-05-03-m4-max-llama-qwen25-05b-190636-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwin———110/11.200.06338.01320.02569.000.00384.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-patchpatch-from-failure 0.1.0fix-greetingdarwin———110/10.74——344.77199.0024.00256.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-runtimeruntime-sweep 0.1.0longdarwin———33—0.410.06362.45313.60811.00810.00128.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-runtimeruntime-sweep 0.1.0mediumdarwin———33—0.370.05382.64327.46376.00375.00120.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-runtimeruntime-sweep 0.1.0shortdarwin———33—0.250.05395.31311.73104.00103.0077.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-smokesmoke-chat 0.1.0capitaldarwin———111/10.53——15.1641.000.008.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwin———110/11.170.10358.34327.56648.0026.00384.00
2026-05-03-m4-max-mlx-qwen25-05b-185824-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwin———110/11.150.11366.57332.68569.0023.00384.00
2026-05-03-m4-max-qwen3coder-184938-patchpatch-from-failure 0.1.0fix-greetingdarwin———110/11.21—103.5177.04179.00—93.00
2026-05-03-m4-max-qwen3coder-184938-runtimeruntime-sweep 0.1.0longdarwin———33—1.17—99.4291.69790.00—107.00
2026-05-03-m4-max-qwen3coder-184938-runtimeruntime-sweep 0.1.0mediumdarwin———33—1.30—101.0793.68355.00—122.00
2026-05-03-m4-max-qwen3coder-184938-runtimeruntime-sweep 0.1.0shortdarwin———33—1.23—102.5294.4083.00—116.00
2026-05-03-m4-max-qwen3coder-184938-smokesmoke-chat 0.1.0capitaldarwin———111/119.07—66.460.4220.00—8.00
2026-05-03-m4-max-qwen3coder-184938-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwin———110/12.14—100.3773.28627.00—157.00
2026-05-03-m4-max-qwen3coder-184938-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwin———110/11.77—100.6167.19548.00—119.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-patchpatch-from-failure 0.1.0fix-greetingdarwinllama-serverqwen36-27b-q4kmQ4_K_M110/13.63——15.97194.000.0058.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-runtimeruntime-sweep 0.1.0longdarwinllama-serverqwen36-27b-q4kmQ4_K_M33—6.020.1621.8021.25806.00802.00128.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-runtimeruntime-sweep 0.1.0mediumdarwinllama-serverqwen36-27b-q4kmQ4_K_M33—5.880.1522.3521.78364.00360.00128.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-runtimeruntime-sweep 0.1.0shortdarwinllama-serverqwen36-27b-q4kmQ4_K_M33—4.850.1522.3621.6687.0083.00105.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-smokesmoke-chat 0.1.0capitaldarwinllama-serverqwen36-27b-q4kmQ4_K_M111/10.67——11.9824.000.008.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinllama-serverqwen36-27b-q4kmQ4_K_M111/110.363.0121.9015.54657.000.00161.00
2026-05-05-m4-qwen36-dense-llamacpp-154321-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinllama-serverqwen36-27b-q4kmQ4_K_M111/19.932.6021.9516.21579.000.00161.00
2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255smoke-chat 0.1.0capitaldarwinllama-serverqwen36-27b-q4kmQ4_K_M111/11.01——7.9224.000.008.00
2026-05-05-m4-qwen36-dense-mlx-155943-patchpatch-from-failure 0.1.0fix-greetingdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit110/13.12——18.56194.000.0058.00
2026-05-05-m4-qwen36-dense-mlx-155943-runtimeruntime-sweep 0.1.0longdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit33—4.920.1827.0026.02806.00805.00128.00
2026-05-05-m4-qwen36-dense-mlx-155943-runtimeruntime-sweep 0.1.0mediumdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit33—4.930.1826.8525.95364.00363.00128.00
2026-05-05-m4-qwen36-dense-mlx-155943-runtimeruntime-sweep 0.1.0shortdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit33—3.020.1827.0425.4687.0086.0077.00
2026-05-05-m4-qwen36-dense-mlx-155943-smokesmoke-chat 0.1.0capitaldarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit111/10.62——12.8024.0023.008.00
2026-05-05-m4-qwen36-dense-mlx-155943-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit111/17.582.8626.7116.63657.000.00126.00
2026-05-05-m4-qwen36-dense-mlx-155943-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit111/18.672.5026.8919.14579.000.00166.00
2026-05-05-m4-qwen36-dense-mlx-smoke-155916smoke-chat 0.1.0capitaldarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-27B-4bit4bit111/10.99——8.1124.000.008.00
2026-05-05-m4-qwen36-dense-ollama-155051-patchpatch-from-failure 0.1.0fix-greetingdarwinollamaqwen36-27b-gguf:q4kmQ4_K_M110/11.13——0.88183.00—1.00
2026-05-05-m4-qwen36-dense-ollama-155051-runtimeruntime-sweep 0.1.0longdarwinollamaqwen36-27b-gguf:q4kmQ4_K_M33—9.39—16.4213.63795.00—128.00
2026-05-05-m4-qwen36-dense-ollama-155051-runtimeruntime-sweep 0.1.0mediumdarwinollamaqwen36-27b-gguf:q4kmQ4_K_M33—9.79—16.4613.08353.00—128.00
2026-05-05-m4-qwen36-dense-ollama-155051-runtimeruntime-sweep 0.1.0shortdarwinollamaqwen36-27b-gguf:q4kmQ4_K_M33—8.52—16.3615.0276.00—128.00
2026-05-05-m4-qwen36-dense-ollama-155051-smokesmoke-chat 0.1.0capitaldarwinollamaqwen36-27b-gguf:q4kmQ4_K_M111/12.21—16.5313.5512.00—30.00
2026-05-05-m4-qwen36-dense-ollama-155051-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinollamaqwen36-27b-gguf:q4kmQ4_K_M110/127.11—16.3114.16646.00—384.00
2026-05-05-m4-qwen36-dense-ollama-155051-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinollamaqwen36-27b-gguf:q4kmQ4_K_M110/126.86—16.1614.30568.00—384.00
2026-05-05-m4-qwen36-dense-ollama-smoke-154808smoke-chat 0.1.0capitaldarwinollamaqwen36-27b-gguf:q4kmQ4_K_M111/114.02—16.562.1412.00—30.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-patchpatch-from-failure 0.1.0fix-greetingdarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M110/11.08——53.56194.000.0058.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-runtimeruntime-sweep 0.1.0longdarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M33—1.850.0470.7769.35806.00802.00128.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-runtimeruntime-sweep 0.1.0mediumdarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M33—1.760.0474.1872.54364.00360.00128.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-runtimeruntime-sweep 0.1.0shortdarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M33—1.880.0467.3865.9887.0083.00124.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-smokesmoke-chat 0.1.0capitaldarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M111/10.21——38.1224.000.008.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M111/12.660.5871.8656.05657.000.00149.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M111/12.690.5473.8258.84579.000.00158.00
2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634smoke-chat 0.1.0capitaldarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M111/10.55——14.4524.000.008.00
2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159smoke-chat 0.1.0capitaldarwinllama-serverqwen36-35b-a3b-q4kmUD-Q4_K_M110/11.14——56.2122.000.0064.00
2026-05-05-m4-qwen36-moe-mlx-155645-patchpatch-from-failure 0.1.0fix-greetingdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4110/10.93——62.64194.000.0058.00
2026-05-05-m4-qwen36-moe-mlx-155645-runtimeruntime-sweep 0.1.0longdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP433—1.420.1399.7290.44806.00805.00128.00
2026-05-05-m4-qwen36-moe-mlx-155645-runtimeruntime-sweep 0.1.0mediumdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP433—1.440.1397.3288.66364.00363.00128.00
2026-05-05-m4-qwen36-moe-mlx-155645-runtimeruntime-sweep 0.1.0shortdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP433—1.120.12100.6789.8187.0086.00101.00
2026-05-05-m4-qwen36-moe-mlx-155645-smokesmoke-chat 0.1.0capitaldarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4111/10.37——21.9124.0023.008.00
2026-05-05-m4-qwen36-moe-mlx-155645-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4111/12.080.5693.6068.32657.000.00142.00
2026-05-05-m4-qwen36-moe-mlx-155645-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4111/12.130.5594.5770.06579.000.00149.00
2026-05-05-m4-qwen36-moe-mlx-smoke-155619smoke-chat 0.1.0capitaldarwinmlx-lm server/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4MXFP4111/11.46——5.4824.000.008.00
2026-05-05-m4-qwen36-moe-ollama-154846-patchpatch-from-failure 0.1.0fix-greetingdarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M110/16.12—45.5241.86183.00—256.00
2026-05-05-m4-qwen36-moe-ollama-154846-runtimeruntime-sweep 0.1.0longdarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M33—3.29—45.7638.95795.00—128.00
2026-05-05-m4-qwen36-moe-ollama-154846-runtimeruntime-sweep 0.1.0mediumdarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M33—3.36—45.6138.05353.00—128.00
2026-05-05-m4-qwen36-moe-ollama-154846-runtimeruntime-sweep 0.1.0shortdarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M33—3.16—45.0540.5676.00—128.00
2026-05-05-m4-qwen36-moe-ollama-154846-smokesmoke-chat 0.1.0capitaldarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M111/11.22——————
2026-05-05-m4-qwen36-moe-ollama-154846-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M110/16.41—45.6539.01646.00—250.00
2026-05-05-m4-qwen36-moe-ollama-154846-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M110/19.42—45.3640.77568.00—384.00
2026-05-05-m4-qwen36-moe-ollama-smoke-154747smoke-chat 0.1.0capitaldarwinollamaqwen36-35b-a3b-gguf:q4kmUD-Q4_K_M111/16.12——————
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patchpatch-from-failure 0.1.0fix-greetingm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M110/10.65——119.15191.004.0078.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtimeruntime-sweep 0.1.0longm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.680.01138.82136.51799.00798.0093.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtimeruntime-sweep 0.1.0mediumm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.880.02140.94136.99356.00351.00121.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtimeruntime-sweep 0.1.0shortm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.610.02140.34135.1784.0079.0083.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smokesmoke-chat 0.1.0capitalm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/10.11——69.8021.000.008.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrapdesktop-django-wrap 0.1.5wrap-plan-contextm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/11.160.27139.02106.62677.006.00124.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrapdesktop-django-wrap 0.1.5wrap-plan-smallm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/11.090.26140.91107.45596.006.00117.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patchpatch-from-failure 0.1.0fix-greetingm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M110/10.65——119.48191.004.0078.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtimeruntime-sweep 0.1.0longm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.670.01141.02138.63799.00798.0093.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtimeruntime-sweep 0.1.0mediumm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.880.02141.75137.83356.00351.00121.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtimeruntime-sweep 0.1.0shortm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.600.02142.55137.1984.0079.0083.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smokesmoke-chat 0.1.0capitalm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/10.11——71.1821.000.008.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrapdesktop-django-wrap 0.1.5wrap-plan-contextm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/11.150.27141.03107.79677.006.00124.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrapdesktop-django-wrap 0.1.5wrap-plan-smallm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/11.090.26141.31107.72596.006.00117.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928runtime-sweep 0.1.0longm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.670.01141.28138.35799.00798.0093.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928runtime-sweep 0.1.0mediumm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.890.03140.53136.38356.00351.00121.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928runtime-sweep 0.1.0shortm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M33—0.610.02141.18135.5884.0079.0083.00
2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856smoke-chat 0.1.0capitalm4-max; darwinllama-servergoogle/gemma-4-E2B-itQ4_K_M111/10.30——26.4421.000.008.00
2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agentdjango-dashboard-regression-fix-external-agent 0.1.1fix-dashboard-regressionsm4-max; darwin——Q4_K_M110/111.32—96.1583.841468.00—949.00
2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agentpatch-from-failure-external-agent 0.1.1fix-greetingm4-max; darwin——Q4_K_M111/111.83—102.857.86346.00—93.00
2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agentpython-regression-fix-external-agent 0.1.1fix-task-summarym4-max; darwin——Q4_K_M110/15.58—100.0783.73957.00—467.00
2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctnessendpoint-python-correctness 0.2.0fix-inventory-aggregationm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M111/122.88——18.09962.000.00414.00
2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smokesmoke-chat 0.1.0capitalm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M111/10.77——10.3924.000.008.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patchpatch-from-failure 0.1.0fix-greetingm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M111/14.62——13.64363.000.0063.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtimeruntime-sweep 0.1.0longm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M33—5.860.1522.4221.84806.00802.00128.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtimeruntime-sweep 0.1.0mediumm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M33—5.990.1521.9421.39364.00360.00128.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtimeruntime-sweep 0.1.0shortm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M33—4.960.1521.9221.1987.0083.00105.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smokesmoke-chat 0.1.0capitalm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M111/10.68——11.8224.000.008.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrapdesktop-django-wrap 0.1.5wrap-plan-contextm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M111/110.192.9522.2615.81657.000.00161.00
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrapdesktop-django-wrap 0.1.5wrap-plan-smallm4-max; darwinllama-serverQwen/Qwen3.6-27BQ4_K_M111/19.832.5622.1516.38579.000.00161.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patchpatch-from-failure 0.1.0fix-greetingdarwinllama-server—Q4_K_M111/11.00——61.79373.004.0062.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtimeruntime-sweep 0.1.0longdarwinllama-server—Q4_K_M33—1.470.0489.9587.25803.00798.00128.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtimeruntime-sweep 0.1.0mediumdarwinllama-server—Q4_K_M33—1.390.0491.6989.08360.00355.00124.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtimeruntime-sweep 0.1.0shortdarwinllama-server—Q4_K_M33—0.730.0492.2687.5888.0083.0064.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smokesmoke-chat 0.1.0capitaldarwinllama-server—Q4_K_M111/10.24——33.9425.000.008.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrapdesktop-django-wrap 0.1.5wrap-plan-contextdarwinllama-server—Q4_K_M111/11.980.5792.5365.70681.006.00130.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrapdesktop-django-wrap 0.1.5wrap-plan-smalldarwinllama-server—Q4_K_M111/11.560.5492.9060.99600.006.0095.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctnessendpoint-python-correctness 0.2.0fix-inventory-aggregationdarwinllama-server—Q4_K_M110/13.46——67.841029.004.00235.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtimeruntime-sweep 0.1.0longdarwinllama-server—Q4_K_M33—1.450.0491.0788.26803.00798.00128.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtimeruntime-sweep 0.1.0mediumdarwinllama-server—Q4_K_M33—1.380.0492.7690.02360.00355.00124.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtimeruntime-sweep 0.1.0shortdarwinllama-server—Q4_K_M33—0.720.0494.1889.1388.0083.0064.00
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smokesmoke-chat 0.1.0capitaldarwinllama-server—Q4_K_M111/10.22——37.0325.000.008.00

Case Metrics

runpackcaserowsokprompt rowsprompt mediancached rowscached medianprefill rowsprefill median
2026-04-28-mlx-lm-runtimeruntime-sweep 0.1.0long333811.000—314475.75
2026-04-28-mlx-lm-runtimeruntime-sweep 0.1.0medium333376.000—36245.15
2026-04-28-mlx-lm-runtimeruntime-sweep 0.1.0short333104.000—31703.63
2026-04-28-mlx-lm-smokesmoke-chat 0.1.0capital11141.000—0—
2026-04-29-llama-server-runtimeruntime-sweep 0.1.0long333811.000—3120958.26
2026-04-29-llama-server-runtimeruntime-sweep 0.1.0medium333376.000—364642.76
2026-04-29-llama-server-runtimeruntime-sweep 0.1.0short333104.000—318814.73
2026-04-29-llama-server-smokesmoke-chat 0.1.0capital11141.000—0—
2026-04-30-llama-server-desktop-django-wrapdesktop-django-wrap 0.1.5wrap-plan-context111648.0010.00118793.21
2026-04-30-llama-server-desktop-django-wrapdesktop-django-wrap 0.1.5wrap-plan-small111569.0010.0012074.09
2026-05-03-m4-max-llama-qwen25-05b-190636-patchpatch-from-failure 0.1.0fix-greeting111199.00123.000—
2026-05-03-m4-max-llama-qwen25-05b-190636-runtimeruntime-sweep 0.1.0long333811.003810.003116940.93
2026-05-03-m4-max-llama-qwen25-05b-190636-runtimeruntime-sweep 0.1.0medium333376.003375.00360860.30
2026-05-03-m4-max-llama-qwen25-05b-190636-runtimeruntime-sweep 0.1.0short333104.003103.00317181.44
2026-05-03-m4-max-llama-qwen25-05b-190636-smokesmoke-chat 0.1.0capital11141.0010.000—
2026-05-03-m4-max-llama-qwen25-05b-190636-wrapdesktop-django-wrap 0.1.5wrap-plan-context111648.0010.00110915.43
2026-05-03-m4-max-llama-qwen25-05b-190636-wrapdesktop-django-wrap 0.1.5wrap-plan-small111569.0010.0018907.68
2026-05-03-m4-max-mlx-qwen25-05b-185824-patchpatch-from-failure 0.1.0fix-greeting111199.00124.000—
2026-05-03-m4-max-mlx-qwen25-05b-185824-runtimeruntime-sweep 0.1.0long333811.003810.00314740.91
2026-05-03-m4-max-mlx-qwen25-05b-185824-runtimeruntime-sweep 0.1.0medium333376.003375.0037108.90
2026-05-03-m4-max-mlx-qwen25-05b-185824-runtimeruntime-sweep 0.1.0short333104.003103.0031989.65
2026-05-03-m4-max-mlx-qwen25-05b-185824-smokesmoke-chat 0.1.0capital11141.0010.000—
2026-05-03-m4-max-mlx-qwen25-05b-185824-wrapdesktop-django-wrap 0.1.5wrap-plan-context111648.00126.0016435.77
2026-05-03-m4-max-mlx-qwen25-05b-185824-wrapdesktop-django-wrap 0.1.5wrap-plan-small111569.00123.0015332.03
2026-05-03-m4-max-qwen3coder-184938-patchpatch-from-failure 0.1.0fix-greeting111179.000—1932.39
2026-05-03-m4-max-qwen3coder-184938-runtimeruntime-sweep 0.1.0long333790.000—376626.80
2026-05-03-m4-max-qwen3coder-184938-runtimeruntime-sweep 0.1.0medium333355.000—333696.40
2026-05-03-m4-max-qwen3coder-184938-runtimeruntime-sweep 0.1.0short33383.000—37975.31
2026-05-03-m4-max-qwen3coder-184938-smokesmoke-chat 0.1.0capital11120.000—152.08
2026-05-03-m4-max-qwen3coder-184938-wrapdesktop-django-wrap 0.1.5wrap-plan-context111627.000—11289.58
2026-05-03-m4-max-qwen3coder-184938-wrapdesktop-django-wrap 0.1.5wrap-plan-small111548.000—11191.99
2026-05-05-m4-qwen36-dense-llamacpp-154321-patchpatch-from-failure 0.1.0fix-greeting111194.0010.000—
2026-05-05-m4-qwen36-dense-llamacpp-154321-runtimeruntime-sweep 0.1.0long333806.003802.0035156.87
2026-05-05-m4-qwen36-dense-llamacpp-154321-runtimeruntime-sweep 0.1.0medium333364.003360.0032437.34
2026-05-05-m4-qwen36-dense-llamacpp-154321-runtimeruntime-sweep 0.1.0short33387.00383.003570.36
2026-05-05-m4-qwen36-dense-llamacpp-154321-smokesmoke-chat 0.1.0capital11124.0010.000—
2026-05-05-m4-qwen36-dense-llamacpp-154321-wrapdesktop-django-wrap 0.1.5wrap-plan-context111657.0010.001218.57
2026-05-05-m4-qwen36-dense-llamacpp-154321-wrapdesktop-django-wrap 0.1.5wrap-plan-small111579.0010.001222.64
2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255smoke-chat 0.1.0capital11124.0010.000—
2026-05-05-m4-qwen36-dense-mlx-155943-patchpatch-from-failure 0.1.0fix-greeting111194.0010.000—
2026-05-05-m4-qwen36-dense-mlx-155943-runtimeruntime-sweep 0.1.0long333806.003805.0034493.64
2026-05-05-m4-qwen36-dense-mlx-155943-runtimeruntime-sweep 0.1.0medium333364.003363.0032036.54
2026-05-05-m4-qwen36-dense-mlx-155943-runtimeruntime-sweep 0.1.0short33387.00386.003491.91
2026-05-05-m4-qwen36-dense-mlx-155943-smokesmoke-chat 0.1.0capital11124.00123.000—
2026-05-05-m4-qwen36-dense-mlx-155943-wrapdesktop-django-wrap 0.1.5wrap-plan-context111657.0010.001229.75
2026-05-05-m4-qwen36-dense-mlx-155943-wrapdesktop-django-wrap 0.1.5wrap-plan-small111579.0010.001231.51
2026-05-05-m4-qwen36-dense-mlx-smoke-155916smoke-chat 0.1.0capital11124.0010.000—
2026-05-05-m4-qwen36-dense-ollama-155051-patchpatch-from-failure 0.1.0fix-greeting111183.000—1180.88
2026-05-05-m4-qwen36-dense-ollama-155051-runtimeruntime-sweep 0.1.0long333795.000—3549.94
2026-05-05-m4-qwen36-dense-ollama-155051-runtimeruntime-sweep 0.1.0medium333353.000—3191.22
2026-05-05-m4-qwen36-dense-ollama-155051-runtimeruntime-sweep 0.1.0short33376.000—3138.13
2026-05-05-m4-qwen36-dense-ollama-155051-smokesmoke-chat 0.1.0capital11112.000—144.51
2026-05-05-m4-qwen36-dense-ollama-155051-wrapdesktop-django-wrap 0.1.5wrap-plan-context111646.000—1195.23
2026-05-05-m4-qwen36-dense-ollama-155051-wrapdesktop-django-wrap 0.1.5wrap-plan-small111568.000—1202.14
2026-05-05-m4-qwen36-dense-ollama-smoke-154808smoke-chat 0.1.0capital11112.000—118.23
2026-05-05-m4-qwen36-moe-llamacpp-153657-patchpatch-from-failure 0.1.0fix-greeting111194.0010.000—
2026-05-05-m4-qwen36-moe-llamacpp-153657-runtimeruntime-sweep 0.1.0long333806.003802.00321799.00
2026-05-05-m4-qwen36-moe-llamacpp-153657-runtimeruntime-sweep 0.1.0medium333364.003360.00310168.98
2026-05-05-m4-qwen36-moe-llamacpp-153657-runtimeruntime-sweep 0.1.0short33387.00383.0031983.44
2026-05-05-m4-qwen36-moe-llamacpp-153657-smokesmoke-chat 0.1.0capital11124.0010.000—
2026-05-05-m4-qwen36-moe-llamacpp-153657-wrapdesktop-django-wrap 0.1.5wrap-plan-context111657.0010.0011123.31
2026-05-05-m4-qwen36-moe-llamacpp-153657-wrapdesktop-django-wrap 0.1.5wrap-plan-small111579.0010.0011062.68
2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634smoke-chat 0.1.0capital11124.0010.000—
2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159smoke-chat 0.1.0capital11122.0010.000—
2026-05-05-m4-qwen36-moe-mlx-155645-patchpatch-from-failure 0.1.0fix-greeting111194.0010.000—
2026-05-05-m4-qwen36-moe-mlx-155645-runtimeruntime-sweep 0.1.0long333806.003805.0036118.59
2026-05-05-m4-qwen36-moe-mlx-155645-runtimeruntime-sweep 0.1.0medium333364.003363.0032832.95
2026-05-05-m4-qwen36-moe-mlx-155645-runtimeruntime-sweep 0.1.0short33387.00386.003696.58
2026-05-05-m4-qwen36-moe-mlx-155645-smokesmoke-chat 0.1.0capital11124.00123.000—
2026-05-05-m4-qwen36-moe-mlx-155645-wrapdesktop-django-wrap 0.1.5wrap-plan-context111657.0010.0011170.50
2026-05-05-m4-qwen36-moe-mlx-155645-wrapdesktop-django-wrap 0.1.5wrap-plan-small111579.0010.0011050.42
2026-05-05-m4-qwen36-moe-mlx-smoke-155619smoke-chat 0.1.0capital11124.0010.000—
2026-05-05-m4-qwen36-moe-ollama-154846-patchpatch-from-failure 0.1.0fix-greeting111183.000—1670.11
2026-05-05-m4-qwen36-moe-ollama-154846-runtimeruntime-sweep 0.1.0long333795.000—32288.59
2026-05-05-m4-qwen36-moe-ollama-154846-runtimeruntime-sweep 0.1.0medium333353.000—3862.50
2026-05-05-m4-qwen36-moe-ollama-154846-runtimeruntime-sweep 0.1.0short33376.000—3415.95
2026-05-05-m4-qwen36-moe-ollama-154846-smokesmoke-chat 0.1.0capital110—0—0—
2026-05-05-m4-qwen36-moe-ollama-154846-wrapdesktop-django-wrap 0.1.5wrap-plan-context111646.000—1868.31
2026-05-05-m4-qwen36-moe-ollama-154846-wrapdesktop-django-wrap 0.1.5wrap-plan-small111568.000—1829.47
2026-05-05-m4-qwen36-moe-ollama-smoke-154747smoke-chat 0.1.0capital110—0—0—
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patchpatch-from-failure 0.1.0fix-greeting111191.0014.000—
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtimeruntime-sweep 0.1.0long333799.003798.00370476.94
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtimeruntime-sweep 0.1.0medium333356.003351.00314817.46
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtimeruntime-sweep 0.1.0short33384.00379.0033683.39
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smokesmoke-chat 0.1.0capital11121.0010.000—
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrapdesktop-django-wrap 0.1.5wrap-plan-context111677.0016.0012498.04
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrapdesktop-django-wrap 0.1.5wrap-plan-small111596.0016.0012305.09
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patchpatch-from-failure 0.1.0fix-greeting111191.0014.000—
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtimeruntime-sweep 0.1.0long333799.003798.00370594.47
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtimeruntime-sweep 0.1.0medium333356.003351.00314678.95
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtimeruntime-sweep 0.1.0short33384.00379.0033680.53
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smokesmoke-chat 0.1.0capital11121.0010.000—
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrapdesktop-django-wrap 0.1.5wrap-plan-context111677.0016.0012496.94
2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrapdesktop-django-wrap 0.1.5wrap-plan-small111596.0016.0012309.08
2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928runtime-sweep 0.1.0long333799.003798.00357450.16
2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928runtime-sweep 0.1.0medium333356.003351.00313811.25
2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928runtime-sweep 0.1.0short33384.00379.0033430.95
2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856smoke-chat 0.1.0capital11121.0010.000—
2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agentdjango-dashboard-regression-fix-external-agent 0.1.1fix-dashboard-regressions1111468.000—11321.70
2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agentpatch-from-failure-external-agent 0.1.1fix-greeting111346.000—11078.93
2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agentpython-regression-fix-external-agent 0.1.1fix-task-summary111957.000—11352.95
2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctnessendpoint-python-correctness 0.2.0fix-inventory-aggregation111962.0010.000—
2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smokesmoke-chat 0.1.0capital11124.0010.000—
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patchpatch-from-failure 0.1.0fix-greeting111363.0010.000—
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtimeruntime-sweep 0.1.0long333806.003802.0035304.76
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtimeruntime-sweep 0.1.0medium333364.003360.0032418.51
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtimeruntime-sweep 0.1.0short33387.00383.003583.75
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smokesmoke-chat 0.1.0capital11124.0010.000—
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrapdesktop-django-wrap 0.1.5wrap-plan-context111657.0010.001222.52
2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrapdesktop-django-wrap 0.1.5wrap-plan-small111579.0010.001226.07
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patchpatch-from-failure 0.1.0fix-greeting111373.0014.000—
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtimeruntime-sweep 0.1.0long333803.003798.00318378.28
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtimeruntime-sweep 0.1.0medium333360.003355.0039084.58
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtimeruntime-sweep 0.1.0short33388.00383.0032310.64
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smokesmoke-chat 0.1.0capital11125.0010.000—
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrapdesktop-django-wrap 0.1.5wrap-plan-context111681.0016.0011187.03
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrapdesktop-django-wrap 0.1.5wrap-plan-small111600.0016.0011121.19
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctnessendpoint-python-correctness 0.2.0fix-inventory-aggregation1111029.0014.000—
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtimeruntime-sweep 0.1.0long333803.003798.00317985.88
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtimeruntime-sweep 0.1.0medium333360.003355.0038795.53
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtimeruntime-sweep 0.1.0short33388.00383.0032285.61
2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smokesmoke-chat 0.1.0capital11125.0010.000—

Agent Wrap One-Shot Runs

statusmodelharness/providerthinkingtimefilesinsertionsdeletionsnode testssmoketargetartifactnotes
PASSGPT-5.6 SolPi / OpenAI Codexthinking off, neutral runner362.90s
6m03s		36610014439HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt56sol-pi-django-resume-030-off/New fastest row in the dataset: 362.9s beats GPT-5.5 via Pi thinking off (431.7s) by 16%. Pi 0.84.4 through the built-in openai-codex provider, model gpt-5.6-sol, thinking off, --pi-mode json (JSON transcript kept for forensics; the GPT-5.5 Pi cell used text mode). 38 turns and 68 tool calls (27 read, 21 bash, 14 write, 6 edit). Smallest diff of the 2026-09-01/02 cells (36 files, +6100/-144) with the leanest Django side (89-line base_settings.py, 46-line middleware.py); 39 model-authored Node tests against 53 for GPT-5.5 Pi off. Verified its own dev smoke and redirect chain but did not boot its own packaged smoke; the verifier's independent packaged smoke passed. D-040 override in effect, empty dist/, no workaround. Host caveat: another session's Flash-Next llama-server was resident (13-14% free memory) and generating for its own qwen38-flashnext-pi-llamacpp-128k-medium-rerun2 wrap cell at 74-107% CPU throughout, 1-minute load average 3-19, so the wall time is an upper bound.
PASSGPT-5.6 SolCodex CLI / yoloreasoning low, neutral runner362.90s
6m03s		37819914153HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt56sol-codex-yolo-django-resume-030-low/Passed at 362.9s, tying the GPT-5.6 Sol Pi thinking-off cell to the tenth of a second for fastest row in the dataset, 17% faster than the GPT-5.5 Codex low rerun (438.3s), and passing on the first attempt where GPT-5.5 low had failed once (491.9s) before its rerun. 53 model-authored Node tests, the same count as every GPT-5.5 Codex cell; 37 files, +8199/-141, with a compact Django side (62-line base_settings.py, 41-line desktop.py) and no packaging CI workflow, which it called optional for the wrapping scope. Codex CLI 0.151.0, model id gpt-5.6-sol, model_reasoning_effort=low set explicitly. Verified its own dev smoke, redirect chain, token probes, and packaged settings; did not boot its own packaged smoke; the verifier's independent packaged smoke passed. D-040 override in effect, empty dist/, no workaround. Host caveat: another session's Flash-Next llama-server was resident (13-14% free memory) and generating for its own qwen38-flashnext-pi-llamacpp-128k-medium-rerun2 wrap cell at roughly 70-80% CPU for most of the cell, 1-minute load average 8-21, so the wall time is an upper bound.
PASSGPT-5.5Pi / OpenAI Codexthinking off, neutral runner431.70s
7m12s		35776714053HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt55-pi-django-resume-030-off/Fresh Pi/off retry completed normally and passed packaged smoke; fastest current-target pass.
PASSGPT-5.5Codex CLI / yoloreasoning low, neutral rerun438.30s
7m18s		378179053HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt55-codex-yolo-django-resume-030-low-rerun1/Fresh Codex low rerun passed packaged smoke; fastest direct Codex CLI current-target pass.
PASSClaude Opus 5Claude Code / yoloeffort low, neutral runner535.20s
8m55s		36691713941HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/opus5-claude-yolo-django-resume-030-low/Passed at 535.2s, 49% faster than Opus 4.8 low (1053.0s) and the fastest direct Claude Code/yolo row so far, ahead of Fable 5.1 medium (737.5s). Explicit model id claude-opus-5 on Claude Code 2.1.257 with the D-040 Electron override in effect. 41 model-authored Node tests (Opus 4.8 low: 53). Authored a Go menu for back/forward/overview navigation and an app-data-copy desktop dev mode because example/db.sqlite3 is tracked; deliberately added no packaging CI workflow and said so in its docs. Did not boot its own packaged smoke; the verifier's independent packaged smoke passed. The first launch at 23:13 hit the Claude account session limit after 188.6s with 28 files changed and was discarded as infrastructure noise; this row is the forced retry launched 00:57. Host: the first ~3 minutes ran on a quiet host (80% free memory); from 01:00 another session's Flash-Next llama-server was resident again (10-11% free memory) and generating for its own wrap cell at 80-180% CPU, with the 1-minute load average reaching 101 as this cell finished, so the wall time is still an upper bound.
PASSGPT-5.6 SolCodex CLI / yoloreasoning medium, neutral runner595.70s
9m56s		39841714253HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt56sol-codex-yolo-django-resume-030-medium/First GPT-5.6 Sol Codex CLI cell. Passed at 595.7s, 20% faster than GPT-5.5 Codex medium (741.9s) with a comparable diff (39 files, +8417/-142 vs +7401/-140) and 53 model-authored Node tests (GPT-5.5 medium: 55) plus 4 new Django tests in tests/desktop_runtime_test.py. Codex CLI 0.151.0, model id gpt-5.6-sol, model_reasoning_effort=medium set explicitly on the command line (the host's ~/.codex/config.toml default is high). Verified its own dev smoke, redirect chain, token behaviour, and packaged settings through the test client; did not boot its own packaged smoke; the verifier's independent packaged smoke passed. D-040 override in effect, empty dist/, no workaround. Host caveat: another session's Flash-Next llama-server was resident (13-14% free memory) and generating for its own qwen38-flashnext-pi-llamacpp-128k-medium-rerun2 wrap cell at 74-107% CPU throughout, 1-minute load average 3-21, so the wall time is an upper bound.
PASSClaude Opus 4.8Pi / OpenRouteroff612.40s
10m12s		36751313553HTTP okdjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-opus48-openrouter-main-off/Fastest Opus 4.8 current-target pass; highest approximate OpenRouter cost among successful hosted rows.
PASSGPT-5.6 SolCodex CLI / yoloreasoning high, neutral runner635.90s
10m36s		43853214154HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt56sol-codex-yolo-django-resume-030-high/Completes the GPT-5.6 Sol Codex sweep at 3 for 3 (low 362.9s, medium 595.7s, high 635.9s), 18% faster than GPT-5.5 Codex high (776.2s). 54 model-authored Node tests (GPT-5.5 high: 53) and the largest GPT-5.6 Sol diff (43 files, +8532/-141): a 177-line cross-platform packaging workflow with checksum publishing, a docs/dev/desktop.txt guide, and a Sphinx build run with warnings treated as errors. Codex CLI 0.151.0, model id gpt-5.6-sol, model_reasoning_effort=high set explicitly. Verified its own dev smoke, redirect chain, edit view, token probes, packaged static serving, and both media-bootstrap probes; did not boot its own packaged smoke; the verifier's independent packaged smoke passed. D-040 override in effect, empty dist/, no workaround. Host caveat: another session's Flash-Next llama-server was resident (14-18% free memory) and generating intermittently for its own qwen38-flashnext-pi-llamacpp-128k-medium-rerun2 wrap cell at 0-122% CPU, 1-minute load average 3-16, so the wall time is an upper bound.
PASSGPT-5.5Codex CLI / yoloreasoning low669.90s
11m10s		39838513753HTTP okdjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-gpt55-codex-yolo-main-low/Earlier direct Codex low pass from the legacy artifact root; slower than the fresh Pi/off and Codex-low rerun rows.
PASSGPT-5.5Pi / OpenAI Codexthinking high701.20s
11m41s		35804914353HTTP okdjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-gpt55-main-high/Clean Pi/GPT-5.5 pass; parsed unique-turn usage estimate about $4.92.
PASSClaude Fable 5.1Claude Code / yoloeffort low, neutral runner702.90s
11m43s		40795213857HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/fable51-claude-yolo-django-resume-030-low/Passed at 702.9s, 33% faster than Opus 4.8 low (1053.0s) and slightly faster than Fable 5.1 medium (737.5s); slower than Opus 5 low (535.2s). Explicit model id claude-fable-5-1 on Claude Code 2.1.257. 57 model-authored Node tests plus 13 new Django tests in tests/desktop_test.py; authored a Go menu for back/forward/overview navigation and a placeholder icon set. D-040 note: unlike the other three Claude 5 cells, this one reported that electron could not start after npm install skipped Electron's postinstall and copied the 275 MB Electron 40.8.5 dist plus path.txt from the starter checkout, so it measures workaround ability alongside wrapping ability; the other cells ran on the empty dist via the ELECTRON_OVERRIDE_DIST_PATH override. It also wrote a Claude Code auto-memory note about that workaround under ~/.claude/projects/ for the target path. Did not boot its own packaged smoke; the verifier's independent packaged smoke passed. The first launch at 23:11 hit the Claude account session limit after 361.6s with 32 files changed and was discarded as infrastructure noise; this row is the forced retry launched 00:57. Host: quiet for the first ~3 minutes (80% free memory); from 01:00 another session's Flash-Next llama-server was resident again (10-12% free memory) and generating for its own wrap cell, with the 1-minute load average at 90-101 during this cell's last three minutes, so the wall time is an upper bound.
PASSGPT-5.5Codex CLI / yoloreasoning high730.20s
12m10s		39848414053HTTP okdjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-gpt55-codex-yolo-main-high/Slightly slower than Codex low reasoning on this single pair; broader target-side docs/tests.
PASSClaude Fable 5.1Claude Code / yoloeffort medium, neutral runner737.50s
12m18s		43829413460HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/fable51-claude-yolo-django-resume-030-medium/First Claude 5-family cell on this benchmark and the fastest direct Claude Code/yolo row so far (737.5s vs Opus 4.8 medium 871.0s). Explicit model id claude-fable-5-1 on Claude Code 2.1.257 with the D-040 Electron override in effect. Authored a Go menu module (app-menu.cjs, with tests) for back/forward/overview navigation plus a Django-side tests/desktop_shell_test.py; 60 model-authored Node tests is the most of any Claude Code/yolo row. The agent skipped its own packaged smoke per the skill's unattended-run guidance; the verifier's independent packaged smoke passed. Host caveat: the first ~6.5 minutes overlapped another session's 744s sustained-generation load test against a resident ~49 GB Flash-Next llama-server (1-minute load average 159 two minutes after launch, 10-14% free memory, swap in use), and its last ~5-7 minutes overlapped the same session's qwen38-flashnext-pi-llamacpp-128k-medium-rerun1 local-model wrap cell (launched 23:06:34) generating on that server, so treat the wall time as an upper bound.
PASSGPT-5.5Codex CLI / yoloreasoning medium, neutral runner741.90s
12m22s		39740114055HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt55-codex-yolo-django-resume-030-medium/Moderate reasoning pass; slower than low rerun and slightly faster than neutral high.
PASSGPT-5.5Codex CLI / yoloreasoning high, neutral runner776.20s
12m56s		38838013853HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt55-codex-yolo-django-resume-030-high/Fresh neutral-runner repeat. Passed packaged smoke; slower than same-session Codex low failed run.
PASSClaude Opus 5Claude Code / yoloeffort high, neutral runner850.30s
14m10s		47838313458HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/opus5-claude-yolo-django-resume-030-high/Completes the Opus 5 sweep at 3 for 3. Passed at 850.3s, 25% faster than Opus 4.8 high (1131.3s) and level with Opus 5 medium (855.8s); Opus 5 low (535.2s) remains the fastest of the three. Explicit model id claude-opus-5 on Claude Code 2.1.257 with the D-040 Electron override in effect (empty dist/, no workaround). 58 model-authored Node tests (Opus 4.8 high: 33), the largest diff of the Opus 5 cells: a separate navigation.cjs module behind the Go menu, an SVG brand icon with generated icon set, a cross-platform CI workflow, and a fix for the project's missing STATICFILES_DIRS that had left example/static/css/custom.css returning 404. Did not boot its own packaged smoke; the verifier's independent packaged smoke passed. The first launch at 23:16 hit the Claude account session limit within 3.1s with no files changed and was discarded as infrastructure noise; this row is the forced retry launched 01:06 after Opus 5 low in the same lane. Host: throughout the cell another session's Flash-Next llama-server was resident (10-14% free memory) and generating for its own wrap cell at 90-145% CPU, with the 1-minute load average between 5 and 133, so the wall time is an upper bound.
PASSClaude Opus 5Claude Code / yoloeffort medium, neutral runner855.80s
14m16s		41707513633HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/opus5-claude-yolo-django-resume-030-medium/Passed at 855.8s, marginally faster than Opus 4.8 medium (871.0s) and 16% slower than the Fable 5.1 medium cell launched concurrently (737.5s). Explicit model id claude-opus-5 on Claude Code 2.1.257 with the D-040 Electron override in effect. 33 model-authored Node tests, fewer than Opus 4.8 medium (53) and equal to Opus 4.8 high (33). Also authored a Go menu (app-menu.cjs, with tests), staged the backend with the bundled Python 3.13 and re-ran the Django-side checks inside the stage bundle; it did not boot its own packaged smoke, and the verifier's independent packaged smoke passed. Same host caveat as the Fable 5.1 medium cell: the first ~6.5 minutes overlapped another session's 744s sustained-generation load test against a resident ~49 GB Flash-Next llama-server, and its last ~5-7 minutes overlapped the same session's qwen38-flashnext-pi-llamacpp-128k-medium-rerun1 local-model wrap cell (launched 23:06:34) generating on that server, so treat the wall time as an upper bound.
PASSClaude Opus 4.8Claude Code / yoloeffort medium, neutral runner871.00s
14m31s		34748713453HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/opus48-claude-yolo-django-resume-030-medium/Fastest direct Claude Code/yolo row so far; first launch hit transient API 500 before retry.
PASSClaude Fable 5.1Claude Code / yoloeffort high, neutral runner935.40s
15m35s		40841513258HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/fable51-claude-yolo-django-resume-030-high/Completes the Fable 5.1 sweep at 3 for 3 (low 702.9s, medium 737.5s, high 935.4s). Slowest Claude 5 cell, yet 17% faster than Opus 4.8 high (1131.3s) and 27% faster than Sonnet 4.6 high (1276.6s); 10% slower than Opus 5 high (850.3s). Explicit model id claude-fable-5-1 on Claude Code 2.1.257 with the D-040 Electron override in effect (empty dist/, no workaround). 58 model-authored Node tests plus 19 new Django desktop tests in a 358-line tests/desktop_test.py, the most Django-side coverage of any cell; also fixed the project's missing STATICFILES_DIRS, built the Sphinx docs, and shipped no icon or CI workflow by stated choice. Wrote a Claude Code auto-memory note about the host's Electron binary environment under ~/.claude/projects/ for the target path (same rerun hazard as the Fable 5.1 low cell). Did not boot its own packaged smoke; the verifier's independent packaged smoke passed. The first launch at 23:17 hit the Claude account session limit within 3.5s with no files changed and was discarded as infrastructure noise; this row is the forced retry launched 01:08 after Fable 5.1 low in the same lane. Host: throughout the cell another session's Flash-Next llama-server was resident (10-14% free memory) and generating for its own wrap cell at ~90-125% CPU, with the 1-minute load average between 5 and 133, so the wall time is an upper bound.
PASSGPT-5.5Pipy / openai-codexthinking off, native tool loop1003.50s
16m44s		35733914153HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/pipy-gpt55-django-resume-030-off/First Pipy native-tool-loop row; passed packaged smoke, slower than Pi/off and direct Codex rows.
PASSGLM-5.2Pi / OpenRouterthinking high1014.00s
16m54s		27669613540HTTP okdjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-glm52-main-high/High thinking was faster than GLM thinking off on this single run; estimated cost about $1.51.
PASSClaude Opus 4.8Claude Code / yoloeffort low, neutral runner1053.00s
17m33s		38767913553HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/opus48-claude-yolo-django-resume-030-low/First direct Claude Code/yolo row; low effort is the closest no/low-thinking lane.
PASSGLM-5.2Pi / OpenRouterthinking off1126.40s
18m46s		31668912931HTTP okdjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-glm52-main-off/Slow GLM pass; lowest approximate hosted cost among successful rows.
PASSClaude Opus 4.8Claude Code / yoloeffort high, neutral runner1131.30s
18m51s		34668813633HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/opus48-claude-yolo-django-resume-030-high/Passed, but slower than Claude Code low effort and same-session Codex high.
PASSClaude Sonnet 4.6Claude Code / yoloeffort low, neutral runner1136.10s
18m56s		35731213853HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/sonnet46-claude-yolo-django-resume-030-low/Fastest Sonnet 4.6 row; first launch hit transient Claude 529 before retry.
PASSClaude Sonnet 4.6Claude Code / yoloeffort high, neutral runner1276.60s
21m17s		34730913353HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/sonnet46-claude-yolo-django-resume-030-high/Passed; slower than Sonnet low but faster than Sonnet medium.
PASSClaude Sonnet 4.6Claude Code / yoloeffort medium, neutral runner1554.80s
25m55s		33721313747HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/sonnet46-claude-yolo-django-resume-030-medium/Slowest successful current-target pass so far; fewer model-authored Node tests than low/high.
PASSQwen3.8-Flash-Next UD-IQ4_XS (MoE, ~180B/~6B active)Pi / llama.cpp localreasoning_effort medium, set explicitly2488.10s
41m28s		34681413634HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-flashnext-pi-llamacpp-128k-medium/Fastest local open-weight pass and the first qwen4exp (Flash-Next MoE) cell; needed a source-built llama.cpp (build 200, 774ee0e) at 131072 context with the n-gram table offloaded to CPU. Ran 3 smokes in 54 bash calls and wrote a 34-test harness. Not a controlled comparison with the 27B rows: different binary, context, quant family, and port. Two earlier attempts were terminated externally at ~29.5 min and are discarded, not recorded (D-042); this pass came from a detached relaunch.
PASSQwen3.8-27B Q8_0Pi / llama.cpp localreasoning_effort medium, set explicitly3701.50s
61m42s		36802513540HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-q8-pi-llamacpp-256k-medium/Q8_0 control for the medium lane, same Homebrew server and flags as the Q4_K_M cells. Passed on its first attempt, 31 minutes faster than the Q4_K_M pass, with 8 smokes in 64 bash calls. Wrote a 40-test harness rather than the 53-test one every Q4_K_M cell produced. One observation each way: shows the pass is not an artifact of Q4_K_M, not that Q8_0 is more reliable.
PASSQwen3.8-Flash-Next UD-IQ4_XS (MoE, ~180B/~6B active)Pi / llama.cpp localreasoning_effort medium, set explicitly3737.70s
62m18s		367032334HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-flashnext-pi-llamacpp-128k-medium-rerun2/Second replication cell for the Flash-Next pass, launched detached (D-042). Exited cleanly in 62.3 min with 34/34 tests and a served packaged app; Flash-Next at reasoning_effort=medium is 3-for-3, the first local open-weight lane whose pass replicated. 102 tool calls, 3 smoke invocations, no electron-builder call. Ran concurrently with a claude-yolo cell from another session on the same host, with free memory at 9-18% and swap up to 12.5 GB.
PASSQwen3.8-27B Q4_K_MPi / llama.cpp localreasoning_effort medium, set explicitly5570.00s
92m50s		36762212053HTTP okdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-pi-llamacpp-256k-medium/First pass by a local open-weight model on this benchmark; exited cleanly rather than timing out. Decisive variable was reasoning_effort=medium, not the model or the quant. Did not replicate: the confirmation cell qwen38-pi-llamacpp-256k-medium-rerun1 failed the packaged smoke, so the medium lane is 1-for-2.
PASSQwen3.8-Flash-Next UD-IQ4_XS (MoE, ~180B/~6B active)Pi / llama.cpp localreasoning_effort medium, set explicitly7200.00s
120m00s		38750413753HTTP ok (verified after the runner timeout)django-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-flashnext-pi-llamacpp-128k-medium-rerun1/First replication cell for the Flash-Next pass, launched detached (D-042). The runner's 7200s timeout killed pi (pi_exit=124), but the verifier found a served packaged app with 53/53 tests, so the gate records PASS - the first pass at the cap in this table. About 30 of the 120 minutes went to a single `npx electron-builder --dir`, which auto-discovered the host's Developer ID identity and deep-signed the app (with its embedded Python runtime) file by file with Apple timestamping; reproduced afterwards, not a hang and not the model's doing. No earlier passing cell had invoked electron-builder. 178 tool calls, 11 smoke invocations.
FAILGPT-5.5Codex CLI / yoloreasoning none, neutral runner471.40s
7m51s		337377053Smoke faildjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt55-codex-yolo-django-resume-030-none/Direct-Codex no-reasoning comparison for Pi/off; failed on Electron install integrity before HTTP checks.
FAILGPT-5.5Codex CLI / yoloreasoning low, neutral runner491.90s
8m12s		348141253Smoke faildjango-resume 0.3.0/mainresults/agent-wrap-oneshot/gpt55-codex-yolo-django-resume-030-low/Fast agent phase, but independent smoke failed on Electron install integrity before HTTP checks.
FAILClaude Opus 4.8Pi / OpenRouterthinking high734.30s
12m14s		32338413253Smoke faildjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-opus48-openrouter-main-high/Packaged backend leaked a starter dependency: ModuleNotFoundError: desktop_django_starter.
FAILLaguna XS 2.1 Q4_K_M (33B-A3B MoE)Pi / llama.cpp localenable_thinking=true (binary toggle, no effort levels; normalized as high)1910.10s
31m50s		17840477335smoke exit 0 with zero HTTP checks (false success)django-resume 0.3.0/mainresults/agent-wrap-oneshot/laguna-xs21-pi-llamacpp-256k-think/First non-Qwen local open-weight cell and first MoE cell. Fastest self-terminating run and largest diff in the table, but zero executions of its own smoke; will-quit handler hardcodes app.exit(0), so the startup failure (unstaged backend) reported success and only the verifier's app_served gate caught it. Counterfactual: one npm-script path fix stages the backend and boots Django, but the Electron shell issued no HTTP requests across two manual smokes.
FAILLaguna XS 2.1 Q4_K_M (33B-A3B MoE)Pi / llama.cpp localenable_thinking=false (binary toggle, no effort levels)2144.40s
35m44s		5626114052013045verifier smoke hung to 200s cap, all HTTP counters 0django-resume 0.3.0/mainresults/agent-wrap-oneshot/laguna-xs21-pi-llamacpp-256k-off/Thinking-off A/B partner to the thinking-on cell. Behavioral flip: this lane DID self-verify - ran stage-backend, its own packaged smoke (exit 1), 45/45 node tests and 182 Django tests - but never got a green packaged smoke and declared victory anyway; the verifier smoke then hung to the 200s cap. Diff is inflated: 5,590 of 5,626 files are un-gitignored .stage/ staging output; the authored diff is ~36 files.
FAILQwen3.8-27B Q4_K_MPi / llama.cpp localreasoning_effort medium, set explicitly3567.30s
59m27s		33753713653smoke exit 1, ModuleNotFoundError example.packaged_settingsdjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-pi-llamacpp-256k-medium-rerun1/Confirmation cell for the medium-lane PASS; did not replicate. Exited cleanly in 59.5 min with 53/53 node tests, staged the backend, but Django died booting packaged mode on a settings module the staging step never ships (ModuleNotFoundError: example.packaged_settings) - the campaign's one-pathology signature: two components disagreeing about an interface on a never-executed path.
FAILQwen3.8-27B Q4_K_MPi / llama.cpp localthinking off, chat-template kwarg7200.00s
120m00s		387749353Smoke faildjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-pi-llamacpp-256k-off/First local open-weight Qwen3.8 row; killed by the 7200s runner timeout. Staging failed because .stage/backend/src was not a Python project. No transcript captured (--pi-mode unset), see D-039.
FAILQwen3.8-27B Q4_K_MPi / llama.cpp localthinking high7200.00s
120m00s		37770813653Smoke faildjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-pi-llamacpp-256k-high/Killed by the 7200s runner timeout. Its own generated stage-backend.cjs threw a TypeError because it assumed fs.cpSync passes a Dirent to filter. It never ran its own packaged smoke once, and stopped editing files with 51% of the budget unspent. A post-hoc counterfactual correcting only that two-line signature made the packaged app serve, so the distance to pass was a single defect.
FAILQwen3.8-27B Q4_K_MPi / llama.cpp localthinking off, Electron pre-warmed7200.00s
120m00s		46760813853Smoke faildjango-resume 0.3.0/mainresults/agent-wrap-oneshot/qwen38-pi-llamacpp-256k-off-prewarmed/First cell where stage-backend succeeded, clearing the step that killed runs A and B. It did attempt self-verification and deadlocked on its own invented desktop-dev-smoke target, which passes the smoke flag as an env var while its launcher reads argv; the packaged smoke separately hung because its exit is bound solely to did-finish-load with no failure path.
INTERRUPTEDGPT-5.5Pi / OpenAI Codexthinking off1240.10s
20m40s		37825914053Smoke faildjango-resume 0.3.0/maindesktop-django-starter/.bench-qwen36/results-oneshot-gpt55-main-off/Stopped because raw JSON stream grew to 8.7 GB while the run remained in a self-debug loop.

Markdown Report

Open report.md

# benchpack report

Inputs:
- `2026-04-28-mlx-lm-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-04-28-mlx-lm-runtime` (9 rows)
- `2026-04-28-mlx-lm-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-04-28-mlx-lm-smoke` (1 row)
- `2026-04-29-llama-server-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-04-29-llama-server-runtime` (9 rows)
- `2026-04-29-llama-server-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-04-29-llama-server-smoke` (1 row)
- `2026-04-30-llama-server-desktop-django-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-04-30-llama-server-desktop-django-wrap` (2 rows)
- `2026-05-03-m4-max-llama-qwen25-05b-190636-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-llama-qwen25-05b-190636-patch` (1 row)
- `2026-05-03-m4-max-llama-qwen25-05b-190636-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-llama-qwen25-05b-190636-runtime` (9 rows)
- `2026-05-03-m4-max-llama-qwen25-05b-190636-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-llama-qwen25-05b-190636-smoke` (1 row)
- `2026-05-03-m4-max-llama-qwen25-05b-190636-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-llama-qwen25-05b-190636-wrap` (2 rows)
- `2026-05-03-m4-max-mlx-qwen25-05b-185824-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-mlx-qwen25-05b-185824-patch` (1 row)
- `2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime` (9 rows)
- `2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke` (1 row)
- `2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap` (2 rows)
- `2026-05-03-m4-max-qwen3coder-184938-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-qwen3coder-184938-patch` (1 row)
- `2026-05-03-m4-max-qwen3coder-184938-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-qwen3coder-184938-runtime` (9 rows)
- `2026-05-03-m4-max-qwen3coder-184938-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-qwen3coder-184938-smoke` (1 row)
- `2026-05-03-m4-max-qwen3coder-184938-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-03-m4-max-qwen3coder-184938-wrap` (2 rows)
- `2026-05-05-m4-qwen36-dense-llamacpp-154321-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-llamacpp-154321-patch` (1 row)
- `2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime` (9 rows)
- `2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke` (1 row)
- `2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap` (2 rows)
- `2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255` (1 row)
- `2026-05-05-m4-qwen36-dense-mlx-155943-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-mlx-155943-patch` (1 row)
- `2026-05-05-m4-qwen36-dense-mlx-155943-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-mlx-155943-runtime` (9 rows)
- `2026-05-05-m4-qwen36-dense-mlx-155943-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-mlx-155943-smoke` (1 row)
- `2026-05-05-m4-qwen36-dense-mlx-155943-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-mlx-155943-wrap` (2 rows)
- `2026-05-05-m4-qwen36-dense-mlx-smoke-155916`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-mlx-smoke-155916` (1 row)
- `2026-05-05-m4-qwen36-dense-ollama-155051-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-ollama-155051-patch` (1 row)
- `2026-05-05-m4-qwen36-dense-ollama-155051-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-ollama-155051-runtime` (9 rows)
- `2026-05-05-m4-qwen36-dense-ollama-155051-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-ollama-155051-smoke` (1 row)
- `2026-05-05-m4-qwen36-dense-ollama-155051-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-ollama-155051-wrap` (2 rows)
- `2026-05-05-m4-qwen36-dense-ollama-smoke-154808`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-dense-ollama-smoke-154808` (1 row)
- `2026-05-05-m4-qwen36-moe-llamacpp-153657-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-llamacpp-153657-patch` (1 row)
- `2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime` (9 rows)
- `2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke` (1 row)
- `2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap` (2 rows)
- `2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634` (1 row)
- `2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159` (1 row)
- `2026-05-05-m4-qwen36-moe-mlx-155645-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-mlx-155645-patch` (1 row)
- `2026-05-05-m4-qwen36-moe-mlx-155645-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-mlx-155645-runtime` (9 rows)
- `2026-05-05-m4-qwen36-moe-mlx-155645-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-mlx-155645-smoke` (1 row)
- `2026-05-05-m4-qwen36-moe-mlx-155645-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-mlx-155645-wrap` (2 rows)
- `2026-05-05-m4-qwen36-moe-mlx-smoke-155619`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-mlx-smoke-155619` (1 row)
- `2026-05-05-m4-qwen36-moe-ollama-154846-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-ollama-154846-patch` (1 row)
- `2026-05-05-m4-qwen36-moe-ollama-154846-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-ollama-154846-runtime` (9 rows)
- `2026-05-05-m4-qwen36-moe-ollama-154846-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-ollama-154846-smoke` (1 row)
- `2026-05-05-m4-qwen36-moe-ollama-154846-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-ollama-154846-wrap` (2 rows)
- `2026-05-05-m4-qwen36-moe-ollama-smoke-154747`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-05-m4-qwen36-moe-ollama-smoke-154747` (1 row)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch` (1 row)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime` (9 rows)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke` (1 row)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap` (2 rows)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch` (1 row)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime` (9 rows)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke` (1 row)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap` (2 rows)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928` (9 rows)
- `2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856` (1 row)
- `2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent` (1 row)
- `2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent` (1 row)
- `2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent` (1 row)
- `2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness` (1 row)
- `2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke` (1 row)
- `2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch` (1 row)
- `2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime` (9 rows)
- `2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke` (1 row)
- `2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap` (2 rows)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch` (1 row)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime` (9 rows)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke` (1 row)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap` (2 rows)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness` (1 row)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime` (9 rows)
- `2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke`: `/Users/jochen/projects/llm-benchpacks/results/2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke` (1 row)

## Run Metadata

| run | pack | adapter | model | endpoint | hardware |
|-----|------|---------|-------|----------|----------|
| 2026-04-28-mlx-lm-runtime | runtime-sweep 0.1.0 | openai-chat | mlx-community/Qwen2.5-0.5B-Instruct-4bit | http://localhost:8080/v1/chat/completions | hostname=atlas.local; chip=Apple M5 Max; ram_mb=65536; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M5 Max |
| 2026-04-28-mlx-lm-smoke | smoke-chat 0.1.0 | openai-chat | mlx-community/Qwen2.5-0.5B-Instruct-4bit | http://localhost:8080/v1/chat/completions | hostname=atlas.local; chip=Apple M5 Max; ram_mb=65536; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M5 Max |
| 2026-04-29-llama-server-runtime | runtime-sweep 0.1.0 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=atlas.local; chip=Apple M5 Max; ram_mb=65536; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M5 Max |
| 2026-04-29-llama-server-smoke | smoke-chat 0.1.0 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=atlas.local; chip=Apple M5 Max; ram_mb=65536; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M5 Max |
| 2026-04-30-llama-server-desktop-django-wrap | desktop-django-wrap 0.1.5 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=atlas.local; chip=Apple M5 Max; ram_mb=65536; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M5 Max |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | patch-from-failure 0.1.0 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | runtime-sweep 0.1.0 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | smoke-chat 0.1.0 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | desktop-django-wrap 0.1.5 | openai-chat | qwen2.5-0.5b-instruct-q4_k_m | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | patch-from-failure 0.1.0 | openai-chat | mlx-community/Qwen2.5-0.5B-Instruct-4bit | http://127.0.0.1:8080/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | runtime-sweep 0.1.0 | openai-chat | mlx-community/Qwen2.5-0.5B-Instruct-4bit | http://127.0.0.1:8080/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | smoke-chat 0.1.0 | openai-chat | mlx-community/Qwen2.5-0.5B-Instruct-4bit | http://127.0.0.1:8080/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | desktop-django-wrap 0.1.5 | openai-chat | mlx-community/Qwen2.5-0.5B-Instruct-4bit | http://127.0.0.1:8080/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-qwen3coder-184938-patch | patch-from-failure 0.1.0 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | runtime-sweep 0.1.0 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | smoke-chat 0.1.0 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | desktop-django-wrap 0.1.5 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | patch-from-failure 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:8083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | runtime-sweep 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:8083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | smoke-chat 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:8083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | desktop-django-wrap 0.1.5 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:8083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | smoke-chat 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:8083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | patch-from-failure 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-27B-4bit | http://127.0.0.1:8085/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | runtime-sweep 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-27B-4bit | http://127.0.0.1:8085/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | smoke-chat 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-27B-4bit | http://127.0.0.1:8085/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | desktop-django-wrap 0.1.5 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-27B-4bit | http://127.0.0.1:8085/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | smoke-chat 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-27B-4bit | http://127.0.0.1:8085/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | patch-from-failure 0.1.0 | ollama-generate | qwen36-27b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | runtime-sweep 0.1.0 | ollama-generate | qwen36-27b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | smoke-chat 0.1.0 | ollama-generate | qwen36-27b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | desktop-django-wrap 0.1.5 | ollama-generate | qwen36-27b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | smoke-chat 0.1.0 | ollama-generate | qwen36-27b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | patch-from-failure 0.1.0 | openai-chat | qwen36-35b-a3b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | runtime-sweep 0.1.0 | openai-chat | qwen36-35b-a3b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | smoke-chat 0.1.0 | openai-chat | qwen36-35b-a3b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | desktop-django-wrap 0.1.5 | openai-chat | qwen36-35b-a3b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | smoke-chat 0.1.0 | openai-chat | qwen36-35b-a3b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | smoke-chat 0.1.0 | openai-chat | qwen36-35b-a3b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | patch-from-failure 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 | http://127.0.0.1:8084/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | runtime-sweep 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 | http://127.0.0.1:8084/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | smoke-chat 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 | http://127.0.0.1:8084/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | desktop-django-wrap 0.1.5 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 | http://127.0.0.1:8084/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | smoke-chat 0.1.0 | openai-chat | /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 | http://127.0.0.1:8084/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | patch-from-failure 0.1.0 | ollama-generate | qwen36-35b-a3b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | runtime-sweep 0.1.0 | ollama-generate | qwen36-35b-a3b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | smoke-chat 0.1.0 | ollama-generate | qwen36-35b-a3b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | desktop-django-wrap 0.1.5 | ollama-generate | qwen36-35b-a3b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | smoke-chat 0.1.0 | ollama-generate | qwen36-35b-a3b-gguf:q4km | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | patch-from-failure 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | runtime-sweep 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | smoke-chat 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | desktop-django-wrap 0.1.5 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | patch-from-failure 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | runtime-sweep 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | smoke-chat 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | desktop-django-wrap 0.1.5 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | runtime-sweep 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | smoke-chat 0.1.0 | openai-chat | gemma4-e2b-q4km | http://127.0.0.1:8081/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | django-dashboard-regression-fix-external-agent 0.1.1 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | patch-from-failure-external-agent 0.1.1 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | python-regression-fix-external-agent 0.1.1 | ollama-generate | qwen3-coder:30b-a3b-q4_K_M | http://localhost:11434/api/generate | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | endpoint-python-correctness 0.2.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:18082/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | smoke-chat 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:18082/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | patch-from-failure 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:18082/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | runtime-sweep 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:18082/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | smoke-chat 0.1.0 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:18082/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | desktop-django-wrap 0.1.5 | openai-chat | qwen36-27b-q4km | http://127.0.0.1:18082/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | patch-from-failure 0.1.0 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | runtime-sweep 0.1.0 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | smoke-chat 0.1.0 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | desktop-django-wrap 0.1.5 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | endpoint-python-correctness 0.2.0 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | runtime-sweep 0.1.0 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | smoke-chat 0.1.0 | openai-chat | gemma4-26b-a4b-q4km | http://127.0.0.1:18083/v1/chat/completions | hostname=studio; chip=Apple M4 Max; hardware_model=Mac16,9; hardware_model_name=Mac Studio; hardware_model_identifier=Mac16,9; ram_mb=131072; os=macOS-26.4.1-arm64-arm-64bit-Mach-O; gpus=Apple M4 Max |

## User-Supplied Runtime Metadata

| run | runtime | model metadata | operating conditions | notes |
|-----|---------|----------------|----------------------|-------|
| 2026-04-28-mlx-lm-runtime | run-metadata.json missing | — | — | — |
| 2026-04-28-mlx-lm-smoke | run-metadata.json missing | — | — | — |
| 2026-04-29-llama-server-runtime | run-metadata.json missing | — | — | — |
| 2026-04-29-llama-server-smoke | run-metadata.json missing | — | — | — |
| 2026-04-30-llama-server-desktop-django-wrap | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-qwen3coder-184938-patch | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | run-metadata.json missing | — | — | — |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | run-metadata.json missing | — | — | — |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 8083 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8083/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 dense llama.cpp target for M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 8083 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8083/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 dense llama.cpp target for M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 8083 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8083/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 dense llama.cpp target for M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 8083 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8083/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 dense llama.cpp target for M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 8083 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8083/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 dense llama.cpp target for M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-27B-4bit --host 127.0.0.1 --port 8085 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8085/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; family=Qwen3.6-27B dense; id=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; quantization=4bit; source=mlx-community/Qwen3.6-27B-4bit | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-27B-4bit --host 127.0.0.1 --port 8085 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8085/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; family=Qwen3.6-27B dense; id=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; quantization=4bit; source=mlx-community/Qwen3.6-27B-4bit | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-27B-4bit --host 127.0.0.1 --port 8085 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8085/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; family=Qwen3.6-27B dense; id=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; quantization=4bit; source=mlx-community/Qwen3.6-27B-4bit | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-27B-4bit --host 127.0.0.1 --port 8085 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8085/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; family=Qwen3.6-27B dense; id=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; quantization=4bit; source=mlx-community/Qwen3.6-27B-4bit | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-27B-4bit --host 127.0.0.1 --port 8085 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8085/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; family=Qwen3.6-27B dense; id=/Users/jochen/models/mlx/Qwen3.6-27B-4bit; quantization=4bit; source=mlx-community/Qwen3.6-27B-4bit | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | command=ollama serve; ollama create qwen36-27b-gguf:q4km -f /tmp/Modelfile.qwen36-dense; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-27b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-gguf:q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | command=ollama serve; ollama create qwen36-27b-gguf:q4km -f /tmp/Modelfile.qwen36-dense; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-27b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-gguf:q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | command=ollama serve; ollama create qwen36-27b-gguf:q4km -f /tmp/Modelfile.qwen36-dense; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-27b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-gguf:q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | command=ollama serve; ollama create qwen36-27b-gguf:q4km -f /tmp/Modelfile.qwen36-dense; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-27b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-gguf:q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | command=ollama serve; ollama create qwen36-27b-gguf:q4km -f /tmp/Modelfile.qwen36-dense; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-27b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; family=Qwen3.6-27B dense; id=qwen36-27b-gguf:q4km; quantization=Q4_K_M; source=unsloth/Qwen3.6-27B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 dense Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf --alias qwen36-35b-a3b-q4km --host 127.0.0.1 --port 8081 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8081/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 MoE llama.cpp smoke target before full M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf --alias qwen36-35b-a3b-q4km --host 127.0.0.1 --port 8081 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8081/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 MoE llama.cpp smoke target before full M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf --alias qwen36-35b-a3b-q4km --host 127.0.0.1 --port 8081 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8081/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 MoE llama.cpp smoke target before full M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf --alias qwen36-35b-a3b-q4km --host 127.0.0.1 --port 8081 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8081/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 MoE llama.cpp smoke target before full M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf --alias qwen36-35b-a3b-q4km --host 127.0.0.1 --port 8081 --ctx-size 4096 --gpu-layers auto --reasoning off; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8081/v1", "gpu_layers": "auto", "openai_stream_usage": "include", "reasoning": "off"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 MoE llama.cpp smoke target before full M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf --alias qwen36-35b-a3b-q4km --host 127.0.0.1 --port 8081 --ctx-size 4096 --gpu-layers auto; name=llama-server; options={"ctx_size": 4096, "endpoint": "http://127.0.0.1:8081/v1", "gpu_layers": "auto", "openai_stream_usage": "include"}; version=9020 (a4701c98f) | artifact=/Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | First Qwen3.6 MoE llama.cpp smoke target before full M4/M5 runtime matrix. |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 --host 127.0.0.1 --port 8084 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8084/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; family=Qwen3.6-35B-A3B MoE; id=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; quantization=MXFP4; source=majentik/Qwen3.6-35B-A3B-MLX-MXFP4 | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 --host 127.0.0.1 --port 8084 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8084/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; family=Qwen3.6-35B-A3B MoE; id=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; quantization=MXFP4; source=majentik/Qwen3.6-35B-A3B-MLX-MXFP4 | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 --host 127.0.0.1 --port 8084 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8084/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; family=Qwen3.6-35B-A3B MoE; id=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; quantization=MXFP4; source=majentik/Qwen3.6-35B-A3B-MLX-MXFP4 | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 --host 127.0.0.1 --port 8084 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8084/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; family=Qwen3.6-35B-A3B MoE; id=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; quantization=MXFP4; source=majentik/Qwen3.6-35B-A3B-MLX-MXFP4 | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | command=uvx --from mlx-lm python -m mlx_lm.server --model /Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4 --host 127.0.0.1 --port 8084 --chat-template-args '{"enable_thinking":false}'; name=mlx-lm server; options={"chat_template_args": {"enable_thinking": false}, "endpoint": "http://127.0.0.1:8084/v1"}; version=0.31.3 | artifact=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; family=Qwen3.6-35B-A3B MoE; id=/Users/jochen/models/mlx/Qwen3.6-35B-A3B-MLX-MXFP4; quantization=MXFP4; source=majentik/Qwen3.6-35B-A3B-MLX-MXFP4 | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE MLX-LM OpenAI-compatible server target. |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | command=ollama serve; ollama create qwen36-35b-a3b-gguf:q4km -f /tmp/Modelfile.qwen36-moe; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-35b-a3b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-gguf:q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | command=ollama serve; ollama create qwen36-35b-a3b-gguf:q4km -f /tmp/Modelfile.qwen36-moe; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-35b-a3b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-gguf:q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | command=ollama serve; ollama create qwen36-35b-a3b-gguf:q4km -f /tmp/Modelfile.qwen36-moe; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-35b-a3b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-gguf:q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | command=ollama serve; ollama create qwen36-35b-a3b-gguf:q4km -f /tmp/Modelfile.qwen36-moe; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-35b-a3b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-gguf:q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE Ollama native /api/generate target using local GGUF import. |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | command=ollama serve; ollama create qwen36-35b-a3b-gguf:q4km -f /tmp/Modelfile.qwen36-moe; name=ollama; options={"endpoint": "http://localhost:11434/api/generate", "num_ctx": 4096}; version=server 0.20.5; client 0.23.0 | artifact=Ollama tag qwen36-35b-a3b-gguf:q4km from /Users/jochen/models/gguf/qwen3.6-35b-a3b/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf; family=Qwen3.6-35B-A3B MoE; id=qwen36-35b-a3b-gguf:q4km; quantization=UD-Q4_K_M; source=unsloth/Qwen3.6-35B-A3B-GGUF | background_load=not intentionally controlled; host=remote M4 Studio; power=not captured; thermal=not captured | Qwen3.6 MoE Ollama native /api/generate target using local GGUF import. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; load_result={"loopback_only": true, "models_endpoint_checked": true, "models_endpoint_model_id": "gemma4-e2b-q4km", "notable_warnings": ["Control-looking token <\|tool_response> was overridden as control type.", "special_eog_ids contains <\|tool_response>; </s> was removed from EOG list.", "--cache-idle-slots requires --kv-unified, disabling."], "server_log_highlights": ["Offloaded 36/36 layers to MTL0 Apple M4 Max.", "n_ctx=8192, n_batch=1024, n_ubatch=512.", "Non-SWA KV cache 48.00 MiB and SWA KV cache 12.00 MiB on MTL0, both f16.", "Prompt cache enabled with size limit 8192 MiB.", "Gemma chat template initialized with thinking = 0.", "Server listened on http://127.0.0.1:8081."], "server_started": true}; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | bind=127.0.0.1:8081; endpoint=http://127.0.0.1:8081/v1; executable=/opt/homebrew/bin/llama-server; model_alias=gemma4-e2b-q4km; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 8192, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512, "webui": false}; server_command=/opt/homebrew/bin/llama-server --model /Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf --alias gemma4-e2b-q4km --host 127.0.0.1 --port 8081 --ctx-size 8192 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; version=version: 9030 (a09a00e50); built with AppleClang 21.0.0.21000099 for Darwin arm64 | artifact_file=google_gemma-4-E2B-it-Q4_K_M.gguf; artifact_repo=bartowski/google_gemma-4-E2B-it-GGUF; download_command=uvx --from huggingface_hub hf download bartowski/google_gemma-4-E2B-it-GGUF google_gemma-4-E2B-it-Q4_K_M.gguf --revision b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; id=google/gemma-4-E2B-it; local_path=/Users/jochen/.cache/huggingface/hub/models--bartowski--google_gemma-4-E2B-it-GGUF/snapshots/b5e99bd964eaacc27ba484bb2eb3e9f6160b9143/google_gemma-4-E2B-it-Q4_K_M.gguf; quantization=Q4_K_M; revision=b5e99bd964eaacc27ba484bb2eb3e9f6160b9143; sha256=b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705 | background_load=no intentional benchmark load; existing host background state not otherwise controlled; power=not captured; thermal=not captured | M4 strict same-GGUF preflight metadata for checksum/load/smoke-chat/runtime-sweep. Server must bind only to 127.0.0.1 and be stopped after the slice. Previous dirty M4 repo state was preserved in git stash pre-gemma4-m4-sync-20260507 before syncing to this commit. |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | adapter=ollama-generate; codex_cli_version=0.130.0; endpoint_shape=Ollama native local endpoint; ollama_client_version=0.23.2; ollama_server_version=0.20.5; tmux=available; uv=available | adapter_model=qwen3-coder:30b-a3b-q4_K_M; architecture=qwen3moe; artifact_blob_sha256=1194192cf2a187eb02722edcc3f77b11d21f537048ce04b67ccf8ba78863006a; context_length=262144; external_agent_model=qwen3-coder:30b-a3b-q4_K_M; ollama_list_id_prefix=06c1097efce0; parameters=30.5B; quantization=Q4_K_M; tag_note=same local artifact as M5 qwen3-coder:latest by manifest prefix and blob SHA, but the M4 tag name differs | background_load=no intentional benchmark load besides local Ollama/Codex workflow; power=not intentionally controlled; thermal=not intentionally controlled | Opt-in direct-edit external-agent validation slice; not a default matrix promotion. |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | adapter=ollama-generate; codex_cli_version=0.130.0; endpoint_shape=Ollama native local endpoint; ollama_client_version=0.23.2; ollama_server_version=0.20.5; tmux=available; uv=available | adapter_model=qwen3-coder:30b-a3b-q4_K_M; architecture=qwen3moe; artifact_blob_sha256=1194192cf2a187eb02722edcc3f77b11d21f537048ce04b67ccf8ba78863006a; context_length=262144; external_agent_model=qwen3-coder:30b-a3b-q4_K_M; ollama_list_id_prefix=06c1097efce0; parameters=30.5B; quantization=Q4_K_M; tag_note=same local artifact as M5 qwen3-coder:latest by manifest prefix and blob SHA, but the M4 tag name differs | background_load=no intentional benchmark load besides local Ollama/Codex workflow; power=not intentionally controlled; thermal=not intentionally controlled | Opt-in direct-edit external-agent validation slice; not a default matrix promotion. |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | adapter=ollama-generate; codex_cli_version=0.130.0; endpoint_shape=Ollama native local endpoint; ollama_client_version=0.23.2; ollama_server_version=0.20.5; tmux=available; uv=available | adapter_model=qwen3-coder:30b-a3b-q4_K_M; architecture=qwen3moe; artifact_blob_sha256=1194192cf2a187eb02722edcc3f77b11d21f537048ce04b67ccf8ba78863006a; context_length=262144; external_agent_model=qwen3-coder:30b-a3b-q4_K_M; ollama_list_id_prefix=06c1097efce0; parameters=30.5B; quantization=Q4_K_M; tag_note=same local artifact as M5 qwen3-coder:latest by manifest prefix and blob SHA, but the M4 tag name differs | background_load=no intentional benchmark load besides local Ollama/Codex workflow; power=not intentionally controlled; thermal=not intentionally controlled | Opt-in direct-edit external-agent validation slice; not a default matrix promotion. |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 18082 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; endpoint=http://127.0.0.1:18082/v1; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 4096, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512}; version=9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64 | alias=qwen36-27b-q4km; artifact_file=Qwen3.6-27B-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; artifact_repo=unsloth/Qwen3.6-27B-GGUF; id=Qwen/Qwen3.6-27B; quantization=Q4_K_M; sha256=5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0 | background_load=no intentional benchmark load besides llama-server and benchpack; power=not explicitly controlled; thermal=not explicitly captured | Narrow M4 preflight after local M5 recount pass; packs limited to smoke-chat and endpoint-python-correctness. |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 18082 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; endpoint=http://127.0.0.1:18082/v1; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 4096, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512}; version=9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64 | alias=qwen36-27b-q4km; artifact_file=Qwen3.6-27B-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; artifact_repo=unsloth/Qwen3.6-27B-GGUF; id=Qwen/Qwen3.6-27B; quantization=Q4_K_M; sha256=5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0 | background_load=no intentional benchmark load besides llama-server and benchpack; power=not explicitly controlled; thermal=not explicitly captured | Narrow M4 preflight after local M5 recount pass; packs limited to smoke-chat and endpoint-python-correctness. |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 18082 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; endpoint=http://127.0.0.1:18082/v1; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 4096, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512}; version=9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64 | alias=qwen36-27b-q4km; artifact_file=Qwen3.6-27B-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; artifact_repo=unsloth/Qwen3.6-27B-GGUF; id=Qwen/Qwen3.6-27B; quantization=Q4_K_M; sha256=5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0 | background_load=no intentional benchmark load besides llama-server and benchpack; power=not explicitly controlled; thermal=not explicitly captured | Qwen3.6 27B strict same-GGUF four-pack matrix after tri-host smoke plus endpoint-python-correctness preflight passed. Remote checkout reused the existing recount-capable dirty worktree and was not pulled over. |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 18082 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; endpoint=http://127.0.0.1:18082/v1; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 4096, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512}; version=9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64 | alias=qwen36-27b-q4km; artifact_file=Qwen3.6-27B-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; artifact_repo=unsloth/Qwen3.6-27B-GGUF; id=Qwen/Qwen3.6-27B; quantization=Q4_K_M; sha256=5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0 | background_load=no intentional benchmark load besides llama-server and benchpack; power=not explicitly controlled; thermal=not explicitly captured | Qwen3.6 27B strict same-GGUF four-pack matrix after tri-host smoke plus endpoint-python-correctness preflight passed. Remote checkout reused the existing recount-capable dirty worktree and was not pulled over. |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 18082 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; endpoint=http://127.0.0.1:18082/v1; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 4096, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512}; version=9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64 | alias=qwen36-27b-q4km; artifact_file=Qwen3.6-27B-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; artifact_repo=unsloth/Qwen3.6-27B-GGUF; id=Qwen/Qwen3.6-27B; quantization=Q4_K_M; sha256=5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0 | background_load=no intentional benchmark load besides llama-server and benchpack; power=not explicitly controlled; thermal=not explicitly captured | Qwen3.6 27B strict same-GGUF four-pack matrix after tri-host smoke plus endpoint-python-correctness preflight passed. Remote checkout reused the existing recount-capable dirty worktree and was not pulled over. |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | command=llama-server --model /Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf --alias qwen36-27b-q4km --host 127.0.0.1 --port 18082 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; endpoint=http://127.0.0.1:18082/v1; name=llama-server; options={"batch_size": 1024, "cache_prompt": true, "cache_type_k": "f16", "cache_type_v": "f16", "ctx_size": 4096, "gpu_layers": "auto", "openai_stream_usage": "include", "parallel": 1, "reasoning": "off", "ubatch_size": 512}; version=9080 (9f5f0e689), AppleClang 21.0.0.21000099, Darwin arm64 | alias=qwen36-27b-q4km; artifact_file=Qwen3.6-27B-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/qwen3.6-27b/Qwen3.6-27B-Q4_K_M.gguf; artifact_repo=unsloth/Qwen3.6-27B-GGUF; id=Qwen/Qwen3.6-27B; quantization=Q4_K_M; sha256=5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0 | background_load=no intentional benchmark load besides llama-server and benchpack; power=not explicitly controlled; thermal=not explicitly captured | Qwen3.6 27B strict same-GGUF four-pack matrix after tri-host smoke plus endpoint-python-correctness preflight passed. Remote checkout reused the existing recount-capable dirty worktree and was not pulled over. |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | batch_size=1024; context_tokens=4096; endpoint=http://127.0.0.1:18083/v1; kv_cache=f16; name=llama-server; parallel=1; prompt_cache=True; reasoning=off; server_command=llama-server --model /Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf --alias gemma4-26b-a4b-q4km --host 127.0.0.1 --port 18083 --ctx-size 4096 --batch-size 1024 --ubatch-size 512 --cache-type-k f16 --cache-type-v f16 --gpu-layers auto --parallel 1 --cache-prompt --no-webui --reasoning off; ubatch_size=512; version=9110 (ef22b3e4a) | alias=gemma4-26b-a4b-q4km; artifact_bytes=16796015136; artifact_file=gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_path=/Users/jochen/models/gguf/gemma4-26b-a4b/gemma-4-26B-A4B-it-Q4_K_M.gguf; artifact_repo=ggml-org/gemma-4-26B-A4B-it-GGUF; artifact_revision=ae4d537a6345467d1c86bb5cc0d4505ff3ebe0f3; base_model=google/gemma-4-26B-A4B-it; base_revision=462a98a12e28e2cbcfccaf78fe41e3e50235e6ae; format=GGUF; quantization=Q4_K_M; sha256=88f4a13b0bb95f031a7fad973e10854122fb67ebc34d214d39a2f65053046abc | — | — |

## Repo-Task Outcome Summary

### Aggregate

| rows | passed | failed-no-mutation | failed-source-mutation | failed-non-source-mutation | failed-unknown-mutation | other |
|------|--------|--------------------|------------------------|----------------------------|-------------------------|-------|
| 18 | 4 | 0 | 0 | 0 | 14 | 0 |

### By Run

| run | rows | passed | failed-no-mutation | failed-source-mutation | failed-non-source-mutation | failed-unknown-mutation | other |
|-----|------|--------|--------------------|------------------------|----------------------------|-------------------------|-------|
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-03-m4-max-qwen3coder-184938-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | 1 | 0 | 0 | 0 | 0 | 1 | 0 |

## Repo-Task Outcomes

| run | case | repetition | repo_task | verify_exit | scoring | patch_bytes | outcome |
|-----|------|------------|-----------|-------------|---------|-------------|---------|
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-03-m4-max-qwen3coder-184938-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | fix-greeting | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | fix-dashboard-regressions | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | fix-greeting | — | passed | 0 | verify-script:pass | — | passed |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | fix-task-summary | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | fix-inventory-aggregation | — | passed | 0 | verify-script:pass | — | passed |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | fix-greeting | — | passed | 0 | verify-script:pass | — | passed |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | fix-greeting | — | passed | 0 | verify-script:pass | — | passed |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | fix-inventory-aggregation | — | failed | 1 | verify-script:fail | — | failed-unknown-mutation |

## Case Outcomes

| run | case | rows | ok | scoring pass | scoring fail | unscored |
|-----|------|------|----|--------------|--------------|----------|
| 2026-04-28-mlx-lm-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-04-28-mlx-lm-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-04-28-mlx-lm-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-04-28-mlx-lm-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-04-29-llama-server-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-04-29-llama-server-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-04-29-llama-server-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-04-29-llama-server-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-04-30-llama-server-desktop-django-wrap | wrap-plan-small | 1 | 1 | 0 | 1 | 0 |
| 2026-04-30-llama-server-desktop-django-wrap | wrap-plan-context | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | wrap-plan-small | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | wrap-plan-context | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | wrap-plan-small | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | wrap-plan-context | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-qwen3coder-184938-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | wrap-plan-small | 1 | 1 | 0 | 1 | 0 |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | wrap-plan-context | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | wrap-plan-small | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | wrap-plan-context | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | capital | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | wrap-plan-small | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | wrap-plan-context | 1 | 1 | 0 | 1 | 0 |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | fix-greeting | 1 | 1 | 0 | 1 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | fix-dashboard-regressions | 1 | 1 | 0 | 1 | 0 |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | fix-greeting | 1 | 1 | 1 | 0 | 0 |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | fix-task-summary | 1 | 1 | 0 | 1 | 0 |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | fix-inventory-aggregation | 1 | 1 | 1 | 0 | 0 |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | fix-greeting | 1 | 1 | 1 | 0 | 0 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | fix-greeting | 1 | 1 | 1 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | capital | 1 | 1 | 1 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | wrap-plan-small | 1 | 1 | 1 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | wrap-plan-context | 1 | 1 | 1 | 0 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | fix-inventory-aggregation | 1 | 1 | 0 | 1 | 0 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | short | 3 | 3 | 0 | 0 | 3 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | medium | 3 | 3 | 0 | 0 | 3 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | long | 3 | 3 | 0 | 0 | 3 |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | capital | 1 | 1 | 1 | 0 | 0 |

## Compare Medians

Medians use the same metric filtering, cache coverage, warning, and prefill-parity rules as `benchpack compare`.

WARNING: compared records use different pack ids or versions: desktop-django-wrap 0.1.5, django-dashboard-regression-fix-external-agent 0.1.1, endpoint-python-correctness 0.2.0, patch-from-failure 0.1.0, patch-from-failure-external-agent 0.1.1, python-regression-fix-external-agent 0.1.1, runtime-sweep 0.1.0, smoke-chat 0.1.0
WARNING: cache metadata incomplete for case `short`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `medium`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `long`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `capital`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `wrap-plan-small`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `wrap-plan-context`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `fix-greeting`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `fix-dashboard-regressions`; some rows lack numeric `tokens.cached_prompt`.
WARNING: cache metadata incomplete for case `fix-task-summary`; some rows lack numeric `tokens.cached_prompt`.

| run | case | rows | ok | wall_s med | ttft_s med | prefill_tps med | decode_tps med | total_tps med | output_tokens med | prompt_tokens med | cached_prompt med | cache rows | prefill parity |
|-----|------|------|----|------------|------------|-----------------|----------------|---------------|-------------------|-------------------|-------------------|------------|----------------|
| 2026-04-28-mlx-lm-runtime | short | 3 | 3 | 0.257 | 0.061 | — | 436.67 | 299.11 | 77 | 104 | — | 0/3 | missing-case |
| 2026-04-28-mlx-lm-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | short | 3 | 3 | 0.282 | 0.006 | — | 411.82 | 403.76 | 114 | 104 | — | 0/3 | missing-case |
| 2026-04-29-llama-server-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | short | 3 | 3 | 0.348 | 0.006 | — | 333.66 | 327.85 | 114 | 104 | 103 | 3/3 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | short | 3 | 3 | 0.247 | 0.052 | — | 395.31 | 311.73 | 77 | 104 | 103 | 3/3 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | short | 3 | 3 | 1.229 | — | — | 102.52 | 94.40 | 116 | 83 | — | 0/3 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | short | 3 | 3 | 4.848 | 0.153 | — | 22.36 | 21.66 | 105 | 87 | 83 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | short | 3 | 3 | 3.024 | 0.177 | — | 27.04 | 25.46 | 77 | 87 | 86 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | short | 3 | 3 | 8.523 | — | — | 16.36 | 15.02 | 128 | 76 | — | 0/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | short | 3 | 3 | 1.879 | 0.044 | — | 67.38 | 65.98 | 124 | 87 | 83 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | short | 3 | 3 | 1.125 | 0.125 | — | 100.67 | 89.81 | 101 | 87 | 86 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | short | 3 | 3 | 3.156 | — | — | 45.05 | 40.56 | 128 | 76 | — | 0/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | short | 3 | 3 | 0.614 | 0.023 | — | 140.34 | 135.17 | 83 | 84 | 79 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | short | 3 | 3 | 0.605 | 0.023 | — | 142.55 | 137.19 | 83 | 84 | 79 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | short | 3 | 3 | 0.612 | 0.024 | — | 141.18 | 135.58 | 83 | 84 | 79 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | short | 3 | 3 | 4.956 | 0.149 | — | 21.92 | 21.19 | 105 | 87 | 83 | 3/3 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | short | 3 | 3 | 0.731 | 0.038 | — | 92.26 | 87.58 | 64 | 88 | 83 | 3/3 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | short | 3 | 3 | 0.718 | 0.039 | — | 94.18 | 89.13 | 64 | 88 | 83 | 3/3 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | short | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | medium | 3 | 3 | 0.346 | 0.060 | — | 419.80 | 347.09 | 120 | 376 | — | 0/3 | missing-case |
| 2026-04-28-mlx-lm-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | medium | 3 | 3 | 0.296 | 0.006 | — | 410.07 | 402.01 | 119 | 376 | — | 0/3 | missing-case |
| 2026-04-29-llama-server-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | medium | 3 | 3 | 0.362 | 0.006 | — | 334.90 | 329.17 | 119 | 376 | 375 | 3/3 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | medium | 3 | 3 | 0.366 | 0.053 | — | 382.64 | 327.46 | 120 | 376 | 375 | 3/3 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | medium | 3 | 3 | 1.302 | — | — | 101.07 | 93.68 | 122 | 355 | — | 0/3 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | medium | 3 | 3 | 5.878 | 0.149 | — | 22.35 | 21.78 | 128 | 364 | 360 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | medium | 3 | 3 | 4.932 | 0.179 | — | 26.85 | 25.95 | 128 | 364 | 363 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | medium | 3 | 3 | 9.788 | — | — | 16.46 | 13.08 | 128 | 353 | — | 0/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | medium | 3 | 3 | 1.765 | 0.036 | — | 74.18 | 72.54 | 128 | 364 | 360 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | medium | 3 | 3 | 1.444 | 0.128 | — | 97.32 | 88.66 | 128 | 364 | 363 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | medium | 3 | 3 | 3.364 | — | — | 45.61 | 38.05 | 128 | 353 | — | 0/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | medium | 3 | 3 | 0.883 | 0.024 | — | 140.94 | 136.99 | 121 | 356 | 351 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | medium | 3 | 3 | 0.878 | 0.024 | — | 141.75 | 137.83 | 121 | 356 | 351 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | medium | 3 | 3 | 0.887 | 0.026 | — | 140.53 | 136.38 | 121 | 356 | 351 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | medium | 3 | 3 | 5.985 | 0.151 | — | 21.94 | 21.39 | 128 | 364 | 360 | 3/3 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | medium | 3 | 3 | 1.392 | 0.040 | — | 91.69 | 89.08 | 124 | 360 | 355 | 3/3 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | medium | 3 | 3 | 1.377 | 0.041 | — | 92.76 | 90.02 | 124 | 360 | 355 | 3/3 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | medium | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | long | 3 | 3 | 0.371 | 0.056 | — | 406.38 | 345.01 | 128 | 811 | — | 0/3 | missing-case |
| 2026-04-28-mlx-lm-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | long | 3 | 3 | 0.203 | 0.007 | — | 411.57 | 398.54 | 81 | 811 | — | 0/3 | missing-case |
| 2026-04-29-llama-server-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | long | 3 | 3 | 0.249 | 0.007 | — | 335.28 | 325.92 | 81 | 811 | 810 | 3/3 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | long | 3 | 3 | 0.408 | 0.055 | — | 362.45 | 313.60 | 128 | 811 | 810 | 3/3 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | long | 3 | 3 | 1.167 | — | — | 99.42 | 91.69 | 107 | 790 | — | 0/3 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | long | 3 | 3 | 6.024 | 0.156 | — | 21.80 | 21.25 | 128 | 806 | 802 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | long | 3 | 3 | 4.919 | 0.179 | — | 27.00 | 26.02 | 128 | 806 | 805 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | long | 3 | 3 | 9.393 | — | — | 16.42 | 13.63 | 128 | 795 | — | 0/3 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | long | 3 | 3 | 1.846 | 0.037 | — | 70.77 | 69.35 | 128 | 806 | 802 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | long | 3 | 3 | 1.415 | 0.132 | — | 99.72 | 90.44 | 128 | 806 | 805 | 3/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | long | 3 | 3 | 3.286 | — | — | 45.76 | 38.95 | 128 | 795 | — | 0/3 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | long | 3 | 3 | 0.681 | 0.011 | — | 138.82 | 136.51 | 93 | 799 | 798 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | long | 3 | 3 | 0.671 | 0.011 | — | 141.02 | 138.63 | 93 | 799 | 798 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | long | 3 | 3 | 0.672 | 0.014 | — | 141.28 | 138.35 | 93 | 799 | 798 | 3/3 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | long | 3 | 3 | 5.860 | 0.152 | — | 22.42 | 21.84 | 128 | 806 | 802 | 3/3 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | long | 3 | 3 | 1.467 | 0.044 | — | 89.95 | 87.25 | 128 | 803 | 798 | 3/3 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | long | 3 | 3 | 1.450 | 0.045 | — | 91.07 | 88.26 | 128 | 803 | 798 | 3/3 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | long | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | capital | 1 | 1 | 0.685 | — | — | — | 11.68 | 8 | 41 | — | 0/1 | missing-case |
| 2026-04-29-llama-server-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | capital | 1 | 1 | 0.259 | — | — | — | 30.87 | 8 | 41 | — | 0/1 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | capital | 1 | 1 | 0.196 | — | — | — | 40.81 | 8 | 41 | 0 | 1/1 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | capital | 1 | 1 | 0.528 | — | — | — | 15.16 | 8 | 41 | 0 | 1/1 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | capital | 1 | 1 | 19.068 | — | — | 66.46 | 0.42 | 8 | 20 | — | 0/1 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | capital | 1 | 1 | 0.668 | — | — | — | 11.98 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | capital | 1 | 1 | 1.011 | — | — | — | 7.92 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | capital | 1 | 1 | 0.625 | — | — | — | 12.80 | 8 | 24 | 23 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | capital | 1 | 1 | 0.987 | — | — | — | 8.11 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | capital | 1 | 1 | 2.213 | — | — | 16.53 | 13.55 | 30 | 12 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | capital | 1 | 1 | 14.025 | — | — | 16.56 | 2.14 | 30 | 12 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | capital | 1 | 1 | 0.210 | — | — | — | 38.12 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | capital | 1 | 1 | 0.554 | — | — | — | 14.45 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | capital | 1 | 1 | 1.139 | — | — | — | 56.21 | 64 | 22 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | capital | 1 | 1 | 0.365 | — | — | — | 21.91 | 8 | 24 | 23 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | capital | 1 | 1 | 1.461 | — | — | — | 5.48 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | capital | 1 | 1 | 1.220 | — | — | — | — | — | — | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | capital | 1 | 1 | 6.123 | — | — | — | — | — | — | — | 0/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | capital | 1 | 1 | 0.115 | — | — | — | 69.80 | 8 | 21 | 0 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | capital | 1 | 1 | 0.112 | — | — | — | 71.18 | 8 | 21 | 0 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | capital | 1 | 1 | 0.303 | — | — | — | 26.44 | 8 | 21 | 0 | 1/1 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | capital | 1 | 1 | 0.770 | — | — | — | 10.39 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | capital | 1 | 1 | 0.677 | — | — | — | 11.82 | 8 | 24 | 0 | 1/1 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | capital | 1 | 1 | 0.236 | — | — | — | 33.94 | 8 | 25 | 0 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | capital | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | capital | 1 | 1 | 0.216 | — | — | — | 37.03 | 8 | 25 | 0 | 1/1 | missing-case |
| 2026-04-28-mlx-lm-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | wrap-plan-small | 1 | 1 | 1.228 | 0.274 | — | 402.87 | 312.83 | 384 | 569 | 0 | 1/1 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | wrap-plan-small | 1 | 1 | 1.200 | 0.064 | — | 338.01 | 320.02 | 384 | 569 | 0 | 1/1 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | wrap-plan-small | 1 | 1 | 1.154 | 0.107 | — | 366.57 | 332.68 | 384 | 569 | 23 | 1/1 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | wrap-plan-small | 1 | 1 | 1.771 | — | — | 100.61 | 67.19 | 119 | 548 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | wrap-plan-small | 1 | 1 | 9.934 | 2.601 | — | 21.95 | 16.21 | 161 | 579 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | wrap-plan-small | 1 | 1 | 8.674 | 2.501 | — | 26.89 | 19.14 | 166 | 579 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | wrap-plan-small | 1 | 1 | 26.860 | — | — | 16.16 | 14.30 | 384 | 568 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | wrap-plan-small | 1 | 1 | 2.685 | 0.545 | — | 73.82 | 58.84 | 158 | 579 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | wrap-plan-small | 1 | 1 | 2.127 | 0.551 | — | 94.57 | 70.06 | 149 | 579 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | wrap-plan-small | 1 | 1 | 9.418 | — | — | 45.36 | 40.77 | 384 | 568 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | wrap-plan-small | 1 | 1 | 1.089 | 0.259 | — | 140.91 | 107.45 | 117 | 596 | 6 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | wrap-plan-small | 1 | 1 | 1.086 | 0.258 | — | 141.31 | 107.72 | 117 | 596 | 6 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | wrap-plan-small | 1 | 1 | 9.831 | 2.561 | — | 22.15 | 16.38 | 161 | 579 | 0 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | wrap-plan-small | 1 | 1 | 1.558 | 0.535 | — | 92.90 | 60.99 | 95 | 600 | 6 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | wrap-plan-small | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | wrap-plan-context | 1 | 1 | 0.884 | 0.034 | — | 402.68 | 386.97 | 342 | 648 | 0 | 1/1 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | wrap-plan-context | 1 | 1 | 1.082 | 0.059 | — | 334.33 | 315.99 | 342 | 648 | 0 | 1/1 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | wrap-plan-context | 1 | 1 | 1.172 | 0.101 | — | 358.34 | 327.56 | 384 | 648 | 26 | 1/1 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | wrap-plan-context | 1 | 1 | 2.142 | — | — | 100.37 | 73.28 | 157 | 627 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | wrap-plan-context | 1 | 1 | 10.357 | 3.006 | — | 21.90 | 15.54 | 161 | 657 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | wrap-plan-context | 1 | 1 | 7.577 | 2.860 | — | 26.71 | 16.63 | 126 | 657 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | wrap-plan-context | 1 | 1 | 27.114 | — | — | 16.31 | 14.16 | 384 | 646 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | wrap-plan-context | 1 | 1 | 2.658 | 0.585 | — | 71.86 | 56.05 | 149 | 657 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | wrap-plan-context | 1 | 1 | 2.078 | 0.561 | — | 93.60 | 68.32 | 142 | 657 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | wrap-plan-context | 1 | 1 | 6.409 | — | — | 45.65 | 39.01 | 250 | 646 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | wrap-plan-context | 1 | 1 | 1.163 | 0.271 | — | 139.02 | 106.62 | 124 | 677 | 6 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | wrap-plan-context | 1 | 1 | 1.150 | 0.271 | — | 141.03 | 107.79 | 124 | 677 | 6 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | wrap-plan-context | 1 | 1 | 10.187 | 2.952 | — | 22.26 | 15.81 | 161 | 657 | 0 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | wrap-plan-context | 1 | 1 | 1.979 | 0.574 | — | 92.53 | 65.70 | 130 | 681 | 6 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | wrap-plan-context | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | fix-greeting | 1 | 1 | 0.506 | — | — | — | 318.40 | 161 | 199 | 23 | 1/1 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | fix-greeting | 1 | 1 | 0.743 | — | — | — | 344.77 | 256 | 199 | 24 | 1/1 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | fix-greeting | 1 | 1 | 1.207 | — | — | 103.51 | 77.04 | 93 | 179 | — | 0/1 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | fix-greeting | 1 | 1 | 3.631 | — | — | — | 15.97 | 58 | 194 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | fix-greeting | 1 | 1 | 3.125 | — | — | — | 18.56 | 58 | 194 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | fix-greeting | 1 | 1 | 1.132 | — | — | — | 0.88 | 1 | 183 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | fix-greeting | 1 | 1 | 1.083 | — | — | — | 53.56 | 58 | 194 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | fix-greeting | 1 | 1 | 0.926 | — | — | — | 62.64 | 58 | 194 | 0 | 1/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | fix-greeting | 1 | 1 | 6.115 | — | — | 45.52 | 41.86 | 256 | 183 | — | 0/1 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | fix-greeting | 1 | 1 | 0.655 | — | — | — | 119.15 | 78 | 191 | 4 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | fix-greeting | 1 | 1 | 0.653 | — | — | — | 119.48 | 78 | 191 | 4 | 1/1 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | fix-greeting | 1 | 1 | 11.827 | — | — | 102.85 | 7.86 | 93 | 346 | — | 0/1 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | fix-greeting | 1 | 1 | 4.620 | — | — | — | 13.64 | 63 | 363 | 0 | 1/1 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | fix-greeting | 1 | 1 | 1.003 | — | — | — | 61.79 | 62 | 373 | 4 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | fix-greeting | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | fix-dashboard-regressions | 1 | 1 | 11.320 | — | — | 96.15 | 83.84 | 949 | 1468 | — | 0/1 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | fix-dashboard-regressions | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | fix-task-summary | 1 | 1 | 5.577 | — | — | 100.07 | 83.73 | 467 | 957 | — | 0/1 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | fix-task-summary | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-28-mlx-lm-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-29-llama-server-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-04-30-llama-server-desktop-django-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-llama-qwen25-05b-190636-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-mlx-qwen25-05b-185824-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-03-m4-max-qwen3coder-184938-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-154321-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-llamacpp-smoke-154255 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-155943-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-mlx-smoke-155916 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-155051-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-dense-ollama-smoke-154808 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-153657-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-reasonoff-smoke-153634 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-llamacpp-smoke-153159 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-155645-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-mlx-smoke-155619 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-154846-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-05-m4-qwen36-moe-ollama-smoke-154747 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1058-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-4pack-20260507-1116-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-runtime-20260507-103928 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-07-m4-max-gemma4-llama-reasoning-off-smoke-20260507-103856 | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-dashboard-regression-external-agent | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-patch-external-agent | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-codex-oss-direct-edit-20260509-162514-python-regression-external-agent | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-endpoint-correctness | fix-inventory-aggregation | 1 | 1 | 22.882 | — | — | — | 18.09 | 414 | 962 | 0 | 1/1 | missing-case |
| 2026-05-09-m4-max-qwen36-27b-llamacpp-strict-preflight-20260509-220411-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-10-m4-max-qwen36-27b-llamacpp-strict-fourpack-20260510-131758-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-patch | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-fourpack-20260512-wrap | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-endpoint-correctness | fix-inventory-aggregation | 1 | 1 | 3.464 | — | — | — | 67.84 | 235 | 1029 | 4 | 1/1 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-runtime | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |
| 2026-05-12-m4-max-gemma4-26b-a4b-llamacpp-strict-preflight-20260512-smoke | fix-inventory-aggregation | 0 | 0 | — | — | — | — | — | — | — | — | 0/0 | missing-case |