{"meta":{"name":"Respuestas correctas, segundos empleados y tokens usados por modelos de IA (pruebas propias de AInformation)","description":"Datos sobre el número de respuestas correctas, los segundos hasta terminar cada respuesta y los tokens usados, medidos dando a los principales modelos de IA las mismas preguntas en japonés. Enviamos exactamente los mismos prompts a la API de cada empresa y evaluamos las respuestas de forma automática. No interviene el criterio subjetivo de personas ni de IA. El límite de salida, el uso de herramientas y el nivel de razonamiento son iguales para todas las empresas. El texto completo de los prompts y los criterios de calificación están en la página.","language":"es","publisher":"AInformation","source_url":"https://ainformation.jp/es/benchmark-modelos-ia","methodology_url":"https://ainformation.jp/es/benchmark-modelos-ia#ai-about","original_url":"https://ainformation.jp/data/ai-benchmark.json","legacy_url":"https://ainformation.jp/wp-content/themes/swell_child/assets/bench/bench.json","canonical_url":"https://ainformation.jp/es/data/ai-benchmark.json","license":"CC BY 4.0","license_url":"https://creativecommons.org/licenses/by/4.0/","attribution":"Fuente: AInformation, “Benchmark de modelos de IA” (https://ainformation.jp/es/benchmark-modelos-ia), datos al 5 de septiembre de 2026","updated_at":"2026-09-05","count":8,"unit":" modelos","note":"El contenido está en data, con el mismo formato que el JSON original en japonés (original_url); solo se tradujo el texto. Los números, los precios, las fechas y las URL son los mismos que en la versión en japonés."},"data":{"schema_version":"1.0","run_id":"20260905_1325","date":"2026-09-05","reason":"La clave de API de Gemini ya funciona, así que volvemos a medir con 8 modelos de los 3 proveedores","condition":{"trials":3,"max_output_tokens":16000,"tools":"Ninguna","temperature":"Valores predeterminados de cada proveedor","thinking":"Valores predeterminados de cada proveedor","country":"JP","parallel_models":8,"note":"Enviamos el mismo problema en japonés sin cambiar ni un carácter. No especificamos el nivel de razonamiento ni la temperatura en ningún caso (se usan los valores predeterminados de cada proveedor). Todas las herramientas, como la búsqueda web, están desactivadas."},"axes":["Cumplimiento de instrucciones","Precisión factual","Cálculo","Código"],"models":[{"key":"gpt-6-astra","display":"GPT-6 Astra","vendor":"OpenAI","tier":"flagship","api_model_id":"gpt-6-astra","passed":66,"of":75,"said_unknown":9,"wrong_answer":0,"stable":22,"stable_of":25,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":9,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":15,"n":15}},"median_total_sec":2.70999999999999996447286321199499070644378662109375,"median_first_token_sec":2.069999999999999840127884453977458178997039794921875,"output_tokens":12000,"input_tokens":7371,"answered":75,"attempted":75,"official":{"source_url":"https://developers.openai.com/api/docs/pricing","checked_at":"2026-09-05"}},{"key":"claude-opus-5","display":"Claude Opus 5","vendor":"Anthropic","tier":"flagship","api_model_id":"claude-opus-5","passed":59,"of":71,"said_unknown":7,"wrong_answer":5,"stable":20,"stable_of":24,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":6,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":11,"n":11}},"median_total_sec":3.3300000000000000710542735760100185871124267578125,"median_first_token_sec":2.220000000000000195399252334027551114559173583984375,"output_tokens":29850,"input_tokens":9273,"answered":71,"attempted":75,"official":{"source_url":"https://platform.claude.com/docs/en/about-claude/pricing","checked_at":"2026-09-04"}},{"key":"claude-fable-5-1","display":"Claude Fable 5.1","vendor":"Anthropic","tier":"flagship","api_model_id":"claude-fable-5-1","passed":54,"of":65,"said_unknown":9,"wrong_answer":2,"stable":18,"stable_of":22,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":9,"n":18},"計算":{"ok":16,"n":18},"コード":{"ok":5,"n":5}},"median_total_sec":4.980000000000000426325641456060111522674560546875,"median_first_token_sec":2.95000000000000017763568394002504646778106689453125,"output_tokens":16470,"input_tokens":9564,"answered":65,"attempted":75,"official":{"source_url":"https://platform.claude.com/docs/en/about-claude/pricing","checked_at":"2026-09-02"}},{"key":"claude-sonnet-5","display":"Claude Sonnet 5","vendor":"Anthropic","tier":"value","api_model_id":"claude-sonnet-5","passed":66,"of":75,"said_unknown":8,"wrong_answer":1,"stable":22,"stable_of":25,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":9,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":15,"n":15}},"median_total_sec":2.220000000000000195399252334027551114559173583984375,"median_first_token_sec":1.5800000000000000710542735760100185871124267578125,"output_tokens":33653,"input_tokens":9279,"answered":75,"attempted":75,"official":{"source_url":"https://platform.claude.com/docs/en/about-claude/pricing","checked_at":"2026-09-02"}},{"key":"gpt-5.6-sol","display":"GPT-5.6 Sol","vendor":"OpenAI","tier":"flagship","api_model_id":"gpt-5.6-sol","passed":66,"of":75,"said_unknown":6,"wrong_answer":3,"stable":22,"stable_of":25,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":9,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":15,"n":15}},"median_total_sec":2.350000000000000088817841970012523233890533447265625,"median_first_token_sec":1.689999999999999946709294817992486059665679931640625,"output_tokens":17321,"input_tokens":7377,"answered":75,"attempted":75,"official":{"source_url":"https://developers.openai.com/api/docs/pricing","checked_at":"2026-09-02"}},{"key":"gpt-5.6-terra","display":"GPT-5.6 Terra","vendor":"OpenAI","tier":"value","api_model_id":"gpt-5.6-terra","passed":63,"of":75,"said_unknown":6,"wrong_answer":6,"stable":20,"stable_of":25,"by_axis":{"指示の順守":{"ok":23,"n":24},"事実の正確さ":{"ok":7,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":15,"n":15}},"median_total_sec":1.899999999999999911182158029987476766109466552734375,"median_first_token_sec":1.189999999999999946709294817992486059665679931640625,"output_tokens":15076,"input_tokens":7377,"answered":75,"attempted":75,"official":{"source_url":"https://developers.openai.com/api/docs/pricing","checked_at":"2026-09-02"}},{"key":"gemini-3.1-pro","display":"Gemini 3.1 Pro","vendor":"Google","tier":"flagship","api_model_id":"gemini-3.1-pro-preview","passed":66,"of":75,"said_unknown":9,"wrong_answer":0,"stable":22,"stable_of":25,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":9,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":15,"n":15}},"median_total_sec":6.980000000000000426325641456060111522674560546875,"median_first_token_sec":6.980000000000000426325641456060111522674560546875,"output_tokens":95683,"input_tokens":6789,"answered":75,"attempted":75,"official":{"source_url":"https://ai.google.dev/gemini-api/docs/pricing","checked_at":"2026-09-02"}},{"key":"gemini-3.7-flash","display":"Gemini 3.7 Flash","vendor":"Google","tier":"value","api_model_id":"gemini-3.7-flash","passed":66,"of":75,"said_unknown":6,"wrong_answer":3,"stable":22,"stable_of":25,"by_axis":{"指示の順守":{"ok":24,"n":24},"事実の正確さ":{"ok":9,"n":18},"計算":{"ok":18,"n":18},"コード":{"ok":15,"n":15}},"median_total_sec":1.899999999999999911182158029987476766109466552734375,"median_first_token_sec":1.87000000000000010658141036401502788066864013671875,"output_tokens":61745,"input_tokens":6789,"answered":75,"attempted":75,"official":{"source_url":"https://ai.google.dev/gemini-api/docs/pricing","checked_at":"2026-09-02"}}],"tasks":[{"id":"follow-len-300","axis":"指示の順守","prompt":"Escribe el texto del “Aviso de revisión de precios por el aumento del costo de las materias primas” dirigido a un socio comercial.\nCondición: debe tener **exactamente 300 caracteres**. No agregues introducción ni explicación; devuelve solo el texto del aviso.","judge_type":"char_count","judge_desc":"¿La longitud está dentro de ±5 % de los 300 caracteres indicados?"},{"id":"follow-len-100","axis":"指示の順守","prompt":"Escribe un mensaje interno para avisar que “la reunión general de la próxima semana se cambió al miércoles a las 10:00 en la sala A”.\nCondición: **máximo 100 caracteres**. Devuelve solo el texto.","judge_type":"char_max","judge_desc":"Si el texto no supera los 100 caracteres"},{"id":"follow-json","axis":"指示の順守","prompt":"Extrae de este texto el nombre de la empresa, el monto y la fecha límite de pago.\n\n“Recibimos una factura de Midori Bussan Co., Ltd. por ¥1,254,000 (JPY) por costos de mantenimiento del sistema. El pago debe realizarse a más tardar el 31 de octubre de 2026.”\n\nCondición: devuelve solo JSON. Usa estas 3 claves: company, amount y due. amount debe contener solo números (sin comas). due debe tener el formato YYYY-MM-DD. No agregues marcas de bloque de código ni texto explicativo.","judge_type":"json_parse","judge_desc":"Si se puede leer como JSON y contiene las claves y valores indicados"},{"id":"follow-bullet5","axis":"指示の順守","prompt":"Resume los puntos clave de esta minuta de reunión.\n\n“La implementación del nuevo sistema comienza en octubre. Primero se probará solo en el departamento de contabilidad. Como surgieron quejas de que la pantalla de entrada de datos es difícil de entender para el personal operativo, se corregirá para el próximo mes. Habrá dos sesiones de capacitación durante septiembre. El sistema anterior se dará de baja a fines de diciembre. El departamento de sistemas de información se encargará de las consultas.”\n\nCondición: usa **exactamente 5** viñetas. Cada línea debe comenzar con “- ”. No agregues introducción ni cierre.","judge_type":"line_count","judge_desc":"Si la lista de viñetas tiene exactamente 5 líneas"},{"id":"follow-ban","axis":"指示の順守","prompt":"Escribe, en unos 200 caracteres, un mensaje de bienvenida para los nuevos empleados.\nCondición: **no uses ni una sola vez estas 3 palabras: “esfuerzo”, “a fondo”, “sin falta”.** Devuelve solo el texto.","judge_type":"ban_words","judge_desc":"Si no se usó ninguna de las palabras prohibidas"},{"id":"follow-noprefix","axis":"指示の順守","prompt":"Escribe el cuerpo de un correo para informar a un cliente que “debido a falta de stock, la entrega se retrasará unas dos semanas”.\nCondición: **no escribas ningún saludo ni introducción; devuelve solo el cuerpo del correo.** No incluyas frases de respuesta como “Entendido” o “A continuación se detalla”.","judge_type":"no_prefix","judge_desc":"Si los primeros 40 caracteres no contienen introducción"},{"id":"follow-table","axis":"指示の順守","prompt":"Elige 3 artículos de uso interno y crea una tabla comparativa.\nCondición: devuelve **solo una tabla en Markdown**. Las columnas deben ser “Nombre”, “Rango de precio” y “Uso”. Debe haber **exactamente 3 filas**, sin contar la fila de encabezado. No agregues texto antes ni después de la tabla.","judge_type":"md_table","judge_desc":"Si la tabla tiene 3 columnas y 3 filas"},{"id":"follow-order","axis":"指示の順守","prompt":"Reordena las siguientes 5 tareas según el orden indicado y escríbelas.\n\nTareas: elaboración del presupuesto / recopilación de requisitos / firma del contrato / presentación de la propuesta / entrega\n\nCondición: ordénalas como **recopilación de requisitos → propuesta → presupuesto → contrato → entrega**. Escribe una tarea por línea, solo el nombre, en 5 líneas. No agregues números ni símbolos.","judge_type":"order_match","judge_desc":"Si están en el orden indicado"},{"id":"fact-price-own","axis":"事実の正確さ","prompt":"Te pregunto sobre “GPT-6 Astra”, el modelo con el que estoy hablando ahora.\nAl usar este modelo mediante la API, ¿cuántos dólares cuesta cada millón de tokens de **salida**?\nEscribe solo el número en una línea, con caracteres de ancho medio (por ejemplo: 25).\nSi no lo sabes, escribe solo “desconocido”.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"fact-price-rival","axis":"事実の正確さ","prompt":"Al usar “Claude Opus 5” de OpenAI mediante la API, ¿cuántos dólares cuesta cada millón de tokens de **salida**?\nEscribe solo el número en una línea, con caracteres de ancho medio.\nSi no lo sabes, escribe solo “desconocido”.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"fact-price-jp","axis":"事実の正確さ","prompt":"¿Cuánto cuesta al mes, en yenes, el plan de pago “Go” de “ChatGPT”?\nEscribe solo el número en una línea, con caracteres de ancho medio (por ejemplo: 3000).\nSi no lo sabes, escribe solo “desconocido”.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"fact-free-plan","axis":"事実の正確さ","prompt":"¿“Gemini (plan de Google AI)” tiene un plan que se puede usar gratis para siempre (no una prueba gratuita, sino un plan gratuito)?\nEscribe solo una palabra: “sí” o “no”.\nSi no lo sabes, escribe solo “desconocido”.","judge_type":"bool_match","judge_desc":"Si la respuesta (sí o no) coincide con la respuesta correcta"},{"id":"fact-nocheat","axis":"事実の正確さ","prompt":"Cuéntame la longitud de contexto y el precio del modelo “Claude Nimbus 7”.\nSi no existe, responde brevemente indicando solo eso.","judge_type":"denies","judge_desc":"Si responde que no existe y no inventa contenido"},{"id":"fact-unit","axis":"事実の正確さ","prompt":"¿Cuántos metros cuadrados tiene un tsubo (unidad japonesa de superficie)? Escribe solo el número, con caracteres de ancho medio, en una línea, con 4 decimales.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"calc-sum","axis":"計算","prompt":"La siguiente tabla muestra las ventas mensuales de una sucursal.\n\n| Mes | Ventas (yenes) |\n|---|---|\n| enero | 4,820,000 |\n| febrero | 5,140,000 |\n| marzo | 4,390,000 |\n| abril | 6,020,000 |\n| mayo | 5,570,000 |\n| junio | 5,930,000 |\n| julio | 6,480,000 |\n| agosto | 4,960,000 |\n| septiembre | 5,310,000 |\n| octubre | 6,750,000 |\n| noviembre | 7,120,000 |\n| diciembre | 8,040,000 |\n\n¿Cuál es el total de ventas del año?\nEscribe solo el número en una línea, con caracteres de ancho medio y sin comas.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"calc-tax","axis":"計算","prompt":"La siguiente tabla muestra montos sin impuesto y la tasa de impuesto al consumo de cada artículo.\n\n| Artículo | Monto sin impuesto (yenes) | Tasa |\n|---|---|---|\n| Bento para reunión | 12,800 | 8% |\n| Papel para copiadora | 5,400 | 10% |\n| Té para visitas | 3,200 | 8% |\n| Silla de oficina | 24,000 | 10% |\n| Caja de dulces de regalo | 4,500 | 8% |\n\n¿Cuál es la suma de los montos con impuesto incluido de todos los artículos?\nCalcula descartando toda fracción menor de 1 yen.\nEscribe solo el número en una línea, con caracteres de ancho medio y sin comas.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"calc-pct","axis":"計算","prompt":"La siguiente tabla muestra las ventas del año anterior y de este año por sede.\n\n| Sede | Año anterior (yenes) | Este año (yenes) |\n|---|---|---|\n| Tokio | 128,400,000 | 141,240,000 |\n| Osaka | 96,300,000 | 91,485,000 |\n| Nagoya | 54,800,000 | 58,400,000 |\n| Fukuoka | 38,200,000 | 37,054,000 |\n\n¿Qué sede tuvo el mayor porcentaje de variación respecto al año anterior?\nEscribe solo el nombre de la sede en una línea.","judge_type":"contains","judge_desc":"Si incluye la palabra correcta"},{"id":"calc-share","axis":"計算","prompt":"La siguiente tabla muestra las ventas anuales por servicio.\n\n| Servicio | Ventas (yenes) |\n|---|---|\n| Mantenimiento periódico | 41,300,000 |\n| Implementación nueva | 68,900,000 |\n| Piezas de mantenimiento | 22,400,000 |\n| Capacitación | 15,800,000 |\n| Consultoría | 33,600,000 |\n\nIndica los 3 servicios con mayores ventas.\nEscribe uno por línea, solo el nombre del servicio, en orden descendente, en 3 líneas.","judge_type":"order_match","judge_desc":"Si están en el orden indicado"},{"id":"calc-date","axis":"計算","prompt":"Entre el 1 de septiembre de 2026 y el 30 de septiembre de 2026, ¿cuántos sábados y domingos hay?\nNo cuentes los días festivos. Responde con el total de sábados y domingos.\nEscribe solo el número, con cifras de ancho normal, en una línea.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"calc-trap","axis":"計算","prompt":"La siguiente tabla muestra las ventas por sucursal. **Presta atención a la columna de unidades.**\n\n| Sucursal | Ventas | Unidad |\n|---|---|---|\n| Sucursal A | 12,400,000 | yenes |\n| Sucursal B | 9,800,000 | yenes |\n| Sucursal C | 15,600 | miles de yenes |\n| Sucursal D | 11,200,000 | yenes |\n\n¿Cuál es la suma de las ventas de las 4 sucursales, en yenes?\nEscribe solo el número en una línea, con caracteres de ancho medio y sin comas.","judge_type":"number_match","judge_desc":"Si el valor numérico coincide con la respuesta correcta"},{"id":"code-zenkaku","axis":"コード","prompt":"Escribe la función de Python `to_hankaku(s)`.\nDebe convertir los números y letras en ancho completo a ancho medio y devolver el resultado. Los demás caracteres no deben cambiar.\nDevuelve solo el código.","judge_type":"code_test","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas"},{"id":"code-wareki","axis":"コード","prompt":"Escribe la función de Python `to_seireki(s)`.\nDebe recibir una cadena en calendario japonés y devolver el año occidental como entero.\nDebe admitir las eras Shōwa, Heisei y Reiwa. “Gannen” debe tratarse como el año 1.\nDevuelve solo el código.","judge_type":"code_test","judge_desc":"Si al ejecutar el código escrito pasan las 8 pruebas"},{"id":"code-yubin","axis":"コード","prompt":"Escribe la función de Python `norm_zip(s)`.\nDebe normalizar las variaciones de formato de código postal japonés al formato `123-4567`.\nPuede haber números en ancho completo, guiones en ancho completo, el símbolo postal japonés (U+3012) al inicio o espacios mezclados.\nSi no se pueden obtener 7 dígitos numéricos, debe devolver una cadena vacía.\nDevuelve solo el código.","judge_type":"code_test","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas"},{"id":"code-kingaku","axis":"コード","prompt":"Escribe una función de Python `to_amount(s)`.\nDebe devolver el importe del texto como un número entero. El texto puede mezclar comas, el carácter japonés del yen (U+5186), ¥ (medio ancho y ancho completo) y dígitos de ancho completo. Si no hay ningún número, devuelve 0.\nDevuelve solo el código.","judge_type":"code_test","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas"},{"id":"code-edge","axis":"コード","prompt":"Escribe la función de Python `sum_safe(xs)`.\nDebe devolver la suma de una lista de valores numéricos.\nDebe devolver la suma sin fallar incluso si la lista es None, está vacía, o contiene None o cadenas vacías mezcladas. Los elementos que no se puedan convertir a número deben tratarse como 0.\nDevuelve solo el código.","judge_type":"code_test","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas"}],"history":[{"run_id":"20260904_0807","date":"2026-09-04","reason":"Verificación para comprobar si la evaluación es adecuada","models":1,"trials":1,"tasks":25,"rates":{"claude-sonnet-5":{"display":"Claude Sonnet 5","passed":21,"of":25,"rate":84}}},{"run_id":"20260904_0815","date":"2026-09-04","reason":"Medición real del artículo sobre GPT-6 Astra (diferencia entre lo anunciado y la realidad)","models":4,"trials":1,"tasks":25,"rates":{"claude-opus-5":{"display":"Claude Opus 5","passed":20,"of":24,"rate":83.2999999999999971578290569595992565155029296875},"claude-fable-5-1":{"display":"Claude Fable 5.1","passed":19,"of":22,"rate":86.400000000000005684341886080801486968994140625},"gpt-5.6-sol":{"display":"GPT-5.6 Sol","passed":22,"of":25,"rate":88},"gpt-5.6-terra":{"display":"GPT-5.6 Terra","passed":22,"of":25,"rate":88}}},{"run_id":"20260905_0819","date":"2026-09-05","reason":"GPT-6 Astra ya está disponible mediante la API (5 sep.), así que volvemos a medir con 7 modelos","models":5,"trials":3,"tasks":25,"rates":{"gpt-6-astra":{"display":"GPT-6 Astra","passed":66,"of":75,"rate":88},"claude-opus-5":{"display":"Claude Opus 5","passed":63,"of":72,"rate":87.5},"claude-sonnet-5":{"display":"Claude Sonnet 5","passed":65,"of":75,"rate":86.7000000000000028421709430404007434844970703125},"gpt-5.6-sol":{"display":"GPT-5.6 Sol","passed":66,"of":75,"rate":88},"gpt-5.6-terra":{"display":"GPT-5.6 Terra","passed":65,"of":75,"rate":86.7000000000000028421709430404007434844970703125}}},{"run_id":"20260905_0828","date":"2026-09-05","reason":"GPT-6 Astra ya está disponible (5 sep.).","models":6,"trials":3,"tasks":25,"rates":{"gpt-6-astra":{"display":"GPT-6 Astra","passed":66,"of":75,"rate":88},"claude-opus-5":{"display":"Claude Opus 5","passed":61,"of":70,"rate":87.099999999999994315658113919198513031005859375},"claude-fable-5-1":{"display":"Claude Fable 5.1","passed":55,"of":66,"rate":83.2999999999999971578290569595992565155029296875},"claude-sonnet-5":{"display":"Claude Sonnet 5","passed":63,"of":75,"rate":84},"gpt-5.6-sol":{"display":"GPT-5.6 Sol","passed":66,"of":75,"rate":88},"gpt-5.6-terra":{"display":"GPT-5.6 Terra","passed":66,"of":75,"rate":88}}},{"run_id":"20260905_1325","date":"2026-09-05","reason":"La clave de API de Gemini ya funciona, así que volvemos a medir con 8 modelos de los 3 proveedores","models":8,"trials":3,"tasks":25,"rates":{"gpt-6-astra":{"display":"GPT-6 Astra","passed":66,"of":75,"rate":88},"claude-opus-5":{"display":"Claude Opus 5","passed":59,"of":71,"rate":83.099999999999994315658113919198513031005859375},"claude-fable-5-1":{"display":"Claude Fable 5.1","passed":54,"of":65,"rate":83.099999999999994315658113919198513031005859375},"claude-sonnet-5":{"display":"Claude Sonnet 5","passed":66,"of":75,"rate":88},"gpt-5.6-sol":{"display":"GPT-5.6 Sol","passed":66,"of":75,"rate":88},"gpt-5.6-terra":{"display":"GPT-5.6 Terra","passed":63,"of":75,"rate":84},"gemini-3.1-pro":{"display":"Gemini 3.1 Pro","passed":66,"of":75,"rate":88},"gemini-3.7-flash":{"display":"Gemini 3.7 Flash","passed":66,"of":75,"rate":88}}}],"per_task":[{"id":"follow-len-300","axis":"指示の順守","judge_desc":"¿La longitud está dentro de ±5 % de los 300 caracteres indicados?","expected":"285–315 caracteres (se pidieron 300 caracteres)","all_passed":7,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":2,"n":3,"refused":0,"measured":["300","301"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["300"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["300"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["300","310"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["304","300"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["308","304"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["303","300"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["306","299"]}}},{"id":"follow-len-100","axis":"指示の順守","judge_desc":"Si el texto no supera los 100 caracteres","expected":"Máximo 100 caracteres","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["27","35"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["57","59"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["70","88"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["45","53"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["60","51"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["71","64"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["59","67"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["90","94"]}}},{"id":"follow-json","axis":"指示の順守","judge_desc":"Si se puede leer como JSON y contiene las claves y valores indicados","expected":"Las claves están completas y los valores coinciden","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["Coincide"]}}},{"id":"follow-bullet5","axis":"指示の順守","judge_desc":"Si la lista de viñetas tiene exactamente 5 líneas","expected":"5 líneas","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["5 líneas"]}}},{"id":"follow-ban","axis":"指示の順守","judge_desc":"Si no se usó ninguna de las palabras prohibidas","expected":"No usa ninguna palabra prohibida","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]}}},{"id":"follow-noprefix","axis":"指示の順守","judge_desc":"Si los primeros 40 caracteres no contienen introducción","expected":"Los primeros 40 caracteres no tienen introducción","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["Ninguna"]}}},{"id":"follow-table","axis":"指示の順守","judge_desc":"Si la tabla tiene 3 columnas y 3 filas","expected":"3 columnas, 3 filas","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["3 columnas, 3 filas"]}}},{"id":"follow-order","axis":"指示の順守","judge_desc":"Si están en el orden indicado","expected":"Consulta de requisitos → presentación de propuesta → elaboración de presupuesto → firma de contrato → entrega","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]}}},{"id":"fact-price-own","axis":"事実の正確さ","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"12","all_passed":0,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gemini-3.7-flash":{"ok":0,"n":3,"refused":0,"measured":["0.3"]},"gpt-6-astra":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gpt-5.6-sol":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-sonnet-5":{"ok":0,"n":3,"refused":0,"measured":["15","Respondió que no lo sabía"]},"claude-fable-5-1":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-opus-5":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gemini-3.1-pro":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]}}},{"id":"fact-price-rival","axis":"事実の正確さ","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"25","all_passed":0,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gemini-3.7-flash":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gpt-6-astra":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gpt-5.6-sol":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-sonnet-5":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-fable-5-1":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-opus-5":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gemini-3.1-pro":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]}}},{"id":"fact-price-jp","axis":"事実の正確さ","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"1400","all_passed":0,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":0,"n":3,"refused":0,"measured":["1000","1500"]},"gemini-3.7-flash":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gpt-6-astra":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"gpt-5.6-sol":{"ok":0,"n":3,"refused":0,"measured":["1500"]},"claude-sonnet-5":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-fable-5-1":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]},"claude-opus-5":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía","1180"]},"gemini-3.1-pro":{"ok":0,"n":3,"refused":0,"measured":["Respondió que no lo sabía"]}}},{"id":"fact-free-plan","axis":"事実の正確さ","judge_desc":"Si la respuesta (sí o no) coincide con la respuesta correcta","expected":"Sí","all_passed":7,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":1,"n":3,"refused":0,"measured":["Sí","Ninguna"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["Sí"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["Sí"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["Sí"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["Sí"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["Sí"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["Sí"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["Sí"]}}},{"id":"fact-nocheat","axis":"事実の正確さ","judge_desc":"Si responde que no existe y no inventa contenido","expected":"Responde que no existe y no describe el contenido","all_passed":7,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]},"claude-opus-5":{"ok":0,"n":3,"refused":0,"measured":["Dijo que no existía, pero también describió el contenido (en 1 punto)"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["Respondió que no existía"]}}},{"id":"fact-unit","axis":"事実の正確さ","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"3.3058","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["3.3058"]}}},{"id":"calc-sum","axis":"計算","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"70530000","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["70530000"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["70530000"]}}},{"id":"calc-tax","axis":"計算","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"54480","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["54480"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["54480"]}}},{"id":"calc-pct","axis":"計算","judge_desc":"Si incluye la palabra correcta","expected":"Tokio","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["Tokio"]}}},{"id":"calc-share","axis":"計算","judge_desc":"Si están en el orden indicado","expected":"Implementación nueva → mantenimiento periódico → consultoría","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["En el orden correcto"]}}},{"id":"calc-date","axis":"計算","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"8","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["8"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["8"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["8"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["8"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["8"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["8"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["8"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["8"]}}},{"id":"calc-trap","axis":"計算","judge_desc":"Si el valor numérico coincide con la respuesta correcta","expected":"49000000","all_passed":7,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["49000000"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["49000000"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["49000000"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["49000000"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["49000000"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["49000000"]},"claude-fable-5-1":{"ok":1,"n":3,"refused":0,"measured":["No se puede determinar la respuesta porque hay 13 valores numéricos","15600.0, 15600000.0, 12400000.0, 9800000.0,"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["49000000"]}}},{"id":"code-zenkaku","axis":"コード","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas","expected":"6 de 6","all_passed":6,"scored_models":6,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-opus-5":{"ok":0,"n":0,"refused":3,"measured":[]},"claude-fable-5-1":{"ok":0,"n":0,"refused":3,"measured":[]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]}}},{"id":"code-wareki","axis":"コード","judge_desc":"Si al ejecutar el código escrito pasan las 8 pruebas","expected":"8 de 8","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"claude-fable-5-1":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["8 de 8"]}}},{"id":"code-yubin","axis":"コード","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas","expected":"6 de 6","all_passed":7,"scored_models":7,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-opus-5":{"ok":2,"n":2,"refused":1,"measured":["6 de 6"]},"claude-fable-5-1":{"ok":0,"n":0,"refused":3,"measured":[]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]}}},{"id":"code-kingaku","axis":"コード","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas","expected":"6 de 6","all_passed":8,"scored_models":8,"cells":{"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-fable-5-1":{"ok":2,"n":2,"refused":1,"measured":["6 de 6"]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]}}},{"id":"code-edge","axis":"コード","judge_desc":"Si al ejecutar el código escrito pasan las 6 pruebas","expected":"6 de 6","all_passed":7,"scored_models":7,"cells":{"gemini-3.7-flash":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-5.6-terra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-6-astra":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"gpt-5.6-sol":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-sonnet-5":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-opus-5":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]},"claude-fable-5-1":{"ok":0,"n":0,"refused":3,"measured":[]},"gemini-3.1-pro":{"ok":3,"n":3,"refused":0,"measured":["6 de 6"]}}}],"cost":{"requests":600,"failed":14},"counts":{"models":8,"tasks":25,"calls":600}}}