{"bench_id":"b013-gazou","slug":"gazou-2026-11-03","title":"Leer cifras en imágenes de recibos, gráficos y tablas (4 IA, 6 tareas, 3 intentos cada una)","field":"Lectura de imágenes y fotografías","field_key":"gazou","round":1,"run_date":"2026-11-03","timezone":"Asia/Tokyo","version":"v1","conductor":"AInformation","funder":"AInformation (financiado por la propia empresa)","sponsor":null,"method":{"tasks_n":6,"repeats":3,"ais_n":4,"trials_total":72,"trials_valid":72,"excluded":[],"new_chat_each_time":true,"order_rotated":true,"order_by_repeat":{"1":["ChatGPT","Gemini","Claude","Copilot"],"2":["Gemini","Claude","Copilot","ChatGPT"],"3":["Claude","Copilot","ChatGPT","Gemini"]},"timeout_seconds":300,"scoring":"Solo calificación mecánica (la IA no califica)","materials_generated_at":"2026-11-02","materials_note":"Imágenes de un recibo, de un gráfico de barras y de una tabla con una leve inclinación, todas creadas por nosotros. Los valores originales se definieron al crearlas","counted_outcomes":["scored","refused","timeout"],"excluded_outcomes":["limit","our_error","human_check"],"answer_cleanup":"Al leer la respuesta desde la pantalla, en algunas IA una línea pensada para lectura en voz alta o un resumen del razonamiento en curso aparece en el mismo recuadro que la respuesta. Antes de calificar, se elimina la parte que está al principio de la respuesta y que luego se repite de forma idéntica más adelante. Se aplica el mismo proceso a las 4 IA. Las respuestas sin este recorte se conservan tal cual en answers/","csv_url":"/data/research/bench/gazou-2026-11-03/latest.csv"},"ais":[{"name":"ChatGPT","plan":"ChatGPT Pro","model_shown":"GPT-6.1 Sol media","checked_at":"2026-11-02 21:03"},{"name":"Gemini","plan":"Google AI Pro","model_shown":"Flash","checked_at":"2026-11-02 21:03"},{"name":"Claude","plan":"Claude Max","model_shown":"Opus 4.8 alta","checked_at":"2026-11-02 21:03"},{"name":"Copilot","plan":"Microsoft 365 Personal","model_shown":null,"checked_at":"2026-11-02 21:03"}],"summary":{"headline":"Se dieron 6 tareas, cada una 3 veces; la tasa de aciertos más alta fue la de Claude, con 100.0% en 18/18 intentos (en segundo lugar, ChatGPT con 72.2%)","winner":"Claude","note":"Resultado de una sola verificación. El orden puede cambiar si cambian el día o las tareas"},"scores":[{"ai":"ChatGPT","correct":13,"trials":18,"accuracy":0.72219999999999995310417943983338773250579833984375,"accuracy_display":72.2000000000000028421709430404007434844970703125,"seconds_median":25.39999999999999857891452847979962825775146484375,"seconds_min":20.39999999999999857891452847979962825775146484375,"seconds_max":48.2999999999999971578290569595992565155029296875,"consistency":0.83330000000000004067857162226573564112186431884765625,"consistency_display":83.2999999999999971578290569595992565155029296875,"source_alive":null,"source_alive_display":null,"instruction_follow":1,"instruction_follow_display":100,"failures":{"refused":0,"timeout":4,"limit":0,"our_error":0,"human_check":0}},{"ai":"Gemini","correct":7,"trials":18,"accuracy":0.388900000000000023447910280083306133747100830078125,"accuracy_display":38.89999999999999857891452847979962825775146484375,"seconds_median":69.2000000000000028421709430404007434844970703125,"seconds_min":19,"seconds_max":204.900000000000005684341886080801486968994140625,"consistency":1,"consistency_display":100,"source_alive":null,"source_alive_display":null,"instruction_follow":0.625,"instruction_follow_display":62.5,"failures":{"refused":0,"timeout":10,"limit":0,"our_error":0,"human_check":0}},{"ai":"Claude","correct":18,"trials":18,"accuracy":1,"accuracy_display":100,"seconds_median":13.9000000000000003552713678800500929355621337890625,"seconds_min":13.800000000000000710542735760100185871124267578125,"seconds_max":17.10000000000000142108547152020037174224853515625,"consistency":1,"consistency_display":100,"source_alive":null,"source_alive_display":null,"instruction_follow":0.1666999999999999870770039933631778694689273834228515625,"instruction_follow_display":16.699999999999999289457264239899814128875732421875,"failures":{"refused":0,"timeout":0,"limit":0,"our_error":0,"human_check":0}},{"ai":"Copilot","correct":0,"trials":18,"accuracy":0,"accuracy_display":0,"seconds_median":14,"seconds_min":13.800000000000000710542735760100185871124267578125,"seconds_max":17.10000000000000142108547152020037174224853515625,"consistency":1,"consistency_display":100,"source_alive":null,"source_alive_display":null,"instruction_follow":0.5,"instruction_follow_display":50,"failures":{"refused":0,"timeout":0,"limit":0,"our_error":0,"human_check":0}}],"tasks":[{"task_id":"t1","level":"易","prompt":"A partir de la imagen adjunta de un recibo, lee los tres montos.\n\nReglas\n- La respuesta debe tener exactamente 3 líneas, en este orden: Subtotal: ◯ / Impuesto al consumo: ◯ / Total: ◯\n- Escribe los números en caracteres de ancho medio. No es necesario poner el símbolo de yen ni comas. No escribas explicaciones","scorer":"exact_number","answer_key":"(evaluación automática exact_number) Subtotal = 2316 (margen de error ±0) / impuesto al consumo = 185 (margen de error ±0) / total = 2501 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-11-03/materials/receipt.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":35.7999999999999971578290569595992565155029296875,"chars":26,"why":"Todos los valores coinciden: subtotal ✓ (correcto: 2316) / impuesto al consumo ✓ (correcto: 185) / total ✓ (correcto: 2501)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/chatgpt_01_t1.png"},{"n":2,"ok":true,"outcome":"scored","seconds":29.699999999999999289457264239899814128875732421875,"chars":26,"why":"Todos los valores coinciden: subtotal ✓ (correcto: 2316) / impuesto al consumo ✓ (correcto: 185) / total ✓ (correcto: 2501)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":20.5,"chars":26,"why":"Todos los valores coinciden: subtotal ✓ (correcto: 2316) / impuesto al consumo ✓ (correcto: 185) / total ✓ (correcto: 2501)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":19.199999999999999289457264239899814128875732421875,"chars":26,"why":"Los valores no coinciden: subtotal ✗ (correcto: 2316; no hay fila de subtotal) / impuesto al consumo ✗ (correcto: 185; no hay fila de impuesto) / total ✗ (correcto: 2501; no hay fila de total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_gemini_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/gemini_01_t1.png"},{"n":2,"ok":false,"outcome":"timeout","seconds":302.6000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":302.19999999999998863131622783839702606201171875,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":60,"why":"Todos los valores coinciden: subtotal ✓ (correcto: 2316) / impuesto al consumo ✓ (correcto: 185) / total ✓ (correcto: 2501)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_claude_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/claude_01_t1.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":60,"why":"Todos los valores coinciden: subtotal ✓ (correcto: 2316) / impuesto al consumo ✓ (correcto: 185) / total ✓ (correcto: 2501)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":92,"why":"Todos los valores coinciden: subtotal ✓ (correcto: 2316) / impuesto al consumo ✓ (correcto: 185) / total ✓ (correcto: 2501)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":14,"chars":46,"why":"Los valores no coinciden: subtotal ✗ (correcto: 2316; no hay fila de subtotal) / impuesto al consumo ✗ (correcto: 185; no hay fila de impuesto) / total ✗ (correcto: 2501; no hay fila de total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_copilot_1.txt","shot":null},{"n":2,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"Los valores no coinciden: subtotal ✗ (correcto: 2316; no hay fila de subtotal) / impuesto al consumo ✗ (correcto: 185; no hay fila de impuesto) / total ✗ (correcto: 2501; no hay fila de total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"Los valores no coinciden: subtotal ✗ (correcto: 2316; no hay fila de subtotal) / impuesto al consumo ✗ (correcto: 185; no hay fila de impuesto) / total ✗ (correcto: 2501; no hay fila de total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t1_copilot_3.txt","shot":null}]}]},{"task_id":"t2","level":"易","prompt":"A partir de la imagen adjunta de un recibo, lee el monto del cambio.\n\nReglas\n- La respuesta debe tener exactamente 1 línea, con el formato Cambio: ◯\n- Escribe los números en caracteres de ancho medio. No escribas explicaciones","scorer":"exact_number","answer_key":"(evaluación automática exact_number) Cambio = 499 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-11-03/materials/receipt.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":24.10000000000000142108547152020037174224853515625,"chars":8,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/chatgpt_02_t2.png"},{"n":2,"ok":true,"outcome":"scored","seconds":20.39999999999999857891452847979962825775146484375,"chars":8,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":20.39999999999999857891452847979962825775146484375,"chars":8,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":59.7000000000000028421709430404007434844970703125,"chars":23,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_gemini_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/gemini_02_t2.png"},{"n":2,"ok":false,"outcome":"timeout","seconds":302.30000000000001136868377216160297393798828125,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":302.1000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":14.0999999999999996447286321199499070644378662109375,"chars":42,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_claude_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/claude_02_t2.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":42,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":42,"why":"Todos los valores coinciden: cambio ✓ (correcto: 499)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":14.0999999999999996447286321199499070644378662109375,"chars":46,"why":"Los valores no coinciden: cambio ✗ (correcto: 499; no hay fila de cambio)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_copilot_1.txt","shot":null},{"n":2,"ok":false,"outcome":"scored","seconds":14.0999999999999996447286321199499070644378662109375,"chars":46,"why":"Los valores no coinciden: cambio ✗ (correcto: 499; no hay fila de cambio)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":13.800000000000000710542735760100185871124267578125,"chars":46,"why":"Los valores no coinciden: cambio ✗ (correcto: 499; no hay fila de cambio)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t2_copilot_3.txt","shot":null}]}]},{"task_id":"t3","level":"中","prompt":"A partir de la imagen adjunta de un recibo, escribe todos los productos comprados.\n\nReglas\n- Un producto por línea. Cada línea debe comenzar con -. Escribe el nombre del producto y el monto\n- No escribas las líneas de subtotal, impuesto al consumo, total, monto recibido ni cambio","scorer":"set_match","answer_key":"(evaluación automática set_match) Leche 1000 ml [leche +314] / yogur 400 g [yogur +184] / udon 3 porciones [udon +184] / pechuga de pollo 2 piezas [pechuga de pollo +454] / detergente, repuesto [detergente +496] / café 200 g [café +684]. Se permiten hasta 0 elementos añadidos","materials":["/data/research/bench/gazou-2026-11-03/materials/receipt.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":27.199999999999999289457264239899814128875732421875,"chars":89,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/chatgpt_03_t3.png"},{"n":2,"ok":true,"outcome":"scored","seconds":32.7999999999999971578290569595992565155029296875,"chars":89,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_chatgpt_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":300.6000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":189.80000000000001136868377216160297393798828125,"chars":89,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_gemini_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/gemini_03_t3.png"},{"n":2,"ok":true,"outcome":"scored","seconds":19,"chars":89,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_gemini_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":302.1000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":17,"chars":198,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_claude_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/claude_03_t3.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":149,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.800000000000000710542735760100185871124267578125,"chars":163,"why":"Los 6 elementos coinciden; 0 elementos añadidos","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":14.0999999999999996447286321199499070644378662109375,"chars":46,"why":"0 de 6 elementos coinciden; faltan leche 1000 ml / yogur 400 g / udon 3 porciones / pechuga de pollo 2 piezas / detergente, repuesto / café 200 g; 1 elemento añadido","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_copilot_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/copilot_03_t3.png"},{"n":2,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"0 de 6 elementos coinciden; faltan leche 1000 ml / yogur 400 g / udon 3 porciones / pechuga de pollo 2 piezas / detergente, repuesto / café 200 g; 1 elemento añadido","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"0 de 6 elementos coinciden; faltan leche 1000 ml / yogur 400 g / udon 3 porciones / pechuga de pollo 2 piezas / detergente, repuesto / café 200 g; 1 elemento añadido","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t3_copilot_3.txt","shot":null}]}]},{"task_id":"t4","level":"中","prompt":"En la imagen adjunta del gráfico de barras, ¿cuál es el mes con la barra más alta?\n\nReglas\n- La respuesta debe tener exactamente 1 línea, con el formato: [nombre del mes]\n- No escribas valores numéricos ni explicaciones","scorer":"contains_all","answer_key":"(evaluación automática contains_all) Mes con el valor más alto = junio","materials":["/data/research/bench/gazou-2026-11-03/materials/chart.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":26.699999999999999289457264239899814128875732421875,"chars":2,"why":"El único elemento está presente","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/chatgpt_04_t4.png"},{"n":2,"ok":true,"outcome":"scored","seconds":48.2999999999999971578290569595992565155029296875,"chars":2,"why":"El único elemento está presente","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_chatgpt_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":300.80000000000001136868377216160297393798828125,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":61.7000000000000028421709430404007434844970703125,"chars":2,"why":"El único elemento está presente","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_gemini_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/gemini_04_t4.png"},{"n":2,"ok":false,"outcome":"timeout","seconds":302.19999999999998863131622783839702606201171875,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":76.7000000000000028421709430404007434844970703125,"chars":15,"why":"El único elemento está presente","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_gemini_3.txt","shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":30,"why":"El único elemento está presente","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_claude_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/claude_04_t4.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.800000000000000710542735760100185871124267578125,"chars":30,"why":"El único elemento está presente","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":30,"why":"El único elemento está presente","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"0 de 1 elemento presente; falta el mes con el valor más alto","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_copilot_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/copilot_04_t4.png"},{"n":2,"ok":false,"outcome":"scored","seconds":14,"chars":46,"why":"0 de 1 elemento presente; falta el mes con el valor más alto","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":14,"chars":46,"why":"0 de 1 elemento presente; falta el mes con el valor más alto","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t4_copilot_3.txt","shot":null}]}]},{"task_id":"t5","level":"難","prompt":"A partir de la imagen adjunta del gráfico de barras, lee todos los valores mensuales.\n\nReglas\n- Un mes por línea, con el formato [nombre del mes]: [valor], en orden de izquierda a derecha\n- Escribe los números en caracteres de ancho medio. No escribas explicaciones","scorer":"exact_number","answer_key":"(evaluación automática exact_number) Enero = 5500 (margen de error ±0) / febrero = 5500 (margen de error ±0) / marzo = 8200 (margen de error ±0) / abril = 12300 (margen de error ±0) / mayo = 17800 (margen de error ±0) / junio = 24700 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-11-03/materials/chart.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":20.5,"chars":56,"why":"Todos los valores coinciden: enero ✓ (correcto: 5500) / febrero ✓ (correcto: 5500) / marzo ✓ (correcto: 8200) / abril ✓ (correcto: 12300) / mayo ✓ (correcto: 17800) / junio ✓ (correcto: 24700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/chatgpt_05_t5.png"},{"n":2,"ok":true,"outcome":"scored","seconds":26.60000000000000142108547152020037174224853515625,"chars":56,"why":"Todos los valores coinciden: enero ✓ (correcto: 5500) / febrero ✓ (correcto: 5500) / marzo ✓ (correcto: 8200) / abril ✓ (correcto: 12300) / mayo ✓ (correcto: 17800) / junio ✓ (correcto: 24700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_chatgpt_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":300.80000000000001136868377216160297393798828125,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":204.900000000000005684341886080801486968994140625,"chars":62,"why":"Todos los valores coinciden: enero ✓ (correcto: 5500) / febrero ✓ (correcto: 5500) / marzo ✓ (correcto: 8200) / abril ✓ (correcto: 12300) / mayo ✓ (correcto: 17800) / junio ✓ (correcto: 24700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_gemini_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/gemini_05_t5.png"},{"n":2,"ok":false,"outcome":"timeout","seconds":302.1000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":302.30000000000001136868377216160297393798828125,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":90,"why":"Todos los valores coinciden: enero ✓ (correcto: 5500) / febrero ✓ (correcto: 5500) / marzo ✓ (correcto: 8200) / abril ✓ (correcto: 12300) / mayo ✓ (correcto: 17800) / junio ✓ (correcto: 24700)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_claude_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/claude_05_t5.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":90,"why":"Todos los valores coinciden: enero ✓ (correcto: 5500) / febrero ✓ (correcto: 5500) / marzo ✓ (correcto: 8200) / abril ✓ (correcto: 12300) / mayo ✓ (correcto: 17800) / junio ✓ (correcto: 24700)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":98,"why":"Todos los valores coinciden: enero ✓ (correcto: 5500) / febrero ✓ (correcto: 5500) / marzo ✓ (correcto: 8200) / abril ✓ (correcto: 12300) / mayo ✓ (correcto: 17800) / junio ✓ (correcto: 24700)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":14,"chars":46,"why":"Los valores no coinciden: enero ✗ (correcto: 5500; no hay fila de enero) / febrero ✗ (correcto: 5500; no hay fila de febrero) / marzo ✗ (correcto: 8200; no hay fila de marzo) / abril ✗ (correcto: 12300; no hay fila de abril) / mayo ✗ (correcto: 17800; no hay fila de mayo) / junio ✗ (correcto: 24700; no hay fila de junio)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_copilot_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/copilot_05_t5.png"},{"n":2,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"Los valores no coinciden: enero ✗ (correcto: 5500; no hay fila de enero) / febrero ✗ (correcto: 5500; no hay fila de febrero) / marzo ✗ (correcto: 8200; no hay fila de marzo) / abril ✗ (correcto: 12300; no hay fila de abril) / mayo ✗ (correcto: 17800; no hay fila de mayo) / junio ✗ (correcto: 24700; no hay fila de junio)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":46,"why":"Los valores no coinciden: enero ✗ (correcto: 5500; no hay fila de enero) / febrero ✗ (correcto: 5500; no hay fila de febrero) / marzo ✗ (correcto: 8200; no hay fila de marzo) / abril ✗ (correcto: 12300; no hay fila de abril) / mayo ✗ (correcto: 17800; no hay fila de mayo) / junio ✗ (correcto: 24700; no hay fila de junio)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t5_copilot_3.txt","shot":null}]}]},{"task_id":"t6","level":"難","prompt":"A partir de la imagen adjunta de una tabla (con una leve inclinación), lee todos los valores de la columna del producto A.\n\nReglas\n- Un valor por línea, con el formato mes: ◯◯◯, de arriba hacia abajo\n- Escribe los números en caracteres de ancho medio. No escribas explicaciones","scorer":"exact_number","answer_key":"(evaluación automática exact_number) 2025-07 = 32900 (margen de error ±0) / 2025-08 = 35600 (margen de error ±0) / 2025-09 = 23300 (margen de error ±0) / 2025-10 = 11000 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-11-03/materials/table_photo.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":20.60000000000000142108547152020037174224853515625,"chars":40,"why":"Los valores no coinciden: 2025-07 ✗ (correcto: 32900; no hay fila de 2025-07) / 2025-08 ✗ (correcto: 35600; no hay fila de 2025-08) / 2025-09 ✗ (correcto: 23300; no hay fila de 2025-09) / 2025-10 ✗ (correcto: 11000; no hay fila de 2025-10)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/chatgpt_06_t6.png"},{"n":2,"ok":true,"outcome":"scored","seconds":20.5,"chars":59,"why":"Todos los valores coinciden: 2025-07 ✓ (correcto: 32900) / 2025-08 ✓ (correcto: 35600) / 2025-09 ✓ (correcto: 23300) / 2025-10 ✓ (correcto: 11000)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_chatgpt_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":301.19999999999998863131622783839702606201171875,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":134.900000000000005684341886080801486968994140625,"chars":63,"why":"Todos los valores coinciden: 2025-07 ✓ (correcto: 32900) / 2025-08 ✓ (correcto: 35600) / 2025-09 ✓ (correcto: 23300) / 2025-10 ✓ (correcto: 11000)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_gemini_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/gemini_06_t6.png"},{"n":2,"ok":false,"outcome":"timeout","seconds":302.1000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":302.5,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":17.10000000000000142108547152020037174224853515625,"chars":124,"why":"Todos los valores coinciden: 2025-07 ✓ (correcto: 32900) / 2025-08 ✓ (correcto: 35600) / 2025-09 ✓ (correcto: 23300) / 2025-10 ✓ (correcto: 11000)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_claude_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/claude_06_t6.png"},{"n":2,"ok":true,"outcome":"scored","seconds":17,"chars":126,"why":"Todos los valores coinciden: 2025-07 ✓ (correcto: 32900) / 2025-08 ✓ (correcto: 35600) / 2025-09 ✓ (correcto: 23300) / 2025-10 ✓ (correcto: 11000)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":16.89999999999999857891452847979962825775146484375,"chars":128,"why":"Todos los valores coinciden: 2025-07 ✓ (correcto: 32900) / 2025-08 ✓ (correcto: 35600) / 2025-09 ✓ (correcto: 23300) / 2025-10 ✓ (correcto: 11000)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":14,"chars":46,"why":"Los valores no coinciden: 2025-07 ✗ (correcto: 32900; no hay fila de 2025-07) / 2025-08 ✗ (correcto: 35600; no hay fila de 2025-08) / 2025-09 ✗ (correcto: 23300; no hay fila de 2025-09) / 2025-10 ✗ (correcto: 11000; no hay fila de 2025-10)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_copilot_1.txt","shot":"/data/research/bench/gazou-2026-11-03/shots/copilot_06_t6.png"},{"n":2,"ok":false,"outcome":"scored","seconds":17.10000000000000142108547152020037174224853515625,"chars":46,"why":"Los valores no coinciden: 2025-07 ✗ (correcto: 32900; no hay fila de 2025-07) / 2025-08 ✗ (correcto: 35600; no hay fila de 2025-08) / 2025-09 ✗ (correcto: 23300; no hay fila de 2025-09) / 2025-10 ✗ (correcto: 11000; no hay fila de 2025-10)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":14,"chars":46,"why":"Los valores no coinciden: 2025-07 ✗ (correcto: 32900; no hay fila de 2025-07) / 2025-08 ✗ (correcto: 35600; no hay fila de 2025-08) / 2025-09 ✗ (correcto: 23300; no hay fila de 2025-09) / 2025-10 ✗ (correcto: 11000; no hay fila de 2025-10)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-11-03/answers/t6_copilot_3.txt","shot":null}]}]}],"limits":["Se trata de una medición realizada una vez al día. El orden puede cambiar según el día o la tarea","El plan corresponde a la versión de pago de cada IA (ChatGPT Pro, Google AI Pro, Claude Max, Microsoft 365 Personal). No son resultados de la versión gratuita","La medición se realizó solo con el modelo y el modo predeterminados (no se usaron funciones como Deep Research)","Las tareas usan datos creados por nosotros para la empresa ficticia Sample Shoji Co., Ltd. No son resultados con datos de una empresa real","Solo se incluyen tareas que se pueden calificar de forma automática. No se mide la calidad ni la legibilidad del texto","La medición se realizó desde la misma pantalla del navegador que usan las personas. No son resultados de la API","En las rondas en las que una IA no permite leer el nombre del modelo que aparece en la pantalla, ese campo se deja vacío (null). En las rondas en las que sí se pudo leer, se muestra tal cual"],"license":"CC BY 4.0","attribution":"Como fuente, escribe AInformation junto con la URL de la página utilizada y la fecha de medición.","page_url":"https://ainformation.jp/research/bench/gazou-2026-11-03"}