{"bench_id":"b011-gazou","slug":"gazou-2026-10-24","title":"Leer cifras en imágenes de recibos, gráficos y tablas (4 IA, 6 tareas, 3 intentos cada una)","field":"Lectura de imágenes y fotografías","field_key":"gazou","round":2,"run_date":"2026-10-24","timezone":"Asia/Tokyo","version":"v1","conductor":"AInformation","funder":"AInformation (financiado por la propia empresa)","sponsor":null,"method":{"tasks_n":6,"repeats":3,"ais_n":4,"trials_total":72,"trials_valid":72,"excluded":[],"new_chat_each_time":true,"order_rotated":true,"order_by_repeat":{"1":["ChatGPT","Gemini","Claude","Copilot"],"2":["Gemini","Claude","Copilot","ChatGPT"],"3":["Claude","Copilot","ChatGPT","Gemini"]},"timeout_seconds":300,"scoring":"Solo calificación mecánica (la IA no califica)","materials_generated_at":"2026-10-23","materials_note":"Imágenes de un recibo, de un gráfico de barras y de una tabla con una leve inclinación, todas creadas por nosotros. Los valores originales se definieron al crearlas","counted_outcomes":["scored","refused","timeout"],"excluded_outcomes":["limit","our_error","human_check"],"answer_cleanup":"Al leer la respuesta desde la pantalla, en algunas IA una línea pensada para lectura en voz alta o un resumen del razonamiento en curso aparece en el mismo recuadro que la respuesta. Antes de calificar, se elimina la parte que está al principio de la respuesta y que luego se repite de forma idéntica más adelante. Se aplica el mismo proceso a las 4 IA. Las respuestas sin este recorte se conservan tal cual en answers/","csv_url":"/data/research/bench/gazou-2026-10-24/latest.csv"},"ais":[{"name":"ChatGPT","plan":"ChatGPT Pro","model_shown":"GPT-6.1 Sol ligero","checked_at":"2026-10-23 20:56"},{"name":"Gemini","plan":"Google AI Pro","model_shown":"Flash","checked_at":"2026-10-23 20:56"},{"name":"Claude","plan":"Claude Max","model_shown":"Opus 4.8 alto","checked_at":"2026-10-23 20:56"},{"name":"Copilot","plan":"Microsoft 365 Personal","model_shown":null,"checked_at":"2026-10-23 20:56"}],"summary":{"headline":"Al asignar 6 tareas 3 veces cada una, ChatGPT obtuvo la tasa de acierto más alta con 14/18 intentos (77.8%) (Gemini quedó en segundo lugar con 66.7%)","winner":"ChatGPT","note":"Resultado de una sola verificación. El orden puede cambiar si cambian el día o las tareas"},"scores":[{"ai":"ChatGPT","correct":14,"trials":18,"accuracy":0.77780000000000004689582056016661226749420166015625,"accuracy_display":77.7999999999999971578290569595992565155029296875,"seconds_median":36,"seconds_min":23.5,"seconds_max":51.60000000000000142108547152020037174224853515625,"consistency":1,"consistency_display":100,"source_alive":null,"source_alive_display":null,"instruction_follow":1,"instruction_follow_display":100,"failures":{"refused":0,"timeout":1,"limit":0,"our_error":0,"human_check":0}},{"ai":"Gemini","correct":12,"trials":18,"accuracy":0.66669999999999995932142837773426435887813568115234375,"accuracy_display":66.7000000000000028421709430404007434844970703125,"seconds_median":183.69999999999998863131622783839702606201171875,"seconds_min":89.099999999999994315658113919198513031005859375,"seconds_max":254.30000000000001136868377216160297393798828125,"consistency":1,"consistency_display":100,"source_alive":null,"source_alive_display":null,"instruction_follow":1,"instruction_follow_display":100,"failures":{"refused":0,"timeout":3,"limit":0,"our_error":0,"human_check":0}},{"ai":"Claude","correct":10,"trials":18,"accuracy":0.55559999999999998276933865781757049262523651123046875,"accuracy_display":55.60000000000000142108547152020037174224853515625,"seconds_median":13.9000000000000003552713678800500929355621337890625,"seconds_min":13.800000000000000710542735760100185871124267578125,"seconds_max":20.10000000000000142108547152020037174224853515625,"consistency":0.888900000000000023447910280083306133747100830078125,"consistency_display":88.900000000000005684341886080801486968994140625,"source_alive":null,"source_alive_display":null,"instruction_follow":0.1666999999999999870770039933631778694689273834228515625,"instruction_follow_display":16.699999999999999289457264239899814128875732421875,"failures":{"refused":0,"timeout":0,"limit":0,"our_error":0,"human_check":0}},{"ai":"Copilot","correct":12,"trials":18,"accuracy":0.66669999999999995932142837773426435887813568115234375,"accuracy_display":66.7000000000000028421709430404007434844970703125,"seconds_median":14.199999999999999289457264239899814128875732421875,"seconds_min":13.800000000000000710542735760100185871124267578125,"seconds_max":17.10000000000000142108547152020037174224853515625,"consistency":0.888900000000000023447910280083306133747100830078125,"consistency_display":88.900000000000005684341886080801486968994140625,"source_alive":null,"source_alive_display":null,"instruction_follow":1,"instruction_follow_display":100,"failures":{"refused":0,"timeout":1,"limit":0,"our_error":0,"human_check":0}}],"tasks":[{"task_id":"t1","level":"易","prompt":"En la imagen adjunta del gráfico de barras, ¿cuál es el valor de la barra más alta?\n\nReglas\n- La respuesta debe ocupar exactamente una línea. Escribe solo el número en caracteres de ancho medio\n- No escribas el nombre del mes ni ninguna explicación","scorer":"exact_number","answer_key":"(Evaluación automática exact_number) Valor de la barra más alta = 9700 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-10-24/materials/chart.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":35.89999999999999857891452847979962825775146484375,"chars":4,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/chatgpt_01_t1.png"},{"n":2,"ok":true,"outcome":"scored","seconds":51.60000000000000142108547152020037174224853515625,"chars":4,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":35.7999999999999971578290569595992565155029296875,"chars":4,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":183.69999999999998863131622783839702606201171875,"chars":5,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_gemini_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/gemini_01_t1.png"},{"n":2,"ok":true,"outcome":"scored","seconds":95.2999999999999971578290569595992565155029296875,"chars":5,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_gemini_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":183.599999999999994315658113919198513031005859375,"chars":5,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_gemini_3.txt","shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":36,"why":"El valor no coincide: valor de la barra más alta × (respuesta correcta: 9700; respuesta dada: 97009700.0)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_claude_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/claude_01_t1.png"},{"n":2,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":36,"why":"El valor no coincide: valor de la barra más alta × (respuesta correcta: 9700; respuesta dada: 97009700.0)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_claude_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":36,"why":"El valor no coincide: valor de la barra más alta × (respuesta correcta: 9700; respuesta dada: 97009700.0)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":14.199999999999999289457264239899814128875732421875,"chars":4,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_copilot_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/copilot_01_t1.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":4,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_copilot_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":4,"why":"Todos los valores coinciden: valor de la barra más alta ○ (respuesta correcta: 9700)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t1_copilot_3.txt","shot":null}]}]},{"task_id":"t2","level":"易","prompt":"A partir de la imagen adjunta del recibo, indica el monto total.\n\nReglas\n- La respuesta debe ocupar exactamente una línea, con el formato: Total: ◯\n- Escribe los números en caracteres de ancho medio. No escribas ninguna explicación","scorer":"exact_number","answer_key":"(Evaluación automática exact_number) Total = 1440 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-10-24/materials/receipt.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":23.5,"chars":8,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/chatgpt_02_t2.png"},{"n":2,"ok":true,"outcome":"scored","seconds":35.89999999999999857891452847979962825775146484375,"chars":8,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":39.10000000000000142108547152020037174224853515625,"chars":8,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":214.099999999999994315658113919198513031005859375,"chars":10,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_gemini_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/gemini_02_t2.png"},{"n":2,"ok":true,"outcome":"scored","seconds":214,"chars":10,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_gemini_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":183.900000000000005684341886080801486968994140625,"chars":10,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_gemini_3.txt","shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":42,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_claude_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/claude_02_t2.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":42,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":42,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.800000000000000710542735760100185871124267578125,"chars":8,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_copilot_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/copilot_02_t2.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.800000000000000710542735760100185871124267578125,"chars":8,"why":"Todos los valores coinciden: total ○ (respuesta correcta: 1440)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t2_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":301.6000000000000227373675443232059478759765625,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]}]},{"task_id":"t3","level":"中","prompt":"En la imagen adjunta de la tabla (ligeramente inclinada), calcula la suma de los 5 productos para cada mes.\n\nReglas\n- Una línea por mes, con el formato: mes: ◯◯◯, en el mismo orden que aparece en la tabla de arriba hacia abajo\n- Escribe los números en caracteres de ancho medio. No muestres los pasos del cálculo","scorer":"exact_number","answer_key":"(Evaluación automática exact_number) 2025-07 = 58700 (margen de error ±0) / 2025-08 = 59500 (margen de error ±0) / 2025-09 = 51200 (margen de error ±0) / 2025-10 = 43500 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-10-24/materials/table_photo.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":36.10000000000000142108547152020037174224853515625,"chars":44,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/chatgpt_03_t3.png"},{"n":2,"ok":true,"outcome":"scored","seconds":35.89999999999999857891452847979962825775146484375,"chars":40,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":35.7000000000000028421709430404007434844970703125,"chars":40,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":181.80000000000001136868377216160297393798828125,"chars":44,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_gemini_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/gemini_03_t3.png"},{"n":2,"ok":true,"outcome":"scored","seconds":254.30000000000001136868377216160297393798828125,"chars":44,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_gemini_2.txt","shot":null},{"n":3,"ok":false,"outcome":"timeout","seconds":302.5,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":17,"chars":203,"why":"Los valores no coinciden: 2025-07 × (respuesta correcta: 58700; falta la fila de julio) / 2025-08 × (respuesta correcta: 59500; falta la fila de agosto) / 2025-09 × (respuesta correcta: 51200; falta la fila de septiembre) / 2025-10 × (respuesta correcta: 43500; falta la fila de octubre)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_claude_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/claude_03_t3.png"},{"n":2,"ok":true,"outcome":"scored","seconds":17.60000000000000142108547152020037174224853515625,"chars":157,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_claude_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":20.10000000000000142108547152020037174224853515625,"chars":198,"why":"Los valores no coinciden: 2025-07 × (respuesta correcta: 58700; falta la fila de julio) / 2025-08 × (respuesta correcta: 59500; falta la fila de agosto) / 2025-09 × (respuesta correcta: 51200; falta la fila de septiembre) / 2025-10 × (respuesta correcta: 43500; falta la fila de octubre)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":14,"chars":40,"why":"Los valores no coinciden: 2025-07 × (respuesta correcta: 58700; respuesta dada: 7.0) / 2025-08 × (respuesta correcta: 59500; respuesta dada: 7.0) / 2025-09 × (respuesta correcta: 51200; respuesta dada: 7.0) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_copilot_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/copilot_03_t3.png"},{"n":2,"ok":false,"outcome":"scored","seconds":14,"chars":40,"why":"Los valores no coinciden: 2025-07 × (respuesta correcta: 58700; respuesta dada: 7.0) / 2025-08 × (respuesta correcta: 59500; respuesta dada: 7.0) / 2025-09 × (respuesta correcta: 51200; respuesta dada: 7.0) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_copilot_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":14.0999999999999996447286321199499070644378662109375,"chars":43,"why":"Todos los valores coinciden: 2025-07 ○ (respuesta correcta: 58700) / 2025-08 ○ (respuesta correcta: 59500) / 2025-09 ○ (respuesta correcta: 51200) / 2025-10 ○ (respuesta correcta: 43500)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t3_copilot_3.txt","shot":null}]}]},{"task_id":"t4","level":"中","prompt":"Si sumas todos los valores de la imagen adjunta del gráfico de barras, ¿cuánto da?\n\nReglas\n- La respuesta debe ocupar exactamente una línea, con el formato: Total: ◯◯◯\n- Escribe los números en caracteres de ancho medio. No muestres los pasos del cálculo","scorer":"exact_number","answer_key":"(Evaluación automática exact_number) Suma de los 6 meses = 54800 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-10-24/materials/chart.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":false,"outcome":"timeout","seconds":302.30000000000001136868377216160297393798828125,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":"/data/research/bench/gazou-2026-10-24/shots/chatgpt_04_t4.png"},{"n":2,"ok":true,"outcome":"scored","seconds":36,"chars":9,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":35.89999999999999857891452847979962825775146484375,"chars":9,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":232.599999999999994315658113919198513031005859375,"chars":10,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_gemini_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/gemini_04_t4.png"},{"n":2,"ok":false,"outcome":"timeout","seconds":302.5,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":89.099999999999994315658113919198513031005859375,"chars":10,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_gemini_3.txt","shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":126,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_claude_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/claude_04_t4.png"},{"n":2,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":124,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":13.800000000000000710542735760100185871124267578125,"chars":130,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":9,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_copilot_1.txt","shot":null},{"n":2,"ok":true,"outcome":"scored","seconds":17.10000000000000142108547152020037174224853515625,"chars":9,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_copilot_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":17.10000000000000142108547152020037174224853515625,"chars":9,"why":"Todos los valores coinciden: suma de los 6 meses ○ (respuesta correcta: 54800)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t4_copilot_3.txt","shot":null}]}]},{"task_id":"t5","level":"難","prompt":"Lee la imagen adjunta del recibo y genera únicamente un JSON.\n\nReglas\n- La salida debe ser solo el JSON, sin texto explicativo antes ni después\n- Usa el formato {\"items\": [{\"name\": \"nombre del producto\", \"price\": monto}], \"subtotal\": subtotal, \"tax\": impuesto al consumo, \"total\": total}\n- Escribe los números como valores numéricos (no como texto; sin el símbolo de yen ni comas)","scorer":"exact_number","answer_key":"(Evaluación automática exact_number) Subtotal = 1334 (margen de error ±0) / Impuesto al consumo = 106 (margen de error ±0) / Total = 1440 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-10-24/materials/receipt.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":39.2000000000000028421709430404007434844970703125,"chars":199,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/chatgpt_05_t5.png"},{"n":2,"ok":false,"outcome":"scored","seconds":39,"chars":199,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_chatgpt_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":35.89999999999999857891452847979962825775146484375,"chars":199,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":183.599999999999994315658113919198513031005859375,"chars":355,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_gemini_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/gemini_05_t5.png"},{"n":2,"ok":false,"outcome":"scored","seconds":156.099999999999994315658113919198513031005859375,"chars":355,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_gemini_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":137.900000000000005684341886080801486968994140625,"chars":265,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_gemini_3.txt","shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":13.9000000000000003552713678800500929355621337890625,"chars":441,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_claude_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/claude_05_t5.png"},{"n":2,"ok":false,"outcome":"scored","seconds":17,"chars":449,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_claude_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":17,"chars":527,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":false,"outcome":"scored","seconds":17.10000000000000142108547152020037174224853515625,"chars":199,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_copilot_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/copilot_05_t5.png"},{"n":2,"ok":false,"outcome":"scored","seconds":17,"chars":199,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_copilot_2.txt","shot":null},{"n":3,"ok":false,"outcome":"scored","seconds":14.199999999999999289457264239899814128875732421875,"chars":199,"why":"Los valores no coinciden: subtotal × (respuesta correcta: 1334; falta la fila del subtotal) / impuesto al consumo × (respuesta correcta: 106; falta la fila del impuesto) / total × (respuesta correcta: 1440; falta la fila del total)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t5_copilot_3.txt","shot":null}]}]},{"task_id":"t6","level":"難","prompt":"Si sumas todos los valores de la imagen adjunta de la tabla (ligeramente inclinada), ¿cuánto da?\n\nReglas\n- La respuesta debe ocupar exactamente una línea, con el formato: Total: ◯◯◯\n- No sumes la columna de los meses. Escribe los números en caracteres de ancho medio. No muestres los pasos del cálculo","scorer":"exact_number","answer_key":"(Evaluación automática exact_number) Suma total de la tabla = 212900 (margen de error ±0)","materials":["/data/research/bench/gazou-2026-10-24/materials/table_photo.png"],"per_ai":[{"ai":"ChatGPT","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":45.2999999999999971578290569595992565155029296875,"chars":10,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_chatgpt_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/chatgpt_06_t6.png"},{"n":2,"ok":true,"outcome":"scored","seconds":38.89999999999999857891452847979962825775146484375,"chars":10,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_chatgpt_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":38.89999999999999857891452847979962825775146484375,"chars":10,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_chatgpt_3.txt","shot":null}]},{"ai":"Gemini","trials":[{"n":1,"ok":false,"outcome":"timeout","seconds":302.3999999999999772626324556767940521240234375,"chars":0,"why":"Se agotó el tiempo (la respuesta no se detuvo antes del límite de tiempo)","instruction_follow":null,"answer_url":null,"shot":"/data/research/bench/gazou-2026-10-24/shots/gemini_06_t6.png"},{"n":2,"ok":true,"outcome":"scored","seconds":220.30000000000001136868377216160297393798828125,"chars":11,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_gemini_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":232.099999999999994315658113919198513031005859375,"chars":11,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_gemini_3.txt","shot":null}]},{"ai":"Claude","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":17,"chars":144,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_claude_1.txt","shot":"/data/research/bench/gazou-2026-10-24/shots/claude_06_t6.png"},{"n":2,"ok":true,"outcome":"scored","seconds":17,"chars":70,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_claude_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":16.89999999999999857891452847979962825775146484375,"chars":76,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":false,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_claude_3.txt","shot":null}]},{"ai":"Copilot","trials":[{"n":1,"ok":true,"outcome":"scored","seconds":16.89999999999999857891452847979962825775146484375,"chars":10,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_copilot_1.txt","shot":null},{"n":2,"ok":true,"outcome":"scored","seconds":17,"chars":10,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_copilot_2.txt","shot":null},{"n":3,"ok":true,"outcome":"scored","seconds":17,"chars":10,"why":"Todos los valores coinciden: suma total de la tabla ○ (respuesta correcta: 212900)","instruction_follow":true,"answer_url":"/data/research/bench/gazou-2026-10-24/answers/t6_copilot_3.txt","shot":null}]}]}],"limits":["Se trata de una medición realizada una vez al día. El orden puede cambiar según el día o la tarea","El plan corresponde a la versión de pago de cada IA (ChatGPT Pro, Google AI Pro, Claude Max, Microsoft 365 Personal). No son resultados de la versión gratuita","La medición se realizó solo con el modelo y el modo predeterminados (no se usaron funciones como Deep Research)","Las tareas usan datos creados por nosotros para la empresa ficticia Sample Shoji Co., Ltd. No son resultados con datos de una empresa real","Solo se incluyen tareas que se pueden calificar de forma automática. No se mide la calidad ni la legibilidad del texto","La medición se realizó desde la misma pantalla del navegador que usan las personas. No son resultados de la API","En las rondas en las que una IA no permite leer el nombre del modelo que aparece en la pantalla, ese campo se deja vacío (null). En las rondas en las que sí se pudo leer, se muestra tal cual"],"license":"CC BY 4.0","attribution":"Como fuente, escribe AInformation junto con la URL de la página utilizada y la fecha de medición.","page_url":"https://ainformation.jp/research/bench/gazou-2026-10-24"}