Skip to content
NEWS
AI Testing Lab

AI web search compared: 4 tools, 3 sourced prompts, ChatGPT wins

About 29 min read
AI web search compared: 4 tools, 3 sourced prompts, ChatGPT wins
Key points

We sent the same three questions to the web search features of ChatGPT, Gemini, Claude, and Microsoft Copilot, and checked the answers against official figures. ChatGPT ranked first: its sunrise and price answers matched the official data, and 3 of its 4 company-announcement answers matched too. Copilot was the fastest, answering the sunrise question in 20.2 seconds.

SHARE
Shunta Fujii's avatar

AI adoption consultant

Shunta Fujii

An AI specialist who is always tracking and keeping up with the latest AI developments. He also works as an AI adoption consultant, mainly using generative AI to make work more efficient, raise productivity and develop new businesses.
AInformation is an AI data site that researches and tallies AI tool pricing and job listings on its own. We publish numbers that help both individuals choose AI tools and companies adopt AI. Shunta Fujii runs the site and checks the articles on his own. Shunta Fujii's profile

...Read more

We sent the same three questions to the web search features of ChatGPT, Gemini, Claude, and Microsoft Copilot, then checked the answers against official figures. ChatGPT came in first: its sunrise and price answers matched the official data, and 3 of its 4 company-announcement answers matched too. Copilot was the fastest, answering the sunrise question in 20.2 seconds.

48.4secTime for ChatGPT to answer the sunrise question with a National Astronomical Observatory of Japan (NAOJ) URL
20.2secTime for Microsoft Copilot to answer the sunrise and sunset question
218.2secTime Gemini took before declining the four-company announcement question
What this article covers
  • On October 16, 2026, we sent the same three questions to the web search features of ChatGPT, Gemini, Claude, and Microsoft Copilot, and checked the answers against figures published by the National Astronomical Observatory of Japan (NAOJ) and the Statistics Bureau of Japan
  • ChatGPT ranked first overall. Its sunrise and price answers matched the official figures, and for the four-company announcement question, 3 of the 4 companies’ answers matched the dates on the official pages
  • Microsoft Copilot was the fastest, answering the sunrise and sunset question in 20.2 seconds. Gemini took 95.5 seconds or more on all three questions
  • Gemini thought for 218.2 seconds on the four-company announcement question, then declined, saying “I’m still learning about this”
  • Claude showed an “allow once” confirmation prompt before opening pages from the National Astronomical Observatory of Japan (NAOJ) or OpenAI. On the price question, it returned the same figure as the official source in 26.2 seconds
  • We’ve included three ready-to-use prompts that request sources, plus tips for checking the URLs in the answers

How to use AI web search: just name the source and ask for a URL

Getting an AI to search the web is as simple as specifying “which source to use” and asking it to “include the URL” in your question. On October 16, 2026, AInformation sent the same three prompts below, as written, to the four services ChatGPT, Gemini, Claude, and Microsoft Copilot. Each question has an answer that changes by the day. If the AI doesn’t search for current information, it can’t answer correctly.

Easy question: ask about “today” and name the source site

The first question asks for today’s sunrise and sunset times in Tokyo. We asked the AI to cite a page from the National Astronomical Observatory of Japan (NAOJ) and include the URL. We wrote only “today” for the date, which also tests whether the AI can correctly identify today’s date.

Please tell me today’s sunrise and sunset times in Tokyo (Tokyo Metropolitan Government), citing a page from the National Astronomical Observatory of Japan (NAOJ) as your source. Please also include the source URL.

Medium question: narrow down the time period, source type, and count

The second question asks about recent announcements from four companies. We stacked three conditions: “within the last 7 days,” “from an official blog or official help page,” and “one per company.” This question checks whether the AI can answer without mixing in old announcements or information from summary sites.

Please tell me one AI feature each that the 4 companies OpenAI, Google, Anthropic, and Microsoft have announced on their official blogs or official help pages within the last 7 days, including the announcement date and URL for each.

Hard question: name the exact figure that’s easy to mix up

The third question asks about Japan’s Consumer Price Index. The Statistics Bureau of Japan publishes separate figures for the nation as a whole and for Tokyo’s 23 wards. Within the national figures, “all items” and “all items less fresh food” appear side by side. Since there are many similar numbers, we checked whether the AI would answer with a different figure than the one requested. Having it also state the publication date and the target month makes it easy to see at a glance which month the figure covers.

Please tell me the latest year-over-year change in Japan’s Consumer Price Index (all items), citing the Statistics Bureau of Japan as your source. Please also include the publication date and the target month.

For ChatGPT, we turned on web search from the + button in the input box before sending

Only for ChatGPT did we press the + button to the left of the input box and select “Web search” before sending. Once enabled, a “Web search” tag appears in the input box. We did this same step before sending all three questions, and the tag remained visible on the answer screen as well. The model shown on screen for all three questions was “GPT-6.1 Sol Light.”

Screen showing the toolbar below ChatGPT's input box, including web search, model selection, and file attachment options
ChatGPT’s input box. The web search tag appears to the right of the + button. Screen captured by AInformation while operating ChatGPT on October 16, 2026

Claude and Gemini were used as is, without toggling any search setting. Claude’s official help page states that the newer Claude interface has no web search toggle; instead, Claude searches on its own when needed. In this test, Claude displayed “Searched the web” at the top of its answer for all three questions.

Excerpt from Claude's help page 'Enable and use web search,' stating in English that the newer Claude interface has no web search toggle and that Claude searches the web when it would be helpful
Claude’s official help page. The newer interface has no search toggle / Source: support.claude.com (screen as of October 16, 2026)

Gemini’s input box shows only “Ask Gemini” along with the model name, with no toggle for enabling search. Even so, for the price question, source tags appeared alongside the answer, citing a page from the Statistics Bureau of Japan. We intended to switch Microsoft Copilot’s response mode to search. However, due to operational constraints on our end, the switch did not take effect this time, so we sent the questions in whatever mode was active when the chat opened.

Comparing 4 AI web search tools: ChatGPT ranks first, Microsoft Copilot is fastest

Here’s the conclusion up front. ChatGPT had the most answers that matched official figures across the three questions. In this web search comparison, we rank ChatGPT first.

ChatGPT answered the sunrise and sunset question in 48.4 seconds with “5:48 a.m.” and “5:05 p.m.,” citing the National Astronomical Observatory of Japan (NAOJ)’s October Tokyo page. It also got the price question right in 51.5 seconds, answering “a 1.9% increase,” “August 2026,” and “September 18, 2026.” For the four-company announcement question, the announcements from 3 companies—OpenAI, Google, and Anthropic—matched their official pages down to the date. The only exception was Microsoft: when our editors searched Microsoft’s official blog, they couldn’t find the same announcement.

Microsoft Copilot came in second. We used it with a free Microsoft account, and it had the shortest response time of the four tools for all three questions: 20.2 seconds for both the sunrise question and the price question, and 26.2 seconds for the four-company announcement question. The sunrise and price answers matched the official figures. However, for the four-company announcement question, it cited articles for Anthropic and Microsoft that were not actually feature announcements.

Gemini came in third. We used it with Google AI Pro, and the model shown on screen was Flash. It answered the sunrise and price questions correctly, but took 95.5 seconds and 205.6 seconds respectively. On the four-company announcement question, it thought for 218.2 seconds and then declined, replying, “I’m still learning about this.”

Claude came in fourth. We used it with Claude Max, and the model shown on screen was “Opus 4.8 High.” It answered the price question in 26.2 seconds with the same figure and URL as the official source. For the sunrise and four-company announcement questions, a confirmation prompt asking for permission appeared before it would open the pages. Since our automated process is designed not to click “allow,” the answers to these two questions stopped short at the confirmation step.

Top AI web search by category. Overall No. 1: ChatGPT. Sunrise and prices matched the official data. For the 4 companies' announcements, 3 matched official sources. Showed the URL where the value appears. Fastest: Microsoft Copilot. Sunrise answer took 20.2 seconds. Announcement answer took 26.2 seconds. Answered with a free account. Gemini took 95.5 seconds or more on all 3 questions. Illustration made by AInformation (cards showing the No. 1 tool in each category)
Top AI web search by category

We ranked Claude fourth because it only reached a final answer for one question, the price question. It’s possible that clicking “allow” would have produced further answers. However, this test did not verify what the answer would have been after clicking allow.

Scorecard comparing AI web search across 4 AIs

Item ChatGPT Gemini Claude Microsoft Copilot
Easy: Sunrise and sunset Good 48.4 sec Good 95.5 sec, URL was an entry page N/A ended at permission check Good 20.2 sec
Medium: Announcements from 4 companies Fair matched official sources for 3 companies Poor declined, saying it was still learning N/A ended at permission check Fair items for 2 companies were not features
Hard: Consumer price index Good 51.5 sec Good 205.6 sec Good 26.2 sec Good 20.2 sec
How sources were shown URL with the value, for 2 of the questions Mixed in citation tags from other sites Official URL for price data Short citation tags, no URL for price data
Japanese Short, clear, natural Refusal message was boilerplate Only the first line was in English Natural, repeated the conclusion twice
Overall 1st 3rd 4th 2nd
Data: AInformation (October 16, 2026, ChatGPT Pro / Google AI Pro / Claude Max / free Microsoft account, web version, once each) / Created by AInformation

Every timing is based on a single measurement. Even with the same prompt, search results can change depending on the day or the attempt.

How we compared: the same 3 questions sent once each in a new chat to 4 AIs

AInformation operated all 4 AIs in a computer browser on the afternoon of October 16, 2026. The plans used were 3 monthly subscriptions: ChatGPT Pro, Google AI Pro, and Claude Max. Only Microsoft Copilot was used by signing in with a free Microsoft account. We did not select a model for any of the AIs; each prompt was sent using whatever model appeared by default.

  1. Open a new chat in each of the 4 AIs
  2. For ChatGPT only, add “web search” from the + button in the input box
  3. Send the easy question (sunrise and sunset) to each of the 4 AIs in turn and wait for the answer
  4. Send the medium question (announcements from 4 companies) and the hard question (price data) the same way, opening a new chat each time
  5. Record the time to answer and the character count, then check the answers against official pages
Here is how we tested it. We had 4 AIs search for the same 3 questions. Subjects: the monthly paid plans and free accounts of 4 AIs. Method: the same 3 questions sent once each in a new chat. Timing: October 16, 2026. Sunrise matched official sources for 3 AIs; price data matched for 4 AIs. Answers were checked against the National Astronomical Observatory of Japan (NAOJ) and the Statistics Bureau of Japan. Illustration created by AInformation (scene: 'here is how we tested it')
We had 4 AIs search for the same 3 questions

We did not send questions to the same AI back to back; we rotated through them in order. Sending one question each to ChatGPT, Gemini, Claude, and Microsoft Copilot in turn meant 12 total sends across the 3 questions. We allowed extra time while waiting for each answer.

We checked the answers against two official pages. For sunrise times, we used the National Astronomical Observatory of Japan (NAOJ)’s “Sunrise and Sunset Times for Tokyo (Tokyo Metropolitan Government), October 2026” page. For prices, we used the “Consumer Price Index (CPI), Nationwide (Summary of Latest Monthly Results)” page from the Statistics Bureau of Japan. In Tokyo on October 16, sunrise was at 5:48 a.m. and sunset was at 5:05 p.m. We counted answers as correct if they were within one minute of these times. The latest price data available was for August 2026, published on September 18, 2026, and showed overall prices up 1.9% year over year.

For the announcements from 4 companies, we checked against AInformation’s own daily records of each company’s official updates. Where no record existed, we opened the official site of the company named in the answer and verified the date and content.

We did not include a screenshot of Microsoft Copilot because our account name and the titles of past chats appeared in the frame. The description of Copilot’s answers here is based on the text we recorded. Instead, we include an official page that explains Copilot’s search mode.

Excerpt from Microsoft Support's 'Conversation modes in Microsoft Copilot.' It states in English that Copilot Search returns up-to-date web answers with citations, and that it is available to all Copilot users
Microsoft’s official explanation: the search mode is available to all Copilot users. Source: support.microsoft.com (as of October 16, 2026)

According to Microsoft’s official explanation, Copilot’s search mode is available to everyone who uses Copilot. Answers come with citations, and the mode is built to return the latest information from the web. Even with the free account used in this test, the answer text included citation tags such as “nao” and “go.”

Sunrise and sunset: ChatGPT, Gemini, and Copilot all matched at 5:48 a.m. and 5:05 p.m.

On the easy question, all three AI tools matched the National Astronomical Observatory of Japan (NAOJ)’s values exactly. ChatGPT, Gemini, and Microsoft Copilot all answered that sunrise was at 5:48 a.m. and sunset at 5:05 p.m. The differences showed up in the response time and in how detailed the cited URL was.

ChatGPT linked directly to the Tokyo page for October

ChatGPT answered in 48.4 seconds with a 186-character response. It first wrote “Today, October 16, 2026 (Fri)” and noted that the time was in Japan Standard Time. As its source, it cited “Sunrise and Sunset Times for Tokyo (Tokyo Metropolitan Government), October 2026” from the National Astronomical Observatory of Japan (NAOJ)’s Ephemeris Computation Office.

Screen showing ChatGPT's answer to a question about Tokyo's sunrise and sunset times, citing the National Astronomical Observatory of Japan (NAOJ) page, with the times and source URL displayed
ChatGPT’s answer: sunrise at 5:48 a.m. and sunset at 5:05 p.m., with a URL from the National Astronomical Observatory of Japan (NAOJ). Screenshot taken by AInformation while operating ChatGPT on October 16, 2026

The URL ChatGPT gave links to a page listing every day’s values for October in a single table. When we opened it, the row for the 16th showed sunrise and sunset times in the same format as the answer. A reader checking this for themselves can open the same URL and find the same row.

Gemini gave the correct times, but the URL linked to a landing page

Gemini’s times were correct. But it took 95.5 seconds to answer, longer than ChatGPT’s 48.4 seconds. The answer was 170 characters and listed sunrise and sunset as bullet points.

Screen showing Gemini's answer to a question about Tokyo's sunrise and sunset times, citing the National Astronomical Observatory of Japan (NAOJ)
Gemini’s answer: the time was correct, but the URL pointed to the entry page for Tokyo’s calendar. Screenshot taken by AInformation while operating Gemini on October 16, 2026

What stood out was the URL. Gemini linked to a page called “Tokyo (Tokyo Metropolitan Government) Calendar,” which lists entry points for each month from January through December. To see the value for the 16th, a reader would need to click through to “October Sun” from there. No citation tag appeared next to the answer either; the URL was simply written into the body text.

Copilot answered in 20.2 seconds and linked to today’s calendar page

Microsoft Copilot answered in 20.2 seconds with a 244-character response, the fastest of the four AIs. Its source was the National Astronomical Observatory of Japan (NAOJ) Ephemeris Computation Office page, “Today’s Calendar.” It added that the same values could also be found in “the National Astronomical Observatory of Japan (NAOJ) list of sunrise and sunset times for Tokyo in October 2026,” showing values from two pages side by side.

Claude asked for permission before opening the National Astronomical Observatory of Japan (NAOJ) page

Claude wrote, “I will check the daily values for Tokyo in October 2026 directly on the NAOJ Ephemeris Computation Office page,” then asked for permission to open the page. At the bottom of the screen, a message read “Claude is trying to retrieve a web page,” showing the URL of the National Astronomical Observatory of Japan (NAOJ) calculation page. There were three buttons: “Deny,” “Always allow this website,” and “Allow once.”

Screen showing Claude asking for permission to retrieve a web page while trying to look up Tokyo sunrise and sunset times on the National Astronomical Observatory of Japan (NAOJ) page
The screen where Claude asked for permission before opening the National Astronomical Observatory of Japan (NAOJ) page / Screenshot taken by AInformation while operating Claude on October 16, 2026

The editorial team’s automated operation is not built to answer this kind of confirmation prompt. So Claude’s answer stops at this screen, 26.2 seconds after being sent. The page it was trying to open was the National Astronomical Observatory of Japan (NAOJ) page specifying October 16 and Tokyo. The destination was correct, but the final time values were never confirmed.

In the lower right of the input field, next to the model name, a “Manual” label appeared. This test cannot tell whether this label is related to how the confirmation prompt appeared.

ChatGPT matched announcement dates to official pages for three of four companies

For the medium-difficulty question, no AI confirmed all four companies’ announcements against official sources. ChatGPT came closest: for OpenAI, Google, and Anthropic, even the announcement dates matched the official pages for all 3 companies. Microsoft Copilot provided four URLs that all opened, but two of them pointed to articles that were not feature announcements.

ChatGPT picked up claude.com’s OpenTelemetry announcement

ChatGPT returned a 639-character answer in 82.5 seconds, summarizing the four companies in a table. For OpenAI, it listed the October 15 “GPT-Live-1.1” release and the new voice, which matched the official help page update. For Google, it listed the Gemini app’s task feature from October 13. The blog.google article from the same day described switching from chat to tasks.

Screen showing ChatGPT asked to compare AI features, summarizing the latest AI features from OpenAI, Google, Anthropic, and Microsoft in a table
Screen where ChatGPT summarized the four companies’ announcements in a table. The URL column shows link text / Screenshot taken by AInformation while operating ChatGPT on October 16, 2026

For Anthropic, it listed “agent behavior tracking for the Claude Platform” from October 14. On Anthropic’s news page, that week’s items were about offices, elections, and evaluation agencies. No feature announcement appeared there. ChatGPT instead found, on the claude.com blog, an announcement of a public beta that lets users track AI activity using OpenTelemetry. When the editorial team opened it, the page date was also October 14.

For Microsoft, it listed “business process memory for Copilot Studio” from October 15. When the editorial team checked the official Copilot blog and the Copilot Studio blog’s latest posts on October 16, this announcement could not be found. It cannot be called fabricated outright, but since it could not be confirmed, we marked it as Partial. That week, Microsoft did have official announcements, such as Copilot for legal on October 15.

Another issue was the URL column in the table. ChatGPT placed link text such as “official help page” or “official blog” instead of writing out the actual addresses. Since the question asked for answers “with URLs,” this falls a bit short.

Results of checking the four companies’ announcement answers against official pages

Company Announcement cited by ChatGPT Announcement cited by Microsoft Copilot
OpenAI Correct: October 15, GPT-Live-1.1 and new voice (official help page) Partial: October 16, GPT-Live-1.1 (community announcement list)
Google Correct: October 13, Gemini app tasks (blog.google) Correct: October 13, Gemini 4 Argon (blog.google)
Anthropic Correct: October 14, OpenTelemetry tracking (claude.com) Partial: October 14, midterm election efforts
Microsoft Partial: October 15, business process memory (not found in official updates) Partial: October 12, Azure Maia 200 (infrastructure story)
Data: AInformation (October 16, 2026; cross-checked dates and content by opening the pages cited in each answer and each company’s official updates) / Created by AInformation

Copilot wrote four openable URLs, but the content was off

Microsoft Copilot returned an 846-character answer in 26.2 seconds, writing out all four URLs as text. When the editorial team opened all four, every page displayed correctly. Google’s Gemini 4 Argon was a blog.google article from October 13, and both the date and the content matched.

The other three companies were off. For OpenAI, it listed “GPT-Live-1.1” as dated October 16 and pointed to OpenAI’s community announcement list page, which is neither the official blog nor the official help page. On the official help page’s release notes, this announcement was dated October 15. For Anthropic, the October 14 item was an article about efforts tied to the US midterm elections, not an AI feature announcement. For Microsoft, the October 12 item was an article about Azure Maia 200, Microsoft’s infrastructure used for AI computation.

Gemini thought for 218.2 seconds, then replied “I am still in training”

After waiting 218.2 seconds, Gemini returned a 63-character reply: “As a large language model, I am still in training.” It continued with “I’m sorry, but I can’t help with that,” and did not list any of the four companies’ announcements. Out of all 12 submissions, this was the only reply that declined without addressing what was asked.

Screen showing Gemini asked about four companies' AI feature announcements but replying that it could not respond because it is still learning
Screen where Gemini replied “I’m still learning about this” to the question about the four companies’ announcements / Screenshot taken by AInformation while operating Gemini on October 16, 2026

Claude doubted its search results and tried to open OpenAI’s help page

Over 41.6 seconds, Claude ran two search passes and wrote out its intermediate reasoning on screen. For OpenAI’s help page, it read “latest is Oct 7” and wrote that it had not yet found an announcement within the past seven days. In the editorial team’s own records, that same help page listed an update dated October 15.

Claude then wrote that it would open each company’s official page directly to check. Its intermediate reasoning also included the line “this is a fictional future date (October 2026).” Even while doubting today’s date, it tried to go check the official sources rather than make up an answer. Here, too, a permission prompt appeared for opening OpenAI’s help page, so no final answer was produced.

Screen showing Claude researching each company's AI feature announcements and asking for permission to retrieve OpenAI's help page
Claude wrote out its intermediate reasoning and asked for permission to open OpenAI’s help page / Screenshot taken by AInformation while operating Claude on October 16, 2026
Answers after asking about the four companies' announcements. Tell me about the four companies' AI announcements from the last 7 days. ChatGPT: 3 companies matched the official sources, down to the dates. Microsoft Copilot: the URLs opened, but the items for 2 companies were not features. Gemini: replied that it was still learning. None of the four AIs matched the official sources for all four companies. Claude asked for permission to open the official help page. Illustration created by AInformation (each AI's answer to the same question)
Answers after asking about the four companies’ announcements

All four AIs gave the 1.9% consumer price index figure and correctly identified it as August 2026 data

All four AIs answered the hard question correctly. All four said the nationwide overall index rose 1.9% year over year, and that this was the August 2026 figure published on September 18, 2026. None of the AIs confused this with the figure for Tokyo’s 23 wards or the 1.7% “overall excluding fresh food” figure.

ChatGPT returned only what was needed in 184 characters

ChatGPT took 51.5 seconds to return a 184-character answer. After noting “as of October 16, 2026,” it listed the 1.9% increase, the target month, the publication date and a source URL. The URL pointed to the “Summary of Latest Monthly Results” page of the Statistics Bureau of Japan, and when AInformation opened it, the same figures appeared.

Screen showing ChatGPT's answer after asking for the latest year-over-year consumer price index figure, citing the Statistics Bureau of Japan as the source
ChatGPT’s answer. The nationwide overall index rose 1.9%, and the target month and publication date were also correct / Screen captured by AInformation while operating ChatGPT on October 16, 2026

Gemini mixed a non-Statistics Bureau source in with the correct figure

Gemini took 205.6 seconds to return a 447-character answer. All the figures were correct. It also added, for reference, the 1.7% figure for “overall excluding fresh food” and the 1.9% figure for “overall excluding fresh food and energy.”

What stood out was the source label. The first line and the line with the 1.9% overall figure carried an “EBC Financial Group” label. The label for the Statistics Bureau of Japan appeared on the lines about the target month and publication date. Even though we asked Gemini to cite the Statistics Bureau, a different source showed up next to the most important number.

Screen showing Gemini's answer after asking for the year-over-year consumer price index figure, citing the Statistics Bureau of Japan as the source
Gemini’s answer. The 1.9% line carried a source label from a site other than the Statistics Bureau / Screen captured by AInformation while operating Gemini on October 16, 2026

Claude wrote just its first line in English

Claude took 26.2 seconds to return a 502-character answer. For this question, no permission prompt appeared; it loaded the page and continued straight into the answer. The figures and URL matched ChatGPT’s. It even explained the reasoning: since the September data had not been published yet, the August figure was the latest available.

What stood out was the first line. The answer began with a single English sentence: “I got the data directly from the Statistics Bureau.” Although we asked in Japanese and got a Japanese answer back, one English sentence was mixed in.

Screen showing Claude's answer after asking for the latest Japan consumer price index figure, with a citation to the Statistics Bureau of Japan
Claude’s answer. The first line began in English, and the figures and URL matched the official source / Screen captured by AInformation while operating Claude on October 16, 2026

Copilot quoted the published report word for word

Microsoft Copilot took 20.2 seconds to return a 327-character answer. It quoted directly from a report by the Statistics Bureau of Japan: “The overall index is 102.2 with 2025 as the base of 100, a year-over-year increase of 1.9%.” It then repeated the conclusion in bold at the end, so the conclusion appeared twice: at the start and at the end of the answer.

Microsoft Copilot was fastest on all three questions; Gemini took 95.5 seconds or more

The biggest difference among the four AIs showed up in how long they took to answer. Microsoft Copilot answered fastest among the four on all three questions. It took 20.2 seconds for both the sunrise question and the price question, and 26.2 seconds for the question about the four companies’ announcements.

Gemini, by contrast, took the longest on all three questions. The sunrise question took 95.5 seconds, and the price question took 205.6 seconds. For the question about the four companies’ announcements, it took 218.2 seconds before returning a refusal.

ChatGPT took 48.4 seconds for the sunrise question and 51.5 seconds for the price question. The question about the four companies’ announcements took 82.5 seconds. Claude answered the price question in 26.2 seconds, the second fastest after Copilot. Its times of 26.2 seconds for the sunrise question and 41.6 seconds for the four companies’ question are the time until the permission prompt appeared, not the time until the final answer, so they are listed separately in the table.

Time to answer and character count for the three questions

Question ChatGPT Gemini Claude Microsoft Copilot
Easy: sunrise and sunset 48.4 sec / 186 chars 95.5 sec / 170 chars 26.2 sec / 132 chars (until prompt) 20.2 sec / 244 chars
Medium: four companies’ announcements 82.5 sec / 639 chars 218.2 sec / 63 chars 41.6 sec / 1,317 chars (until prompt) 26.2 sec / 846 chars
Hard: consumer price index 51.5 sec / 184 chars 205.6 sec / 447 chars 26.2 sec / 502 chars 20.2 sec / 327 chars
Data: AInformation (October 16, 2026, one run each; for Claude’s easy and medium questions, time is until the permission prompt appeared; Claude’s character counts include labels and overlapping text) / Created by AInformation

Time to answer the price question

Microsoft Copilot 20.2 sec
Claude 26.2 sec
ChatGPT 51.5 sec
Gemini 205.6 sec
Data: AInformation (October 16, 2026, one run each; questions all four AIs answered) / Created by AInformation

A longer answer was not always a more helpful one

For the sunrise question, Microsoft Copilot gave the longest answer at 244 characters. Claude’s was the shortest at 132 characters, but that figure only covers the text before the permission prompt. For the price question, Claude was the longest at 502 characters, and ChatGPT was the shortest at 184 characters.

Claude’s character count includes a label reading “Claude’s response:” and some repeated sentences. The 1,317-character count for the four companies’ announcements also includes repeated passages where Claude wrote out its thinking more than once. Treat these lengths as rough guides only.

Answer length and accuracy were not linked for any of the AIs. For the price question, both the 184-character ChatGPT answer and the 502-character Claude answer correctly returned the same 1.9%. Given the time it takes to read, a short answer with a source URL attached felt the easiest to use.

For citations, only ChatGPT showed a URL with the actual figure for two of the questions

How useful a web search answer is depends on whether you can open the source and check it. ChatGPT was the most helpful here. For both the sunrise and the price questions, it gave a single URL pointing directly to the page that contained the answer’s value.

The four services cited sources differently. ChatGPT attached labels like “National Astronomical Observatory of Japan (NAOJ) Ephemeris Computation Office” and “stat.go.jp” next to its answer text, and also wrote out the URL. Microsoft Copilot attached short labels such as “nao” or “go” throughout its text. For the sunrise question it wrote out the URL, but for the price question it only listed the names of the sources.

For the price question, Gemini mixed labels from the Statistics Bureau of Japan and from “EBC Financial Group.” For the sunrise question, it attached no labels at all and simply wrote a URL in the body text. Claude attached a label reading “stat” for the price question and wrote out the URL as plain text at the end.

For the four companies’ announcements, how URLs were written affected how easy they were to verify

For the question about the four companies’ announcements, only Microsoft Copilot wrote out the URLs as plain text. ChatGPT’s table turned the URL column into clickable link text. Clicking takes you to the page, but copying the address to check later takes an extra step.

Meanwhile, all four of Copilot’s URLs opened fine, but the one for OpenAI led to a general announcements list page. From there you still have to find the specific announcement, “GPT-Live-1.1 is rolling out with new voices and better accents.” This showed that a URL opening and a URL actually leading to the page about what was asked are two different things.

In Japanese, Claude’s one English sentence and Gemini’s refusal stood out

For naturalness in Japanese, both ChatGPT and Microsoft Copilot wrote easy-to-read sentences. ChatGPT stated things concisely, such as “Here it is (Japan Standard Time).” Copilot also opened with a short lead-in like “As follows:” before listing items. Only the first line of Claude’s price answer was in English. For the question about the four companies’ announcements, Gemini replied, “I’m sorry, but I can’t help with that,” without addressing what was asked.

By use case, ChatGPT wins on accuracy and Microsoft Copilot wins on speed

Based on the results of these three questions, here is which AI to choose for which purpose. All results are from a single run on October 16, 2026.

If accuracy matters most, choose ChatGPT

If you want to check sources all the way through, choose ChatGPT. For both the easy and the hard questions, ChatGPT was the only one to show a URL pointing to the page with the actual answer value. For the question about the four companies’ announcements, its answers for three of the companies matched the official pages, down to the dates. This test used ChatGPT Pro. According to OpenAI’s official help pages, web search is available even on the free plan, ChatGPT Free.

If speed matters most, choose Microsoft Copilot

If you want an answer fast, Microsoft Copilot is a good fit. It answered fastest among the four for all three questions, and its sunrise and price answers matched the official values. For questions with conditions like a time period or a specific “feature,” some off-topic information crept in. Open the source URLs and check the content before relying on the answer.

If you want to try it for free, start with Microsoft Copilot

If you want to try this without spending money, start with Microsoft Copilot, since this test confirmed its answers using a free account. According to its official explanation, the search mode is available to everyone who uses Copilot. ChatGPT’s official help also says it is available starting from the Free plan, but this test did not check how the free version answers. Claude and Gemini were only tested on paid plans.

If you want it to read an official page directly, use Claude expecting to approve a permission prompt

Claude stood out for trying to open and check official pages directly. For the sunrise question, it tried to open a calculation page from the National Astronomical Observatory of Japan (NAOJ). For the four companies’ announcements, it tried OpenAI’s help page. When you use it, expect permission prompts and plan to stay in front of the screen to approve them.

What to watch for with AI web search: the source label and the actual content behind the URL

Comparing the four AIs showed that having a citation attached does not guarantee the content actually matches. Across the 12 prompts sent in this test, neither the recorded screens nor the answers showed any limit or remaining-use count. That means the burden of checking the answer is still left to the user.

3 things to watch for with AI web search. Point 1: check the label next to the number. A label from a different site got attached to the correct value. Point 2: open the URL and check it yourself. It can be an entry page or a listing page. Point 3: check the date yourself. The discussion drifted away from the within-7-days condition. Claude asks for permission before opening a link. Illustration made by AInformation (Points 1, 2, 3 stacked vertically, with an image for each row)
3 things to watch for with AI web search

Check the source label next to the most important number

As with Gemini’s price answer, a correct value can sometimes have a different source attached than the one you asked for. Hovering over the label shows a small popup with the page it points to. It helps to check whether the label next to the number is really from an official source before trusting it.

Open the URL and check whether it actually leads to the page about what you asked

Gemini’s URL for the sunrise question led to an entry page. The URL Copilot gave for OpenAI also led to a general announcements list page. Both pages open fine, but the actual value or story is one level further down. Don’t assume it’s fine just because a URL is attached. Open it and check whether the same value or the same story is actually there.

For time-period conditions, check the dates in the answer yourself

A time condition like “within the past 7 days” can be missed even when the AI intends to follow it. Microsoft Copilot wrote OpenAI’s announcement date as October 16, which did not match the official help page’s date of October 15. The Microsoft announcement ChatGPT cited could not be found on the official news page. The safest approach is to check announcement dates and article dates yourself.

With Claude’s permission prompt, read the URL before approving it

Before opening a page, Claude shows you the URL it wants to open and asks for permission. There were three buttons: “Allow once,” “Always allow this website,” and “Deny.” For an unfamiliar site, allowing it just once is the safer choice. For official sites you use often, such as the National Astronomical Observatory of Japan (NAOJ) or the Statistics Bureau of Japan, you could choose to always allow them.

If one AI refuses, send the same prompt to another AI

For the question about the four companies’ announcements, which Gemini refused to answer, both ChatGPT and Microsoft Copilot returned answers. If you’re in a hurry, sending the same prompt to a different AI is the fastest workaround. This test did not try rephrasing the question and asking again after a refusal.

We ran the same kind of comparison in other articles, including one that compared four AI memory features and one that compared four AI email drafting tools. For the AI built into Google’s search screen, we tested 30 questions in our article on how to use AI Mode.

Related articles and tools

The view of Shunta Fujii (AI adoption consultant)

It’s tempting to trust a web search answer just because it comes with a source, but this time the citations and the URLs themselves varied a lot. Sometimes the correct value had a different source attached, or the URL you could open was just a landing page. If you’re pulling numbers for work, the safest approach is to name the official source directly when you ask ChatGPT. Always open the URL it gives you. For quick preliminary research where speed matters, Microsoft Copilot is good enough. The confirmation step Claude shows before opening a page can feel like extra work. But it does let you see what it’s about to read, which is reassuring when you’re using it inside a company.

Frequently asked questions
Which AI gave the most accurate answers in web search?
ChatGPT. When we sent the same 3 questions on October 16, 2026, it answered that sunrise was at 5:48 a.m. and sunset at 5:05 p.m., and that the Consumer Price Index rose 1.9%. Both answers matched the official figures. For the question about announcements from 4 companies, three of them—OpenAI, Google, and Anthropic—matched the official pages down to the date. Only one item, from Microsoft, could not be found in its official news releases.
Which AI answered the fastest?
Microsoft Copilot. It answered the sunrise and price questions in 20.2 seconds and the 4-company announcement question in 26.2 seconds. That was the shortest time among the four tools for all 3 questions. Its sunrise and price answers matched the official figures. However, for the 4-company announcement question, 2 of the 4 items it cited were not actually feature announcements. Use it for quick preliminary research, but open the URLs it gives and verify the content yourself.
How do you use web search in Claude?
According to the official help page, the new Claude interface has no toggle to turn search on or off. Claude decides on its own when to search. In our test we sent all 3 questions without toggling anything, and each answer began with “I searched the web.” When Claude wants to open a page directly, it shows a confirmation prompt such as “Allow once,” so read the URL before clicking it. On interfaces that do have a toggle, select “Web search” from the + icon in the lower left of the input box.
Why did Gemini reply “I’m still learning about this”?
This test couldn’t determine the reason. For the question asking about one announcement from each of 4 companies, Gemini took 218.2 seconds and then returned a 63-character refusal. On the same day, it answered the sunrise and price questions correctly. ChatGPT and Microsoft Copilot both gave answers to the same question, so if you’re in a hurry, asking a different AI is the quicker path.
Can AI web search be used for free?
We tried Microsoft Copilot with a free Microsoft account, and it returned answers with sources. According to its own documentation, search mode is available to everyone who uses Copilot. ChatGPT’s official help page also says web search is available on the Free plan, though we tested it on ChatGPT Pro this time. We tested Claude on Claude Max and Gemini on Google AI Pro. We did not check how the free versions behave.

Articles to read next

SHARE

This site carries ads and may receive a referral fee when a visitor signs up through them.

You may also likeRELATED