Skip to content
NEWS
AInformation original surveys and measurements

How AI is changing work: we ask, measure and keep tracking

Surveys of working people and tests that give 4 AIs the same tasks. We publish the full text of the questions and tasks, the bases, and even how we tally the results.

All surveys listed here were conducted in Japanese with respondents living in Japan. AInformation translated the questions and answer choices from the original Japanese. See the original in Japanese

Read the surveys →
29.1% Cancel and switch to a different paid tool
16 of 55 people (base: People who pay for AI tools themselves)

Survey figures are shares among respondents. They do not represent Japan as a whole.

No matches found. Clear your search to see everything again.

Every 5 daysAI Practical Work Benchmark (measured results)

We give 4 AIs (ChatGPT, Gemini, Claude and Copilot) exactly the same work tasks under the same conditions and measure their accuracy and how long they take to answer. All scoring is done by a program; no AI scores the answers. Each task is run 3 times, so the numbers also show how much the answers vary.

Accuracy combined across 13 runs and 856 trials in total. As of November 2, 2026.

  • #1 ChatGPT Accuracy: 90.7% (204 of 225 trials)
  • #2 Claude Accuracy: 78.8% (164 of 208 trials)
  • #3 Copilot Accuracy: 65.7% (130 of 198 trials)
  • #4 Gemini Accuracy: 59.6% (134 of 225 trials)

How we run the surveys

All tallying is done by a program; we do not let AI do the tallying. We also do not change the questions after collection starts.

  • STEP 1 Set the questions We first fix in writing who we will ask and what the questions are. They do not change after collection starts. If we revise the wording, we raise the version number, and rounds with different versions are not joined by a trend line. Questions finalized down to the option wording
  • STEP 2 Recruit respondents We recruit respondents through an open online call. It is first come, first served, one response per person, and limited to people with a good record of past responses. Participation is voluntary, and AInformation pays the reward. Reward paid by AInformation
  • STEP 3 Check quality A program flags duplicate, blank and internally inconsistent answers using several rules. The checks are set for each survey, and a person decides case by case whether to exclude each response. Checks for inconsistencies
  • STEP 4 Tally and publish We publish the results for each question together with the survey method. They are also available as JSON and CSV. JSON and CSV released at the same time

How we report numbers

These rules are written into the program. We do not change them from round to round to suit ourselves.

  • We do not weight the results

    The respondents are people who chose to take part, not a sample that can be used to estimate figures for Japan as a whole. We also do not give a margin of error (±X%).

  • We always show the base

    Each percentage uses the number of respondents who answered that question as the base. If some people did not answer, we show that number too.

  • Bases under 30 people are for reference only, and under 10 are not shown

    If only one cell were hidden, its value could be worked out from the others, so we hide one more cell in the same table.

  • We do not publish free-text answers as written

    For anything we quote in articles, a person chooses it after removing details that could identify an individual or company.

  • We do not delete past versions

    When we make a correction, we add a new version and record the reason. This keeps links from people who cited us from breaking.

Definitions

What the terms used in the questions mean.

Generative AI
AI that creates text or images, such as ChatGPT. This does not include the AI summaries that appear automatically at the top of search results (such as AI Overviews).
Company rules
Rules set by the employer for using generative AI at work. Includes both written rules and rules given verbally.
Base
The number of people who answered that question. It varies by question. For questions asked only of “people who use AI at work,” the number of those people is the base.
Suppression
For cells with a base of under 10 people, we show neither the percentage nor the count. So that the hidden value cannot be worked out by subtracting from the other values, we also hide a second cell in the same table.

Limitations of this survey

We state the survey's limitations in advance and list them again when we publish the results.

  • This survey asked people who answered an open online call for respondents. It does not represent Japan as a whole.
  • All answers are self-reported. We have not verified them ourselves.
  • Each person can answer only once, but we cannot fully prevent the same person from answering again under another registration.

Other limitations differ from survey to survey, so each survey's page lists all of them.

Data available now

Separate from the surveys, these are datasets AInformation's editors collect and publish themselves. All of them are available as JSON and CSV.

See /en/data/index.json for the list and About us for how you may use it. You can get the list of published surveys from /en/data/research/index.json.

FAQ

Common questions about using the surveys and how we handle personal information.

  • Who runs these surveys?

    AInformation (run by Shunta Fujii) plans the surveys and pays for them itself. No one commissions or sponsors them. We never create numbers to serve anyone's advertising.

  • How many people do you survey?

    We set a target number of respondents for each survey before recruiting. Surveys published so far: 3, with 602 valid responses in total. Each survey's page shows how many responses we collected and how many we removed in quality checks. The base for each question is on the same page.

  • Can I use these figures as “X% of people in Japan”?

    No. The survey asked people who answered an open online call for respondents, and the figures are shares of those respondents. The sample cannot be used to estimate figures for Japan as a whole, so we do not give a margin of error (±X%) either.

  • Do you use AI to tally the results?

    All tallying is done by a program, not by AI. We use AI only for groundwork when reading open-ended answers and picking candidates for articles, and a person makes the final decision.

  • Can I use the data in my own materials or articles?

    Yes. Please cite the AInformation survey name and URL as the source. The tallied figures are available as JSON and CSV. You may modify and redistribute them.

  • Could anyone tell which answers are mine?

    No. We never publish anything in a form that could identify individuals. We do not publish the original open-ended answers either. Anything used in articles is chosen by a person after removing details that could identify an individual or a company.

  • Can I withdraw my answers?

    Yes. Contact us through the contact form. If we have not tallied the results yet, we will remove your response. We keep responses for 2 years and delete them after that.

  • What will you survey next, and when?

    Next, we will start a recurring survey that asks the same questions every time. Asking the same questions over time lets us show changes from the previous round in percentage points. We will post the topics and timing on this page when recruitment starts.

Cite this survey

Source: AInformation, “Original AI Surveys” https://ainformation.jp/en/ai-surveys

You can copy and use this as is. The tallies are also available as JSON and CSV. You may modify and redistribute them. The license is CC BY 4.0.

Upcoming recurring survey

So far we have published 2 surveys, all of them one-time surveys. Next we will start a recurring survey that asks the same questions each time. Asking the same questions each time will let us show the change from the previous round in percentage points.

  • How often people use generative AI
  • Which generative AI tools people use
  • Which one people use most
  • How often people use it at work
  • Who pays for it
  • How much people pay out of pocket each month
NEWSLETTER

The latest AI news, rounded up once a week

One email with the week's main AI news and the tools AInformation's editors actually tried.