Ad
Skip to content
Subscribe Now
AI in practice
Copy the url to clipboard Share this article Go to comment section

Testing AI chatbots' expertise in translating Japanese texts

Matthias Bastian
Matthias Bastian View the LinkedIn Profile of Matthias Bastian
Jul 19, 2023

The Japan Times tested AI-assisted tools for Japanese-to-English translation, pitting ChatGPT with GPT-4 against Bing, Bard, and DeepL to determine which one best-understood context and translated accurately into natural English. A bilingual senior editor from TJT evaluated the results.

The test involved translating literature, song lyrics, and a speech from Japanese to English. GPT-4 scored highest overall, closely followed by Bard and Bing, although it struggled to translate the subject matter of the literature sample. DeepL consistently scored the lowest. AI chatbots can produce varying results based on factors such as device, timing, and phrasing, but ChatGPT-4 consistently offers the highest quality, according to language expert Tom Gally of the University of Tokyo.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Read on for the full picture.
Subscribe for hype-free coverage.

  • Access to all THE DECODER articles.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder