Content
summary Summary

Anthropic's ChatGPT competitor Claude can now handle hundreds of pages of text, overtaking GPT-4.

The context window of a chatbot like ChatGPT determines the amount of text the AI model can process at a time. In OpenAI's currently available GPT-4, the window is just under 8,000 tokens, and a variant with just under 32,000 tokens is in closed testing.

AI startup Anthropic is now expanding the context window of its ChatGPT competitor Claude from just under 9,000 tokens to 100,000 tokens. According to the company, this is the equivalent of about 75,000 words, or hundreds of pages of text.

Anthropic Claude can process hundreds of pages

Claude is said to be able to process that amount in less than a minute. In one example, the company changed a sentence in the classic "The Great Gatsby" and asked Claude if anything had changed. Claude found the changed sentence in 22 seconds.

Ad
Ad

With the large context window, Claude should be able to combine knowledge from multiple documents or an entire book for businesses, for example. " For complex questions, this is likely to work substantially better than vector search based approaches," says Anthropic.

Companies are already using vector databases from vendors such as Pinecone to store large amounts of text and make it processable for ChatGPT or other language models. Whether the context window actually offers advantages over such vector databases remains to be seen.

Anthropic sees numerous applications that could benefit from the context window

Claude could create summaries of transcribed podcasts - 100,000 tokens equals about six hours of audio - or make hundreds of pages of API documentation searchable, according to Anthropic.

Recommendation

Other use cases include:

  • Digest, summarize, and explain dense documents like financial statements or research papers
  • Analyze strategic risks and opportunities for a company based on its annual reports
  • Assess the pros and cons of a piece of legislation
  • Identify risks, themes, and different forms of argument across legal documents.
  • Read through hundreds of pages of developer documentation and surface answers to technical questions
  • Rapidly prototype by dropping an entire codebase into the context and intelligently build on or modify it

The 100,000 token context window is now available through the Claude API. Access to Claude can be requested here.

Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Anthropic's ChatGPT competitor Claude gets an update that allows the chatbot to process significantly more text than OpenAI's GPT-4.
  • Claude can now process a total of 100,000 tokens or about 75,000 words in the context window.
  • This should allow Claude to answer questions that "require synthesis of knowledge across many parts of the text," says Anthropic.
Sources
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.