Hub Artificial Intelligence
Artificial intelligence is either a field of research, the most important technical innovation of mankind, its downfall – or simply a pipe dream from Silicon Valley. Can machines really be intelligent? What is intelligence anyway? What opportunities does AI technology offer, and what are the risks? From neural networks to the science fiction vision of super AI, from deepfakes to AI surveillance: THE DECODER delivers the latest AI news and information on all facets of artificial intelligence.
Anthropic's prompt caching feature can cut the cost of long prompts by up to 90% and reduce latency by as much as 85%. The technology lets developers cache frequently used context between API calls, giving Claude more background knowledge and examples to work with. Prompt caching is now in public beta for Claude 3.5 Sonnet and Claude 3 Haiku models, with support for Claude 3 Opus on the way. The feature is a good fit for chat agents, coding assistants, long document processing, detailed instruction sets, agent-based search and tool usage. It also works well for answering questions about books, papers, documentation, and podcast transcripts, Anthropic says. Google also offers prompt caching.
