Large Language Models (LLMs) are transforming software development, but their newness and complexity can be daunting for developers. In a comprehensive blog post, Matt Bornstein and Rajko Radovanovic provide a reference architecture for the emerging LLM application stack that captures the most common tools and design patterns used in the field. The reference architecture showcases in-context learning, a design pattern that allows developers to work with out-of-the-box LLMs and control their behavior with smart prompts and private contextual data.
"Pre-trained AI models represent the most significant architectural change in software since the internet."
Matt Bornstein and Rajko Radovanovic