Researchers have released a preview of LongLLaMA, a large language model capable of handling long contexts up to 256.000 tokens or more. Built on the open-source OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method, it permits some attention layers to access a memory cache of key-value pairs to extend their context length.
According to the researchers, the model retains performance on tasks that don't require long contexts, and can be used as a drop-in replacement for shorter context LLaMA implementations. The team has released their smaller 3B variant under the Apache 2.0 license, with inference code supporting longer contexts on Hugging Face. More information and examples of LongLLaMA can be found on their GitHub repository.
Axel Springer has formed a global Generative AI team to consolidate efforts and drive innovation in Generative AI.
The initiative, led by Niddal Salah-Eldin and Samir Fadlallah, will support Axel Springer and its brands in harnessing and leveraging Generative AI in their processes and products. The team will focus on product and market research, in-depth analysis of potential M&A opportunities and partnerships, prototyping disruptive scenarios and developing strategic partnerships with AI-driven tech companies and startups. The plans were previously announced in an internal podcast and then leaked.
GPT Researcher is an AI-based autonomous agent for conducting comprehensive online research on a variety of tasks. The tool, inspired by AutoGPT and the "Plan-and-Solve" prompting, seeks to improve on speed and determinism issues found in current language models, "offering a more stable performance and increased speed through parallelized agent work, as opposed to synchronous operations."
According to the team, GPT Researcher facilitates research by generating relevant research questions, aggregating data from over 20 web sources, and leveraging both GPT3.5-turbo-16k and GPT-4 to create comprehensive research reports. The project aims to address the time-consuming nature of manual research tasks and the biases that result from limited resource usage in alternative approaches such as ChatGPT + WebPlugin. It includes a web interface and provides an export function for research reports in various formats.
Urtopia unveiled the world's first e-bike with ChatGPT integration at EuroBike 2023. The bike features a digital voice interface that allows users to interact with ChatGPT.
The ChatGPT integration could potentially provide users with customized workout programs, assist with bike repairs, plan rides, and provide safety information, perhaps including information about the region you are riding through. Still, the question remains as to why you would want to use it on your bike instead of just via your phone and earbuds, which seems more flexible.
The release date and pricing for Urtopia's ChatGPT-powered e-bike has not yet been announced. In addition to standard e-bike features such as GPS and anti-theft locking systems, the bike also connects to Apple's fitness ecosystem and Strava.
