Content
summary Summary

With "Grok", Elon Musk introduces a chatbot built with "X" data for "X" premium users. In contrast to OpenAI with ChatGPT, Musk gives the chatbot more creative leeway in its responses.

Ad

Musk and his company describe Grok as a humorous, witty, and rebellious chatbot that can answer almost any question. Grok uses its model knowledge based on Internet and X data, as well as real-time information from X, to provide answers. According to xAI, the chatbot also answers "spicy questions" that would be rejected by most other AI systems.

Elon Musk is pleased with a sarcastic response from his chatbot about the history of Sam Bankman-Fried, which includes up-to-date information.| Image: xAI

Grok is currently a text-only chatbot. It does not offer multimodal capabilities such as speech or image recognition, but these are in the works. xAI emphasizes that Grok is still a "very early beta product."

The unusual name is inspired by the science fiction story "The Hitchhiker's Guide to the Galaxy". It stands for empathy and friendly communication, among other things.

Ad
Ad

Grok-1 was built in just four months

Grok is based on the large language model Grok-1, which was built in the last four months using a training and inference stack developed by xAI, based on Kubernetes, Rust, and JA, with the goal of maximizing usable computing power per watt. It took two months to train the model.

According to xAI, the early prototype, Grok-0, with 33 billion parameters, achieved a performance close to LLaMA 2 (70B) on standard language model benchmarks. However, compared to Meta's open-source LLM, it required half the training resources, the company claims.

The context length is 8,192 tokens, and the Internet training data and human feedback data end in the third quarter of 2023.

According to xAI, further "significant improvements" have been made in the last two months in the areas of logic and programming, leading to better performance of Grok-1 in the corresponding benchmarks.

In the published benchmarks, Grok-1 is clearly behind GPT-4, but performs better than GPT-3.5 and reaches the level of Anthropics Claude 2 in the language comprehension benchmark MMLU with five examples ("5-shot").

Recommendation

Image: xAIIn the somewhat unusual benchmark Hungarian National High School Finals in Mathematics, Grok-1 came in second, well ahead of GPT-3.5 and relatively close to GPT-4. xAI justifies the choice of the benchmark by the fact that it was published at the end of May and therefore guaranteed not to have been included in the model's training data. xAI believes that its language model is superior to other models in its class.

Image: xAI

In the Grok-1 model card, xAI points out that the language model, like all others, can make up ("hallucinate") information. So it's not yet TruthGPT.

Exclusive to paying X customers

Toby Pholen, founding member of xAI, gives an insight into the user interface of Grok on X. The program can handle multiple queries simultaneously, and you can toggle between the answers in a tree interface. Code generations can be opened directly in a VS code editor, and text responses can be saved in a markdown editor for later use.

Video: Toby Pholen via xAI

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.

xAI is offering early access to the Grok prototype to a limited number of Premium Plus users in the U.S. to gather feedback to improve functionality before a wider release. Premium Plus membership costs $16 per month.

Interested Premium customers in the US can join the Grok waiting list. The company plans to introduce new features and capabilities in the coming months.

xAI's research and development is focused on additional areas such as scalable, tool-assisted control, integration with formal verification for security, understanding, and retrieval of long contexts, robust defense against attacks, and multimodal capabilities.

According to Musk, xAI focuses on deep scientific questions such as dark matter, gravity, and the Fermi paradox, among others, and aims to understand "the true nature of the universe". The company has assembled a team of experts from leading AI research institutions such as OpenAI, Google Research, Microsoft Research and DeepMind.

Musk and his team believe that super-intelligent AI is a realistic possibility by 2029 and will help society to understand "what the hell is really going on." In addition to its scientific focus, xAI will also compete with OpenAI and provide offerings for consumers and businesses.

Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Elon Musk unveils Grok, a "humorous and rebellious chatbot" based on Internet data and real-time X information. It is designed to answer virtually any question, including "spicy" ones.
  • Grok uses the large language model Grok-1, which took four months to develop and two months to train. It outperforms GPT-3.5 on popular benchmarks, but lags behind OpenAI's GPT-4.
  • Grok is currently a text-only chatbot, with no multimodal capabilities such as speech or image recognition. A limited number of Premium Plus users in the US already have access to the Grok prototype. The chatbot is still in early beta.
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.