March 11th, Elon Musk Said xAI plans to open source its AI chatbot Grok, and an open release is currently available on GitHub. This allows researchers and developers to build on the model, influencing how xAI updates his Grok in the future as it competes with competing technologies such as OpenAI, Meta, and Google. You can give.
The company's blog post explains that the open release includes “base model weights and network architecture” for “a 314 billion parameter expert mixture model, Grok-1.” The company went on to say that this model is from last October's Checkpoint and has not undergone any tweaks “for specific uses such as interaction.”
as venture beat Note that it is released under the Apache 2.0 license, which allows commercial use, but does not include data used for training or a connection to X for real-time data. xAI said in a November 2023 post that LLM Grok was “developed over the past four months” and is targeted at applications such as code generation, creative writing, and question answering.
After Musk acquired Twitter (now known as X), the code behind its algorithms was finally made public, and Musk has publicly criticized companies that don't open source their AI models. That includes OpenAI, which he helped found but is currently suing for violating its original founding agreement to make it open source.
Companies release open source models or limited open source models to get feedback from other researchers on how to improve their models. While there are many fully open source AI-based models, such as Mistral and Falcon, the most widely used models are closed source or offer limited open licenses. For example, Meta's Llama 2 provides its research for free, but forces customers with 700 million daily users to pay and does not allow developers to iterate on his Llama 2.