A week ago, Elon Musk had promised that his AI chatbot, GrokAI, would be open-sourced soon. Fulfilling his promise, the X chief has now made the AI tool open-sourced and an open release is available on GitHub. Open-sourcing an AI model means offering its source code to the public for modification and redistribution. Thus, open-sourcing GrokAI will let researchers and developers work with the model and improve Grok’s xAI abilities enabling it to keep up with other tech companies like OpenAI, Meta, Google, and others. On the other hand, Musk also took another jibe at OpenAI, asking them to talk more about the "Open" part.
xAI, the company behind GrokAI, published a blog post that announced that GrokAI is now open-sourced. The blog post said that the xAI team is "releasing the base model weights and network architecture of Grok-1, a large language model."
The blog post also mentioned that people who are interested in using the model need to follow instructions on Github.
"We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI. This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue. We are releasing the weights and the architecture under the Apache 2.0 license. To get started with using the model, follow the instructions at github.com/xai-org/grok," the company’s blog post noted.
Regarding the base model’s details, GrokAI noted that it has been trained on a lot of data and hasn’t been specially adjusted for any specific task. The model is called a 314-billion-parameter Mixture-of-Experts model and has been trained from the ground up by the xAI team using "a custom training stack on top of JAX and Rust in October 2023."
Meanwhile, Musk took another jibe at OpenAI on X, asking them to talk more about the "open" in their name. "Tell us more about the "Open" part of OpenAI," he said in a tweet.
Elon Musk has often expressed his disappointment with the company, accusing it of abandoning its original mission and focusing more on profits. Recently, the X chief sued OpenAI for "breaching its contract and indulging in unfair business practices." Musk said in the lawsuit that OpenAI’s focus on maximising profits for Microsoft, instead of benefiting humanity, goes against the company’s original mission.
Shortly after the lawsuit was filed, OpenAI CEO Sam Altman was seen sharing an old conversation between him and Musk on X, in which the OpenAI CEO could be seen backing Musk when many were against Tesla in 2019. Later, OpenAI published a blog post saying that Musk had originally backed the idea of a for-profit arm for OpenAI and also at one point, wanted complete control of the company and merge it with Tesla.
For the unversed, Musk was one of the founding members of the company back in 2015. He left the company and let go of all his stake in 2018.
{Categories} _Category: Platforms,*ALL*{/Categories}
{URL}https://www.indiatoday.in/technology/news/story/elon-musk-makes-grokai-chatbot-open-source-takes-another-jibe-at-openai-2516194-2024-03-18{/URL}
{Author}unknown{/Author}
{Image}https://akm-img-a-in.tosshub.com/businesstoday/images/story/202403/elon-musk-11344917-16x9_2-original.jpg{/Image}
{Keywords}{/Keywords}
{Source}TECHNOLOGY{/Source}
{Thumb}{/Thumb}