What is open‑source AI? A software engineering researcher explains

Jeffrey Young, Georgia Institute of Technology

You’ve probably heard artificial intelligence models described as “open” or “closed.” These are not descriptions of the model’s personality. Large language model AIs like the one under the hood of ChatGPT don’t have actual personalities, despite appearances.

The labels refer to whether all of the information about how an AI model works is publicly available and the model can be modified, or whether the model’s developer keeps its inner workings secret and the model itself private property.

Open-source software

The concept of open-source software originated in the free software movement of the 1980s and ’90s. The movement’s founders believed that software creators and users had the right to “four freedoms” – to run the program, to study and modify it, to distribute copies of the original, and to distribute copies of subsequently modified versions. The fundamental requirement was that the source code – the basic instructions – for a program should be made available.

In the late 1990s, software developers associated with projects such as the Netscape web browser and the Linux operating system coined and promoted the term “open source” to refer to these ideals.

As part of the evolving movement, certain organizations developed open-source licenses that specified how a particular piece of source code could be used and distributed, including the Gnu General Public License, Apache License, MIT License and the Berkeley Software Distribution. Each type of license also specified any potential restrictions on how software patents applied to the source code.

Open source or open weight?

The open-source idea has risen to prominence again in the past several years as artificial intelligence large language models have surged, notably OpenAI’s ChatGPT, released in 2022. Developers first train new models on large datasets, then deploy the models for use by other people. https://www.youtube.com/embed/Gmz24X86-5E?wmode=transparent&start=0 Open-source artificial intelligence is explained in two minutes.

Meta was one of the first large companies to release an open-source large language model, called LLaMa. The company released LLaMa on Feb. 24, 2023, and made available the “inference” source code – the instructions that run the model. And it released the so-called weights, the encoded knowledge the model learned during training. However, open-source organizations such as the Open Source Initiative have stated that the LLaMa licensing guidelines prohibit commercial reuse, which the initiative maintains is not truly open source.

Other companies have released “open weight” models, such as DeepSeek from DeepSeek AI and Qwen from Alibaba. The models have less restrictive terms for reuse, and the AI community has adopted them rapidly. Still, many developers believe that a true open-source AI model must not only include the source code and weights but also the data that is used to train the model.

A lot to open up

The Open Source Initiative’s definition of a fully open-source AI model includes the training data as a key element. Some developers wonder, however, how feasible it is to distribute the enormous datasets required.

Jeffrey Young, Principal Research Scientist, Partnership for an Advanced Computing Environment, Georgia Institute of Technology

This article is republished from The Conversation under a Creative Commons license. Read the original article.