Open weights are the publicly released learned parameters of a trained artificial intelligence model, principally its weights and biases. In an artificial neura
| Part of a series on |
| Artificial intelligence (AI) |
|---|
| Glossary |
Open weights are the publicly released learned parameters of a trained artificial intelligence model, principally its weights and biases. In an artificial neural network, weights are numerical values that determine how strongly inputs contribute to the network's calculations. Publishing these values allows others to download and use the model, while permission to modify, fine-tune or redistribute it depends on its license. The term is commonly applied to large language models and other generative artificial intelligence models.[1][2]
During training, a neural network adjusts its parameters to improve its output. Weights determine the contribution of inputs to weighted sums, while biases are additional learned values. A model described as having seven billion parameters contains roughly seven billion learned values.[3]
Releasing model weights may form part of a broader effort to make an artificial intelligence model more transparent and reproducible. The Model Openness Framework evaluates whether components such as the model's parameters, source code, training data, evaluation results, intermediate checkpoints and technical documentation are publicly available under an open license. Under the framework, releasing only the final weights represents a lower degree of openness than releasing the materials needed to study, modify and reproduce the model.[4]
A model card is a document accompanying a trained machine learning model that describes a model’s intended uses, limitations, training data and evaluation results. On Hugging Face, model cards are stored as Markdown README.md files with additional metadata in each model repository, helping users evaluate a model before downloading or deploying it.[5][6]
The Open Source Initiative distinguishes open weights from open-source artificial intelligence when the materials needed to study and modify the model's development process are not also available.[1]
| Component | Open weights | Open-source |
|---|---|---|
| Weights and biases | Released | Released |
| Training code | Not shared | Fully shared |
| Intermediate checkpoints | Withheld | Optional, but desirable |
| Training dataset | Not shared or disclosed | Released where legally permitted |
| Training-data composition | Partially disclosed or undisclosed | Fully disclosed |
Open weights can support local deployment, customization, independent research and competition without requiring access through the original developer's API. However, widely distributed weights generally cannot be withdrawn and may be modified to remove safeguards. A 2024 report by the National Telecommunications and Information Administration examined these benefits and risks and recommended continued monitoring rather than immediate restrictions.[7][8]
Professors Peter Henderson and Mark Lemley argue that open-weight license terms are largely unenforceable because they presuppose intellectual property rights in ML model weights that do not exist. Whereas computer programs are typically copyrightable because they are "derived from a human-written copyrightable expression of an idea", model weights are generated automatically by a machine learning algorithm. The functional nature of ML model weights likely precludes copyright protection as well.[9] A whitepaper published by the Intellectual Property Owners Association in 2020 proposes a sui generis right in trained AI models.[10]
The following is a list of notable large language models and model families for which at least one version has been released with publicly accessible weights.[11]
Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.