GPT-SW3 is the first truly large-scale generative language model for the Swedish language. It is now released for all organizations to start using it.

AI Sweden, with support from WASP, NVIDIA, and RISE, has developed a large-scale generative language model for the Nordic languages, primarily Swedish. The model was trained on the Berzelius supercomputer hosted at the National Supercomputer Center, Linköping University. With the open release, any company, government agency, or organization can tap into the power of GPT-SW3 to build products and services.

GPT-SW3 is the first truly large-scale generative language model for the Swedish language. It is based on the same technical principles as the much-discussed GPT-4.

“We’re happy that this cross-organizational effort turned out so well, and that we can now share the resulting models under an open license for others to try,” says Johanna Björklund, Project Manager WARA Media and Language.

The models (with 126M, 356M, 1.3B, 6.7B, 20B, 40B parameters) are accessible under an open and permissive license from AI Sweden’s repository on Hugging Face, where also a model card and a datasheet are provided.

About GPT-SW3

GPT-SW3 is a collection of large decoder-only pretrained transformer language models that are developed by AI Sweden with support from the WASP Research Arena for Media and Language, NVIDIA, and RISE.

Decoder language models are generative language models built specifically to be able to generate language (GPT stands for Generative Pretrained Transformer). GPT-SW3 is built on massive amounts of Swedish, Norwegian, Danish, Icelandic, and English text data with the explicit purpose of being able to generate Swedish and Nordic language texts.

GPT-SW3 is not an off-the-shelf product or service ready for use. Developers must harness its capabilities to construct applications like chatbots or document summarization services.

Organizations can further tailor GPT-SW3 by training it on their own data sets for specific tasks.

More information

Published: December 1st, 2023

Latest news

We use cookies to personalise content and ads, to provide social media features and to analyse our traffic. We also share information about your use of our site with our social media, advertising and analytics partners. View more
Cookies settings
Privacy & Cookie policy
Privacy & Cookies policy
Cookie name Active
The WASP website uses cookies. Cookies are small text files that are stored on a visitor’s computer and can be used to follow the visitor’s actions on the website. There are two types of cookie:
  • permanent cookies, which remain on a visitor’s computer for a certain, pre-determined duration,
  • session cookies, which are stored temporarily in the computer memory during the period under which a visitor views the website. Session cookies disappear when the visitor closes the web browser.
Permanent cookies are used to store any personal settings that are used. If you do not want cookies to be used, you can switch them off in the security settings of the web browser. It is also possible to set the security of the web browser such that the computer asks you each time a website wants to store a cookie on your computer. The web browser can also delete previously stored cookies: the help function for the web browser contains more information about this. The Swedish Post and Telecom Authority is the supervisory authority in this field. It provides further information about cookies on its website,
Save settings
Cookies settings