> ## Content Index > Fetch the complete content index at: https://itsfoss.com/llms.txt > Use this file to discover other available public pages before exploring further. # Red Hat's AI Upgrade + IBM's New Open Source LLM: What Should You Know? - URL: https://itsfoss.com/news/red-hats-ai-ibm-granite/ - Published: 2024-10-22T10:16:56.000Z - Updated: 2024-10-22T10:16:56.000Z - Description: It's time for some AI-focused releases for IBM. - Author: Sourav Rudra - Tags: AI Spotlight, News, #Import 2025-11-08 21:15 Not a day goes by without me reading about some new developments in the rapidly evolving field of Artificial Intelligence (AI). Be it big multinationals like Meta getting [called out](https://itsfoss.com/osi-meta-ai/) for being misleading, or an AI startup [receiving funding](https://itsfoss.com/pearai-controversy/) by copying another's work. So far, this space has been full of surprises and controversies, with such happenings showing no signs of stopping anytime soon. Now, we have two rather interesting pieces of news to report from the house of IBM. Let's see what they have been up to. ## Upgraded Red Hat Enterprise Linux AI (RHEL AI) ![an official artwork in combination of black and red by red hat to represent its rhel AI](https://itsfoss.com/content/images/2024/10/RHEL_AI_Illustration.png) Image Credits: [Red Hat](https://developers.redhat.com/sites/default/files/styles/keep%5Foriginal/public/rhel-ai%5F0.png.webp?itok=HpliAFX9&ref=itsfoss.com) We kick things off in this two-part article with the RHEL AI 1.2 release, which has arrived just over a month after the [initial release](https://itsfoss.com/red-hat-gen-ai/) with loads of new improvements that focus on making things easier for AI developers and researchers. With this release, there is now support for AMD's [Instinct Accelerators](https://www.amd.com/en/products/accelerators/instinct.html?ref=itsfoss.com), including full integration with the [ROCm](https://www.amd.com/en/products/software/rocm.html?ref=itsfoss.com) software stack, and newly added availability on [Azure](https://docs.redhat.com/en/documentation/red%5Fhat%5Fenterprise%5Flinux%5Fai/1.2/html/installing/installing%5Fazure?ref=itsfoss.com#installing%5Fazure) and [GCP](https://docs.redhat.com/en/documentation/red%5Fhat%5Fenterprise%5Flinux%5Fai/1.2/html/installing/installing%5Fgcp?ref=itsfoss.com). Similarly, the developers have worked on adding support for Lenovo [ThinkSystem SR675 V3](https://lenovopress.lenovo.com/lp1611.pdf?ref=itsfoss.com) servers, bringing automatic detection of hardware accelerators, and introducing [PyTorch FSDP](https://pytorch.org/tutorials/intermediate/FSDP%5Ftutorial.html?ref=itsfoss.com) for enhancing training tasks. There's also **a new training checkpoint and resume feature** that lets users save their long training runs so that they can return to working on them later, saving time and resources. **Suggested Read** 📖 [Red Hat Enterprise Linux Gets In On The Generative AI ActionRed Hat has joined the generative AI model space with its new platform. Learn more here.![](https://news.itsfoss.com/content/images/size/w256h256/2022/08/android-chrome-192x192.png)It's FOSS NewsSourav Rudra![](https://news.itsfoss.com/content/images/2024/09/redhat-generative-ai.png)](https://itsfoss.com/red-hat-gen-ai/) ### Get RHEL AI 1.2 You can grab the latest RHEL AI release from the [official website](https://developers.redhat.com/products/rhel-ai/overview?ref=itsfoss.com), with the [announcement blog](https://www.redhat.com/en/blog/whats-new-red-hat-enterprise-linux-ai-12?ref=itsfoss.com) consisting of all the relevant information on it. Another thing to note is that **support for RHEL AI 1.1 will be deprecated by the second week of November**, and users are advised to upgrade to the 1.2 release to continue receiving support. [RHEL AI 1.2](https://developers.redhat.com/products/rhel-ai/overview?ref=itsfoss.com) ## Introduction Of Granite 3.0 ![](https://itsfoss.com/content/images/2024/10/Granite_Banner.jpg) Image: [IBM](https://newsroom.ibm.com/image/Granite%5Fbanner+%281%29.jpg?ref=itsfoss.com) Next up on the agenda is IBM's newly released family of open source LLMs, [Granite 3.0](https://www.ibm.com/new/ibm-granite-3-0-open-state-of-the-art-enterprise-models?ref=itsfoss.com). Acting as the third iteration for the popular AI model family, Granite 3.0 is touted by IBM to be better than LLMs provided by other organizations on both academic and industrial grounds. Released under the [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0?ref=itsfoss.com) license, **there are a total of ten models under the Granite 3.0 family**, which cover many use cases. For **general purpose or language tasks**, there are models like the Granite 3.0 8B Instruct, Granite 3.0 2B Instruct, Granite 3.0 8B Base, and Granite 3.0 2B Base. For **running models on CPU-based systems or for low latency applications**, there are *Mixture Of Experts* ([MoE](https://huggingface.co/blog/moe?ref=itsfoss.com)) models such as the Granite 3.0 3B-A800M Instruct, Granite 3.0 1B-A400M Instruct, Granite 3.0 3B-A800M Base, and Granite 3.0 1B-A400M Base. And, finally, there are **two guardrail/safety-focused models**, the Granite Guardian 3.0 8B and Granite Guardian 3.0 2B. These are used to detect and prevent harmful content/inputs, and can be deployed alongside any open or proprietary AI models. All of these join an ever-expanding list of [open source LLMs](https://itsfoss.com/open-source-llms/) that can be used freely for both research and commercial use cases. If you are searching for the numbers behind IBM's claims, here are some benchmarks for the *Base* and *Instruct* models shared by them. 👇 ![](https://itsfoss.com/content/images/2024/10/Granite_3.0_Base_Model_Bench.jpg) ![](https://itsfoss.com/content/images/2024/10/Granite_3.0_Instruct_Model_Bench.jpg) Source: [IBM](https://github.com/ibm-granite/granite-3.0-language-models/?ref=itsfoss.com#evaluation-results) According to IBM, **the data used to train these models has been gathered from various curated sources** that include things like unstructured natural language text, code data, a collection of synthetic datasets, and many publicly available datasets with permissive licenses. ### Get Granite 3.0 If you are interested in deploying any one of the Granite 3.0 models, then you can get started by visiting the [Hugging Face](https://huggingface.co/collections/ibm-granite/granite-30-models-66fdb59bbb54785c3512114f?ref=itsfoss.com) collections page for this family of models. Alternatively, you can source the models from the project's [GitHub](https://github.com/ibm-granite/granite-3.0-language-models/?ref=itsfoss.com) repo. If you just want a quick hands-on, then IBM has also provided a live demo of the Granite 3.0 8B Instruct model on the [Granite playground](https://www.ibm.com/granite/playground/?ref=itsfoss.com). [Granite 3.0 (Hugging Face)](https://huggingface.co/collections/ibm-granite/granite-30-models-66fdb59bbb54785c3512114f?ref=itsfoss.com) If you are keen on learning more about the Granite 3.0 family of models, then you can go through the extensive [technical paper](https://github.com/ibm-granite/granite-3.0-language-models/blob/main/paper.pdf?ref=itsfoss.com) and [announcement blog](https://newsroom.ibm.com/2024-10-21-ibm-introduces-granite-3-0-high-performing-ai-models-built-for-business?ref=itsfoss.com). *💬 Looking forward to these new releases? Let me know your thoughts in the comments below!* **Suggested Read** 📖 [14 Top Open Source LLMs For Research and Commercial UseThere are hundreds of open-source LLMs, here, we handpick some of the best ones for you to check out.![](https://itsfoss.com/content/images/size/w256h256/2022/12/android-chrome-192x192.png)It's FOSSAnkush Das![](https://itsfoss.com/content/images/2024/05/open-source-llms.png)](https://itsfoss.com/open-source-llms/)