IBM Granite

2023 text-generating language model

Multimodal
Large language model
Generative pre-trained transformer
Foundation model

LicenseProprietary

Machine learning and data mining
Part of a series on
Paradigms Supervised learning Unsupervised learning Online learning Batch learning Meta-learning Semi-supervised learning Self-supervised learning Reinforcement learning Curriculum learning Rule-based learning Quantum machine learning
Problems Classification Generative modeling Regression Clustering Dimensionality reduction Density estimation Anomaly detection Data cleaning AutoML Association rules Semantic analysis Structured prediction Feature engineering Feature learning Learning to rank Grammar induction Ontology learning Multimodal learning
Supervised learning (classification • regression) Apprenticeship learning Decision trees Ensembles Bagging Boosting Random forest k-NN Linear regression Naive Bayes Artificial neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH CURE Hierarchical k-means Fuzzy Expectation–maximization (EM) DBSCAN OPTICS Mean shift
Dimensionality reduction Factor analysis CCA ICA LDA NMF PCA PGD t-SNE SDL
Structured prediction Graphical models Bayes net Conditional random field Hidden Markov
Anomaly detection RANSAC k-NN Local outlier factor Isolation forest
Artificial neural network Autoencoder Cognitive computing Deep learning DeepDream Feedforward neural network Recurrent neural network LSTM GRU ESN reservoir computing Restricted Boltzmann machine GAN Diffusion model SOM Convolutional neural network U-Net Transformer Vision Mamba Spiking neural network Memtransistor Electrochemical RAM (ECRAM)
Reinforcement learning Q-learning SARSA Temporal difference (TD) Multi-agent Self-play
Learning with humans Active learning Crowdsourcing Human-in-the-loop RLHF
Model diagnostics Coefficient of determination Confusion matrix Learning curve ROC curve
Mathematical foundations Kernel machines Bias–variance tradeoff Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory
Machine-learning venues ECML PKDD NeurIPS ICML ICLR IJCAI ML JMLR
Related articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline of machine learning
v t e

IBM Granite is a series of foundation models created by IBM for use in Watsonx, a cloud-based data and generative AI platform. It was announced on September 7, 2023,^[2]^[3] and an initial paper was published 4 days later.^[4] Granite models are trained on datasets curated from Internet, academic publishings, code datasets, legal and finance documents.^[5]^[1]

Foundation models

A foundation model is an AI model trained on broad data at scale such that it can be adapted to a wide range of downstream tasks.^[6]

As of February 2024, Granite's foundation models include Granite.13b.instruct and Granite.13b.chat. The "13b" in their name comes from 13 billion, the amount of parameters they have as models, lesser than most of the larger models of the time.^[2]

References

^ ^a ^b McDowell, Steve. "IBM's New Granite Foundation Models Enable Safe Enterprise AI". Forbes.
^ ^a ^b Nirmal, Dinesh (September 7, 2023). "Building AI for business: IBM's Granite foundation models". IBM.
^ "IBM debuts Granite series of hardware-efficient language models". September 7, 2023.
^ "Granite Foundation Models" (PDF). IBM. 2023-11-30.
^ Moorhead, Patrick. "A Year In Review Of IBM's Ambitious AI Strategy". Forbes.
^ "Introducing the Center for Research on Foundation Models (CRFM)". Stanford HAI. 18 August 2021.

IBM

History

Products

Hardware

Current	Mainframe IBM Z Power microprocessors Power Systems Storage FlashSystem DS8000 Quantum Q System One Q System Two Eagle Osprey Heron Condor
Former	Blue Gene Cell microprocessors PowerPC Midrange computer Personal Computer Selectric ThinkPad

Other

Business
entities

Current	Apptio Center for The Business of Government Consulting Promontory Kenexa International subsidiaries India Press Red Hat Research
Former	AdStar AIM alliance Kaleida Labs Taligent Ambra Computer Cognos EduQuest Kyndryl Lexmark Merative Microelectronics Product Center Science Research Associates Service Bureau The Weather Company (Weather Underground)

Facilities

Towers
- 1250 René-Lévesque, Montreal, QC
- One Atlantic Center, Atlanta, GA
Software Labs
- Rome Software Lab
- Toronto Software Lab
IBM Buildings
- 330 North Wabash, Chicago, IL
- Honolulu
- Seattle
Facilities
Cambridge Scientific Center
IBM Hursley
Canada Head Office Building
IBM Rochester

Initiatives

Inventions

Terminology

CEOs

Thomas J. Watson (1914–1956)
Thomas Watson Jr. (1956–1971)
T. Vincent Learson (1971–1973)
Frank T. Cary (1973–1981)
John R. Opel (1981–1985)
John Fellows Akers (1985–1993)
Louis V. Gerstner Jr. (1993–2002)
Samuel J. Palmisano (2002–2011)
Ginni Rometty (2012–2020)
Arvind Krishna (since 2020)

Board of
directors

Other

A Boy and His Atom
Big Blue sports teams
- American football
- Rugby union
Common Public License/IBM Public License
Deep Blue
Deep Thought
Dynamic infrastructure
GlobalFoundries
GUIDE International
IBM and the Holocaust
International chess tournament
Lucifer cipher
Mathematica
IBM Plex
SHARE computing
ScicomP
Unions

Category
Commons
Navigational boxes
- FOSS
- Midrange computers
- Operating systems
- Personal computers
- System/360
- System/370
- Typewriters
- Vacuum tube computers

Differentiable computing

General

Concepts

Gradient descent
- SGD
Clustering
Regression
- Overfitting
Hallucination
Adversary
Attention
Convolution
Loss functions
Backpropagation
Batchnorm
Activation
- Softmax
- Sigmoid
- Rectifier
Regularization
Datasets
- Augmentation
Diffusion
Autoregression

Applications

Hardware

Software libraries

TensorFlow
PyTorch
Keras
Theano
JAX
Flux.jl
MindSpore

Implementations

Audio–visual	AlexNet WaveNet Human image synthesis HWR OCR Speech synthesis Speech recognition Facial recognition AlphaFold Text-to-image models DALL-E Midjourney Stable Diffusion Text-to-video models Sora VideoPoet Whisper
Verbal	Word2vec Seq2seq BERT Gemini LaMDA Bard NMT Project Debater IBM Watson IBM Watsonx Granite GPT-1 GPT-2 GPT-3 GPT-4 ChatGPT GPT-J Chinchilla AI PaLM BLOOM LLaMA PanGu-Σ
Decisional	AlphaGo AlphaZero Q-learning SARSA OpenAI Five Self-driving car MuZero Action selection Auto-GPT Robot control