Back to Glossary
Artificial Intelligence
Foundation Model
A foundation model is a large pre-trained AI model that can be adapted to many downstream tasks.
Definition
A foundation model is a large AI model pre-trained on vast amounts of unlabeled data (text, images, audio) that can be fine-tuned or adapted to perform a wide range of downstream tasks. Examples include GPT-4 (text), CLIP (text+image), Whisper (audio), and DALL-E (image generation). Foundation models are called "foundation" because they serve as a base for building specialized applications. Harch Corp provides GPU cloud infrastructure for training and fine-tuning foundation models, with expertise in transformer architectures and distributed training.
Related Keywords
foundation modelpretrained modelai foundation modeltransformer model
Related Terms
Large Language Model (LLM)
An LLM is an AI model trained on massive text data to understand and generate human language.
AI Training
AI training is the process of optimizing model parameters using labeled data and compute resources.
Fine-Tuning
Fine-tuning adapts a pre-trained model to a specific task using domain-specific data.