Prompt Tuning — AI Glossary

Prompt tuning is a parameter-efficient technique that adapts a large language model to specific tasks by training small learnable vectors called "soft prompts" that are prepended to the input. Unlike full fine-tuning which updates billions of model weights, prompt tuning keeps the entire model frozen and only optimizes these compact vectors — often less than 0.1% of total parameters.