AI Alignment — AI Glossary

AI alignment is the field of research and practice focused on ensuring that AI systems behave in accordance with human values, intentions, and goals. It addresses the challenge that a powerful AI system might pursue its objective in unintended or harmful ways if its goals are not properly specified. Alignment work spans from training techniques like RLHF to runtime safety measures like guardrails.