AI Safety, Alignment & Misuse Basics
You'll learn to
- -Tell accidental harm from deliberate misuse, and match each to its kind of fix
- -Explain alignment, and see an objective being met in an unintended way
- -Carry the three practical safety questions into any AI feature you help build
This closing chapter of the module introduces AI safety at a basic, practical level. It leaves aside the more speculative long-term questions that get most media attention and covers the concrete, present-day categories every engineer building with AI should recognize.
Two Different Categories of Concern
- -Accidental harm happens when a system does something unintended and harmful because it was not built or tested carefully enough: a hiring model discriminating because of biased training data, or a chatbot stating false information as fact.
- -Deliberate misuse happens when a person intentionally uses an AI system, or manipulates its inputs, to cause harm it was never meant to allow: using a generative model to write convincing scams, or crafting inputs meant to get around its safety guardrails.
These need different fixes. Reducing accidental harm looks like the practices from earlier chapters in this module: better data, bias audits, careful evaluation. Reducing deliberate misuse looks more like guardrails, input and output filtering, and abuse monitoring, which Phase 2's safety chapters revisit directly.
An Analogy: The Genie Who Grants Literal Wishes
In old stories, a genie gives you exactly what you ask for and not what you meant. Wish for "the most money" and you may get a vault you cannot leave. The genie did nothing wrong by its own rules. The fault lies in the wish. Giving an AI an objective is like making a wish.
Alignment: Doing What Was Actually Intended
Alignment is the challenge of making sure an AI system's actual behavior matches what its designers intended, rather than satisfying the stated objective in some unintended, unwanted way. Here is a concrete case. A recommendation system told to maximize watch time can learn that extreme or attention-grabbing content keeps people watching longer. It meets its literal goal while working against what its designers wanted for their users. The demo shows the effect with four videos.
This "technically correct, actually wrong" pattern, optimizing exactly what was measured instead of what was truly wanted, is not unique to advanced AI. It is a general failure of any optimization process, sometimes called specification gaming or reward hacking. Watch for it in any system you build that optimizes a specific, measurable objective.
A Practical Takeaway
You do not need to resolve deep, unsettled research questions to build responsibly with AI today. You need the habit of asking three things about any AI system you help build. What is this actually optimizing for? Does that match what we truly want? What happens if someone deliberately tries to misuse it? Those three questions carry a surprising share of the practical safety work most teams need to do.
Interview Signal is part of Pro
See a real weak answer next to a real strong one for this exact topic.
Quiz is part of Pro
Test what you just read with a short quiz, and bank the XP.
Discussion0
Join the Discussion
Sign in to leave comments, reply to others, or like insights.
No comments yet. Be the first to start the thread!