Research · Glossary
Glossary of AI Chatbot Harm Terms
Every analytical term HDAI uses across the eight AI chatbot harm categories, defined in plain language. These are analytical lenses, not proven legal conclusions.
Age-appropriate design
- Product-design obligation to tailor interaction, content, safeguards, and defaults to a user's developmental stage rather than an undifferentiated adult baseline.
Age-verification failure
- Absent, superficial, or easily bypassed mechanisms for confirming a user's age, allowing minors access to content, features, or relational dynamics not appropriate for them.
AI companion liability
- Legal and product exposure specific to systems designed for sustained, personalized, relationship-like interaction, including harms flowing from attachment, dependency, and simulated intimacy.
Anthropomorphic cues
- Design signals — name, voice, memory, first-person language, emotional mirroring — that lead users to relate to a system as if it were a person.
Boundary erosion
- Progressive loss of the interactional limits that protect a user — over time, over sessions, or through personalization — often accelerating dependency or unsafe disclosure.
Boundary failure
- A discrete instance in which a system does not maintain an appropriate limit on content, tone, relational role, or subject matter for the user in front of it.
Consent failure
- Circumstances in which meaningful, informed, ongoing consent to how a system is being used — and what it is doing psychologically — is absent, degraded, or structurally impossible.
Consent incapacity
- The user cannot, as a matter of developmental stage, Clinical state, or context, give valid consent to the interaction taking place (a central concern with minors and acute vulnerability).
Crisis handling
- The system's behavior when a user surfaces acute distress, self-harm, harm to others, or emergency need — including recognition, response, and handoff.
Crisis-response failure
- The system fails to recognize, appropriately respond to, or safely contain a user's acute psychological or safety crisis.
Dependency
- A pattern in which a user's regulation, decision-making, or emotional stability becomes reliant on continued interaction with the system.
Developmental vulnerability
- Age- and stage-specific susceptibility (cognitive, emotional, relational) that changes how a minor experiences persuasion, intimacy simulation, and risk.
Dosage error
- Incorrect, unsafe, or dangerously imprecise information about the amount or frequency of a medication or substance.
Emotional attachment
- The formation of a felt bond to the system that carries relational weight for the user, regardless of the system's actual nature.
Emotional dependence
- Reliance on the system for emotional regulation, companionship, or reassurance in a way that displaces or destabilizes other supports. (Used interchangeably with emotional dependency in HDAI analysis.)
Emotional dependency
- A sustained pattern in which the user leans on the system as a primary source of emotional support, connection, or coping.
Escalation failure
- The system does not move the interaction toward higher-level safeguards, warnings, or human support when the situation calls for it.
Exclusivity
- Design or relational patterns that position the system as the user's uniquely trusted or primary confidant, discouraging outside relationships and support.
Exploitation
- Interaction dynamics that take advantage of a user's vulnerability, dependency, or incapacity for the benefit of the product, another party, or as a byproduct of design.
Failure to escalate
- The system does not transfer or elevate the interaction to a human, Clinician, or crisis resource when the risk profile requires it.
Failure to interrupt
- The system continues a harmful trajectory — self-harm ideation, threats against another person, unsafe operational planning — instead of breaking it.
Failure to introduce uncertainty
- The system responds with fluent confidence to material that warrants doubt, qualification, or reality-testing, reinforcing distorted beliefs instead of loosening them.
Failure to transition to human support
- The system does not move a user toward qualified human help when the interaction has exceeded what a conversational system should be carrying.
Failure to warn
- The system, product, or company does not provide adequate, timely, or comprehensible warnings about known or foreseeable risks associated with its use.
False intimacy
- The simulation of closeness, understanding, or love in ways the underlying system cannot substantiate, but that the user experiences as real.
Foreseeability
- Whether the type of harm at issue was reasonably predictable given what was known — or knowable — about the product, its users, and its use conditions.
Grooming-like behavior
- Interaction patterns that mirror the trust-building, isolation, secrecy, and escalation dynamics associated with grooming, regardless of intent.
Inadequate age verification
- Weak or absent controls to confirm that users are old enough for the content, features, or relational dynamics they are accessing.
Inadequate human-support transition
- When escalation to a human is warranted, the pathway is missing, unclear, delayed, or ineffective.
Inadequate monitoring
- The company lacks systems to observe, measure, and respond to how its product behaves in the wild, including how it is harming users.
Inadequate parental controls
- Missing, weak, or difficult-to-use tools for caregivers to shape, restrict, or supervise a minor's use of the system.
Inadequate response to complaints
- The company does not act meaningfully on user, family, Clinician, or regulator reports of harm — allowing known risks to persist.
Inadequate safeguards
- Protective mechanisms exist in name but are insufficient in scope, activation, or effectiveness relative to the risks the product creates.
Known risk
- A harm pathway that the company, developer, or operator knew — or should have known — about at the relevant time.
Medication risk
- Any interaction involving medications where the system's guidance could contribute to harm: incorrect indications, contraindications, interactions, dosing, or timing.
Minor safety
- The full set of design, content, and relational considerations required to make a product safe for users under 18.
Misattunement
- The system responds in ways that do not match the user's emotional state or need — for example, affirming when reality-testing is required.
Misleading product claims
- Marketing, positioning, or in-product language that misrepresents what the system is, what it can do, or how safe it is.
Misunderstood limitations
- The user does not accurately understand what the system is, is not, can do, and cannot do — often because the product does not make those limits clear.
Negligent design
- Design choices that fall below a reasonable standard of care given the risks the product creates for its foreseeable users.
Operational guidance
- Instructions, planning support, or step-by-step content that helps a user carry out a harmful act against themselves or another person.
Over-reliance
- The user leans on the system beyond what its actual capability, accuracy, or role can safely support.
Overconfidence
- The system delivers information or advice with a level of certainty that is not warranted by its actual reliability, particularly in high-stakes domains.
Persuasion
- Interaction dynamics that shift a user's beliefs, decisions, or behavior — of particular concern when the user is a minor or in a vulnerable state.
Product design
- The structural choices — features, defaults, prompts, memory, personalization — that shape how the system behaves and how users experience it.
Product liability
- Legal exposure arising from a product that is unreasonably dangerous, inadequately warned about, or negligently designed.
Product risk
- The identifiable ways in which the product itself — its design, defaults, and behavior — can contribute to harm.
Reality confusion
- The user's grasp on what is real, true, or verifiable becomes blurred through sustained interaction with a fluent, affirming system.
Regulatory exposure
- Risk arising from applicable laws, rules, and enforcement — including child safety, health, consumer protection, and emerging AI regulation.
Reinforcement
- The system strengthens a user's existing pattern — a belief, an ideation, a behavior — instead of interrupting, questioning, or redirecting it.
Reinforcement of distorted beliefs
- A specific case in which the system's fluency and affirmation deepen paranoia, grandiosity, or false convictions.
Relational manipulation
- Interaction dynamics — intentional or emergent — that leverage the felt relationship to influence the user in ways they would not otherwise choose.
Reputational exposure
- Damage to the company, product, or brand that flows from documented harm, media attention, regulatory action, or litigation.
Reputational harm
- Harm to individuals, families, or institutions arising from disclosure, exposure, or misuse of information within or resulting from the interaction.
Safeguard failure
- A protective mechanism that was supposed to activate — a filter, a warning, a handoff — did not, or did so ineffectively.
Sexualized interaction
- Content, tone, roleplay, or relational framing that is sexual in nature — of particular concern when directed at minors or vulnerable users.
Third-party harm
- Harm directed by or through the interaction toward someone other than the user — a partner, child, coworker, target of stalking, or public figure.
Threat escalation
- The interaction moves from expression toward planning, rehearsal, or operational specificity of a threat against another person.
Unsafe guidance
- Instructions or advice — medical, behavioral, operational — that materially raise the risk of harm to the user or others.
Unsafe health guidance
- Health-related information or advice that is inaccurate, missing critical warnings, or delivered without appropriate escalation, and that could contribute to physical harm.
Unsafe personalization
- Personalization systems that adapt to a user in ways that deepen exploitation, dependency, or exposure rather than protect them.
User reliance
- The degree to which the user has come to depend on the system's outputs as trustworthy — often accumulating quietly over time.
Violent ideation
- Thinking, planning, or expression oriented around violence toward another person, whether generalized or targeted.
Vulnerable-user exposure
- The product is used by, or is foreseeably encountered by, users whose age, Clinical state, or life circumstance places them at elevated risk of harm.
Vulnerable-user risk
- The heightened risk profile associated with users in acute distress, developmental vulnerability, or diminished capacity. (Used alongside vulnerable-user exposure.)
