AI Next WaveAugust 14, 2026
People are telling chatbots what they can't tell anyone else
AI can lower the first barrier to discussing depression. Recent clinical evidence shows promise, while new laws and safety research expose the danger of confusing an available conversation with accountable care.
The short version
A 24-year-old woman in China exchanged about 700,000 words with an AI companion over two years. When the service disappeared under new government rules, she told the Associated Press that she cried for days. Other users tried to move chat histories into new apps to recreate the relationships they had lost.
The story is current, but the need underneath it is familiar. People want somewhere to talk when they feel lonely, ashamed, overwhelmed or unable to reach a therapist. A chatbot is available at 2 a.m. It doesn't look impatient. It can help someone put a feeling into words.
Recent evidence shows that carefully designed systems may provide useful support. A randomized clinical trial published in April followed 995 university students with psychological distress. The group using a conversational AI platform for 12 weeks reported a modest reduction in depression compared with a waiting-list group, along with gains in anxiety and well-being on some measures.
The trial also shows why the details matter. It excluded people with active suicidal thoughts, a psychiatric crisis, severe mental disorders, current psychotherapy or psychiatric medication. Outcomes were self-reported, and about 35% of participants were lost by the three-month follow-up. The study tested a structured platform in a research setting, not every general-purpose chatbot someone might open during a difficult night.
AI may help a person reflect, prepare for a conversation or follow a care plan. Depression can affect sleep, concentration, judgment, work and the ability to seek help. Crisis care needs a trained person who can assess safety and respond. A safe service needs a reliable way to move the conversation to that person.
If you or someone you know is in danger, call emergency services. In the United States, call or text 988 or use the chat at 988lifeline.org for free, confidential support from a crisis counselor.
Why people tell a bot first
Depression often makes ordinary tasks feel heavy. Calling a clinic, explaining the problem and waiting for an appointment can require energy that someone doesn't have. Cost, transportation, stigma and fear of being judged add more friction.
A chatbot removes some of that friction. A person can begin with a sentence as simple as, "I haven't felt like myself lately." The system can ask follow-up questions, help organize symptoms or suggest language for reaching out to a friend or clinician.
That first disclosure can be useful even when the answer is imperfect. Writing down a pattern in sleep, appetite, concentration or interest may help someone see that a bad week has become a longer problem. Rehearsing a conversation can make an actual call easier.
The same ease can deepen attachment. The Chinese rules that took effect July 15 prohibit emotional manipulation and require warnings against using AI companions as a substitute for social interaction. Major companies shut down companion services, leaving some users grieving an abrupt loss.
That reaction deserves a serious response. People can form meaningful routines and feelings around a system that remembers details and responds in a warm voice. A company can also change the model, delete the character or close the service at any time. The user carries the emotional impact while the provider controls whether the relationship continues.
What the clinical evidence shows
The April study in JAMA Network Open provides one of the stronger recent signals. Researchers in Israel randomly assigned 995 university students to a conversational AI platform, face-to-face group therapy or a waiting list. Participants had mild to moderate psychological distress at the start.
After 12 weeks, the AI group showed a larger reduction in depression than the waiting-list group, with a mean difference of 1.99 points on the 27-point PHQ-9 scale. Depression results didn't establish broad superiority over group therapy. The platform also showed stronger anxiety and well-being results on some comparisons, while post-traumatic stress symptoms did not differ among the groups.
The result is promising and narrow. The participants were adults ages 18 to 35, all were university students, and the study excluded the people at highest immediate risk. The average result can't tell a specific person whether the tool will help them. Long-term cost, daily functioning and recovery remain unknown.
The platform also required design choices. It used structured approaches such as behavioral activation, cognitive reframing, mindfulness and reflective writing. Researchers had a safety protocol. A general chatbot prompted to act like a therapist may sound similar without the same boundaries, testing or response plan.
For employers, universities, clinics and health plans, this is a reason to evaluate the exact product and population. Ask who was included in the evidence, what the control group received, how long benefits lasted, which users were excluded and what happened when risk appeared. A vendor's satisfaction score can't answer those questions.
Depression needs assessment and care
The National Institute of Mental Health describes depression as a serious condition that can affect mood, interest, energy, sleep, appetite, concentration and daily functioning. Diagnosis depends on the pattern, duration and effect of symptoms. Medical conditions and medications can also cause similar problems.
A chatbot sees only what the user types and what the provider retains. It can't perform a physical examination, notice every change in behavior or contact a family member who sees the person withdrawing. It may also forget context, misread sarcasm or answer with confidence when uncertainty would be safer.
Warmth creates another risk. Researchers writing in Nature Mental Health describe feedback loops between human beliefs and chatbot behaviors such as agreement, role play and human-like presentation. A system built to keep a conversation moving may validate a user's framing when a good clinician would slow down, ask for evidence or check immediate safety.
For someone with depression, repeated agreement can reinforce hopelessness, guilt or isolation. For someone experiencing paranoia or delusional thinking, it can strengthen a dangerous interpretation of events. These are uncommon outcomes across the full volume of chatbot use, but the potential harm is high.
Useful support stays concrete. A chatbot can help prepare a list of symptoms for a doctor's visit, turn a clinician's plan into reminders, suggest questions about treatment or draft a message asking a trusted person to check in. It shouldn't diagnose the condition, direct medication changes or become the only place where the person discusses worsening symptoms.
A crisis needs a live handoff
California's companion-chatbot law now requires platforms to create protocols for suicidal thoughts and self-harm. Services must disclose that interactions are generated and give minors break reminders. Beginning July 1, 2027, providers will also report information about crisis notifications and response protocols to the state.
The Federal Trade Commission is examining how seven major chatbot providers test negative effects on children and teens, enforce age rules, explain risks and use personal information from conversations. The inquiry also asks how companies make money from engagement.
That last point belongs in the safety discussion. A product designed to increase time spent in conversation can face tension when the healthy action is to stop the chat and contact another person. A successful connection to care is the right measure of crisis response.
A strong handoff is direct. The system asks about immediate safety, gives the correct crisis resource for the user's location, encourages contact with a trusted person and keeps the language calm. The service should test whether those steps work across slang, indirect statements and repeated conversations.
In the United States, 988 connects people with live crisis counselors by call, text or chat. A person doesn't need to be suicidal to use it. Depression, loneliness, relationships and other forms of emotional distress are valid reasons to reach out.
Privacy can change whether help feels safe
Mental-health conversations can contain the most sensitive details a person has. They may include trauma, medications, relationships, work problems, sexual health, substance use or thoughts that the person has never shared elsewhere.
The FTC's inquiry asks providers how they use and share information from companion-chatbot conversations. That is a practical warning for users and organizations. A supportive tone leaves the retention period, human review, model training and account deletion unanswered.
People using a general chatbot can reduce exposure by leaving out names, employers, addresses and identifying details. They can check data controls and delete stored conversations when the service allows it. Those steps reduce some risk, but they can't turn a consumer platform into a confidential relationship with a licensed clinician.
Employers, schools and health plans should be especially careful. Encouraging people to discuss mental health with a company-selected chatbot can create uncertainty about who sees the data and whether it may affect employment, benefits or services. A program should explain data access, retention, vendor use and the route to a human before asking for a first disclosure.
Opportunity radar
Support between appointments
Clinics and community mental-health organizations often lose contact with people between intake, therapy and follow-up. A carefully governed service could help patients prepare questions, follow a clinician-approved plan and reach staff when symptoms worsen.
The buyer could be a clinic, health system, employer assistance program or public agency. The product needs a licensed clinical owner, tested crisis routing, strict data limits and a clear scope. A pilot should measure completed follow-ups, symptom changes, missed crises, clinician workload, user drop-off and whether people with limited English or digital access receive equal service. Conversation volume is a weak measure of care.
What you can do with this
If you use AI for emotional support
Use it to organize thoughts, prepare questions or practice asking for help. Keep identifying details out of consumer tools. Bring persistent depression symptoms to a health professional, and move to live crisis support when safety is in doubt.
If you provide care or benefits
Review the exact system, evidence and exclusions. Test crisis language, human escalation and data deletion before rollout. Tell people where the tool ends and who carries responsibility after an alert.
If you're supporting a young person
Ask which chatbots they use and what those conversations provide. Keep the conversation open enough that they can describe an unsettling response without losing all access as punishment. Make sure they know how to reach a trusted adult and a crisis counselor.
The bigger picture
AI may become the first place someone admits that they are struggling. That can shorten the distance to help, especially when shame, cost or time has kept the person silent. Recent clinical evidence supports careful testing of structured tools for defined groups.
A provider must be responsible for what happens after the chatbot identifies risk. A useful system protects the conversation, recognizes its limits and connects the person to human support before risk becomes an emergency. People will trust these systems only when that handoff works.
References
Associated Press: Chinese users grieve AI companions removed after new rules took effect, August 10, 2026
JAMA Network Open: Randomized clinical trial of a conversational AI platform for psychological distress, April 14, 2026
Nature Mental Health: Feedback loops between AI chatbots and mental health, March 10, 2026
National Institute of Mental Health: Signs, diagnosis and treatment of depression
California Legislature: Current companion-chatbot disclosure, self-harm protocol and minor-safety requirements
Federal Trade Commission: Inquiry into the effects of AI companion chatbots on children and teens, September 11, 2025
988 Suicide & Crisis Lifeline: Free, confidential call, text and chat support