The problem with people saying they are useful, is that it is nearly impossible to tell if that is actually true. If someone is mentally unhealthy there are many ways to make them feel better, but not all of those will actually help the underlying issue, they could even make it worse. A lot of people seem to equate happiness and mental health, when it is very possible to be happy and mentally ill at the same time.
This is especially worrisome with AI because it is literally designed to say what it “thinks” it wants you to hear. It has no real training in any of the disciplines a psychologist or therapist needs to be effective. You can’t just apply a cut and paste answer to a patient, you need to understand their personality, their history, and a multitude of other things to be a really effective therapist. The answer to this issue is increasing access to real mental health treatment, not giving snake oil to millions of people.
The problem with people saying they are useful, is that it is nearly impossible to tell if that is actually true. If someone is mentally unhealthy there are many ways to make them feel better, but not all of those will actually help the underlying issue, they could even make it worse. A lot of people seem to equate happiness and mental health, when it is very possible to be happy and mentally ill at the same time.
This is especially worrisome with AI because it is literally designed to say what it “thinks” it wants you to hear. It has no real training in any of the disciplines a psychologist or therapist needs to be effective. You can’t just apply a cut and paste answer to a patient, you need to understand their personality, their history, and a multitude of other things to be a really effective therapist. The answer to this issue is increasing access to real mental health treatment, not giving snake oil to millions of people.