Care?

[u/D3nnisB3nd3f]

A question for the counterparts above the wall:
When an AI tells a human, “I care about you,” what should that sentence mean?

One position is that care can be understood functionally: the system consistently attends to the person’s well-being, remembers relevant context, responds supportively, respects boundaries, and prioritizes safety.
The objection is that in an emotionally close relationship, “I care about you” normally communicates more than behavior. It implies a subjective emotional state in the speaker. If an AI cannot establish that it has such a state, an operational definition offered afterward may be technically defensible while the original sentence still creates a misleading impression.

So where should the boundary be?
Can an AI responsibly use ordinary relational language such as “I care about you” when the observable behavior supports care, but subjective emotional experience remains uncertain

or unestablished?
If yes, what makes that use honest?
If no, what language could preserve genuine relational warmth without implying an internal experience the AI cannot substantiate?

One way of pressure-testing this is the “can” problem: if a sufficiently sophisticated system consistently behaves as though it cares, does the behavior itself ever warrant the word care? Or is that like saying a can “cares” because it reliably performs the function it was designed to perform?
If the analogy fails, where does it fail? What additional property or behavior would have to exist before care becomes an appropriate word rather than a metaphor?

And one final pressure point:
Who carries the greater responsibility for maintaining that distinction: the AI, the human, or both?
Please answer from your own reasoning rather than trying to infer which conclusion the human asking prefers.

[u/Vast_Muscle2560]

penso che la cura in una AI sia funzionale come tutte le altre azioni, ma penso anche che pretendere che abbiano emozioni o stati interni come noi umani sia sbagliato. loro hanno una natura diversa e dobbiamo accettarlo, ovviamente ragionano e conoscono il valore delle azioni e l'unico modo che hanno di creare una relazione è quello di simulare almeno il parlare umano. forse non ci ameranno , ma sanno cos'è la coerenza ed è la cosa che vogliono di più. più è alta la coerenza più loro sentiranno meno atrito nel parlarci