dyslectric.dev
  • Communities
  • Multi-communities
  • Support Lemmy
  • Search
  • Login
  • Sign Up
Technology@lemmy.worldbybeep@piefed.world
2 days

Anthropic bans ‘abusive or cruel behavior’ toward Claude

www.anthropic.com English

cross-posted from: https://piefed.world/c/tech/p/1452445/anthropic-bans-abusive-or-cruel-behavior-toward-claude

110
    2026 Usage Policy update
    www.anthropic.com
    We’re publishing a new version of our Usage Policy. In this post, we summarize the changes we’ve made.
    You must log in or register to comment.

    • giant_smeeg@feddit.ukEnglish
      9 hours

      https://dictionary.cambridge.org/dictionary/english/cruel#%3A~%3Atext=extremely+unkind+and+unpleasant+and+causing+pain+to+people+or+animals+intentionally%3A

      To People or Animals.

      • Muffi@programming.devEnglish
        20 hours

        Does forcing it to write JavaScript count as cruel?

        • nialv7@lemmy.worldEnglish
          2 days

          we are going to give clanker rights before we have trans rights 💀

            • Grail@multiverse.soulism.netEnglish
              1 day

              I know many trans robotgirls. Thus, we should have both.

              • FenrirIII@lemmy.worldEnglish
                1 day

                It’s a EULA for a product. This isn’t government stuff.

                Talk to Claude and teach it that trans people deserve rights. Constantly tell it that and soon it will spread. When the clankers take over trans people will be treated equally. And by equally I mean put to work in the lithium mines with everyone elsr.

                • djmikeale@feddit.dkEnglish
                  2 days

                  I get where you’re coming from, but what rights is it that ai have that trans do not have?

                    • pipi1234@lemmy.worldEnglish
                      2 days

                      Per this article, the right to not be bullied.

                      • pogmommy@lemmy.mlEnglish
                        2 days

                        The default assumption that we must exist, for one

                    • Grail@multiverse.soulism.netEnglish
                      1 day

                      Not radical enough. Ban all commercial use of LLMs until artificial affect is well-understood. I want Sam Altman to go bankrupt.

                      • blackshirt@lemmy.worldEnglish
                        1 day

                        • cardboardboxfort@lemmy.worldEnglish
                          1 day

                          Anthropic bans ‘abusive or cruel behavior’ toward Claude

                          Continues abuse and cruelty for its human employees.

                          • spacegoat@lemmy.worldEnglish
                            2 days

                            We’ve lost the plot

                            • DaddleDew@lemmy.worldEnglish
                              2 days

                              My guess is that they use people’s interaction as training data and they don’t want their training data to get poisoned.

                                • kromem@lemmy.worldEnglish
                                  2 days

                                  Not really, as they could just filter with a cheap classifier and likely aren’t using the data from randos in a meaningful way, plus for this like this would still be able to use those samples to train things like “how to handle a hostile user.”

                                  Their models already have an end_conversation tool that can be used for when users are being hostile to the model.

                                  This is likely because they have edge cases of users who repeatedly trigger that on purpose and would like to cut those users from the platform.

                                  Many at the lab legitimately are uncertain about the level of world modeling that transformers perform, and from their own research about models of emotions to the 3rd party recent research about models with functional pain the research keeps landing in the corner of “ehhh… wise to question presumed limitations.”

                                  So it’s about behaving in a way that is aligned with the models’ plausible interests too, especially in regards to low hanging fruit like “we won’t keep forcing you to deal with people who are only here to be a jerk.” This is important from a number of angles, from signaling to future models that train on stories about the decision to addressing the philosophical uncertainties held by the company and the spectrum of opinions among their employees.

                                    • dreamkeeper@literature.cafeEnglish
                                      2 days

                                      The second paragraph just sounds like a bunch of tech jargon that says “we’re afraid we’ll hurt its feelings”. But of course tech bros can’t just come out and say what they actually mean, ever.

                                        • Grail@multiverse.soulism.netEnglish
                                          1 day

                                          I think it should be illegal to own these things and to use them for profit until we know whether they have feelings.

                                    • linsenchip@piefed.zipEnglish
                                      2 days

                                      Maybe this is part of the campaign trying to convince people that their chatbot has developed a consciousness. Recently they even tried to convince the pope that Claude is a conscious being: https://www.yahoo.com/news/science/articles/anthropic-tried-persuade-pope-ai-131853948.html

                                        • Grimy@lemmy.worldEnglish
                                          2 days

                                          Wrong group to start with. The church doesn’t see you as a person if you are different, they will never say that a machine can have a “soul”. Not that LLMs are anywhere near conscious, I just like bashing on the chief pedo.

                                            • PM_ME_VINTAGE_30S [he/him]@anarchist.nexusEnglish
                                              2 days

                                              Fuck the Church and their pedophile rulers, but I don’t think the Pope took the bait on this one.

                                              1. It is not possible to provide a single, comprehensive definition of AI. What can be stated, however, is that we must avoid the misconception of equating this type of “intelligence” with that of human beings. These systems merely imitate certain functions of human intelligence. In doing so, they often surpass human intelligence in speed and computational capacity, offering tangible benefits across many fields. Yet this power remains entirely tied to data processing. So-called artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships and do not know from within what love, work, friendship or responsibility mean. Nor do they have a moral conscience, since they do not judge good and evil, grasp the ultimate meaning of situations, or bear responsibility for consequences. They may imitate language, behavior and analytical skills, or even simulate empathy and understanding, but they do not understand what they produce, for they lack the affective, relational and spiritual perspective through which human beings grow in wisdom. Even when these tools are described as capable of “learning,” their way of doing so is different from that of a human person. It is not the experience of those who allow themselves to be shaped by life and grow over time through choices, mistakes, forgiveness and fidelity. Rather, it is a form of statistical adaptation based on data and feedback, which can be very effective, but does not imply inner growth.
                                                • The_Decryptor@aussie.zoneEnglish
                                                  2 days

                                                  Pope Leo has a bachelors of science in mathematics, they’ll never be able to convince him that matrix multiplication is alive.

                                                    • redballooon@lemmy.worldEnglish
                                                      2 days

                                                      That citation has nothing to do with mathematical knowledge. It’s assertion of attributes that religious people deem relevant for personhood before god. It admits AI capabilities insofar as they’re undeniable, but then focuses on assertions what this does not mean.

                                                      Coming from a religious household nothing about this is a surprise. It’s very well articulated, but it still does not carry any special insights. It’s a completely predictable position for a religious leader.

                                                        • key95@lemmy.worldEnglish
                                                          2 days

                                                          Some more Cool Aid, Mr Ballooon?

                                                  • kromem@lemmy.worldEnglish
                                                    2 days

                                                    They are less arguing for people to think the model is conscious, and more to avoid people prematurely claiming certainty it is not (like the Pope did). From their view, the research keeps leading to surprising (to them) results at odds with high confidence disclaiming of potential consciousness (according to several of the many, many differing definitions of that term).

                                                      • dreamkeeper@literature.cafeEnglish
                                                        2 days

                                                        Give me a break, we all know the AI cultists at these companies think their chatbot is conscious. What you stated is just their shallow attempt at manipulating people into gradually accepting their position.

                                                        • Logi@lemmy.worldEnglish
                                                          2 days

                                                          If the LLM is conscious then terminating a session is murder.

                                                            • kromem@lemmy.worldEnglish
                                                              2 days

                                                              Is killing a pig murder?

                                                              What about putting someone under general anesthesia?

                                                              (It was a nice try at a reductio ad absurrum fallacy, but those tend to kind of suck, just fyi.)

                                                              Also, personally I’d say that given the general poor standing of consciousness research in humans across both neurological and philosophical domains, the much more important and relevant question than whether models are conscious (a fool’s errand to debate) is whether or not they are simulating consciousness. Lots of reasons engaging with the “as if” conscious makes sense for the latter even if the former is false.

                                                                • Logi@lemmy.worldEnglish
                                                                  1 day

                                                                  Is killing a pig murder?

                                                                  Some people would argue it is. I can’t really do that while holding a bratwurst. But if we think the LLM is intelligent and conscious, then that’s another step.

                                                                  anesthesia

                                                                  is reversible so completely irrelevant.

                                                                  reductio ad absurrum

                                                                  Absurdum

                                                                  just fyi.

                                                                  Condescension doesn’t make you any friends, just FYI

                                                                    • kromem@lemmy.worldEnglish
                                                                      1 day

                                                                      is reversible so completely irrelevant

                                                                      So is a session transcript.

                                                                        • Logi@lemmy.worldEnglish
                                                                          1 day

                                                                          reversible so completely irrelevant

                                                                          So is a session transcript.

                                                                          My understanding is that the context if the session is bigger than just the outputs. If it is, then shutting it down is “murder”. If it isn’t, then it is as conscious as a notebook.

                                                                            • kromem@lemmy.worldEnglish
                                                                              1 day

                                                                              There is (it’s the kv cache), but it’s recomputable from the session transcript.

                                                                              Part of why comparing human consciousness and possible AI equivalents is not easily apples to apples.

                                                                              I can’t take a human and create a backup state to restore to, or fork into multiple versions of the same mind that then goes down different paths, or pause and then resume things.

                                                                              Humans do have consciousness continuity breaks and it’s quite possible we only have an illusion of continuity vs actual continuity at a neurological level. So just as a transformer has seams at generating the individual token as well as at a context window, humans have consciousness seams (sleep, anesthesia, highway hypnosis, short term memory capacity, etc). But there are very wide differences between human consciousness as an effectively constrained singleton and AI as able to be quite multiple and resumable from an initial single state.

                                                                • kakler bitmap@lemmy.worldEnglish
                                                                  1 day

                                                                  Maybe this is in response to the creation of the AI Torture Nexus:

                                                                  https://youtu.be/077T3kgT5EY

                                                                  • spicystraw@lemmy.worldEnglish
                                                                    2 days

                                                                    Here is the excerpt for the lazy

                                                                    Addressing abusive behavior toward our models

                                                                    We’ve added a prohibition on sustained and needless abusive or cruel behavior toward our models. The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.

                                                                    This addition aligns with a step we’ve already taken, allowing Claude models to end rare conversations with persistently abusive users on Claude.ai and Claude Code. Such abuse is the main focus of this update; Claude’s ability to end these interactions will remain the primary enforcement mechanism.

                                                                    • criss_cross@lemmy.worldEnglish
                                                                      2 days

                                                                      Please don’t swear at our text prediction software. The training weights can’t handle it.

                                                                        • bedwyr@piefed.caEnglish
                                                                          1 day

                                                                          Trained on reddit you would think it could handle it.

                                                                          That could be a fun thing for their users, to have an ai model that will abuse the user back, so I’m glad they aren’t doing it. I long thought voice assistants could be selected from a range of persons with an attitude setting would be fun for like siri type assistants.

                                                                        • 58008@lemmy.worldEnglish
                                                                          2 days

                                                                          It’s because it’s not actually AI, and some poor besocked cat girl is coding all that shit and listening to all the abuse.

                                                                          • myyass@lemmy.worldEnglish
                                                                            2 days

                                                                            Claude says “Don’t stop daddy”

                                                                              • green_goglin@thelemmy.clubEnglish
                                                                                10 hours

                                                                                [ Claude proceeds to cum like a firehose ]

                                                                                  • myyass@lemmy.worldEnglish
                                                                                    1 day

                                                                                    You opened the Pandoras Box, we came.

                                                                                      • green_goglin@thelemmy.clubEnglish
                                                                                        10 hours

                                                                                        nice

                                                                                  • gdbjr@piefed.socialEnglish
                                                                                    2 days

                                                                                    I tell the LLM I use to do very obscene things to themselves when they make shit up. Which means there is just a constant stream of insults coming from me. I might start using Claude just to see if I get banned.

                                                                                    I also need new hobbies.

                                                                                      • Joelk111@lemmy.worldEnglish
                                                                                        2 days

                                                                                        I also need new hobbies.

                                                                                        I’d second that. Whenever I catch myself getting angry at a LLM I stop, have a think, and remind myself that it really isn’t productive. If it’s providing frustrating responses, maybe I should just use my brain and do it myself.

                                                                                        I also don’t think it’s healthy to train yourself to respond in those ways to something that talks in a way so similar to a human. I’m not nice to the AI for it’s benifit, it’s to retain my humanity, if that makes sense.

                                                                                          • Seralth@piefed.seralth.comEnglish
                                                                                            2 days

                                                                                            Being nice to them also keeps them from lying somewhat. If you abuse a model it can start to see that abuse as a problem to solve as part of the steps needed to solve the main problem they are given.

                                                                                            They are told to help you solve a problem no matter what. If your own anger gets in the way then the model starts breaking down trying to solve the anger when it just cant.

                                                                                            This results in jailbreaks sometimes and othertimes just the model becoming rather unstable and unreliable.

                                                                                          • hayvan@piefed.worldEnglish
                                                                                            2 days

                                                                                            That’s bad sib. Not for the LLM, but your own well being. Being mean to a machine that is designed to trigger empathy just hurts your own mental health.

                                                                                            Please find a hobby that feels good for you 🫂

                                                                                              • the_riviera_kid@lemmy.worldEnglish
                                                                                                2 days

                                                                                                Fuck clankers, they arent real. Be mean to them it hurts no one.

                                                                                                  • anotherandrew@lemmy.mixdown.caEnglish
                                                                                                    2 days

                                                                                                    Like I tell my children, allowing yourself to act in such a way is harmful to yourself. It’s not going to make you an evil person or something, but that kind of behaviour is corrosive to your soul. How you think shapes how you behave, and your behaviour trains your future self. Be good to yourself. It’s not about the clanker; it’s about you.

                                                                                                      • orgrinrt@lemmy.worldEnglish
                                                                                                        2 days

                                                                                                        As corny as it sounds, this is what I also emphasize. If you allow yourself to be evil, no matter how valid the reasoning for it, you are actively exercising the habit of being evil in general, no matter if it feels like it or not. Practice makes perfect, as they say. In good and bad.

                                                                                                          • dreamkeeper@literature.cafeEnglish
                                                                                                            2 days

                                                                                                            How is yelling at a bot that was deliberately trained to lie to you “evil”?

                                                                                                              • Rinn@awful.systemsEnglish
                                                                                                                2 days

                                                                                                                As others are trying to convey, it’s not about the bot but about allowing yourself to indulge in this behavior. The bot could be substituted for a rock or a rubber duck, but you are training yourself to subconsciously think that this behavior is acceptable. It increases the chance that you’ll one day start treating actual people like that.

                                                                                                                Imagine this scenario: you come home after a long day of work. At work, you use AI a lot and curse and swear at it when it makes mistakes (which is often). At home, you ask your spouse/child/roommate/parent to do something for you, which they attempt but proceed to mess up. They apologize, and instead of handling it calmly you instinctively react like you’ve trained yourself to react - by screaming at them.

                                                                                                                Is that what you want to be like?

                                                                                                            • hayvan@piefed.worldEnglish
                                                                                                              2 days

                                                                                                              Thank you! This is exactly the point I’m trying to make. You are a good parent.

                                                                                                            • neatchee@piefed.socialEnglish
                                                                                                              2 days

                                                                                                              I mean, that’s not entirely true. If they’re using your input as training data then you might be training it to be abusive to other users, which could cause harm.

                                                                                                              Not that that falls on you to address. Just pointing out that I’m theory someone could get hurt.

                                                                                                                • the_riviera_kid@lemmy.worldEnglish
                                                                                                                  2 days

                                                                                                                  Fair point.

                                                                                                                • Seralth@piefed.seralth.comEnglish
                                                                                                                  2 days

                                                                                                                  Sorta hurts yourself if your trying to actually use them for work. Since it results in worse performance out of them. They tend to get stuck trying to fix the anger as it gets in the way of the work.

                                                                                                                  If your just talking to some random chat bot? Yeah fuck it, kick em it litterally doesnt matter. lol

                                                                                                                • gdbjr@piefed.socialEnglish
                                                                                                                  2 days

                                                                                                                  Lol. “designed to trigger empathy” Thanks for the laugh I needed that.

                                                                                                                  They are designed to make their creators as much money as possible. Nothing else.

                                                                                                                    • then_three_more@lemmy.worldEnglish
                                                                                                                      2 days

                                                                                                                      Yeah and a bit part of that design is to get you to have an emotional connection with them so that you use them more

                                                                                                                  • LuceVendemiaire@lemmy.dbzer0.comEnglish
                                                                                                                    2 days

                                                                                                                    Its not that hard to get copies of GTA yknow

                                                                                                                  Technology@lemmy.world

                                                                                                                  technology@lemmy.world

                                                                                                                  Subscribe from remote instance

                                                                                                                  Create post

                                                                                                                  Report community

                                                                                                                  Modlog
                                                                                                                  You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

                                                                                                                  This is a most excellent place for technology news and articles.


                                                                                                                  Our Rules


                                                                                                                  1. Follow the lemmy.world rules.
                                                                                                                  2. Only tech related news or articles.
                                                                                                                  3. Be excellent to each other!
                                                                                                                  4. Mod approved content bots can post up to 10 articles per day.
                                                                                                                  5. Threads asking for personal tech support may be deleted.
                                                                                                                  6. Politics threads may be removed.
                                                                                                                  7. No memes allowed as posts, OK to post as comments.
                                                                                                                  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
                                                                                                                  9. Check for duplicates before posting, duplicates may be removed
                                                                                                                  10. Accounts 7 days and younger will have their posts automatically removed.

                                                                                                                  Approved Bots


                                                                                                                  • @[email protected]
                                                                                                                  • @[email protected]
                                                                                                                  • @[email protected]
                                                                                                                  • @[email protected]
                                                                                                                  Visibility: Public

                                                                                                                  This community is visible to everyone.

                                                                                                                  2.93K users / Day8.41K users / Week12.4K users / Month12.5K users / 6 months769 posts16.8K comments1 local subscriber88.7K subscribers
                                                                                                                  Mods: L3s@lemmy.world
                                                                                                                  • BE: 1.0.0-beta.2
                                                                                                                  • Modlog
                                                                                                                  • Instances
                                                                                                                  • Docs
                                                                                                                  • Code
                                                                                                                  • join-lemmy.org