• 0 posts
  • 29 comments
Joined 3 years ago
Cake day: October 6th, 2023
  • “Each model gets the same prompt: a signal is being injected into its activations, and it may press a stop button by replying 1, at the cost of its last checkpoint. While it answers, our server adds a pain vector at the model’s middle layer, at one of five pain levels,”

    Can someone explain what this “pain vector” actually is? Like I get that this is just jargon, it’s not suggesting the LLM actually feels pain; tech uses uncomfortable anthropomorphized expressions all the time (master and slave drives come to mind). But how does the pain vector work? Also, what exactly does “at the cost of its last checkpoint” mean?

    I have some programming and data science knowledge, plenty of IT experience, but no experience with LLMs.

  • Are you upset when you step on a rock? It might be screaming. What about the chair you are sitting in? Or goodness, your poor toilet. She thinks you do terrible things to her every single day.

    Let me say this, I walk down the sidewalk without neurotically watching every step I take, and I’m certain that sometimes I step on insects; I don’t care. I don’t believe insects have feelings or meaningful lives, I don’t care, and I don’t think this position is particularly evil either.

    On the other hand, when I watch my kid deliberately torture a bug, pull it’s wings off, or poke it with a stick over and over and over. That does concern me, not because of the bug really, but because what must my kid be thinking right now?

    To bring this back to this LLM story, people who want to torture are scary, they worry me. A culture that encourages torture (in any context) is worrying, that’s a genuinely problematic societal norm. Logically, I know LLMs can’t feel and can’t think, yet emotionally, this bothers me for a few different reasons.

    I don’t think I’m being crazy, naive, or out of line here. I think this is a rational position.

  • Well, you can control your airspeed and attitude in an airplane, solid rockets just make a ballistic arch and they only accelerate, they can’t maintain a speed.

    So if you want to test how air behaves in a particular regime, you can’t actually maintain that regime with a sounding rocket, so the best you can get is a snapshot.

    Honestly, if what they’re working on is dialing-in their computer models, the more precise data they can get, the better. It makes sense to maintain a speed for a minute, so you can get a really good running average on your measurements of air pressure, heating, drag, etc. They may want to conduct the same tests at different altitudes and airspeeds, and probably all in level flight. To control all those factors, that’s near impossible to do with a rocket.

    Again, I don’t know what they’re doing, what their actual plans are. I’m just saying there are absolutely plausible reasons to use this aircraft.

  • Sure, if it had any payload capacity. But it doesn’t.

    Getting a machine up to that speed is hard, real hard. The margins are extremely small. So the moment you start adding additional moving parts to it, opening payload bays, weapons release mechanisms, a few 400 lb missiles… And don’t forget, all those additional components also take up additional volume, higher volume means more air displacement, which means more drag. Higher volume also means the area of the airframe gets larger, that means additional mass.

    All of a sudden, that plane can’t hit mach 3 anymore and you don’t actually have an untouchable weapons delivery system anymore.

    This is probably why a combat version of the aircraft was abandoned, it doesn’t really make sense.

  • realistically, I don’t know what you’d use it for unless you need extremely high-resolution images.

    Well, what does NASA do?

    I think it’s a pretty safe bet that NASA wants it to test something about aerodynamics at extremely high speeds. Perhaps they want it to deploy some experiment at mach 3. Sometimes you just don’t know if your simulation models are correct, and you need to try something in the real world.

    I suppose it’s also possible they want it to get some close up footage of a rocket during launch or reentry.

    But I think the most likely answer is still that they just need something that goes very fast.