The TEE mentioned in this article is essentially hardware level identity/encryption similar to the boot chain of a phone or game console, so if you trust nvidia then it sounds like it would work. If you trust nvidia. And all of the other implementation details.
But basic logic says if the data (your prompt) gets processed by anything then it needs to be able to read it.
There is actually Homomorphic encryption where you can operate on encrypted data, but I don’t imagine it’s used much in machine learning since it takes 100-10,000x longer than the plaintext operation.
The TEE mentioned in this article is essentially hardware level identity/encryption similar to the boot chain of a phone or game console, so if you trust nvidia then it sounds like it would work. If you trust nvidia. And all of the other implementation details.
There is actually Homomorphic encryption where you can operate on encrypted data, but I don’t imagine it’s used much in machine learning since it takes 100-10,000x longer than the plaintext operation.