Exactly, I also struggle to take seriously the "security" concerns of an organisation that releases this product with plugins and no proper way to restrict them and what they can do. The prompt injections are just ridiculous and show a complete lack of thought going into the design [0]. "move fast and break things" It very much feels like they are trying to build a legislative moat, blocking out competitors and even open source projects. Ridiculous. I don't fear what this technology does to us, I fear what we do to each other because of it. This is just the start. 0: twitter.com/wunderwuzzi23/status/165941… > Let ChatGPT visit a website and have your email stolen. > Plugins, Prompt Injection and Cross Plug-in Request Forgery.

I think the author just removed the prompt injection code before the other person tried it: twitter.com/wunderwuzzi23/status/165945…

AI Alignment is a real issue, but there are more pressing issues, like AI taking leading to mass unemployment and uneven power distribution. Existential AI is not a near-term issue, and the biggest "evil AI" issue right now is spam. Moreover, AI alignment falls into the more general category of AI understanding and AI constraints. Topics like "AI Injection Attacks" are somewhat relevant to alignment; preventing an AI from revealing a secret code or exfiltrating emails (twitter.com/wunderwuzzi23/status/165941…) are relevant to prevent it from swearing or trying to hurt people. Constraining AI responses so they can be trusted and used by other algorithms is very important, see GPT's "system prompt", Microsoft Guidance (github.com/microsoft/guidance) and other tools and discussions. But you probably won't hear much about AI alignment itself, except from people who think its unnecessary.