Recently I was quite surprised how good inversion from the OpenAI ada-002 embeddings can be: twitter.com/thesephist/status/169809573…

Thanks for sharing Simon! I will note that by training an adapter layer between this autoencoder's embedding space and OpenAI's, it's possible to recover a significant amount of detail from text-embedding-ada-002's embeddings with this model too[0]. But as the paper author's reply in a different thread points out, their iterative refinement approach is able to recover much more detail in their research with a smaller model. [0] twitter.com/thesephist/status/169809573…