i'm increasingly convinced that ken thompson's "reflections on trusting trust" also applies to ai. much like a malicious "seed" compiler can insert backdoors into compiled code, especially later compilers that bootstraps from it, today's ai models will emit content that inevitably end up as future model's training set. by the time a bunch of tensors becomes our overlord (lol), you know the seed of malice is planted no later than 2022

Follow

@terrorjack tbh even now I still don't 100% trust bootstrap self-compilers... (including GHC) Practically I roughly get that if you self-compile twice without issues then you are in good shape, but I can't understand how they can theoretically work without problems in general.

@GZGavinZhao lots of other people share similar concern, that's how gnu mes comes along

Sign in to participate in the conversation
小森林

每个人都有属于自己的一片森林,也许我们从来不曾走过,但它一直在那里,总会在那里。迷失的人迷失了,相逢的人会再相逢。愿这里,成为属于你的小森林。