The Central Node of ChatGPT's Signifying Network? The Phallus!
I wish I knew more about LLMS and the like to really understand this. Maybe people who do can tell me if this is as meaningful or exciting as it seems?
'By creating a custom embedding at the token centroid (the mean vector of all 50,257 GPT-J token embeddings), prompting the model to define it and considering logits, it's possible to construct a "definition tree" which consists overwhelmingly of vague generalities. This is hardly surprising, as GPT-J is basically being challenged to define "the average thing". However, the most probable branch in the tree which gives a definition containing anything specific defines the "ghost token" at the centroid as "a man's penis". '
Looks like Lacan was onto something with his late-in-life interest in cybernetics!