Shaping Vectors

Discipline and Control in Word Embeddings

Authors

DOI:

https://doi.org/10.7146/aprja.v13i1.151234

Keywords:

Word embeddings, Digital encoding, Societies of control, Large Language Models

Abstract

This article investigates how the word embeddings at the heart of large language models are shaped into acceptable meanings. We show how such shaping follows two educational logics. The use of benchmarks to discover the capabilities of large language models exhibit similar features to Foucault’s disciplining school enclosures, while the process of reinforcement learning is framed as a modulation made explicit in Deleuze’s control societies. The consequences of this shaping into acceptable meaning is argued to result in semantic subspaces. These semantic subspaces are presented as the restricted lexical possibilities of human-machine dialogic interaction, and their consequences are discussed.

Author Biography

Pierre Depaz, Paris-3 Sorbonne Nouvelle

Pierre Depaz is a Lecturer of Interactive Media at NYU Berlin and Sciences Po Paris. After completing a doctoral research on the aesthetics of code at Paris-3 Sorbonne-Nouvelle, under the direction of Alexandre Gefen and Nick Montfort, he now researches how software systems create representational frameworks for inter- and intra-personal organization.

Downloads

Published

2024-11-19