The Weight of Forgotten Words