The Rising Entropy of English in the Attention Economy

no code implementations • 27 Jul 2021 • Charlie Pilgrim, Weisi Guo, Thomas T. Hills

We present evidence that the word entropy of American English has been rising steadily since around 1900, contrary to predictions from existing sociolinguistic theories.

Bias in Zipf's Law Estimators

1 code implementation • 3 Aug 2020 • Charlie Pilgrim, Thomas T Hills

This method is shown to have less bias for data generated from idealised rank-frequency Zipfian distributions.

Applications