Back Up Next

Shannon Game Simulation

Goal: Refine the estimated entropy of English (0.6 to 1.3 bpc)

Use neural network predictor to play Shannon game

Input size Hmin H Hmax Interpolation constant
10K 2.013 3.028 3.131 0.907
100K 1.600 2.375 2.670 0.724
731K 1.416 2.061 2.448 0.625

Suggests entropy of English is < 1.0-1.1 bpc.

See also Refining the Estimate of the Entropy of English by Shannon Game Simulation (unpublished).