6.1 An Introduction to Statistical Learning

So we realize actually–as often is the case, you can get some of the signal pretty quickly. But getting down to a very good error rate, in this case, trying to classify some of the harder to classify things is difficult. 7.2 Foundations of statistical natural language processing (by Christopher D. Manning & Hinrich schutze)

Zipf’s law: Human behavior and the principle of least effort. Principle of least effort: people will act so as to minimize their probable average rate of work (i.e. not only to minimize the work that they would have to do immediately, but taking due consideration of future work that might result from doing work poorly in the short term.)

Chomsky’s dictum: “Probability theory is inappropriate for formalizing the notion of grammaticality.”