(Work in process by John Kraus, 4/25/25)
Here are some snippets of evidence regarding how well LLMs perform in making judgements under uncertainty.
The mean IQ of the population of eighth graders in a city is known to be 100. You have selected a random sample of 50 children for a study of educational achievements. The first child tested has an IQ of 150. What do you expect the mean IQ to be for the whole sample? [^1]