short history of probability.
You can read
Introduction to Probability by Grinstead and Snell, a
freely available book on the net for preliminary reading.
Probability and Statistics Some classical problems.
Layman's Guide to Probability Theory A simple
introduction with examples.
Laboratories in Probability and Statistics An interactive
place to do probability and statistics.
A handbook of continuous distributions A good collection.