http://20bits.com/article/statistical-analysis-and-ab-testing
A good introduction to the statistics math of split testing.
http://abtester.com/calculator/
Includes the math behind the calculation, and sample PHP code to actually generate the numbers. Very cool.
http://blog.asmartbear.com/easy-statistics-for-adwords-ab-testing-and-hamsters.html
Simple formula to calculate statistical significance at 95% on AB / split tests. N = total clicks, D = diff between win & lose, if D² > N, it's statistically significant. Example, 14 clicks A, 22 clicks B, N=36, D=22-14=8, 8²=64>36, win. If 2D²>N, 99%.
http://lognormal.com/blog/2012/08/13/analysing-performance-data/
Mirror of the same bluesmoon / lognormal blog post on analysing performance data.
http://newrelic.com/
A system to monitor multiple aspects of a live application in production including the page load times, server load times, mysql response times, javascript render times, and so on. Expensive.
http://onlinestatbook.com/2/index.html
Useful online book on statistics. A work in progress, but looks very valuable.
http://www.guypo.com/business/17-statistics-to-sell-web-performance-optimization/
Really handy post with links to sources of web performance optimisation statistics.
http://www.quantcast.com/p-18-mFEk4J448M/traffic/sites
QuantCast stats on the WordPress.com hosted network
http://www.speedawarenessmonth.com/analyzing-performance-data/
Blog post from bluesmoon / lognormal on how to analyse performance data. Includes some great points on geometric means and geometric standard deviation which better apply to lognormal distributions than arithmetic means / standard deviations. Very useful.
