Selecting statistical tests made easy

Why are there so many tests? If you need to conduct statistical testing for your thesis or your first paper you might be overwhelmed by the large quantity of statistical tests. Why are so many available? How do I choose and how can I be sure to have selected the...