If you're shooting sports how do you decide whether to use all the available focus points in the camera in C/AF and when would you use a more selective pattern, even using only one point?

I've only been using AF for 3-4 years and not really tried much action. I previously used MF cameras and pre-focused before tracking the subject and firing the shutter when the subject hit the spot so to speak. I still have a tendency to try to pan using only 'Single Point Center in C/AF.

As far as AF cameras go I was using an E-1 which only had 3 points anyway and Single Center seemed the best option IMO, now I'm using an E-3 and have 11 points to choose from. I can select to use all 11 points, A single point priority but which also uses the 4 surrounding points if needed (I can decide which point is used initially, or Single Point only (again I can choose what point I want to use)

I guess what I want to know is, in general when is it best to use the maximum amount of points and when to use the minimum.

Thanks in Advance, Richard