I notice a difference if I enable it, but there is meant to be a priority assigned to loading the current page objects, etc.
So I guess it would depend on your browsing habits, but I simply can't see the point in pre-fetching as the likelihood of visiting all links is very low, not to mention for those on fast broadband not much difference either; again dependant on your browsing habits, to me it is a function looking for a purpose.