Fruit trees should be pruned back this time of year. The long whips won't be able to support fruit next year. Splintering and breaking branches are very damaging to a tree.
If left untamed, fruit trees will get too tall for even the largest ladder. Leaving fruit on a tree or on the ground to rot invites insects and diseases.
After pruning fruit trees, remember to spray copper oil on the branches to ward off common ailments.