You have never made a mistake at your job? And I bet when you did, you didn't have 1000's of people yelling at you about it. How much harder would your job be if everything you did was being watched and criticized by 1000's of people?
As Strike3 said, anyone who becomes an official is not a coward, its the people in the stands who go crazy because they know there is no consequence for what they do.