Why is prostitution illegal?

If prostitution is legalized, then rape would go down, because sex-deprived men would not go out of their way to commit a crime and just pay for the sex instead.