How do you get rid of oily skin?

I am having a problem with oily skin. I have tried some beauty products to reduce it, but I have REALLY sensitive skin and some creams just cause me to break out and create rashes. Anyone have any suggestions?