Do I need to pay for rental car insurance when I rent a car?

I don't own a car, so I don't have car insurance. I have heard that if I pay for my rental with a credit card, it will cover insure the car. Any clarification on this?