You are *definitely* not alone. In one of the first focus tests for webcams before they are prevalent today, the housewives felt compelled to cover the webcam instinctively when it’s not in use. That is why early webcams usually have a physical shutter to block it.
These days, people seem to care less, or rather be careless. Samsung’s SmartTVs have been hacked. One of the advices is to cover up the webcam (if your SKU has it). But there’s still the mic.
Neogaf is a core gamers forum. You need to have a strong heart, mind and soul to visit there, or your head may explode. But there are good people there. I visit it sometimes because some of them are very very funny. ^_^
I should also say I get some of my game shopping advices from there and here.
EDIT: Even for PSEye, I unplug it when not in use. One of my PS3s is in the office.
What they have said is that you will be allowed to turn off the camera.