That's what I think too. Even if you're OK telling your best buddy, you have no idea who else he talks to in his circle of friends. He could easily tell someone else in a conversation, "hey, I was over at John house, you should see all the firearms he has".
So, loose lips sink ships, the less people who know what you have and where it's stored, the better. Even my wife doesn't know what's in my collection. My two boys have a better idea, since they go to the range with me. That's it. Some other family members know I own "something", but that's where it ends.
Criminals aren't usually known to the sharpest knives in the drawer, and will attempt to break in and steal stuff, even with alarm systems. This is why I feel video surveillance is way better than alarm systems, so you will have video proof of what happened, not just an alarm going off.