re: Sir and Ma'am..... Do you use it?

I was raised to always use sir/and Ma'am,but there are times when it was Ok to relax it a little bit.Like if a conversation turned into joking around,and the respect was already made clear.
Too much formality could put a damper on those types of conversations, but always show the respect up front.