I am sure he just wanted to scare you. Brothers can be like that. I have 3 brothers before me and when we were growing up, they'd give me hell all day since I was my dad's favourite. lol. But we are very close since our childhood - since we grew up.
Anyway, I am sure everyone has some kind of fear or fears even but yours seemed more like a phobia. Perhaps only my interpretation of your original post.
I find clowns quite creepy. Not sure why people think they are funny.