No, it is not super weird to want to do that, it is called a rim job and there are plenty of people who enjoy giving and recieving them and very few will admit it.
I would suggest letting him, if you don't like it just tell him not to do it again and if you do like it, hey, you just found someone new you liked