He surrounded you in the toilet with his friends...
Swollen nose is far from worst case scenario. 
So glad you brought this up... first thing I thought of!
Anyways, I've got what they call a "Deviated Septum" which occurred from a potentially broken nose. Many years back I took a soccer ball (football, I guess you might call it
) to the nose, and ever since I could barely breathe out of my left nostril. I didn't really think much of it at the time, just thought it would heal with time and all. Then it became the norm, and I totally forgot about it. Then I stopped being super active, and when I went on an excruciating hike last year, I nearly passed out since I couldn't breathe. I don't have asthma or anything (as far as I know) and I noticed that even though I was breathing regularly, I just wasn't getting enough oxygen it seemed. So I went to a nose doctor (forget what their 'medical name' is) and he said that my septum had deviated somewhere in my past, most likely due to the soccer incident. Basically, it just means that after getting hit, the septum (cartilage in the middle of your nose, what separates your nostrils) was bent off to one side, and healed that way. If your breathing is perfectly normal, and neither nostril feels at all stuffy, then you should be fine. However, since you said you have allergies, you may want to visit a nose doctor nevertheless. My septum was apparently severely bent, but in such a way that you can't really see just by looking at it. I never once saw that my nose was crooked in the years since I took the ball to the face, but after learning that my nose was indeed bent, a long, long, loooong look in the mirror told me "oh, I guess, it MIGHT be considered crooked, if you look at it from this angle... under this lighting... under a magnifying glass..."
Long story short, it might look fine, but may not be underneath. If you can breathe normally though, don't worry too much. As far as what I can do to your nose if the septum is indeed displaced... well, the only option is surgery, where they have to break your nose and realign it... I have yet to go with that option.. still deciding, since being unable to breathe is a bitch. If you catch this problem earlier, I am not sure if there are any preventative measures that they may be able to take to keep your septum straight and your nasal passages clear!
And Logen... I'm thinking you've got the same problem as me. My left nostril feels forever-stuffy because the septum is covering more than half of the nasal passage. Might want to go get it checked and potentially go with the surgery if it is really bothersome.
Hope this helps!
