If it's straight and your breathing isn't affected much by it, I wouldn't worry, even if it is fractured in any way there isn't anything to do about it, just let it heal. My nose got broken and isn't straight anymore but I just left it to heal and it's okay, other than being slightly wonky.
Funny thing is the guy that broke my nose did it with all his mates around aswell, they were tooled up with a knife, knuckle duster and other shit so I just stood there and let him punch me about 8 times, a slightly broken nose aside he couldn't even put me to the floor. A long while after I saw him and he wasn't with his friends, I asked him if he'd like to try it again, to which he refused and basically admitted defeat before I had even swung a punch. As much as I would have liked to punch his stupid fucking face in, for once in my life I just let it go, I had him verbally cowering before me and he kisses my arse now.
Plus he must have looked like a major cunt infront of his friends considering he couldn't put a guy half his size to the floor with 8 free punches, I imagine he wanted to avoid the extra embarassment of getting his face smashed in by the same small guy.
Fucking hate these type of people, always tough in groups with their friends and/or weapons behind them.