Probably just freaks them out.

[ People tend to fear what's different. At least, that's the only reason he can think of. ]

They might have had a history with magic-users, but no one's brought up anything like that yet.

[ Not that he's asked either, which is probably something he should stop slacking off on. Intel gathering just hadn't been his forte in the past. ]

Just keep a low profile for now.