Just like those wuxia movies where the hero quietly sips his wine despite the commotion or fight going on. Until they invaded his private space then he'll strike....
By continuing to eat slowly and low key, he didn't trigger them. All their attention went to the young guy who made big fuss and got robbed instead. Or they were already targeting the young guy. If he stops eating, he warrants attention.