"Oh, that's true! I probably wouldn't want to stick around..." Not because he would be terribly worried about his own injury and/or death, but... because Ryoji really doesn't like fighting. Comes from being an unwilling participant in the end of the world? (Or it's just Ryoji being weird.) "And I can take someone with me, so I could get anyone else in danger out too."