It definitely changes a few things, but he'll try to make that less obvious.

"That you're kind of clumsy and you won't stick up for yourself? I barely know you, Miss Haruhi. I'm sure the way I feel about you will change at least a little, given time." Now the smile he shoots her is more charming than derisive.