Of course we hate you!

I like to think this is from the Kyoto-arc scene where Saito is about to beat up Sanosuke, and Yahiko warns that Saito is certain to fight dirty. Saito replies, "I'm really hated around here, aren't I?" and Yahiko is only too glad to agree.
 
Added: 7/23/02 From: Celga
 
Of course we hate you!