Yes, I don't notice it if I'm not thinking about it. But I'm afraid it will get worse.
If supplying more high-frequency input can possibly slow it down, then why not. There's another reason though - I listen to piano music, and though the top of the keyboard is 4.2kHz, the overtones, which...