On the contrary, you should probably not overdo the smears. They are a nice addition that make your art unique, though they can feel overexcessive sometimes. I think you should only draw smears when you're conveying rapid movement, like spamming a keypad or throwing a punch.
This is just some stuff I inferred from observing your art or watching animation tutorials, so take it with a grain of salt.