You've probably got some sort of nasty malware infection on your computer, and although IE is more likely than not the root of the problem, removing it won't help solve the issue. You best bet is to simply clean up your computer of any remaining crapware as best as you can (instructions stated below) and stick to a standard alternative browser such as Opera or Firefox, whilst keeping a hoard of anti-malware tools at bay, and making sure that all of them are as up-to-date as possible.
Yes, you can remove IE from your computer, but I don't recommend it. Internet Explorer was the browser designed to be used with all Windows operating systems, and it is incorporated to the OS as such. You can however choose to 'lock down' Internet Explorer with the handy free utility
Enough Is Enough!, which is probably the best way to keep malware from targetting your PC through IE in the future, short of uninstalling IE completely.
Click on
this link and follow the instructions stated.