Try restarting the computer in safe mode and then removing them...
to restart in safe mode turn the computer off, then turn it back on and start tapping F8 as soon as it's come on, when you get the boot menu select safe mode and press enter, if you see the windows starting logo you've missed getting the boot menu. (don't worry about everything looking huge in safe mode, that's normal)
http://www.pchell.com/support/safemode.shtml
Once in safe mode try removing the ovi stuff again.