The exclamation mark means you have missing meshes (the things that live in Morrowind/Data Files/Meshes).
When you remove a plugin from a running game, you need to use the tool
http://wrye.ufrealms.net/Wrye Mash.html. See the section of the web page
Adding/Removing Mods From a Save Game and
Repairing a Save Game (<- these are links).
But it sounds like you've made a bit of a mess of your mod installation, so you should double-check that all your mods are installed correctly.
When you've tried all that, and if you are still getting errors, you should post your list of mods (either the list of [Game Files] from the end of your Morrowind.ini or use Wrye Mash to
Copy List from your last save) and the contents of the Warnings.txt from your Morrowind directory. Maybe someone will recognize the error and be able to help.