Once you have added a mod to a game, it becomes part of the structure of the saved game. If you try to remove the mod the game will crash when you try to start the game, it will be looking for non-existent resources. This is how the game works.
NB: This does not apply to purely graphical texture mods such as the winter snow (Frosty November) type mods that can be added and removed at any time.