The manage annotations dialog that is used to create Annotation Definitions automatically saves any changes made. If the dialog is closed then all of the changes are saved even if there was not an intent to save them. Please add a save button or ask the user if they would like to save upon closing.