Add to Registry button still shows, even after deactivating registry (v. 2.5)

There's an issue with the 2.5 version or lower, where the registry doesn't deactivate properly if you go through the 'Pages' area of the storeadmin. This has been corrected as of version 2.51.

For previous versions, to deactivate the registry for now, access the 'Gift Registry' link in the storeadmin, and select the 'Deactivate' link. (You may have to click 'Activate' and then 'Deactivate' if it's already deactivated.) This will deactivate the gift registry properly.