Changed phone and now my S60 is getting duplicate notifications.

Texts and notifications are now duplicated a few seconds apart. I just paired my new phone to set it up. Am I supposed to delete the old one? I kept the old phone as a backup but its been put away and not turned on at all. Thanks in advance.