email address book -unwanted additions

My xfinity email address book automatically adds anyone that I send an email to.  I do not want this.  I only want contacts that I specifically add to the address book.  How do I stop this automatic addition?