Be sure to only add vendor contacts to the vendor's contact section, and not your organization's contacts section (at the bottom of the page). The bottom section is intended for internal contacts who can act as references for the vendor. See Add Contacts as References for Vendors in Portfolio Financials.