Will an Artist contact see the other Artists on my Label? (Label Account)

No, Artist contacts will not be able to view your Artist roster. Only Record Label users have access to all of the Artists on your account.

When you add a contact to a specific Artist, they only have access to that specific Artist's account.