OED definition:
An organized society of persons performing certain common functions and possessing special rights and privileges; a body of colleagues, a guild, fellowship, association
Examples: college of cardinals, college of physicians
Use of electoral college predates the United States constitution. It’s first use was in the late seventeenth century to describe the body of prince-electors who chose the Holy Roman Emperor.