Short answer: Yes, they were pronounced differently; the exact quality of the vowels is not important in this context, what’s important is that long vowels are clearly distinct from short vowels in languages where vowel length is distinctive (like Ancient Greek, as opposed to Modern Greek).