I have worked a bit and created a pull request (Support symmetry when reading vibrations from Orca by jcerezochem · Pull Request #2866 · OpenChemistry/avogadrolibs · GitHub) with a patch. It make changes to avogadro/quantumio/orca.cppin:
case Frequencies: {
Handles the extra line "(“Point group: X”) and extra column with symmetry labels. Should properly handle cases with imag freqs
case VibrationalModes: {
Handles the extra “Point group: X” line, the extra line with sym labels and the fact that normal mode blocks are separated by a blank line