3 ms·
in the notebook there is a passage where it goes trough the exam dataset and use an embedding model to compare answer. I don't think that's the accepted methodo
by avereveard 3y ago
in the notebook there is a passage where it goes trough the exam dataset and use an embedding model to compare answer. I don't think that's the accepted methodology (I think they ought to compare the logist weight on the answers keys), on top of that, the embedding model they use for similarity is somewhat weak.
also passing in their own graph means 61% right or something like that.