Isn't the data structure that supports quaternions just one dimension up from matrices? Why not continue using matrices and retain that last dimension seperate

Isn't the data structure that supports quaternions just one dimension up from matrices? Why not continue using matrices and retain that last dimension seperately somehow? Then it doesn't require having to retool the GPU/matrix side of it. IE you will have multiple matrices where you would have had one otherwise.