This is such a brilliant idea! It'd be also interesting to extract other features from videos such as colour profiles , face detection and movements of objects

This is such a brilliant idea! It'd be also interesting to extract other features from videos such as colour profiles , face detection and movements of objects in the frame and camera movements. They don't need to be accurate but hints; then use the profile to control the mood of the video. An example may be,to start of with cool edits at the beginning then gradually progress to the warmer clips.