See the section "On Pitch Estimation" which addresses exactly that: --- Pitch detection (also called fundamental frequency estimation) is not an exact science.

See the section "On Pitch Estimation" which addresses exactly that: --- Pitch detection (also called fundamental frequency estimation) is not an exact science. What your brain perceives as pitch is a function of lots of different variables, from the physical materials that generate the sounds to your body's physiological structure. One would presume that you can simply transform a signal to its frequency domain representation, and look at the peak frequencies. This would work for a sine wave, but as soon as you introduce any kind of timbre (e.g., when you sing, or play a note on a guitar), the spectrum is flooded with overtones and harmonic partials. --- All this said, you don't need deep learning for decent pitch detection -- it's a solved problem, and there are lots of well-known algorithms for it. Deep learning is useful for more advanced music info retrieval such as interval and chord recognition, which was one of my goals with this experiment.