For your specific problem (avoiding the use of libraries that do too much of the work), two sources I found useful: - Data Science from Scratch, by Joel Grus

For your specific problem (avoiding the use of libraries that do too much of the work), two sources I found useful: - Data Science from Scratch, by Joel Grus - The first 5 deeplearning.ai courses (whose exercises relied only on numpy IIRC)