Maybe this is a stupid question, but is there any downside to harvesting heat from the planet? Would we slow convections by cooling it and then cause some weird

Maybe this is a stupid question, but is there any downside to harvesting heat from the planet? Would we slow convections by cooling it and then cause some weird ass problem?