CUDA 5.0 (not released yet) is going to have recursion and a bunch of other things. But most of these new features are available only on the new kepler 2 device

CUDA 5.0 (not released yet) is going to have recursion and a bunch of other things. But most of these new features are available only on the new kepler 2 devices. As for memories, it becomes natural once you start programming CUDA day in and day out and understand the algorithm well enough :)