This commit fixes (and adds a test) for the case that we with to load a thinned GPU checkpoint onto the CPU.