Planetary systems have been found systematically orbiting main sequence stars and red giants. But the detection of planets per se during the white dwarf phase has been more elusive with only 3 systems.  We have, however, ample indirect evidence  of the existence of planetary debris around these systems in the form of material acreted onto the white dwarf, disks and even planetesimals. In this talk, I will review how we can put the pieces together: how we can reconcile what we see in white dwarfs with what we can infer regarding the evolution of planetary systems from the main sequence phase.