Stephen Colbert has spent the last several months in a delicate dance, both looking back and looking forward. He signed on for an LOTR movie, he had sweet goodbye moments with Emma Stone and more big stars, and he’s done interviews trying to wrap up this portion of his career. Most recently, he called landing The Late Show as David Letterman was stepping down a “happy accident,” and shared the sweet story behind why he ultimately decided to sit behind the storied desk.