Colbert (right) in a 2011 appearance on Late Show with David Letterman Bill Carter has told me for at least two years that Stephen Colbert will replace David Letterman. On Thursday, CBS made it official. As Carter, the author of The War for Late Night as well as The Late Shift, would point out, Colbert