Elvis Costello wrote the song 'The Last Day Of My Youth' on Wednesday and performed it on the Late Show with David Letterman on Thursday.