The singer-actress will be making an appearance on this week’s episode of the talk show hosted by Drew Barrymore