Return to last watched channel from guide

Is there any way to return to the channel I was watching before I exited to the guide? Sometimes I forget what channel I was on and trying to find the program in the guide is annoying to say the least. If I hit exit on my Harmony remote (mapped to Back), I would expect to exit the guide and return to the show I was watching, but I exit to the Android TV menu instead.