On the latest TestFlight, when I use the remote shortcuts (color buttons) to toggle captions, Picture in Picture is also toggled on at the same time.
Which one is your setting set to?
Please reproduce this and the. submit diagnostics from the app.
It is set to captions. Submitted the diagnostics.