I have not experienced this type of video stuttering but both my apple tvs (both 2021 4K models) have had diffifculty with my sofabaton remotes that I have been using for well over a year. I have to press remote buttons multiple times to get a response. It is almost like it is losing connectivity or responsiveness to the remote.
This definitely started when I updated to tvOS 17. It is quite annoying