Well… turns out hardware transcoding works fine with my recordings. But it still does’t work with live TV. I have to set the DVR in Heavy mode to make it work. But if set to none, the transcoder fails with the same error as the other computer had.
weird.