[Outage][Resolved]: Gracenote guide data is currently unavailable

Older items fine, but looking at the web schedule show the issue I’m seeing.

I'm seeing that too.
But only on one of my servers. The other one displays the image.

Scheduled jobs
BROKEN IMAGE

  {
    "ID": "1692755880-9",
    "Name": "Primal Survivor: Extreme African Safari",
    "Time": 1692755880,
    "Duration": 3900,
    "Channels": [
      "6070"
    ],
    "Channel": "",
    "DeviceID": "",
    "RuleID": "9",
    "Serial": 1692394532,
    "FileID": "",
    "Skipped": false,
    "Failed": false,
    "Dead": false,
    "Error": "",
    "Airing": {
      "Source": "tms",
      "Channel": "6070",
      "OriginalDate": "2023-08-22",
      "Time": 1692756000,
      "Duration": 3600,
      "Title": "Primal Survivor: Extreme African Safari",
      "EpisodeTitle": "Untamed Coast",
      "Summary": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
      "FullSummary": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
      "Image": "assets/p25056397_b_h9_ab.jpg?w=720&h=540",
      "Categories": [
        "Episode",
        "Series"
      ],
      "Genres": [
        "Outdoors",
        "Travel",
        "Reality"
      ],
      "Tags": [
        "CC",
        "HD 1080i",
        "HDTV",
        "New"
      ],
      "SeriesID": "25056395",
      "ProgramID": "EP047885710005",
      "SeasonNumber": 1,
      "EpisodeNumber": 5,
      "Cast": [
        "Hazen Audel"
      ],
      "ReleaseYear": 2023,
      "ContentRating": "TV-PG",
      "Raw": {
        "startTime": "2023-08-23T02:00Z",
        "endTime": "2023-08-23T03:00Z",
        "duration": 60,
        "channels": [
          "6070"
        ],
        "stationId": "49438",
        "qualifiers": [
          "CC",
          "HD 1080i",
          "HDTV",
          "New"
        ],
        "program": {
          "tmsId": "EP047885710005",
          "rootId": "25191241",
          "seriesId": "25056395",
          "entityType": "Episode",
          "subType": "Series",
          "title": "Primal Survivor: Extreme African Safari",
          "titleLang": "en",
          "episodeTitle": "Untamed Coast",
          "episodeNum": 5,
          "seasonNum": 1,
          "releaseYear": 2023,
          "releaseDate": "2023-08-22",
          "origAirDate": "2023-08-22",
          "descriptionLang": "en",
          "shortDescription": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
          "longDescription": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
          "topCast": [
            "Hazen Audel"
          ],
          "genres": [
            "Outdoors",
            "Travel",
            "Reality"
          ],
          "ratings": [
            {
              "body": "USA Parental Rating",
              "code": "TVPG"
            },
            {
              "body": "Canadian Parental Rating",
              "code": "PG"
            },
            {
              "body": "Freiwillige Selbstkontrolle der Filmwirtschaft",
              "code": "6"
            },
            {
              "body": "Departamento de Justiça, Classificação, Títulos e Qualificação",
              "code": "12"
            }
          ],
          "preferredImage": {
            "uri": "assets/p25056397_b_h9_ab.jpg?w=720&h=540",
            "height": "540",
            "width": "720",
            "primary": "true",
            "category": "Banner-L1",
            "text": "yes",
            "tier": "Season"
          }
        }
      }
    },
    "UpdatedAt": 1692394532737
  }

WORKING IMAGE

  {
    "ID": "1692766800-704",
    "Name": "Primal Survivor: Extreme African Safari",
    "Time": 1692766800,
    "Duration": 3660,
    "Channels": [
      "757"
    ],
    "Channel": "",
    "DeviceID": "",
    "RuleID": "704",
    "Serial": 1692378736,
    "FileID": "",
    "Skipped": false,
    "Failed": false,
    "Dead": false,
    "Error": "",
    "Airing": {
      "Source": "tms",
      "Channel": "757",
      "OriginalDate": "2023-08-22",
      "Time": 1692766800,
      "Duration": 3600,
      "Title": "Primal Survivor: Extreme African Safari",
      "EpisodeTitle": "Untamed Coast",
      "Summary": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
      "FullSummary": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
      "Image": "https://tmsimg.fancybits.co/assets/p25056397_b_h9_ab.jpg?w=720&h=540",
      "Categories": [
        "Episode",
        "Series"
      ],
      "Genres": [
        "Outdoors",
        "Travel",
        "Reality"
      ],
      "Tags": [
        "CC",
        "HD 1080i",
        "HDTV",
        "New"
      ],
      "SeriesID": "25056395",
      "ProgramID": "EP047885710005",
      "SeasonNumber": 1,
      "EpisodeNumber": 5,
      "Cast": [
        "Hazen Audel"
      ],
      "ReleaseYear": 2023,
      "ContentRating": "TV-PG",
      "Raw": {
        "startTime": "2023-08-23T05:00Z",
        "endTime": "2023-08-23T06:00Z",
        "duration": 60,
        "channels": [
          "757"
        ],
        "stationId": "71601",
        "qualifiers": [
          "CC",
          "HD 1080i",
          "HDTV",
          "New"
        ],
        "program": {
          "tmsId": "EP047885710005",
          "rootId": "25191241",
          "seriesId": "25056395",
          "entityType": "Episode",
          "subType": "Series",
          "title": "Primal Survivor: Extreme African Safari",
          "titleLang": "en",
          "episodeTitle": "Untamed Coast",
          "episodeNum": 5,
          "seasonNum": 1,
          "releaseYear": 2023,
          "releaseDate": "2023-08-22",
          "origAirDate": "2023-08-22",
          "descriptionLang": "en",
          "shortDescription": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
          "longDescription": "Hazen Audel is on a mission to reach a legendary coastal bat colony.",
          "topCast": [
            "Hazen Audel"
          ],
          "genres": [
            "Outdoors",
            "Travel",
            "Reality"
          ],
          "ratings": [
            {
              "body": "USA Parental Rating",
              "code": "TVPG"
            },
            {
              "body": "Canadian Parental Rating",
              "code": "PG"
            },
            {
              "body": "Freiwillige Selbstkontrolle der Filmwirtschaft",
              "code": "6"
            },
            {
              "body": "Departamento de Justiça, Classificação, Títulos e Qualificação",
              "code": "12"
            }
          ],
          "preferredImage": {
            "uri": "https://tmsimg.fancybits.co/assets/p25056397_b_h9_ab.jpg?w=720&h=540",
            "height": "540",
            "width": "720",
            "primary": "true",
            "category": "Banner-L1",
            "text": "yes",
            "tier": "Season"
          }
        }
      }
    },
    "UpdatedAt": 1692378736656
  }

Just fall out from being in between updates. The future things will be fine. This is what was fixed. If you’re super worried, re-download all guide data.

To fix recordings that were made during this window, fix them with the art editor.

1 Like

Sorry, but recordings started this morning have the same issue.

aha! I think i got it now.

For those wondering - don't try to recover artwork with "delete and recreate database" - the "redownload all guide data" will fix the issue, minus the items between the outage, and when you redownload.

1 Like

Same old stuff ...

2023/08/19 07:08:16.247787 [DVR] Fetching guide data for 121 stations in X-TVE @ 2023-08-19 7:00AM
2023/08/19 07:08:21.288707 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 07:08:21.289212 [DVR] Fetching guide data for 44 stations in USA-OTA97070 @ 2023-08-19 7:00AM
2023/08/19 07:08:21.432995 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 07:12:21.651073 [DVR] Fetching guide data for 44 stations in USA-OTA97070 @ 2023-08-19 7:00PM
2023/08/19 07:12:21.801451 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable

No joy here either running server version 2023.08.18.2205:

2023/08/19 07:54:29.620837 [DVR] Error fetching movie data: gracenote error 3001: internal_server_error
2023/08/19 07:54:29.622868 [DVR] Fetching guide data for 141 stations in X-M3U @ 2023-08-19 1:30PM
2023/08/19 07:54:31.916364 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 07:54:31.916364 [DVR] Fetching guide data for 141 stations in X-M3U @ 2023-08-19 7:30PM
2023/08/19 07:55:31.572079 [WRN] Retrying guide data request in 20s due to 504 Gateway Timeout
2023/08/19 07:56:04.938100 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 07:56:04.938100 [DVR] Fetching guide data for 141 stations in X-M3U @ 2023-08-20 1:30AM
2023/08/19 07:56:05.064192 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 07:56:32.135095 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 07:56:32.135095 [DVR] Fetching guide data for 141 stations in X-M3U @ 2023-08-20 7:30AM
2023/08/19 07:56:48.580637 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 07:56:48.596267 [DVR] Fetching guide data for 141 stations in X-M3U @ 2023-08-20 1:30PM
2023/08/19 07:57:26.835566 [DVR]   indexed 876 airings (141 channels) [38s fetch, 0s index]
2023/08/19 07:57:26.966838 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 07:57:47.239411 [WRN] Retrying guide data request in 40s due to 503 Service Unavailable
2023/08/19 07:58:35.990210 [DVR]   indexed 113 movies (34 channels) [69s fetch, 0s index]
2023/08/19 07:58:35.998322 [DVR] Fetching guide data for 141 stations in X-M3U @ 2023-08-20 7:30PM
2023/08/19 07:59:04.488229 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
1 Like

Looking into this now.

Immediatly after looking into this I was seeing the errors as well, but now I am not. Can anyone else use "Fetch Guide Updates" and check their logs now?

Looks Good Now.

Errors seem to be intermittent. Maybe server overloaded.

2023/08/19 10:52:15.352866 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-22 4:30PM
2023/08/19 10:52:24.775711 [DVR] indexed 805 airings (105 channels) [8s fetch, 0s index]
2023/08/19 10:52:28.021096 [DVR] indexed 28 movies (11 channels) [3s fetch, 0s index]
2023/08/19 10:52:28.031309 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-22 4:30PM
2023/08/19 10:52:44.838492 [DVR] indexed 739 airings (93 channels) [16s fetch, 0s index]
2023/08/19 10:52:53.936803 [DVR] indexed 17 movies (7 channels) [9s fetch, 0s index]
2023/08/19 10:52:53.957916 [DVR] pruned 13 replaced airings in 0s.
2023/08/19 10:52:53.963685 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-22 10:30PM
2023/08/19 10:52:59.490090 [DVR] indexed 868 airings (105 channels) [4s fetch, 0s index]
2023/08/19 10:52:59.603078 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 10:53:31.496963 [DVR] indexed 22 movies (10 channels) [31s fetch, 0s index]
2023/08/19 10:53:31.506613 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-22 10:30PM
2023/08/19 10:54:20.294936 [DVR] indexed 773 airings (93 channels) [48s fetch, 0s index]
2023/08/19 10:54:35.061095 [DVR] indexed 16 movies (7 channels) [14s fetch, 0s index]
2023/08/19 10:54:35.070252 [DVR] pruned 8 replaced airings in 0s.
2023/08/19 10:54:35.076917 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-23 4:30AM
2023/08/19 10:55:14.336742 [DVR] indexed 893 airings (105 channels) [38s fetch, 0s index]
2023/08/19 10:55:36.701089 [DVR] indexed 14 movies (8 channels) [22s fetch, 0s index]
2023/08/19 10:55:36.709531 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-23 4:30AM
2023/08/19 10:55:36.878462 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 10:55:36.885947 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-23 10:30AM
2023/08/19 10:55:53.790609 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 10:55:53.796260 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-23 10:30AM
2023/08/19 10:55:53.909978 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 10:56:29.177536 [DVR] indexed 742 airings (93 channels) [34s fetch, 0s index]
2023/08/19 10:56:36.535067 [DVR] indexed 16 movies (7 channels) [7s fetch, 0s index]
2023/08/19 10:56:36.546656 [DVR] pruned 28 replaced airings in 0s.
2023/08/19 10:56:36.552487 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-23 4:30PM
2023/08/19 10:56:43.639066 [DVR] indexed 822 airings (105 channels) [6s fetch, 0s index]
2023/08/19 10:56:48.124265 [DVR] indexed 23 movies (10 channels) [4s fetch, 0s index]
2023/08/19 10:56:48.149757 [DVR] pruned 47 replaced airings in 0s.
2023/08/19 10:56:48.154409 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-23 4:30PM
2023/08/19 10:57:13.281492 [DVR] indexed 735 airings (93 channels) [24s fetch, 0s index]
2023/08/19 10:57:38.902938 [DVR] indexed 22 movies (9 channels) [25s fetch, 0s index]
2023/08/19 10:57:38.918036 [DVR] pruned 1 replaced airings in 0s.
2023/08/19 10:57:38.924288 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-23 10:30PM
2023/08/19 10:57:57.811857 [DVR] indexed 864 airings (105 channels) [18s fetch, 0s index]
2023/08/19 10:58:27.391310 [DVR] indexed 22 movies (10 channels) [29s fetch, 0s index]
2023/08/19 10:58:27.400721 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-23 10:30PM
2023/08/19 10:58:42.533367 [DVR] indexed 785 airings (93 channels) [14s fetch, 0s index]
2023/08/19 10:58:47.372020 [DVR] indexed 16 movies (8 channels) [4s fetch, 0s index]
2023/08/19 10:58:47.382274 [DVR] pruned 1 replaced airings in 0s.
2023/08/19 10:58:47.388123 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-24 4:30AM
2023/08/19 10:58:50.806609 [DVR] indexed 880 airings (105 channels) [2s fetch, 0s index]
2023/08/19 10:58:51.087137 [DVR] indexed 15 movies (7 channels) [0s fetch, 0s index]
2023/08/19 10:58:51.096932 [DVR] Fetching guide data for 93 stations in X-TVE @ 2023-08-24 4:30AM
2023/08/19 10:58:54.025378 [DVR] indexed 771 airings (93 channels) [2s fetch, 0s index]
2023/08/19 10:58:54.463964 [DVR] indexed 6 movies (4 channels) [0s fetch, 0s index]
2023/08/19 10:58:54.474681 [DVR] Fetching guide data for 105 stations in USA-OTA75098 @ 2023-08-24 10:30AM

I'm seeing the same thing. Most data is getting downloaded but it's slow and still seeing some errors.

I'm still seeing issues after running "Fetch Guide Updates" on v2023.08.18.2205

2023/08/19 12:02:17.859736 [DVR] Fetching guide data for 9 stations in X-STRMLNK @ 2023-09-04 12:00AM
2023/08/19 12:02:22.149391 [DVR]   indexed 60 airings (9 channels) [3s fetch, 0s index]
2023/08/19 12:02:32.359729 [DVR] Fetching guide data for 82 stations in X-TVE @ 2023-09-04 12:00AM
2023/08/19 12:02:53.108254 [DVR]   indexed 622 airings (82 channels) [18s fetch, 2s index]
2023/08/19 12:02:53.135045 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 12:03:13.169466 [WRN] Retrying guide data request in 40s due to 503 Service Unavailable
2023/08/19 12:04:14.862318 [DVR]   indexed 47 movies (22 channels) [80s fetch, 1s index]
2023/08/19 12:04:15.446850 [DVR]   pruned 3 replaced airings in 0s.
2023/08/19 12:04:15.447688 [DVR] Fetching guide data for 6 stations in USA-OTAxxx @ 2023-09-04 12:00AM
2023/08/19 12:04:15.546706 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 12:04:55.861299 [DVR] Error fetching guide data: gracenote error 3001: internal_server_error
2023/08/19 12:04:55.861978 [DVR] Fetching guide data for 9 stations in X-STRMLNK @ 2023-09-04 6:00AM
2023/08/19 12:05:08.012590 [DVR]   indexed 49 airings (9 channels) [11s fetch, 0s index]
2023/08/19 12:05:08.119126 [WRN] Retrying guide data request in 20s due to 503 Service Unavailable
2023/08/19 12:05:28.216219 [WRN] Retrying guide data request in 40s due to 503 Service Unavailable
2023/08/19 12:06:15.621832 [DVR]   indexed 4 movies (3 channels) [67s fetch, 0s index]
2023/08/19 12:06:15.625043 [DVR] Fetching guide data for 82 stations in X-TVE @ 2023-09-04 6:00AM
2023/08/19 12:06:20.383445 [DVR]   indexed 647 airings (82 channels) [3s fetch, 1s index]
2023/08/19 12:06:27.176049 [DVR]   indexed 38 movies (19 channels) [5s fetch, 1s index]
2023/08/19 12:06:27.179730 [DVR] Fetching guide data for 6 stations in USA-OTAxxx @ 2023-09-04 6:00AM
2023/08/19 12:07:01.923086 [DVR]   indexed 45 airings (6 channels) [32s fetch, 2s index]

Logs have been submitted as e34038f8-6dfb-4f21-a803-7ab84baeafe5.

Getting the 3001 and 503 errors also on v2023.08.18.2205

Also appears it gave up after trying to get a few days of updates. One server stopped updates at 08/22/2023, another at 08/25/2023 and the third gave up after no updates. All should have updated to 09/04/2023.

These were the daily morning updates, I didn't try to force a guide update.
Diagnostics from those three servers
Logs have been submitted as db8ccb57-f94b-4ab7-90e3-6fc91265509f
Logs have been submitted as 57b6021f-5433-4c9a-b901-704396d862b2
Logs have been submitted as 963a5bde-fa1a-47ec-a889-d42947d0ba85

Fourth server, same issue
Logs have been submitted as 31fe7ace-d380-46f6-a9a1-f58407a29395

Reminds me of the time we accidentally dDOS'd GitHub's API with an automated update check. Had to add some randomness in the cronjobs after that one...

I know it's all MY fault for running four servers :grin:

I remember a long time ago when Plex had an issue getting EPG data because Cloudflare was blocking the traffic.

1 Like

Appears to be working again.

Seems to be working again here as well.

Can you check the NVIDIA container build. Still getting 403 with that build on guide data

I'm showing no guide data tonight. Is there another outage?
I'm on DVR version: 2023.08.25.0606.
I've rebooted and restarted the server several times. Both of my HDHomeRun CONNECT QUATRO
Model: HDHR5-4US are functioning correctly as well as my other HDHomeRun CONNECT
Model: HDHR4-2US