Advanced Analytica Advanced Analytica: IBOM
← All connectors
Youtube Data logo

Source connector

Youtube Data

Set up Youtube Data as a source and move its data into your chosen destination.

Version 1.1.4 certified generally available

YouTube Data API

Use this page to set up the YouTube Data API source connector and find reference information.

Sync video details, channel metadata, comments, and other YouTube channel data with the YouTube Data API v3. For detailed analytics and reporting data, use the YouTube Analytics connector.

Prerequisites

  • One or more YouTube Channel IDs for the channels you want to sync
  • For Airbyte Open Source, a Google Cloud project with the YouTube Data API v3 enabled. You also need one authentication method from that project:
    • A Google API Key for public data only
    • OAuth 2.0 credentials: Client ID, Client Secret, and Refresh Token

Set up the connector

Find your Channel IDs

  1. Go to YouTube and open the channel you want to sync.
  2. Find the Channel ID in the URL: https://www.youtube.com/channel/CHANNEL_ID. Channel IDs contain 24 characters and start with UC. A handle URL such as https://www.youtube.com/@handle isn’t a Channel ID.
  3. Alternatively, find it in YouTube Studio under Settings > Channel > Advanced settings.

Verify every Channel ID before setup. The connection check fails if any ID doesn’t resolve to an existing channel.

Airbyte Cloud

  1. Sign in to your Log into your Airbyte Cloud account.
  2. Click Sources, then click + New source.
  3. Select YouTube Data API from the list.
  4. Enter a name for your source.
  5. Choose your authentication method:
    • For OAuth 2.0, click Sign in with Google to authenticate your Google account.
    • For API Key, enter your Google API key.
  6. Enter one or more Channel IDs for the channels you want to sync.
  7. Click Set up source.

Airbyte Open Source

Create credentials

Authenticate with either an API Key or OAuth 2.0.

Option A: API Key (simpler setup, public data only)

  1. Go to the Google Cloud Console.
  2. Create a project or select an existing one.
  3. Go to APIs & Services > Library and enable the YouTube Data API v3.
  4. Go to APIs & Services > Credentials.
  5. Click Create Credentials > API key.
  6. Copy the generated API key.
  7. We recommend clicking Restrict key to restrict the key to the YouTube Data API v3.

Option B: OAuth 2.0 (required for accessing private data)

  1. Go to the Google Cloud Console.
  2. Create a project or select an existing one.
  3. Go to APIs & Services > Library and enable the YouTube Data API v3.
  4. Go to APIs & Services > Credentials.
  5. Click Create Credentials > OAuth client ID. If prompted, configure the OAuth consent screen.
  6. Select Web application as the application type. Add https://developers.google.com/oauthplayground as an authorised redirect URI to generate a refresh token later.
  7. Copy the Client ID and Client Secret.
  8. Open the OAuth 2.0 Playground. Click the settings icon and select Use your own OAuth credentials. Enter your Client ID and Client Secret.
  9. Enter https://www.googleapis.com/auth/youtube.force-ssl in the scope field, then click Authorize APIs. To sync unlisted and private videos, sign in with the Google account that owns the channel.
  10. Click Exchange authorization code for tokens and copy the Refresh token.

If your OAuth consent screen has a publishing status of Testing, Google expires refresh tokens after 7 days. Syncs then begin failing with authentication errors. Before generating the refresh token for scheduled syncs, set the publishing status to In production.

Set up the connector

  1. In Airbyte, go to Sources and click + New source.
  2. Select YouTube Data API from the list.
  3. Enter a name for your source.
  4. Choose your authentication method and enter the required credentials.
  5. Enter one or more Channel IDs for the channels you want to sync.
  6. Click Set up source.

Supported sync modes

The YouTube Data API source connector supports these sync modes:

Every stream except channels supports incremental sync. The YouTube Data API doesn’t provide date filters, but every endpoint lists the newest records first. An incremental sync reads pages until it reaches the first existing record, then stops. See Quota and rate limiting for each stream’s request cost.

Two streams work differently in incremental mode:

  • video fetches only videos published since the previous sync. Statistics are snapshots taken when each video was first fetched and aren’t refreshed. Use video_engagement for counters that change.
  • video_engagement reads every video’s counters again during each sync. It uses each record’s fetch time as its cursor. Incremental - Append therefore creates a counter time series for each video. Incremental - Append + Deduped retains only the latest counters.

Comment streams use the top-level comment’s publish time as the cursor. Incremental syncs therefore miss edits to existing comments and changes to reply counts. They also don’t remove destination records when videos or comments are deleted from YouTube.

Supported streams

Stream NamePrimary KeyCursorPaginationSupports Full SyncSupports Incremental
videosvideoIdpublishedAtDefaultPaginatorYesYes
videovideoIdpublishedAtDefaultPaginatorYesYes
video_engagementvideoIddatetime (fetch time)NoneYesYes
channelsid—DefaultPaginatorYesNo
commentsvideoId, idpublishedAtDefaultPaginatorYesYes
channel_commentschannelId, idpublishedAtDefaultPaginatorYesYes

Stream details

  • videos: Returns one record for each upload in every configured channel. For each channel from channels, it reads the uploads playlist through playlistItems.list, with 50 items per page. Records are concise. They contain kind and videoId, the primary key, from the playlist item’s resourceId. They also contain channelId, title, and publishedAt, which shows when the upload joined the channel. Finally, they contain privacyStatus, which can be public, unlisted, or private. OAuth 2.0 includes unlisted and private uploads when authenticated as the channel owner. An API key includes only public uploads. OAuth 2.0 also includes only public uploads for channels the user doesn’t own. The video, video_engagement, and comments streams use this parent stream to identify videos to fetch.
  • video: Returns detailed information about videos from specified channels. It uses videos.list and fetches 50 videos per request. Snippet data includes title, description, thumbnails, publish date, tags, category, and language settings. Content details include duration, dimension, definition, caption availability, and region restrictions. Statistics include view, like, and comment counts. Player information includes embed HTML. Status data includes upload status, privacy status, licence, embeddable, and made for kids. Each record also includes datetime, which the connector sets to the fetch time. This isn’t a YouTube timestamp. Use it to distinguish snapshots in Full Refresh - Append mode.
  • video_engagement: Returns every specified video’s current statistics: viewCount, likeCount, commentCount, and favoriteCount. It uses videos.list with part=statistics and fetches 50 videos per request. Records also include videoId and a datetime field set to the fetch time. YouTube provides cumulative counters, not their history, so each sync creates one snapshot. Schedule the connection at your preferred sampling frequency. For daily views, watch time, and other report metrics, use the YouTube Analytics connector.
  • channels: Returns information about specified YouTube channels from channels.list. Snippet data includes title, description, custom URL, country, and thumbnails. Content details include related playlists. Statistics include subscriber, view, and video counts. Branding settings include channel keywords, trailer, and default language. Records also include topic details, status, localisations, and content owner details. Status includes privacy status and made for kids. The connector adds an uploadsPlaylistId field copied from contentDetails.relatedPlaylists.uploads. The videos stream uses this field to list the channel’s uploads.
  • comments: Returns comment threads for individual videos from specified channels. It uses commentThreads.list filtered by videoId. For each video found by videos, it fetches comment threads newest first, with 100 per request. Each record contains one thread’s snippet. The top-level comment appears in topLevelComment, while totalReplyCount provides the reply count. The connector copies the top-level comment’s ID into a top-level id field, which forms part of the primary key. It also copies its publishedAt into a top-level publishedAt cursor field. Records don’t include the replies themselves. The stream skips deleted videos and videos with disabled comments without failing the sync.
  • channel_comments: Returns all comment threads related to specified channels. It uses commentThreads.list filtered by allThreadsRelatedToChannelId, fetching newest first with 100 per request. This includes comments on the channel’s videos and channel page. It therefore provides a broader engagement view than the comments stream. An incremental sync uses one or two requests per channel, rather than one per video. Records match the comments structure, including the copied id and publishedAt fields. If you don’t need comments grouped by video, choose this stream instead of comments.

Comment records also contain updatedAt within the nested topLevelComment.snippet object. It isn’t moved to the top level or used as a cursor.

YouTube API Services disclosure

This connector retrieves YouTube data through YouTube API Services. By using the connector, you agree to the YouTube Terms of Service.

Google provides YouTube API Services. Review the Google Privacy Policy to learn how Google handles data.

With OAuth 2.0 authentication, the connector accesses authorised user data. You can revoke its Google account access through the Google security settings page at any time. To delete previously synced data, remove the relevant connection in Airbyte or delete it from your configured destination.

Limits and considerations

Quotas and rate limits

The YouTube Data API applies a daily quota to each Google Cloud project. Google’s documented default is 10,000 quota units per day. Every endpoint this connector reads costs 1 unit per request: playlistItems.list, channels.list, videos.list, and commentThreads.list. Google states that defaults can change. Check the YouTube Data API’s Quotas page in Google Cloud console for your project’s current allocation. If you need more quota, request a quota extension from Google.

Each sync’s request count scales with the configured channels’ number of videos, V. The video, video_engagement, and comments streams each read the uploads playlist to find video IDs. Their costs below therefore include this parent read. In incremental mode, video reads only new playlist items. video_engagement and comments read the entire playlist again during every sync.

StreamFirst sync or Full RefreshIncremental sync
videosAbout V/50About one per channel
videoAbout V/50 for the playlist plus V/50 for video detailsAbout one per channel, plus one per 50 new videos
video_engagementAbout V/50 for the playlist plus V/50 for statisticsSame as a first sync
channelsOne per channelNot supported
commentsAbout V/50 for the playlist, plus one per video, plus one per additional 100 comment threads on a videoAbout V/50 for the playlist plus one per video
channel_commentsOne per channel, plus one per additional 100 comment threadsAbout one or two per channel

For example, consider a channel with 5,000 videos. Syncing videos, video, video_engagement, channels, and channel_comments incrementally each hour uses about 200 units per sync. That’s about 5,000 units per day. video_engagement uses most of this quota. Sync it less often, or exclude it, if you don’t need frequent counter snapshots.

The connector limits its requests to guard against bursts. It sends at most 100 requests per minute across all endpoints. Requests exceeding this limit wait for the next available slot instead of failing. The connector retries with backoff when YouTube returns rateLimitExceeded, userRateLimitExceeded, or HTTP 429 per-minute rate-limit errors. The sync fails immediately when YouTube returns quotaExceeded or dailyLimitExceeded for an exhausted daily quota. It doesn’t retry because the quota resets only at midnight Pacific time. Incremental streams resume from their latest checkpoint during the next scheduled sync.

Request pacing applies separately to each Airbyte source, while Google measures quota by Google Cloud project. Sources sharing a project’s API keys or OAuth clients draw from the same quota. Use a separate project for each source or request more quota.

Authentication

  • API keys can access public data only. To sync unlisted or private videos and their comments, authenticate with OAuth 2.0 as the channel owner.
  • With OAuth 2.0, the connector requests the youtube.force-ssl scope. This provides read and write access to YouTube resources. The scope is required, although the connector only reads data.
  • With OAuth 2.0, the connector refreshes the access token and retries after an HTTP 401 response. If the 401 continues, the sync fails with a configuration error. Re-authenticate with Google in the source settings. API keys have no token to refresh, so a persistent 401 causes the same failure.
  • The connector returns a configuration error instead of retrying in several cases. These include an invalid API key or a token without the youtube.force-ssl scope. The error also occurs when the project’s YouTube Data API v3 isn’t enabled or a configured Channel ID doesn’t exist. Correct the credentials or Channel IDs, then run the sync again.
  • Service account authentication isn’t supported because the YouTube Data API doesn’t support it for most operations.

Data coverage

  • The videos stream reads each channel’s uploads playlist. The playlist has no result limit, so it returns every upload regardless of channel size.
  • Unlisted and private uploads appear in videos, video, video_engagement, and comments only with channel-owner OAuth 2.0 authentication. With an API key, these streams contain public videos only. They also contain only public videos for channels the OAuth user doesn’t own.
  • YouTube provides only current engagement counters. video_engagement records are snapshots from each sync, not historical data the connector can backfill.
  • The comments stream skips deleted videos and videos with disabled comments. It produces no records or errors for them.
  • Incremental comments maintains a cursor for each video. For channels exceeding 10,000 videos, the connector switches to one stream-level cursor. This can read more comments again during each sync than strictly required.

IP allow list

If you use Airbyte Cloud and restrict access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.

Changelog

Expand to review
VersionDatePull RequestSubject
1.1.42026-11-1091783Update dependencies
1.1.32026-11-0390796Update dependencies
1.1.22026-10-3190314Report a specific error message when YouTube cannot find a channel’s uploads playlist
1.1.12026-10-2790088Update dependencies
1.1.02026-10-2087495Add incremental sync to videos, video, comments, and channel_comments; add the video_engagement stream; add publishedAt, privacyStatus, channelId, and title to videos records; fetch 50 videos per videos.list request and 100 comment threads per commentThreads.list request; fail fast when the daily quota is exhausted
1.0.82026-10-2089482Update dependencies
1.0.72026-10-1388831Update dependencies
1.0.62026-10-0787637Enumerate channel videos through the uploads playlist to remove the search endpoint’s 500-video cap.
1.0.52026-10-0688113Update dependencies
1.0.42026-09-2987429Update dependencies
1.0.32026-09-2286891Update dependencies
1.0.22026-09-2186466Fix authentication failures (HTTP 401) on channels with many videos: refresh the access token and retry on 401, and shorten API budget windows so syncs no longer wait past the token lifetime
1.0.12026-09-1586306Update dependencies
1.0.02026-09-1085214Breaking: promote connector to certified — declare primary keys and timestamp formats and restrict videos to video results (see the migration guide)
0.0.662026-09-0885721Update dependencies
0.0.652026-08-1884813Update dependencies
0.0.642026-08-1184181Update dependencies
0.0.632026-08-0483693Update dependencies
0.0.622026-07-2883186Update dependencies
0.0.612026-07-2182663Update dependencies
0.0.602026-07-1482070Update dependencies
0.0.592026-06-3081317Update dependencies
0.0.582026-06-2380730Update dependencies
0.0.572026-06-1680123Update dependencies
0.0.562026-06-0979580Update dependencies
0.0.552026-06-0279000Update dependencies
0.0.542026-04-2877496Update dependencies
0.0.532026-04-2176818Update dependencies
0.0.522026-04-0875185Replace connector icon with updated YouTube logo
0.0.512026-03-1774392Migrate to scopes object array format
0.0.502026-03-1774698Update dependencies
0.0.492026-03-0373914Update dependencies
0.0.482026-02-1773507Update dependencies
0.0.472026-02-1073175Update dependencies
0.0.462026-01-2772066Update dependencies
0.0.452026-01-1470677Update dependencies
0.0.442026-01-0571016Fixed schemas
0.0.432025-12-1970971Add acceptance tests
0.0.422025-12-1669315Add OAuth 2.0 support
0.0.412025-11-2570079Update dependencies
0.0.402025-11-1869532Update dependencies
0.0.392025-10-2968942Update dependencies
0.0.382025-10-2168456Update dependencies
0.0.372025-10-1467987Update dependencies
0.0.362025-10-0767241Update dependencies
0.0.352025-09-3066846Update dependencies
0.0.342025-09-2466475Update dependencies
0.0.332025-09-0965731Update dependencies
0.0.322025-08-2465468Update dependencies
0.0.312025-08-1064863Update dependencies
0.0.302025-08-0264386Update dependencies
0.0.292025-07-2664056Update dependencies
0.0.282025-07-1963640Update dependencies
0.0.272025-07-1263216Update dependencies
0.0.262025-07-0562701Update dependencies
0.0.252025-06-2862233Update dependencies
0.0.242025-06-2161759Update dependencies
0.0.232025-06-1561171Update dependencies
0.0.222025-05-2460786Update dependencies
0.0.212025-05-1059968Update dependencies
0.0.202025-05-0459566Update dependencies
0.0.192025-04-2658930Update dependencies
0.0.182025-04-1958550Update dependencies
0.0.172025-04-1358052Update dependencies
0.0.162025-04-0557379Update dependencies
0.0.152025-03-2956821Update dependencies
0.0.142025-03-2256338Update dependencies
0.0.132025-03-0955664Update dependencies
0.0.122025-03-0155162Update dependencies
0.0.112025-02-2354632Update dependencies
0.0.102025-02-1553087Update dependencies
0.0.92025-01-2552387Update dependencies
0.0.82025-01-1852006Update dependencies
0.0.72025-01-1151380Update dependencies
0.0.62025-01-0450753Update dependencies
0.0.52024-12-2150326Update dependencies
0.0.42024-12-1449756Update dependencies
0.0.32024-12-1249403Update dependencies
0.0.22024-12-1149125Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64
0.0.12024-11-08Initial release by @bala-ceg via Connector Builder
Advanced Analytica

Most businesses are sitting on information they can’t use at speed. The people who hold it are busy, and when they leave, the knowledge goes with them. The documents are static, and the processes around them weren’t designed for AI.

Advanced Analytica works with these businesses to turn that information into structured data assets. Once they're integrated, AI systems can govern it, and the business can use it. We bring in the strategy, the specification and the AI skills to rework how the business operates.

MOVE FAST. STAY SAFE.