Skip to main content

Configuring Your Redshift Connector to DataHub

Now that you have created a DataHub user in Redshift in the prior step, it's time to set up a connection via the DataHub UI.

Configure Secrets​

  1. Within DataHub, navigate to the Ingestion tab in the top, right corner of your screen

Navigate to the "Ingestion Tab"

note

If you do not see the Ingestion tab, please contact your DataHub admin to grant you the correct permissions

  1. Navigate to the Secrets tab and click Create new secret

Secrets Tab

  1. Create a Redshift User's Password secret

This will securely store your Redshift User's password within DataHub

  • Click Create new secret again
  • Enter a name like REDSHIFT_PASSWORD - we will use this later to refer to the secret
  • Enter your datahub redshift user's password
  • Optionally add a description
  • Click Create

Redshift Password Secret

Configure Recipe​

  1. Navigate to the Sources tab and click Create Source

Click "Create Source"

  1. Select Redshift

Select BigQuery from the options

  1. Fill out the Redshift Recipe

Enter a Source Name at the top of the Connection Details page, then fill in the connection fields.

Populate the Password field by selecting Redshift Password secrets you created in steps 3 and 4.

Fill out the Redshift Recipe

Schedule Execution​

Now it's time to schedule a recurring ingestion pipeline to regularly extract metadata from your Redshift instance.

  1. In the Sync Schedule section, turn on Run on a schedule, then decide how regularly you want this ingestion to run-- day, month, year, hour, minute, etc. Select from the dropdown

schedule selector

  1. Ensure you've configured your correct timezone

timezone_selector

Save and Run​

  1. Click Save and Run at the top of the page

You will now find your new ingestion source running

ingestion_running

Validate Ingestion Runs​

  1. View the latest status of ingestion runs on the Ingestion page

ingestion succeeded

  1. Open the Run History tab to see the full list of historical runs and outcomes; click a run's status to open its Run Details page

ingestion_details

  1. In the Assets section of the Run Details page, click View all to see which entities were ingested

ingestion_details_view_all

  1. Pick an entity from the list to manually validate if it contains the detail you expected

ingestion_details_view_all

Congratulations! You've successfully set up Redshift as an ingestion source for DataHub!