Access Key Integration
  • 18 Jul 2024
  • Dark
    Light
  • PDF

Access Key Integration

  • Dark
    Light
  • PDF

Article summary

Overview

AWS Access Key Integration allows the Dataloop platform to securely connect with AWS services using access keys. This integration enables seamless interaction with AWS resources, allowing for automated data transfers, processing, and management tasks.

The AWS access key integration process involves:

Create an S3 Bucket

  1. Log in to the AWS Management Console.
  2. Go to Services > Storage and click the S3 service.
  3. Click Create bucket. The Create Bucket page is displayed.
  4. Provide a Bucket name.
  5. Select your AWS region from the list.
  6. Ensure you block public access settings for this bucket - Block all public access.
  7. For all other optional settings, use the default values.
  8. Click Create bucket. A confirmation message is displayed.

For a step-by-step guide on creating an S3 bucket in AWS, see Creating a bucket.


Create an IAM Policy


Create an IAM User

  1. Log in to the AWS Management Console.
  2. Go to Services and click All services. A list of services is displayed.
  3. Click the IAM service from the list.
  4. From the left portal menu, click Users.
  5. Click Add users.
  6. Enter a username.
  7. Ensure the Programmatic access checkbox is selected as the type of access you want to grant the user.
  8. Click Next. A Set Permissions page is displayed.
  9. Choose the Attach policies directly.
  10. Select the permission policy that you created for accessing your S3 bucket from the list.
  11. Click next.
  12. Click Create user. A confirmation message is displayed.
    See Creating an IAM user in AWS for more information.

Create an Access Key for the IAM User

  1. Log in to the AWS Management Console.
  2. Go to Services and click All services. A list of services is displayed.
  3. Click the IAM service from the list.
  4. From the left portal menu, click Users.
  5. Find and click on the desired user (for example, a Dataloop user) for whom you want to create an access key.
  6. Click on the Security credentials tab.
  7. In the Access keys section, click Create access key.
  8. In the Access key best practices & alternatives, choose Application running outside AWS.
  9. Click Next.
  10. Enter a description that includes Dataloop.
  11. Click Create access key.
  12. Copy and save the Access Key and Secret Access Key in a secure location, or download the CSV file. The access key and secret access key are required for the integration phase.
  13. Click Done. It completes the access key creation process for the IAM user.
    See Set up an S3 policy for setting up a policy in AWS.


Create an AWS Access Key Integration on Dataloop Platform

  1. Log in to the Dataloop platform.
  2. From the left-side panel, select Data Governance.
  3. Click Create Integration. A pop-up window is displayed.
  4. Integration Name: Enter a Name for the integration.
  5. Provider: Choose AWS from the list.
  6. Integration Type: Select the Access Key from the list.
  7. Key: Enter the IAM user’s access key ID that you noted while creating an access key for the IAM user.
  8. Secret: Enter the IAM user’s secret access key that you noted while creating an access key for the IAM user.
  9. Click Create Integration. A confirmation message is displayed.

Create S3 Storage Service on the Dataloop Platform

For more information, see the Create AWS S3 Storage Driver on the Dataloop Platform topic.