Secrets Overview

In Dataloop, Secrets and API Keys are sensitive credentials or tokens that are securely stored and managed using Dataloop’s Secrets Manager. These secrets are used by applications, models, and pipelines to authenticate with external services—without ever exposing them in your code or configuration files.

🔐 Secrets

in Dataloop are encrypted credentials or sensitive data—such as cloud access tokens, private keys, passwords, or connection strings—securely managed through the Dataloop Secrets Manager. They are designed to be referenced by services and pipelines during runtime, enabling your applications to authenticate with external systems like AWS, GCP, Azure, or third-party APIs without exposing the credentials in your codebase.

By creating and storing secrets and integrating them with Pipelines and Application, our platform offers a comprehensive solution for all your secret management needs.

Key Features:

• Fully encrypted at rest and in transit
• Scoped to project or organization level
• Supports versioning and updates without code changes
• Integrates with both application services and automation pipelines

Examples:

• AWS access key & secret
• GCP service account JSON
• Azure client secret
• GitHub private codebase

🔑 API Keys

API Keys in Dataloop are secure, token-based credentials that allow programmatic access to the Dataloop platform APIs. These keys are typically generated to enable automated systems, bots, or external tools to interact with Dataloop (e.g., to upload data, manage annotations, or trigger services) based on defined permission scopes.

Key Features:

• Can be generated directly from the UI or via API
• Permissions and project access are configurable
• Ideal for use in CI/CD, automation, or external integrations
• Tokens can be revoked or rotated at any time

Examples:

• A CI/CD pipeline using an API Key to deploy code or trigger processing
• An external script using the key to upload images or retrieve annotation results

Access Secrets and API Keys

Access the data Secrets tab by clicking on the Integrations from the left-side panel. The Integrations page displays Integration and Secrets available in your organization by tabs and enable a more provider-focused view.

Create Secrets and API Keys

Create a unique name for your secret and store it as a key-value pair for easy access whenever you need it. To create a secret in Dataloop platform, do the following steps:

1. Click Integrations from left panel.
2. Click Secrets tab.
3. Click Create Secret. Also, you can click on the down-arrow next to the Create Integration and select Create Secret. A side panel is displayed.
4. Secret name: Enter a unique name for your secret.
5. Secret: Enter the secret value in the Secret field.
6. Provider (optional): Select the relevant secret provider to help you easily identify the secrets.
7. Click Create Secret to finalize the process.

Search and Filter

By default, the Integrations tab is displayed, select the secret tab. The following list provides the specific criteria of search and filters for Secrets:

• To search: Search secrets by Secrets Name.
• To Filter:
  • Filter the listed secrets by the following provider, for example, AWS, Hugging Face, NVIDIA, Open AI, etc.
  • Filter secrets based on the email ID of the creator.

List of Secrets

The Secrets tab displays available Secrets in your organization in a list view. The column values are populated according to the Secrets.

• Copy Secret ID: Click on the Copy icon to copy the secret ID.
• Edit Secret: Click on the Pencil icon to edit Secret Name and Secret value.
• Delete Secret: Click on the Trash icon to delete a secret from your organization.

Secret Manager Helps to?

Create and Store Secrets
Easily create a unique name for your secret and store it as a key-value pair. This key-value pair can include anything from API keys to database credentials.

Retrieve Secrets
Access your stored secrets whenever you require them. Our platform ensures secure retrieval, allowing only authorized users to access the information.

Integrate with Pipeline and Application
Utilize your secrets across various Pipelines, or Function as a Service (Application), within our platform. This seamless integration enhances functionality and efficiency.

Manage Access
Control who can access, modify, or delete secrets. Our robust access controls ensure that only authorized users can manage secrets.

Refer to the Manage Secrets to learn more.