Amazon S3 Metadata V2
The Qlik Amazon S3 Metadata V2 Connector uses the Amazon S3 AWS SDK for .NET API to access your Amazon S3 metadata, such as the names of files and subfolders in your Amazon S3 bucket. This allows you to stream data directly into your Qlik Sense app from your Amazon S3 public account or via PrivateLink.
Supported offerings
- Qlik Sense Business
- Qlik Sense Enterprise SaaS
Ways to access your data
You need to authenticate the connector with your Amazon S3 account credentials: access key, secret key, region, and bucket name.
Creating a connection and selecting data
Loading data from tables
After you authenticate the connector with your account credentials, use the tables to fetch your data.
Do the following:
-
Under the list of connections, find your Amazon S3 Metadata V2 connection. Click
Select tables.
-
Enter the required table parameters and click Preview data.
Required parameters are marked with an asterisk (*).
-
The table fields are displayed under the Data preview tab. You can select fields individually by selecting the box beside each field name.
-
Select Insert script after you have made your selection.
Below are use cases for some of the available tables:
Table | Description |
---|---|
ListBuckets | Fetches a list of buckets from your Amazon S3 account. |
List | Fetches a list of folders in a bucket and the objects inside those folders. You need the bucket region and bucket name to run this table. |
ListObjects | Fetches a list of objects in a bucket. You need the bucket region and bucket name to run this table. |
Metadata | Returns metadata for the object. |
Reference - AWS SDK for .NET documentation
You can refer to the AWS SDK for .NET API documentation to learn more about the requirements and restrictions imposed by the AWS SDK for .NET API.
Troubleshooting
You receive an error message that you have reached the API rate limit
Possible cause
You have exceeded the API limits that are imposed by the Amazon S3 API.
Proposed action
To reduce the impact of reaching the API rate limits, develop your app with the following in mind:
- Extract only the data you need.
- Reload one Amazon S3-based application at a time.
- Ensure that loops in your script that make API calls will not result in infinite loops.