Skip to main content Skip to complementary content

Amazon S3 V2

The Qlik Amazon S3 V2 connector lets you fetch your stored data from Amazon S3 buckets.

Tip note

The Qlik Web Connectors help you connect to different data sources and fetch data in the same way. Learn how to authenticate a data source connection and how to use tables to fetch data.

Connecting to data sources

Supported offerings

  • Qlik Sense Desktop
  • Qlik Sense Enterprise on Windows
  • QlikView

This connector must be installed separately.

Ways to access your data

You need to authenticate the connector with your Amazon S3 access key and secret key. Your access credentials are stored in the Qlik Web Connectors.

Warning noteWhen selecting an Amazon S3 bucket location, note that geographic distance between your hosted Qlik Sense environment and the bucket hosting may have an impact on download/upload performance.
For example, a Qlik Sense deployment in the North American region may have significantly slower download/upload speeds when connecting to an Amazon S3 bucket in the Asia-Pacific region.

The Amazon S3 V2 connector supports AWS PrivateLink. PrivateLink allows you to access Amazon S3 data from a Qlik Sense server that does not have internet access for security reasons. For more information, see AWS PrivateLink for Amazon S3.

To use PrivateLink, insert your VPC Endpoint ID before you run your table.

Loading data from tables

After you authenticate the connector with your account credentials, you can use tables such as the following to select and load data: 

Tables that can be loaded
Table Description
ListBuckets Fetches a list of buckets from your Amazon S3 account.
List Fetches a list of folders in a bucket and the objects inside those folders. You need the bucket region and bucket name to run this table.
ListObjects Fetches a list of objects in a bucket. You need the bucket region and bucket name to run this table.
Metadata Returns metadata for the object.
GetRawObject Returns an object from Amazon S3. You must have READ access to the object.
GetRawObjectAsText Returns an object from Amazon S3, as Text. You must have READ access to the object.
SaveRawObjectToDisk Saves an object from Amazon S3 to disk. You must have READ access to the object.
Upload Uploads a file to Amazon S3. You must have WRITE permissions on a bucket to add an object to it.
InProgressUploads Checks for in progress uploads.

Reference - AWS SDK for .NET documentation

You can refer to the AWS SDK for .NET API documentation to learn more about the requirements and restrictions imposed by the AWS SDK for .NET API.

AWS SDK for .NET API Reference

Troubleshooting

You receive generic access error messages

There are multiple generic access error messages: "cannot open file", "no fields to load", etc. that can occur.

Possible cause  

You have incorrectly entered Amazon S3 credentials or file/bucket information.

Proposed action  

Ensure that your Amazon S3 account credentials have been correctly entered:

  • Check that your Amazon S3 access key, secret key, region and bucket name are accurately entered in your connector configuration.
  • Check that your load script correctly references your connection name, file name, file path, and file formatting information.
  • Ensure that the file is available in your Amazon S3 instance at the specified file path.

You receive an error message that you have reached the API rate limit

Possible cause  

You have exceeded the API limits that are imposed on Qlik Web Connectors by the Amazon S3 API.

Proposed action  

To reduce the impact of reaching the API rate limits, develop your app with the following in mind:

  • Extract only the data you need.
  • Reload one Amazon S3-based application at a time.
  • Ensure that loops in your script that make API calls will not result in infinite loops.