Start an Amazon EMR cluster
In the Talend Studio, you create a new Standard Job to launch an Amazon EMR cluster.
Procedure
-
Provide your Amazon credentials to the Job.
- If you have set up the context for these credentials in the previous steps, do the following:
- In the Contexts view of your Job, add the
AmazonCredentials context that is stored in the
Repository.
- In the Access Key and Secret key fields, use the context variables you created previously, context.AccessKey and context.SecretKey respectively.
- In the Contexts view of your Job, add the
AmazonCredentials context that is stored in the
Repository.
- If the security policy of your organization does not allow you to expose the credentials in a Job, select the Inherit credentials from AWS check box to obtain AWS security credentials from your EMR instance metadata. To use this option, the S3 system to be used must be S3A and an IAM role must has been configured to manage temporary credentials for client applications. For more information, see Using an IAM Role to Grant Permissions to Applications Running on Amazon EC2 Instances.
- If you have set up the context for these credentials in the previous steps, do the following:
-
In the Instance configuration area, specify the number
of nodes you want. At runtime, one instance will be designated as the master and
the others are designated as slaves. You can also specify the instance type for
the master node and the slave nodes.
Results
A new cluster is launched. You can verify it from the Amazon EMR home page:
You can also check the the status from the EC2 instances list:
In the Studio, the console in the Run view shows the following message:
Your cluster is now ready.