Test the architecture

Our whole architecture is now fully setup and configured. We can go ahead and test.

Procedure

Go to S3 console.
Click on the bucket talend-lambda-demos.
Click on the input folder.
Remove any previous file which may be present in this folder.
Upload the customers.csv file.
1. Click Upload.
2. Click Add files and then select the customers.csv file.
3. Click Next.
4. Add Read/Write permissions for Any authenticated AWS user on Objects.
5. Click Next.
6. Set properties: keep default values.
7. Click Next.
8. Review.
9. Click Upload.
Go to Talend Administration Center web console.
In Job Conductor view, check that the Job Talend has been triggered by the Lambda function.
Go to Lambda console dashboard to view the monitoring charts which shows all Lambda invocation metrics:
Go back to AWS S3 console, then check the output folder in the bucket talend-lambda-demos.

You should have a customers.xml file which is created by the Talend Job.
Finally go to AWS Cloudwatch console then click on Logs.
Click on the Log Groups /aws/lambda/S3LambdaFunctionHandler to display all log streams:
Click on the latest log stream which corresponds to the last execution.

As you can see, all logs related to your Lambda execution are displayed here:

You have successfully integrated AWS S3, Lambda andTalend Data Integration in a very flexible and event-driven way.

Important: When you are done, do not forget to clean up all resources created for this demo to save money.

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!