Upserting data to MongoDB
Procedure
-
Double-click tMongoDBConnection to open
its Basic settings view.
-
Double-click tFixedFlowInput to open its
Basic settings view.
Select Use Inline Content (delimited file) in the Mode area.In the Content field, enter the data for upserting the MongoDB database, for example:1;Andy;Open Source Outlook;Open Source,Talend;Talend, the leader of the open source world... 2;Andy;Data Integration Overview;Data Integration,Talend;Talend, the leading player in the DI field... 3;Anderson;ELT Overview;ELT,Talend;Talend, the big name in the ELT circle... 4;Andy;Big Data Bang;Big Data,Talend;Talend, the driving force for Big Data applications...As shown above, the 3rd record has its author changed and the 4th record is new. -
Double-click tMongoDBOutput to open its
Basic settings view.
Select the Use existing connection and Die on error check boxes.In the Collection field, enter the name of the collection, namely blog.Select Upsert from the Action on data list. -
Click the [...] button next to Edit schema to open the schema editor.
-
Click the [+] button to add five columns
in the right part, namely id, author, title, keywords and
contents, with the type as Integer and String respectively.
Click
to copy all the columns to the input table.Click Ok to close the editor. -
In the Advanced Settings view, select the
Generate JSON Document check
box.
Select the Remove root node check box.In the Data node and Query node fields, enter "data" and "query".
-
Click the [...] button next to Configure JSON Tree to open the configuration
interface.
-
Right-click the node rootTag and select
Add Sub-element from the contextual
menu.
In the dialog box that appears, type in data for the Data node:
Click OK to close the window.Repeat this operation to define query as the Query node.Right-click the node data and select Set As Loop Element from the contextual menu.Information noteWarning:These nodes are mandatory for update and upsert actions. They are intended to enable the update and upsert actions though will not be stored in the database.
-
Select all the columns under the Schema
list and drop them to the data node.
In the window that appears, select Create as sub-element of target node.
Click OK to close the window.Repeat this operation to drop the id column from the Schema list under the Query node. -
Right-click the node id under data and select Add
Attribute from the contextual menu.
In the dialog box that appears, type in type as the attribute name:
Click OK to close the window.Right-click the node @type under id and select Set A Fix Value from the contextual menu.In the dialog box that appears, type in integer as the attribute value, ensuring the id values are stored as integers in the database.
Click OK to close the window.Repeat this operation to set this attribute for the id node under Query.Click OK to close the JSON Tree configuration interface. -
Double-click tMongoDBInput to open its
Basic settings view.
Select the Use existing connection check box.In the Collection field, enter the name of the collection, namely blog.Click the [...] button next to Edit schema to open the schema editor.
Click the [+] button to add five columns, namely id, author, title, keywords and contents, with the type as Integer and String respectively.Click OK to close the editor.The columns now appear in the left part of the Mapping area.For columns author, title, keywords and contents, enter their parent node post so that the data can be retrieved from the correct positions. -
Double-click tLogRow to open its
Basic settings view.
In the Mode area, select Table (print values in cells of a table for better display.