Hash128 - script and chart function

Overview

Open the Data load editor and add the load script below to a new tab.

The load script contains:

• A dataset which is loaded into a data table called Example.

• The following fields which will be used to create a 128-bit hash value:

  • Region

  • Year

  • Month

Load script

Example:
Load *
inline [
Region, Year, Month
abc, xyz, 123
EU, 2022, 01
UK, 2022, 02
US, 2022, 02
];

Results

Load the data and open a sheet. Create a new table and add these fields as dimensions:

• Region

• Year

• Month

Create the following calculated dimension:

• =Hash128(Region, Year, Month), to calculate the 128-bit hash value.

For each row, the hash strings for Region, Year, and Month are joined together and a 22-character string is returned.

The following code shows how to use the function in a load script.

Hash_128:
Load *,
Hash128(Region, Year, Month) as Hash128_Region_Year_Month;
Load * inline [
Region, Year, Month
abc, xyz, 123
EU, 2022, 01
UK, 2022, 02
US, 2022, 02 ];

Overview

This example creates a unique hash value for each product entry. The hash value serves as a unique identifier, allowing the company to detect and manage duplicates effectively.

Open the Data load editor and add the load script below to a new tab.

The load script contains:

• A dataset which is loaded into a data table called Example.

• The following fields in the data table:

  • TransactionID

  • ProductID

  • ProductName

  • SupplierID

Load script

Example:
Load *
inline [
TransactionID, ProductID, ProductName, SupplierID
1, 101, Widget A, S001, 100
2, 102, Widget B, S002, 200
3, 101, Widget A, S001, 50
];

Results

Load the data and open a sheet. Create a new table and add these fields as dimensions:

• Transaction ID

• ProductID

• ProductName

• SupplierID

Create the following calculated dimension:

• =Hash128(ProductID, ProductName, SupplierID), to calculate a 22-character key.

Compare the output of the Hash128 function. Notice that the first and third TransactionID records have duplicate hash values because the combination of the ProductID, ProductName, and SupplierID strings are the same for these rows.

Overview

A financial services company handles sensitive customer information, such as credit card numbers, social security numbers, and customer names. To protect privacy and ensure compliance with regulations such as General Data Protection Regulation (GDPR) or Health Insurance Portability and Accountability Act (HIPAA), they need to anonymize sensitive data when generating reports for analysis. However, they also need to maintain consistency, so that they can track the same customer across different datasets without revealing the customer's identity.

Open the Data load editor and add the load script below to a new tab.

The load script contains:

• A dataset which is loaded into a data table called Example.

• The following fields in the data table:

  • CustomerID

  • CustomerName

  • SSN

Load script

Example:
Load *
inline [
CustomerID, CustomerName, SSN
101, John Doe, 123-45-6789|
102, Jane Smith, 987-65-4321
];

Results

Load the data and open a sheet. Create a new table and add these fields as dimensions:

• CustomerID

• CustomerName

• SSN

Create the following calculated dimensions:

• ​=Hash128(CustomerName)

• =Hash128(SSN)

• Data Privacy: The original sensitive data is not directly visible, but the hash value remains consistent across different records. This allows for analysis, such as aggregating customer activity, without exposing the actual identity of the customer.

• Compliance: By hashing sensitive fields, the company ensures compliance with data privacy regulations.

• Security: The hash function produces a fixed-size output that is not reversible, adding an extra layer of protection for sensitive data.