Migration to Hierarchical Metadata
The earlier metamodel/profile for JSON was too limited and incomplete as it did not model both arrays and structures, and did not capture the root object which could be an array. This situation has been corrected in the latest product. This change has impact in many places both MIMB and MIMM.
In MIMB, JSON is used by almost all bridges except databases.
- File System / Data Lakes
- File System (Delimited, Fixed Width, Excel, XML, JSON, Avro, Parquet, ORC, COBOL Copybook)
- AWS Simple Storage Service (S3) File System
- Azure Data Lake Storage (ADLS) File System
- Azure Blob Storage File System
- Google Cloud Storage (GCS) File System
- Kafka File System
- Swift Object Store File System
- NoSQL databases bvased on JSON
- MongoDB
- Azure Cosmos DB NoSQL Database
- Cassandra
- CouchDB
- ETL/DI/BI bridges reading/writing JSON file based data stores
- Data Mapping Script
- any DI tool supporting hierrachies like Talend DI jobs (many stitched to JSON files)
- Haddop HiveQL
In MIMM, JSON is also used with
- Model Browser
- Data Mapper
- Data Flow
- Configuration / Connection resolutions
- And others.
In order to ensure proper migration and no loss of metadata and no loss of linking (documentation, mappings, stitching/data flow, etc.) this upgrade is performed automatically as part of the database upgrade to this latest version.