Data Catalog

Purpose & Use Case

The Data Catalog is a centralized metadata store for discovering AmSC datasets.
It is a catalog of catalogs, synthesizing dataset registries from AmSC Infrastructure Partners and facilities.
AmSC Early Users can access the AmSC Data Catalog to search for registered datasets using an API or via an agentic interface.

Functionality

• Based on OpenMetadata
• Data Catalog manages references to datasets hosted by IPs as well as curated datasets in the AmSC Data Lakehouse
• IP Data Owners/Data Stewards will have responsibility and access to manage catalog entries
• Catalog updated via push (API calls) or pull (OpenMetadata connectors)
• Catalog will enforce a minimal schema
• OpenMetadata data classification types/levels and AmSC projects will be used for access control

Current Status

Service available to AmSC Early Users only

Roadmap