Docly

Finding Important Information about Tables and Columns

Estimated reading: 4 minutes

Stemma provides out-of-the-box integration with applications such as Snowflakedbt, and dashboarding systems such as Looker to capture rich metadata from each of these systems automatically. For example, in the case of Snowflake, Stemma reads both the information_schema and the query logs, and automatically generates important information such as when a table was last updated, table-to-table lineage, table-to-dashboard lineage, frequent queriers of the table, common join and filter conditions, etc.

The Stemma UI makes it easy for you to discover this important information about your tables and columns, and also provides a convenient way to add and modify curated information.

The table details page provides following information:

Table attributes

Asset status:

This can be CertifiedDeprecatedIntermediate, or No Status:

336

Description:

A brief summary of the contents of the table:

338

See Advanced Description Editing for more information.

Issues:

JIRA issues logged against this table:

441

This section explains how to link a JIRA issue to the Stemma catalog.

Owners:

The person or people responsible for maintaining this table:

441

Click on an owner to see other assets owned by that user, as well as their bookmarks and frequently used tables. You can also email the user via this profile page.

See also Assigning Bulk Ownership of Tables.

Last Updated:

The date and time of the last update to the table (this can be different from the most recent date covered by the data itself):426

Date Range:

The date range covered by the data in the table.

173

Note that this need not be synchronous with the Last updated date and time, which simply reflects the date of the most recent modification to the table.

Tags:

Descriptive tags for cross-referencing, such as covidcases, etc.:

187

Frequent Users:

People who have frequently used this table:

288

Click on a user to see assets owned by that user, as well as their bookmarks and other frequently used tables. You can also email the user via this profile page. See also How Does Stemma Calculate “Top 5 Columns”, “Frequent Users”, etc?

Commonly Used With

Links to tables often used with this one (see Using Commonly Used With). See also How Does Stemma Calculate “Top 5 Columns”, “Frequent Users”, etc?

288

Table lineage graph:

See Displaying Data Lineage in the Stemma UI :

Dashboards:

Dashboards that use the table:864

See also Finding Important Information about Dashboards.

Upstream, Downstream:

Upstream and downstream tables:

:576576

See also Displaying Data Lineage in the Stemma UI

Slack Conversations:

Slack threads that mention this table:864

Column attributes

Column description:

Brief description of the column contents:864

See Advanced Description Editing for more information.

Data type:

Text or Number:

750

Column Statistics:

For example, minimum and maximum values over a period:720

Shared descriptions:

See Sharing Column Descroptions.

Column usage and lineage:

The most-used upstream and downstream columns, as measured by the number of queries, dashboard views, catalog views, etc.:

288

See also Tracking Data Lineage and How Does Stemma Calculate “Top 5 Columns”, “Frequent Users”, etc?.

Curated versus automated metadata

Where possible, Stemma captures the information directly from the source. This table shows which attributes are populated from the source and which you can edit:.

Table MetadataAutomatically captured?Users can edit?
Table description.
Asset status.
Owners✅ (dbt)
Tags✅ (dbt)
Jira issues
Last updated time
Data date range
Commonly used with tables
Frequent users
Upstream & downstream table lineage
Dashboards that use the table
Slack threads with table mentions

Notes

Editing curated items

To add or edit a curated item, hover you cursor over over it until you see a pencil; then click on the pencil and add or edit text in the resulting box.389389

Using Commonly Used With

Clicking on a link below this heading opens a dialog window. This window provides details of the usage; for example:1008