TABLE_STORAGE_USAGE_TIMELINE view
The INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE
view provides daily
totals of storage usage for the past 90 days for the following types of tables:
- Standard tables
- Materialized views
- Table clones that have a delta in bytes from the base table
- Table snapshots that have a delta in bytes from the base table
Tables that don't have billable bytes aren't included in the
INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE
view. This includes the
following types of tables:
- External tables
- Anonymous tables
- Empty tables
- Table clones that have no delta in bytes from the base table
- Table snapshots that have no delta in bytes from the base table
When you query the INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE
view, the query results contain one row per day for each table or
materialized view for the current project.
The data in this table is not kept in real time. It takes approximately 72 hours for table data to be reflected in this view.
Storage usage is returned in MiB second. For example, if a project uses 1,000,000 physical bytes for 86,400 seconds (24 hours), the total physical usage is 86,400,000,000 byte seconds, which is converted to 82,397 MiB seconds, as shown in the following example:
86,400,000,000 / 1,024 / 1,024 = 82,397
This is the value that would be returned by the BILLABLE_TOTAL_PHYSICAL_USAGE
column.
For more information, see Storage pricing details.
Required permissions
To query the INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE
view, you need the
following Identity and Access Management (IAM) permissions:
bigquery.tables.get
bigquery.tables.list
Each of the following predefined IAM roles includes the preceding permissions:
roles/bigquery.dataViewer
roles/bigquery.dataEditor
roles/bigquery.metadataViewer
roles/bigquery.admin
For queries with a region qualifier, you must have permissions for the project.
For more information about BigQuery permissions, see Access control with IAM.
Schema
The INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE
view has the following schema:
USAGE_DATE |
DATE |
The billing date for the bytes shown, using the
America/Los_Angeles time zone |
PROJECT_ID |
STRING |
The project ID of the project that contains the dataset |
TABLE_CATALOG |
STRING |
The project ID of the project that contains the dataset |
PROJECT_NUMBER |
INT64 |
The project number of the project that contains the dataset |
TABLE_SCHEMA |
STRING |
The name of the dataset that contains the table or materialized view,
also referred to as the datasetId |
TABLE_NAME |
STRING |
The name of the table or materialized view, also referred to as the
tableId |
BILLABLE_TOTAL_LOGICAL_USAGE |
INT64 |
The total logical usage, in MiB second. Returns 0 if the dataset uses the physical storage billing model. |
BILLABLE_ACTIVE_LOGICAL_USAGE |
INT64 |
The logical usage that is less than 90 days old, in MiB second. Returns 0 if the dataset uses the physical storage billing model. |
BILLABLE_LONG_TERM_LOGICAL_USAGE |
INT64 |
The logical usage that is more than 90 days old, in MiB second. Returns 0 if the dataset uses the physical storage billing model. |
BILLABLE_TOTAL_PHYSICAL_USAGE |
INT64 |
The total usage in MiB second. This includes physical bytes used for fail-safe and time travel storage. Returns 0 if the dataset uses the logical storage billing model. |
BILLABLE_ACTIVE_PHYSICAL_USAGE |
INT64 |
The physical usage that is less than 90 days old, in MiB second. This includes physical bytes used for fail-safe and time travel storage. Returns 0 if the dataset uses the logical storage billing model. |
BILLABLE_LONG_TERM_PHYSICAL_USAGE |
INT64 |
The physical usage that is more than 90 days old, in MiB second. Returns 0 if the dataset uses the logical storage billing model. |
Scope and syntax
Queries against this view must include a region qualifier. The following table explains the region scope for this view:
View name | Resource scope | Region scope |
---|---|---|
[PROJECT_ID.]`region-REGION`.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE[_BY_PROJECT] |
Project level | REGION |
Optional: PROJECT_ID
: the ID of your
Google Cloud project. If not specified, the default project is used.
REGION
: any dataset region name.
For example, `region-us`
.
The following example shows how to return storage information for tables in a specified project:
SELECT * FROM myProject.`region-REGION`.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE;
The following example shows how to return storage information for tables in a specified region:
SELECT * FROM `region-REGION`.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE;
Examples
Example 1
The following example sums the storage usage by day for projects in a specified region.
SELECT usage_date, project_id, SUM(billable_total_logical_usage) AS billable_total_logical_usage, SUM(billable_active_logical_usage) AS billable_active_logical_usage, SUM(billable_long_term_logical_usage) AS billable_long_term_logical_usage, SUM(billable_total_physical_usage) AS billable_total_physical_usage, SUM(billable_active_physical_usage) AS billable_active_physical_usage, SUM(billable_long_term_physical_usage) AS billable_long_term_physical_usage FROM `region-REGION`.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE GROUP BY 1, 2 ORDER BY usage_date;
The result is similar to the following:
+-------------------------+------------------------------+-------------------------------+-----------------------------------+-------------------------------+--------------------------------+-------------------------------------+ | usage_date | project_id | billable_total_logical_usage | billable_active_logical_usage | billable_long_term_logical_usage | billable_total_physical_usage | billable_active_physical_usage | billable_long_term_physical_usage | +-------------------------+------------------------------+-------------------------------+-----------------------------------+-------------------------------+--------------------------------+-------------------------------------+ | 2023-04-03 | project_A | 305085738096 | 7667321458 | 297418416638 | 74823954823 | 124235724 | 74699719099 | +-------------------------+------------------------------+-------------------------------+-----------------------------------+-------------------------------+--------------------------------+-------------------------------------+ | 2023-04-04 | project_A | 287033241105 | 7592334614 | 279440906491 | 75071991788 | 200134561 | 74871857227 | +-------------------------+------------------------------+-------------------------------+-----------------------------------+-------------------------------+--------------------------------+-------------------------------------+ | 2023-04-03 | project_B | 478173930912 | 8137372626 | 470036558286 | 0 | 0 | 0 | +-------------------------+------------------------------+-------------------------------+-----------------------------------+-------------------------------+--------------------------------+-------------------------------------+ | 2023-04-04 | project_B | 496648915405 | 7710451723 | 488938463682 | 0 | 0 | 0 | +-------------------------+------------------------------+-------------------------------+-----------------------------------+-------------------------------+--------------------------------+-------------------------------------+
Example 2
The following example shows the storage usage for a specified day for tables in a dataset that uses logical storage.
SELECT usage_date, table_schema, table_name, billable_total_logical_usage FROM `region-REGION`.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE WHERE project_id = 'PROJECT_ID' AND table_schema = 'DATASET_NAME' AND usage_date = 'USAGE_DATE' ORDER BY billable_total_logical_usage DESC;
The result is similar to the following:
+--------------+--------------+------------+------------------------------+ | usage_date | table_schema | table_name | billable_total_logical_usage | +--------------+--------------+------------+------------------------------+ | 2023-04-03 | dataset_A | table_4 | 734893409201 | +--------------+--------------+------------+------------------------------+ | 2023-04-03 | dataset_A | table_1 | 690070445455 | +--------------+--------------+------------+------------------------------+ | 2023-04-03 | dataset_A | table_3 | 52513713981 | +--------------+--------------+------------+------------------------------+ | 2023-04-03 | dataset_A | table_2 | 8894535355 | +--------------+--------------+------------+------------------------------+
Example 3
The following example shows the storage usage for the most recent usage date for tables in a dataset that uses physical storage.
SELECT usage_date, table_schema, table_name, billable_total_physical_usage FROM ( SELECT *, ROW_NUMBER() OVER (PARTITION BY project_id, table_schema, table_name ORDER BY usage_date DESC) AS rank FROM `region-REGION`.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE ) WHERE rank = 1 AND project_id = 'PROJECT_ID' AND table_schema ='DATASET_NAME' ORDER BY usage_date;
The result is similar to the following:
+--------------+--------------+------------+-------------------------------+ | usage_date | table_schema | table_name | billable_total_physical_usage | +--------------+--------------+------------+-------------------------------+ | 2023-04-12 | dataset_A | table_4 | 345788341123 | +--------------+--------------+------------+-------------------------------+ | 2023-04-12 | dataset_A | table_1 | 0 | +--------------+--------------+------------+-------------------------------+ | 2023-04-12 | dataset_A | table_3 | 9123481400212 | +--------------+--------------+------------+-------------------------------+ | 2023-04-12 | dataset_A | table_2 | 1451334553 | +--------------+--------------+------------+-------------------------------+
Example 4
The following example joins the TABLE_OPTIONS
and
TABLE_STORAGE_USAGE_TIMELINE
views to get storage usage details based on tags.
SELECT * FROM region-REGION.INFORMATION_SCHEMA.TABLE_OPTIONS INNER JOIN region-REGION.INFORMATION_SCHEMA.TABLE_STORAGE_USAGE_TIMELINE USING (TABLE_CATALOG, TABLE_SCHEMA, TABLE_NAME) WHERE option_name='tags' AND CONTAINS_SUBSTR(option_value, '(\"tag_namespaced_key\", \"tag_namespaced_value\")')