You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When bigquery.case-insensitive-name-matching is enabled, there is currently no caching of the mappings from case insensitive names to remote case sensitive names:
(see here for details: #10697)
This is a problem because when listing schemas/tables through trino .toRemoteDataset/.toRemoteTable are called once per schema/table respectively, resulting in a listing query for each respective schema/table.
This is likely the root cause of slow metadata listing in this issue: #4580
The issue was reported (Jul 26, 2020) before adding bigquery.case-insensitive-name-matching (Mar 5, 2021) and I could reproduce the issue without the flag.
When
bigquery.case-insensitive-name-matching
is enabled, there is currently no caching of the mappings from case insensitive names to remote case sensitive names:(see here for details: #10697)
This is a problem because when listing schemas/tables through trino
.toRemoteDataset/.toRemoteTable
are called once per schema/table respectively, resulting in a listing query for each respective schema/table.https://github.com/trinodb/trino/blob/master/plugin/trino-bigquery/src/main/java/io/trino/plugin/bigquery/BigQueryMetadata.java#L128
https://github.com/trinodb/trino/blob/master/plugin/trino-bigquery/src/main/java/io/trino/plugin/bigquery/BigQueryMetadata.java#L176-L179
This is likely the root cause of slow metadata listing in this issue: #4580
The text was updated successfully, but these errors were encountered: