[jira] [Created] (FLINK-20416) Need a cached catalog for batch SQL job

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-20416) Need a cached catalog for batch SQL job

Shang Yuanchun (Jira)
Sebastian Liu created FLINK-20416:
-------------------------------------

             Summary: Need a cached catalog for batch SQL job
                 Key: FLINK-20416
                 URL: https://issues.apache.org/jira/browse/FLINK-20416
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / API, Table SQL / Planner
            Reporter: Sebastian Liu


For OLAP scenarios, There are usually some analytical queries which running time is relatively short. These queries are also sensitive to latency. In the current Blink sql processing, parse/validate/optimize stages are all need meta data from catalog API. But each request to the catalog requires re-run of the underlying meta query. 

 

We may need a cached catalog which can cache the table schema and statistic info to avoid unnecessary repeated meta requests. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)