[jira] [Created] (FLINK-13611) Introduce analyze statistic utility to generate table & column statistics

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13611) Introduce analyze statistic utility to generate table & column statistics

Shang Yuanchun (Jira)
godfrey he created FLINK-13611:
----------------------------------

             Summary: Introduce analyze statistic utility to generate table & column statistics
                 Key: FLINK-13611
                 URL: https://issues.apache.org/jira/browse/FLINK-13611
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / Planner
            Reporter: godfrey he
             Fix For: 1.10.0


this issue aims to introduce a utility class to generate table & column statistics, the main steps include:
1. generate sql, like {{select approx_count_distinct(a) as ndv, count(1) - count(a) as nullCount, avg(char_length(a)) as avgLen, max(char_lenght(a)) as maxLen, max(a) as maxValue, min(a) as minValue, ... from MyTable }}
2. execute the query
3. convert to the result to {{TableStats}} (maybe the source table is not a catalog table)
4. convert to {{TableStats}} to {{CatalogTableStatistics}} if needed

This issue does not involve DDL, however the DDL could use this utility class once it's supported.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)