[jira] [Created] (FLINK-13918) Add class for TokenizerMapper.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13918) Add class for TokenizerMapper.

Shang Yuanchun (Jira)
Xu Yang created FLINK-13918:
-------------------------------

             Summary: Add class for TokenizerMapper.
                 Key: FLINK-13918
                 URL: https://issues.apache.org/jira/browse/FLINK-13918
             Project: Flink
          Issue Type: Sub-task
          Components: Library / Machine Learning
            Reporter: Xu Yang


TokenizerMapper is a transformer to transform all words into lower case, and split it by white space.
 * Add TokenizerMapper for the operation of the TokenizerMapper.
 * Add TokenizerMapperParams for the params of TokenizerMapper.
 * Add TokenizerMapperTest for the test example.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)