Exceptions: org.apache.flink.table.factories.DeserializationSchemaFactory

[Ramya Ramamurthy]

Hi,

I am trying to read from Kafka and push to Elasticsearch. I use Flink SQL tables as well.

I have added all the dependencies in my pom file. But still i get this error. 

If i add the sql-jar to my /lib folder everything works fine. But i want to know whats being missed in creating a fat jar.

i tried to see if all the dependencies are present in my JAR.

I could see i have this :

META-INF/services/org.apache.flink.table.factories.TableFactory

but nothing of this sort on the DeserializationSchemaFactory.

Any suggestions on what could be missing ??

Attaching my pom file.

Thanks,

[Timo Walther-2]

Hi Ramya,

at the first glance your pom.xml looks correct. What is the contents of
META-INF/services/org.apache.flink.table.factories.TableFactory? Is the
JsonXXXFactory listed there?

If not, maybe a Maven service file transformer is missing to collect all
table factories into the service file.

Regards,
Timo


Am 06.02.19 um 13:37 schrieb Ramya Ramamurthy:

> Hi,
>
> I am trying to read from Kafka and push to Elasticsearch. I use Flink
> SQL tables as well.
> I have added all the dependencies in my pom file. But still i get this
> error.
> If i add the sql-jar to my /lib folder everything works fine. But i
> want to know whats being missed in creating a fat jar.
>
> i tried to see if all the dependencies are present in my JAR.
> I could see i have this :
> META-INF/services/org.apache.flink.table.factories.TableFactory
>
> but nothing of this sort on the DeserializationSchemaFactory.
> Any suggestions on what could be missing ??
>
> Attaching my pom file.
>
> Thanks,
>
>

[Ramya Ramamurthy]

Thanks so much Timo.

Adding the ServicesResourceTransformer solved my problem.

Regards,
~Ramya.

On Wed, Feb 6, 2019 at 9:48 PM Timo Walther <[hidden email]> wrote:

> Hi Ramya,
>
> at the first glance your pom.xml looks correct. What is the contents of
> META-INF/services/org.apache.flink.table.factories.TableFactory? Is the
> JsonXXXFactory listed there?
>
> If not, maybe a Maven service file transformer is missing to collect all
> table factories into the service file.
>
> Regards,
> Timo
>
>
> Am 06.02.19 um 13:37 schrieb Ramya Ramamurthy:
> > Hi,
> >
> > I am trying to read from Kafka and push to Elasticsearch. I use Flink
> > SQL tables as well.
> > I have added all the dependencies in my pom file. But still i get this
> > error.
> > If i add the sql-jar to my /lib folder everything works fine. But i
> > want to know whats being missed in creating a fat jar.
> >
> > i tried to see if all the dependencies are present in my JAR.
> > I could see i have this :
> > META-INF/services/org.apache.flink.table.factories.TableFactory
> >
> > but nothing of this sort on the DeserializationSchemaFactory.
> > Any suggestions on what could be missing ??
> >
> > Attaching my pom file.
> >
> > Thanks,
> >
> >
>
>