osdir.com

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re:


Hi Hengyu,

currently, metadata between Flink programs can only be shared via code. For this, we recently introduced a programmatic descriptor-based way of specifying sources and sinks [1].

However, a catalog such as Hive metastore would be much easier and the community is currently working on making this possible [2].

Regards,
Timo



Am 27.11.18 um 09:44 schrieb Henry Dai:
Hi,
Is there a way to get table's metadata in flink?
if I emit a table to kafka, then how can I know the table columns when I subscribe the kafka topic and restore the table using tableEnv.registerDataStream("t1", source, "field1, field2 ...")  in another flink program?

Flink should provide something like Hive's metastore to keep metadata of tables.

--
best wishes
hengyu