Cygnus release / 0.6.0 does not create extended Hive tables
I am running a cygnus instance in Fi-Lab vm. I compiled it from the /0.6.0 branch release. Everything works, except that no extended Hive tables are created for context updates. Cygnus successfully receives updates from Orion, they are sent to Cosmos and HDFS files are generated.
The cygnus log speaks Creating Hive external table=...
and does not throw any error. Then if I go into the space head node I can see the HDFS files generated, but if I use the Hive console there won't be tables there.
If I type SHOW TABLES;
in the Hive console, I see some tables ending in _row
and _column
, so I think it works for others.
Any hint? Should I be using a different version of cygnus?
source to share
Finally I found the problem. Flume uses libthrift 0.7, but cygnus needs 0.9. The solution is in the README (at the end of the section Installing Cygnus and its dependencies (from sources)
), but I missed it. You have to manually overwrite the jar file in Flume bin distribution with version 0.9.
source to share