Clever Geek Handbook

Integration Flume - Solr

This is my scenario.

JSON input goes into Flume and needs to be indexed and stored in Solr in real time. I am using the latest CDH.

I haven't found the documentation complete. It turns off in places.

Could you point me in the right direction?

  • Should I use a Morphilines sink and say don't do any conversions? Or if I don't want any conversions to json, can I use some other sink to write Solr directly?
  • Pointers to documentation with clear steps.
  • Or please list what you are doing step by step (very high level of course).
+3


source to share


1 answer


Here are some pointers:

1) If your source is RabbitMQ, JMSSource is the correct component.



2) If you haven't created your own SOLR file, I would recommend using MorphlineSOLRSink without conversion. Works great. If you need to transform or change anything, you can either implement your own custom handler or use an interceptor. Keep in mind that the number of SOLR entries must match the number of events your source receives.

+1


source






More articles:


All Articles