Dr. Dobb's is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.


Welcome Guest | Log In | Register | Benefits
Channels ▼
RSS

Database

Acquiring Big Data Using Apache Flume



Related Reading


More Insights




kavya tg

Hi Tim, i hope your facing problem with Flume Configuration,,,,I hope this apache flume tutorial may help you to resolve your queries.

kavyatg1990

hi article is very informative, even i suggest to explain in simple manner,,,too configure source,sink and channel in apache flume

TimH041

The only thing I found a problem in your example was the line: hdfs-agent.channels= memory-channel

This needs to be: hdfs-agent.channels= memoryChannel

At least with my latest installation. Prior to this change I was seeing flume-ng errors like:

14/02/09 21:19:52 WARN conf.FlumeConfiguration: Agent configuration for 'hdfs-agent' does not contain any valid channels. Marking it as invalid.

14/02/09 21:19:52 WARN conf.FlumeConfiguration: Agent configuration invalid for agent 'hdfs-agent'. It will be removed.

Changed that one line, and it works fine. FWIW