Skip to content
phunt edited this page Sep 14, 2010 · 26 revisions

Flume Frequently Asked Questions

These FAQs and answers are relative to the current release unless otherwise noted.

How do I change the maximum raw event size?

Set the flume.event.max.size.bytes property in the flume-site.xml file to a max size value.

Where can I get a tar ball with source?

http://archive.cloudera.com/cdh/3/

Does this version support output file compression?

Not yet, it is on our list of things TODO !

autoDFOChain stuff seems to hang!

Yup, it’s a bug. Fix one bug and it causes a bunch of new ones to appear. We are working on it. autoBEChain stuff is more likely to work at the moment.

Why is zookeeper a dependency? Why is it included?

We use it to make the master reliable.

From packages, flume runs as a flume user but we can’t read certain files becuase they belong to root!

For now, we suggest adding a group that the flume user is part of, and make the file give read writes to members of that group.

Clone this wiki locally