Flume is a distributed, reliable, and available service for
efficiently collecting, aggregating, and moving large amounts of log
data. It has a simple and flexible architecture based on streaming
data flows. It is robust and fault tolerant with tunable reliability
mechanisms and many failover and recovery mechanisms. It
uses a simple extensible data model that allows for online analytic
application.
News
Oct 24, 2022 - Apache Flume 1.11.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.11.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Flume 1.11.0 is stable, production-ready software, and is backwards-compatible with
previous versions of the Flume 1.x codeline.
This version of Flume adds support for deploying Flume as a Spring Boot application, adds support to the
Kafka source and sink for passing the Kafka timestamp and headers, and allows SSL hostname verification
to be disabled in the Kafka source and sink.
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
Aug 16, 2022 - Apache Flume 1.10.1 Released
The Apache Flume team is pleased to announce the release of Flume 1.10.1.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Flume 1.10.1 is stable, production-ready software, and is backwards-compatible with
previous versions of the Flume 1.x codeline.
This version of Flume adds the automatic module name to the manifest of the various Flume
jars allowing them to be usable in applications using the Java Platform Module System.
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
June 13, 2022 - Apache Flume 1.10.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.10.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Flume 1.10.0 is stable, production-ready software, and is backwards-compatible with
previous versions of the Flume 1.x codeline.
This version of Flume upgrades many dependencies, resolving the CVEs associated with them.
Enhancements included in this release include the addition of a LoadBalancingChannelSelector,
the ability to retrieve the Flume configuration from a remote source such as a Spring
Cloud Config Server, and support for composite configurations.
Flume has been updated to use Log4j 2.x instead of Log4j 1.x.
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
January 8, 2019 - Apache Flume 1.9.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.9.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.9.0 is the eleventh Flume release as an Apache top-level project. Flume
1.9.0 is stable, production-ready software, and is backwards-compatible with
previous versions of the Flume 1.x codeline.
Several months of active development went into this release: about 70 patches were committed since 1.8.0, representing many features, enhancements, and bug fixes. While the full change log can be found on the 1.9.0 release page (link below), here are a few new feature highlights:
Better SSL/TLS support
Configuration Filters to provide a way to inject sensitive information like passwords into the configuration
Float and Double value support in Context
Kafka client upgraded to 2.0
HBase 2 support
Below is the list of people (from Git logs) who submitted and/or reviewed
improvements to Flume during the 1.9.0 development cycle:
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
October 4, 2017 - Apache Flume 1.8.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.8.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.8.0 is the eleventh Flume release as an Apache top-level project. Flume
1.8.0 is stable, production-ready software, and is backwards-compatible with
previous versions of the Flume 1.x codeline.
Several months of active development went into this release: about 80 patches were committed since 1.7.0, representing many features, enhancements, and bug fixes. While the full change log can be found on the 1.8.0 release page (link below), here are a few new feature highlights:
Add Interceptor to remove headers from event
Provide netcat UDP source as alternative to TCP
Support environment variables in configuration files
Below is the list of people (from Git logs) who submitted and/or reviewed
improvements to Flume during the 1.8.0 development cycle:
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
October 17, 2016 - Apache Flume 1.7.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.7.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.7.0 is the tenth Flume release as an Apache top-level project.
Flume 1.7.0 is stable, production-ready software, and is backwards-compatible
with previous versions of the Flume 1.x codeline.
Several months of active development went into this release: almost 100 patches were committed since 1.6.0, representing many features, enhancements, and bug fixes. While the full change log can be found on the 1.7.0 release page (link below), here are a few new feature highlights:
Taildir source
Kafka integration improvements (eg. security)
Below is the list of people (from Git/SVN logs) who submitted and/or reviewed
improvements to Flume during the 1.7.0 development cycle:
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
May 20, 2015 - Apache Flume 1.6.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.6.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.6.0 is the ninth Flume release as an Apache top-level project.
Flume 1.6.0 is stable, production-ready software, and is backwards-compatible
with previous versions of the Flume 1.x codeline.
Several months of active development went into this release: 105 patches were committed since 1.5.2, representing many features, enhancements, and bug fixes. While the full change log can be found on the 1.6.0 release page (link below), here are a few new feature highlights:
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
November 18, 2014 - Apache Flume 1.5.2 Released
The Apache Flume team is pleased to announce the release of Flume 1.5.2
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.5.2 is the eighth Flume release as an Apache top-level project.
Flume 1.5.2 is stable, production-ready software, and is backwards-compatible
with previous versions of the Flume 1.x codeline.
Apache Flume 1.5.2 is a security and maintenance release that disables SSLv3
on all components in Flume that support SSL/TLS. All users are encouraged to
update to this release as soon as possible.
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
July 16, 2014 - Apache Flume 1.5.0.1 Released
The Apache Flume team is pleased to announce the release of Flume 1.5.0.1
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.5.0.1 is the sixth Flume release as an Apache top-level project.
Flume 1.5.0.1 is stable, production-ready software, and is backwards-compatible
with previous versions of the Flume 1.x codeline.
Apache Flume 1.5.0.1 is a maintenance release primarily meant to add support to build
against Apache HBase 0.98.x. This release adds a new build profile that builds Flume
against HBase 0.98.2.
Apache BigTop 0.8.0 release will ship Flume binaries built
against HBase 0.98.x.
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
May 20, 2014 - Apache Flume 1.5.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.5.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.5.0 is the fifth Flume release as an Apache top-level project.
Flume 1.5.0 is stable, production-ready software, and is backwards-compatible
with previous versions of the Flume 1.x codeline.
Several months of active development went into this release: 123 patches were committed since 1.4.0, representing many features, enhancements, and bug fixes. While the full change log can be found on the 1.5.0 release page (link below), here are a few new feature highlights:
New in-memory channel that can spill to disk
A new dataset sink that use Kite API to write data to HDFS and HBase
Support for Elastic Search HTTP API in Elastic Search Sink
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
July 2, 2013 - Apache Flume 1.4.0 Released
The Apache Flume team is pleased to announce the release of Flume 1.4.0.
Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of streaming event data.
Version 1.4.0 is the fourth Flume release as an Apache top-level project.
Flume 1.4.0 is stable, production-ready software, and is backwards-compatible
with previous versions of the Flume 1.x codeline.
Six months of active development went into this release: 261 patches were committed since 1.3.1, representing many features, enhancements, and bug fixes. While the full change log can be found on the 1.4.0 release page (link below), here are a few new feature highlights:
New JMS Source
New Solr Sink with ETL capabilities
Updated ElasticSearch sink to support ES version 0.90
Support for secure SSL transport over Avro-RPC clients, sources & sinks
Support for Thrift-RPC as a transport mechanism
Support for embedding a Flume agent within applications
Support for a new plugins.d directory structure for managing Flume addons
Support for reading Avro files via the Spooling Directory source
Support for writing Avro files with arbitrary schemas via the HDFS sink
Support for ingesting Avro-serializable objects via the log4j API
Improvements to the file channel to keep a backup checkpoint to avoid replays
Performance improvements to the file channel, including group commit
New file channel consistency check tool
Below is the list of people (from Git/SVN logs) who submitted and/or reviewed
improvements to Flume during the 1.4.0 development cycle:
This release can be downloaded from the Flume Download page.
Your contributions, feedback, help and support make Flume better!
For more information on how to report problems or contribute,
please visit our Get Involved page.
The Apache Flume Team
January 2, 2013 - Apache Flume 1.3.1 Released
The Apache Flume team is pleased to announce the release of Flume version 1.3.1.
Apache Flume 1.3.1 is the fifth release under the auspices of Apache of the
so-called “NG” codeline, and our third release as a top-level Apache
project! Flume 1.3.1 has been put through many stress and regression tests,
is stable, production-ready software, and is backwards-compatible with
Flume 1.3.0 and Flume 1.2.0.
Apache Flume 1.3.1 is a maintainance release for the 1.3.0 release, and includes
several bug fixes and performance enhancements.
The Apache Flume team is pleased to announce the release of Flume version 1.3.0.
Apache Flume 1.3.0 is the fourth release under the auspices of Apache of the
so-called “NG” codeline, and our second release as a top-level Apache
project! Flume 1.3.0 has been put through many stress and regression tests,
is stable, production-ready software, and is backwards-compatible with
Flume 1.2.0.
Four months of very active development went into this release: a whopping
221 patches were committed since 1.2.0, representing many features,
enhancements, and bug fixes. While the full change log can be found in the
link below, here are a few new feature highlights:
The Apache Flume team is pleased to announce the release of Flume version 1.2.0.
Apache Flume 1.2.0 is the third release under the auspices of Apache of the
so-called “NG” codeline, and our first release as a top-level Apache
project! Flume 1.2.0 has been put through many stress and regression tests,
is stable, production-ready software, and is backwards-compatible with
Flume 1.1.0.
Four months of very active development went into this release: a whopping
192 patches were committed since 1.1.0, representing many features,
enhancements, and bug fixes. While the full change log can be found in the
link below, here are a few new feature highlights:
New durable file channel
New client API
New HBase sinks (two different implementations)
New Interceptor interface (a plugin processing API)
Strata + Hadoop World (http://strataconf.com/stratany2012) will be
held October 23-25 in NYC. A Flume Meetup is being organized
around this event. This Meetup will be a good place for users to
interact with each other and with Flume developers.
In order to help with organization, a form
has been set up with a few questions about what kind of Meetup the community wants, and which evening is best.
Please fill out the form.
Feel free to post to the User’s mailing list with any questions.
