data-collector log-collector Ruby fluentd logging cncf HTML
Need help with fluentd?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.
fluent

Description

Fluentd: Unified Logging Layer (project under CNCF)

9.8K Stars 1.1K Forks Apache License 2.0 5.7K Commits 226 Opened issues

Services available

Need anything else?

Fluentd: Open-Source Log Collector

Travis CI:

Code Climate CII Best Practices FOSSA Status

Drone CI for Arm64:

pipeline status

Fluentd collects events from various data sources and writes them to files, RDBMS, NoSQL, IaaS, SaaS, Hadoop and so on. Fluentd helps you unify your logging infrastructure (Learn more about the Unified Logging Layer).

An event consists of tag, time and record. Tag is a string separated with '.' (e.g. myapp.access). It is used to categorize events. Time is a UNIX time recorded at occurrence of an event. Record is a JSON object.

Example Use Cases

Use Case

Description Diagram
Centralizing Apache/Nginx Server Logs Fluentd can be used to tail access/error logs and transport them reliably to remote systems.
Syslog Alerting Fluentd can "grep" for events and send out alerts.
Mobile/Web Application Logging Fluentd can function as middleware to enable asynchronous, scalable logging for user action events.

Quick Start

$ gem install fluentd
$ fluentd -s conf
$ fluentd -c conf/fluent.conf &
$ echo '{"json":"message"}' | fluent-cat debug.test

Development

Branch

  • master: For v1 development.
  • v0.12: For v0.12. This is deprecated version. we already stopped supporting (See https://www.fluentd.org/blog/drop-schedule-announcement-in-2019).

Prerequisites

  • Ruby 2.4 or later
  • git

git
should be in
PATH
. On Windows, you can use
Github for Windows
and
GitShell
for easy setup.

Install dependent gems

Use bundler:

$ gem install bundler
$ bundle install --path vendor/bundle

Run test

$ bundle exec rake test

You can run specified test via

TEST
environment variable:
$ bundle exec rake test TEST=test/test_specified_path.rb
$ bundle exec rake test TEST=test/test_*.rb

Fluentd UI: Admin GUI

Fluentd UI is a graphical user interface to start/stop/configure Fluentd.

More Information

  • Website: https://www.fluentd.org/
  • Documentation: https://docs.fluentd.org/
  • Project repository: https://github.com/fluent
  • Discussion: https://groups.google.com/group/fluentd
  • Slack / Community: https://slack.fluentd.org
  • Newsletters: https://www.fluentd.org/newsletter
  • Author: Sadayuki Furuhashi
  • Copyright: 2011-2019 Fluentd Authors
  • License: Apache License, Version 2.0

Security

A third party security audit was performed by Cure53, you can see the full report here.

Contributors:

Patches contributed by great developers.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.