High-performance, vendor-neutral observability pipelines.
The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:
Vector is a lightweight, ultra-fast, open-source tool for building observability pipelines. Compared to Logstash and friends, Vector improves throughput by ~10X while significantly reducing CPU and memory usage.
The following performance tests demonstrate baseline performance between common protocols with the exception of the Regex Parsing test.
| Test | Vector | Filebeat | FluentBit | FluentD | Logstash | SplunkUF | SplunkHF | | ---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | | TCP to Blackhole | 86mib/s | n/a | 64.4mib/s | 27.7mib/s | 40.6mib/s | n/a | n/a | | File to TCP | 76.7mib/s | 7.8mib/s | 35mib/s | 26.1mib/s | 3.1mib/s | 40.1mib/s | 39mib/s | | Regex Parsing | 13.2mib/s | n/a | 20.5mib/s | 2.6mib/s | 4.6mib/s | n/a | 7.8mib/s | | TCP to HTTP | 26.7mib/s | n/a | 19.6mib/s | <1mib/s | 2.7mib/s | n/a | n/a | | TCP to TCP | 69.9mib/s | 5mib/s | 67.1mib/s | 3.9mib/s | 10mib/s | 70.4mib/s | 7.6mib/s |
To learn more about our performance tests, please see the Vector test harness.
The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:
| Test | Vector | Filebeat | FluentBit | FluentD | Logstash | Splunk UF | Splunk HF | | ---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | | Disk Buffer Persistence | ✅ | ✅ | ❌ | ❌ | ⚠️ | ✅ | ✅ | | File Rotate (create) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | File Rotate (copytruncate) | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | | File Truncation | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | Process (SIGHUP) | ✅ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | | JSON (wrapped) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ |
To learn more about our correctness tests, please see the Vector test harness.
swimlanestransform allow for complex control-flow logic.
typesoption that can automatically parse timestamps.
leveldbfor robust data durability across restarts.
Run the following in your terminal, then follow the on-screen instructions.
curl --proto '=https' --tlsv1.2 -sSf https://sh.vector.dev | sh
Or use your own preferred method.