aircompressor

by airlift

airlift / aircompressor

A port of Snappy, LZO, LZ4, and Zstandard to Java

227 Stars 56 Forks Last release: Not found Apache License 2.0 246 Commits 17 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

Compression in pure Java

Maven Central Build Status

This library contains implementations of LZ4, Zstandard (Zstd), Snappy, and LZO written in pure Java. They are typically 10-40% faster than the JNI wrapper for the native libraries.

Hadoop CompressionCodec

In addition to the raw block encoders, there are implementations of the Hadoop CompressionCodec for each algorithm. They are typically 300% faster than the JNI wrappers.

Requirements

This library requires a Java 1.8+ virtual machine containing the

sun.misc.Unsafe
interface running on a little endian platform.

Users

This library is used in projects such as Presto (https://prestosql.io), a distributed SQL engine.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.