ChaCha20 uses CipherCore for it's byte[] and ByteBuffer operations. CipherCore does too much copying of data that it slows down performance. Similar to what was done with AES/GCM, ChaCha20 and Poly1305 should operate on input & output data directly to avoid these slowdowns