There is currently a hard check in build.gradle that excludes AArch64 cpu's being used on linux.
Removing this hard check allows to build OpenJFX (base/graphics/controls/fxml) for Linux AArch64.
Additional changes might be needed for the media and web module, and they should be tackled in different issues.