Calling set on VarHandle in java 14 causes UnsatisfiedLinkError

I'm invoking the set method via reflection on the VarHandle instance

set.invoke(varHandle, arrayOf(field, field.modifiers and Modifier.FINAL.inv()))

However I'm getting UnsatisfiedLinkError everytime and I wasn't able to find anything related to my situation.

Caused by: java.lang.UnsatisfiedLinkError: 'void java.lang.invoke.VarHandle.set(java.lang.Object[])'

The field VarHandle points to is the modifiers field of Field class