I tried the workaround described in #577 but that does not solve it. Also, I'd prefer not having to enable PasswordAuthentication anyways.
Log entry on the server:
pid 95039 (etterminal), jid 0, uid 1002: exited on signal 6 (no core dump - other error)