Slow connection with SL 3.0 via Homekit

Even though I have Apple TV and Homepod in all rooms (including one very close to the lock) the connection via Bluetooth is extremely slow, like… more than 10 seconds to execute any command.

Any way to improve that? Meanwhile I’m using a homebridge plugin to be able to use the lock “via wifi” (through HTTP API)