The safety of the recovery phrase is way more important than keeping the hardware wallet safe, according to executives at Ledger and Trezor.