You have to put the original remote away in a drawer, and use something that Home Assistant (or other smart home platform / controller) can use as a trigger instead - whatever combinations you feel like your family will respond well to. That, paired with Bond’s local network API, is the most reliable way to keep smart control of inherently un-smart RF one-way signals, even with a Bridge.
For instance, I use Insteon switches + remotes, as well as Logitech Harmony remotes and Bond Sidekick remotes to trigger fan on or off, speed, and light kit on/off (as well as color).
It is not necessarily the most simple to set up, and yes, even with pretty robust design occasionally something gets out of sync (power blips or whatnot being contributing factors).
That being said, a Bond Bridge Pro + Sidekick remotes, while not inexpensive and noted that it would still require putting the original remote away in a drawer, may be the lowest maintenance solution.
An alternative would be to find and change fans out to kinds which have discrete Fan ON vs Fan OFF (and potentially Light ON vs Light OFF) signals, but I don’t know if a good list of that kind of fan + remote.