There are some issues with stability in controlling multiple shades in the publicly-released versions of the Bond firmware. There’s a fix already released to beta which I hope to get public next week.
Can you check how the Google Home app groups them up? Google handles all the mapping between voice command and device, so this might give you some insight into what’s going on. Let me know if everything looks as expected there and we’ll dig deeper.