Why is the Google smart speaker device in my home responding when I'm trying to use the Google Assistant on my Stream TV Box?

When using the Google Assistant on the Stream TV Box, you simply press and release the Google button on the remote. You do not need to say “Hey Google” which is what triggers a Google smart speaker device to answer you.