This typically goes for your Fire Stick's paired remote control as well; the remote is sending signals to the Stick, not the TV, so it typically shouldn't matter if you plug it into a new device.

You can now control your TV's volume using the Volume Up and Volume Down buttons on your Firestick's remote. You can also use the remote's power button to turn the TV off and back on.