It won't damage your watch, but it might get magnetized, which isn't an issue. If it gets magnetized, you can go to any watchmaker to get it de-magnetized for free.
This account is verified. WatchCrunch has confirmed that this account is the authentic presence for this person or brand.