You are about 10 seconds from a disaster.
The harmonic balancer is a two piece affair. An outside ring, and the inside one that the bolt goes through. There is a thin rubber ring that holds the two together. If it's wiggling then that ring is shot, and the two parts are about to come apart and you could expect much damage if/when they do.
I'd be getting this fixed right away, if not sooner.
.