Play in my forks

Regarding play in my forks: If I see movement between the upper and lower part of the fork when the brakes are on, it is to me a good sign that I need a new fork. Is this condition at all dangerous? Or can I take my time in finding a replacement?