this is not exactly a thumb rule...its written in code commentary of ASCE 7-05 chapter CC3 or 2 i think...
building drift should fulfill this requirement unless you are sure that the building is more ductile and can satisfy other limits for example H/200 etc...
but remember this one check only for wind and the wind is service is here...
you need to satisfy inter stroey drifts too for wind..and you can consider the limit to be 10mm
similary you need to satisfy seismic drift of 0.025 or 0.020 and also the vertical and horizontal irregularities of the building in seismic design...
close your eyes and just sing a song