Textile sector distress damps wages, sparks worker exodus :