That was true of a small subset of people. Most men were doing some form of manual labor. Women's experiences varied a lot, but they certainly worked.