Men work more than women, women most affected