You have a great work ethic. There is no work that anyone should be ashamed of if it is honest. I think what is mocked is an attitude more than a job-its a lack of aspiration to do more than the minimum of getting by.
My sister runs a cleaning business with dozens of contractors. She tells of her observations of attitudes-there is the immigrant/ entreprenurial attitude-just a step in their goals (they don't work for her for long) and those who. . . .just take enough work to keep body and soul together. Plenty of other kinds, but I think it is the latter kind of attitude that is being mocked. Subsistence is a sad way to go through life to many of us. No worldly ambitions seems to be a mark of righteousness for some JWs.
I wish I had been physically fit to do that kind of work. I have done it-its hard work, but when you can do it well, it pays pretty good.
My sis has been a landlord and run other businesses. This is what she got into because of her property management experience. She's actually great at it and is driving a company car and getting a lot of perks. She had enough of entreprenurial positions, but is running someone elses business and getting a great cut AND a great salary and she doesn't have to worry about the taxes at the end of the year or the rest of business ownership challenges. It doesn't sound flashy or sexy, but it pays well and is challenging.