You can keep tighter control over your business if you don't outsource particularly when it's small (and I assume it's still small as you are posting here) and still subject to many market forces.

When a business is growing, that is the time when you need maximum control. Outsource what you must, but keep everything under your control DIRECTLY if you can.