Electric water heater output only slightly warmer than tap water, is it the thermostat or thermocouple?

Electric water heaters don't have thermocouples, only gas units do. It is probably the heating element burnt out. Not an expensive fix, after you drain the tank.