Use cooking spray to coat the trouble areas where mud is really tough to get out.The mud will stick a little, but as it dries it will usually fall off in clumps. Little garden hose will get the rest off.

Or some good ol' fashioned elbow grease...