Crowds haul 400-ton Japanese castle by hand