Yeah, you have to be perfect and not get knocked off, otherwise its back to square one. Super annoying. But it does feel like a real accomplishment when you finally beat him!