Can I leave The Gold Cup Lunch and come back later that day?

Yes, that’s fine. Just remember to get a hand-stamp before leaving, to make your re-entry as smooth as possible when you return.