I've picked up a few in various sizes from e-bay over the years, I suspect they originally came from binoculars, these days I suspect the easiest option is just to 3D print them.
For applications where strength is not an issue I've also made some modified ones from craft paper. That was the easiest way to end up with aperture control on my monster 150/1.2 projector lens (paper cap with a hole cut that's one stop less than wide open, then paper discs for smaller apertures that can be held on with this cap)
Push on caps don't seem to be made at 5" diameters
A challenging lens by
Mike Kanssen, on Flickr