Do it by manually extracting packages from pungi cache instead of
redownloading, because we can't access yum configuration (repositories,
gpg keys etc) here, so it would be even more hacky...
All this is needed because pungi does not support including multiple
versions of a single package.