fedora-infra/fedora-packages

Make clear that bugs for packages aren't in this repo

Update xapian index when pkgdb_updater changes things like upstream_url.

Add caching and cache invalidation to the bugzilla tab.

…o develop

My branch

Streamline mdapi updates.

As discussed in IRC, we're going to change the format of mdapi messages
so that they are much smaller.  This should handle both the old way and
the new way while we make the changeover.

Try real hard to get a write lock for xapian.

* The symptom I'm seeing is that every so often, the fedora-packages
  fedmsg-based updater will go into a failure mode where it can never
  get a write lock on the xapian database.  It just fails over and over
  again for every message.  This causes fedora-packages to ingest no new
  packages once it occurs (until one of us goes and restarts it, at
  which point it is annoyingly too late).
* Unless I missed something somewhere, there should be **no** other
  processes writing to the database, so there shouldn't be anything else
  holding that lock.
* There's this big ``try``/``finally`` block in there that is *supposed*
  to call ``indexer.indexer.close()`` at the end.  If this is the only
  place a write lock is acquired, then that leads me to think that some
  exception in either ``pull_icons`` or ``cache_icons`` is causing it to
  die early and not return the lock.

So, to deal with that stuff, this commit:

* Catches and ignores exceptions from those ``pull_icons`` and
  ``cache_icons`` calls so that we can still try to return the lock at
  the end.
* In the event that we still cannot get the lock, we'll spin and try to
  acquire it until it works.  This will prompt a human to come take a
  look so we can diagnose.  (The lock uses fnctl, and supposedly we can
  look for a ``cat`` process in the ``ps`` list holding a file called
  ``flintlock`` in ``/var/cache/fedoracommunity``).

Try a second icon_dir location.

I just hit this when rebuilding the prod index.

Handle failure to copy an icon.

Handle past and future mdapi json keys.

See fedora-infra/mdapi@c2eafd8#commitcomment-14646204 for discussion.

Use a threadpool when refreshing cache items.