The location of your catalog databases are shown in the Catalog Management window (click the expansion triangle in "Local catalogs" next to the catalog name to see its location.)
Collections are part of the catalog database: if the catalog is backed up, so are the collections.
Please note that this is a backup of the index of your images, not the images themselves.