What you describe is closest to 'beta testing' or maybe 'quality assurance', I'm not sure if there's a better term. It's more searching for bugs than tracking bugs - bug/issue tracking has to do with reporting the bug on an issue tracker site and the developers go through and fix the reported bugs.