"Quality Metrics" is an IMLSâ€“funded research project which aims to address longstanding deficits in the formal conceptual support for and development of scholarly digital libraries. Central to attaining these goals is collecting and analyzing feedback from stakeholders in the scholarly community about the efficacy and value of key aspects of search technologies; including search interfaces, modalities, and results displays. A team at Emory University conducted this foundational research by utilizing the qualitative methodology of focus groups. In addition to an initial set of exploratory focus groups, the team conducted a second round of focus group sessions with a protoype search system specially designed for scholarly digital libraries. This paper describes the concept, objectives, methodology, and findings of the focus groups component of the Quality Metrics Project.