When looking for a thorough overview of the research on how noise affects people I always still refer to the document “Community Noise” prepared for the World health Organisation (WHO). It used to be a book, but has for many years existed on the web as well. Here you can find the documentation edited by Birgitta Berglund , Thomas Lindvall and Dietrich H Schwela.
Guidelines for Community Noise