Most scholarly journals are peer-reviewed; however, to be certain you must read the editorial statements or instructions to authors (usually found in the first few pages of the journal or at the end). You can also visit the publisher's website (check the about section) or look up the journal in Ulrich's Periodical Directory for verification.
Ulrich's will have a "referee's jersey icon" (black and white stripe) next to the title if it is considered peer-reviewed or refereed.
There is usually a statement indicating "This journal is peer-reviewed or refereed."
This short video shows how to use Ulrich's Periodical Directory.
Address: