Often, yes, but it depends on how flat, sound, and dry the brick surface is. Many installs use furring strips or a prepared substrate to create a secure, level fastening surface and to handle moisture correctly.