Often, yes, but it depends on the condition and flatness of the brick. Many installs use a prepared substrate so panels can be fastened level and securely.