ALSA: ASoC: Fix at32-pcm build breakage with PM enabled