WAF policies can be deleted from an application gateway by using the Azure CLI.
Stop the application gateway.
az network application-gateway stop -g MyResourceGroup -n MyAppGateway
Remove the policy
az network application-gateway waf-policy delete --name MyApplicationGatewayWAFPolicy --resource-group MyResourceGroup