Fused mult-head attention on GPU

[masahi]

Is there a plan to support fused MHA on GPU (i.e. without decomposition)? It seems there is such support for CPU, but I'm interested in GPU support specifically. This would help improving stable diffusion perf tremendously, at least that's the case on NVIDIA GPUs.