Code

Add support for torch.sdp attention#4

Code

Open

Birch-san wants to merge 2 commits intocrowsonkb:maincrowsonkb/guided-diffusion:mainfrom Birch-san:torch-sdpBirch-san/guided-diffusion:torch-sdpCopy head branch name to clipboard

+42-5

Commits

Commits on Oct 18, 2023

• add support for torch.sdp attention. passes allclose() comparison with original attention.

  Birch-san

  committed
  f695546

Commits on Oct 19, 2023

• support non-math torch sdp kernels by ensuring contiguity of attn projections

  Birch-san

  committed
  051a449