Merge 126cdc582b into ff838657fa

Cleaner handling of attention mask in ltxv model code.
2025-01-11 02:15:17 +00:00 · 2025-01-09 09:12:29 -05:00 · 2025-01-09 07:12:03 -05:00
1 changed files with 2 additions and 3 deletions
--- a/comfy/ldm/lightricks/model.py
+++ b/comfy/ldm/lightricks/model.py
@ -456,9 +456,8 @@ class LTXVModel(torch.nn.Module):
        x = self.patchify_proj(x)
        timestep = timestep * 1000.0

-        attention_mask = 1.0 - attention_mask.to(x.dtype).reshape((attention_mask.shape[0], 1, -1, attention_mask.shape[-1]))
-        attention_mask = attention_mask.masked_fill(attention_mask.to(torch.bool), float("-inf"))  # not sure about this
-        # attention_mask = (context != 0).any(dim=2).to(dtype=x.dtype)
+        if attention_mask is not None and not torch.is_floating_point(attention_mask):
+            attention_mask = (attention_mask - 1).to(x.dtype).reshape((attention_mask.shape[0], 1, -1, attention_mask.shape[-1])) * torch.finfo(x.dtype).max

        pe = precompute_freqs_cis(indices_grid, dim=self.inner_dim, out_dtype=x.dtype)
Author	SHA1	Message	Date
Alexander Piskun	4668af7d3a	Merge `126cdc582b` into `ff838657fa`	2025-01-09 09:12:29 -05:00
comfyanonymous	ff838657fa	Cleaner handling of attention mask in ltxv model code.	2025-01-09 07:12:03 -05:00