no attention backend support for softmax = learnable and cp_comm_type = p2p

[jordane95]

When using context parallel to fine-tune gpt-oss, no attention backend is supported for this configuration. I have to change cp_comm_type to a2a to enable FusedAttention. But this is potentially less efficient than a2a at large context length (say 128k).

[coderabbitai]

📝 CodeRabbit Plan Mode

Generate an implementation plan and prompts that you can use with your favorite coding agent.

• Create Plan

Examples

• Example 1
• Example 2

---

🧪 Issue enrichment is currently in open beta.

You can configure auto-planning by selecting labels in the issue_enrichment configuration.

To disable automatic issue enrichment, add the following to your .coderabbit.yaml:

issue_enrichment:
  auto_enrich:
    enabled: false

💬 Have feedback or questions? Drop into our discord or schedule a call!