Mitigating Misaligned Co-drift among Router and Experts

SIGNAL ANALYSIS

Models that adapt to a stream of tasks without forgetting prior capabilities still struggle to isolate updates between different LoRA experts. PASs-MoE creates separate pathway activation subspaces for each expert, which helps mitigate misaligned co-drift. If your MLLM pipeline relies on continual instruction tuning, this could be a game-changer.