Xuan-Son Nguyen
4cbafad4f0
model: support MiMo-V2-Flash (#18328)
* mimov2: convert ok
* rename mimov2 --> mimo2
* fix conversion
* runnable not incorrect
* use sink
* add_sliding_window_pattern
* add swa and per-layer n_head_kv
* correct params
* somewhat working
* correct gating func
* nits
* mimo2: wire RMS eps + MoE bias + converter guards
* add co-author
Co-authored-by: Aaryan-Kapoor <Aaryan-Kapoor@users.noreply.github.com>
* use add_rope_freq_base_swa
---------
Co-authored-by: Aaryan Kapoor <aaryankapoor2006@gmail.com>
Co-authored-by: Aaryan-Kapoor <Aaryan-Kapoor@users.noreply.github.com>
2025-12-24 23:07:08 +01:00
..
2025-12-24 23:07:08 +01:00
2025-12-24 23:07:08 +01:00
2025-09-05 17:32:39 -06:00
2025-09-05 17:32:39 -06:00
2025-12-24 23:07:08 +01:00
2025-12-24 23:07:08 +01:00
2025-12-11 14:29:47 +02:00
2025-12-11 14:29:47 +02:00
2025-11-05 10:28:58 +01:00
2025-11-05 10:28:58 +01:00
2025-12-22 11:00:37 +01:00
2025-12-15 09:24:59 +01:00
2025-06-15 10:08:58 +03:00
2025-11-02 18:14:04 +02:00
2025-12-09 00:32:57 -06:00
2025-12-09 00:32:57 -06:00
2025-12-16 09:36:21 +02:00
2025-12-16 09:36:21 +02:00
2025-12-16 11:25:26 +01:00
2025-12-24 23:07:08 +01:00
2025-12-15 09:24:59 +01:00
2025-12-03 07:12:18 +01:00
2025-03-13 12:35:44 +02:00
2025-03-13 12:35:44 +02:00
2025-11-07 20:03:25 +02:00
2025-09-24 16:53:48 +02:00
2025-12-15 19:28:35 +02:00
2025-12-15 19:28:35 +02:00
2025-10-29 18:09:18 +01:00
2025-12-16 09:36:21 +02:00
2025-09-24 16:53:48 +02:00
2025-11-10 17:14:23 +02:00
2025-10-28 11:23:54 +01:00
2025-06-30 18:03:03 +03:00
2025-09-24 16:53:48 +02:00
2025-12-18 08:27:19 +02:00
2025-12-18 08:27:19 +02:00
2025-12-23 00:28:19 +01:00
2025-12-23 00:28:19 +01:00
2025-06-20 14:04:09 +02:00
2025-05-12 14:44:49 +02:00
2025-12-24 23:07:08 +01:00
2025-12-24 23:07:08 +01:00
2025-12-15 09:24:59 +01:00
2025-01-03 10:18:53 +02:00
2025-12-17 19:46:00 +02:00
2025-01-12 11:32:42 +02:00
2025-12-23 00:28:19 +01:00
2025-11-14 13:54:10 +01:00
2025-12-18 08:12:18 +01:00
2024-10-08 13:27:04 +02:00
2024-10-02 15:49:55 +02:00
2025-12-05 13:52:23 +02:00
2025-09-27 02:03:33 +08:00