What's Changed
- Change test to use foundry images by @bowenyang008 in #1839
- Bias in QKV input projections for supporting Qwen2 model series by @gupta-abhay in #1837
- Fix backwards compatibility with attention_bias by @dakinggg in #1840
- Add Head Dim as a configurable parameter for Attention and Rope by @jdchang1 in #1842
- Support for reusing the input to W_k and W_v by @ShashankMosaicML in #1710
- Display data type in error message by @emmanuel-ferdman in #1834
- updated composer and streaming versions by @ethantang-db in #1857
- updated and restricted our composer and mlflow libraries by @ethantang-db in #1859
Full Changelog: v0.21.0...v0.22.0
Contributors
gupta-abhay, jdchang1, and 5 other contributors