Transformer as Linear Expansion of Learngene

Xia et al. "Transformer as Linear Expansion of Learngene." AAAI Conference on Artificial Intelligence, 2024. doi:10.1609/AAAI.V38I14.29533

[Xia et al. "Transformer as Linear Expansion of Learngene." AAAI Conference on Artificial Intelligence, 2024.](https://mlanthology.org/aaai/2024/xia2024aaai-transformer/) doi:10.1609/AAAI.V38I14.29533

@inproceedings{xia2024aaai-transformer,
  title     = {{Transformer as Linear Expansion of Learngene}},
  author    = {Xia, Shiyu and Zhang, Miaosen and Yang, Xu and Chen, Ruiming and Chen, Haokun and Geng, Xin},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {16014-16022},
  doi       = {10.1609/AAAI.V38I14.29533},
  url       = {https://mlanthology.org/aaai/2024/xia2024aaai-transformer/}
}