Zuo, Chunsheng

1 publications

NeurIPSW 2024 Positional Information Can Emerge Through Causal Attention Making Nearby Token Embeddings Similar Even Without Positional Encodings Chunsheng Zuo, Pavel Guerzhoy, Michael Guerzhoy