CLIP-FSAC: Boosting CLIP for Few-Shot Anomaly Classification with Synthetic Anomalies

Abstract

Neural fields are now the central focus of research in 3D vision and computer graphics. Existing methods mainly focus on various scene representations, such as neural points and 3D Gaussians. However, few works have studied the rendering process to enhance the neural fields. In this work, we propose a plug-in method named K-Buffers that leverages multiple buffers to improve the rendering performance. Our method first renders K buffers from scene representations and constructs K pixel-wise feature maps. Then, We introduce a K-Feature Fusion Network (KFN) to merge the K pixel-wise feature maps. Finally, we adopt a feature decoder to generate the rendering image. We also introduce an acceleration strategy to improve rendering speed and quality. We apply our method to well-known radiance field baselines, including neural point fields and 3D Gaussian Splatting (3DGS). Extensive experiments demonstrate that our method effectively enhances the rendering performance of neural point fields and 3DGS.

Cite

Text

Zuo et al. "CLIP-FSAC: Boosting CLIP for Few-Shot Anomaly Classification with Synthetic Anomalies." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/203

Markdown

[Zuo et al. "CLIP-FSAC: Boosting CLIP for Few-Shot Anomaly Classification with Synthetic Anomalies." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/zuo2024ijcai-clip/) doi:10.24963/ijcai.2024/203

BibTeX

@inproceedings{zuo2024ijcai-clip,
  title     = {{CLIP-FSAC: Boosting CLIP for Few-Shot Anomaly Classification with Synthetic Anomalies}},
  author    = {Zuo, Zuo and Wu, Yao and Li, Baoqiang and Dong, Jiahao and Zhou, You and Zhou, Lei and Qu, Yanyun and Wu, Zongze},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {1834-1842},
  doi       = {10.24963/ijcai.2024/203},
  url       = {https://mlanthology.org/ijcai/2024/zuo2024ijcai-clip/}
}