Improving Private Random Forest Prediction Using Matrix Representation
Abstract
We introduce a novel matrix representation for differentially private training and prediction methods tailored to random forest classifiers. Our approach involves representing each root-to-leaf decision path in all trees as a row vector in a matrix. Similarly, inference queries are represented as a matrix. This representation enables us to collectively analyze privacy across multiple trees and inference queries, resulting in optimal DP noise allocation under the Laplace Mechanism. Our experimental results show significant accuracy improvements of up to 40% compared to state-of-the-art methods.
Cite
Text
Tajima et al. "Improving Private Random Forest Prediction Using Matrix Representation." AAAI Conference on Artificial Intelligence, 2025. doi:10.1609/AAAI.V39I19.34289Markdown
[Tajima et al. "Improving Private Random Forest Prediction Using Matrix Representation." AAAI Conference on Artificial Intelligence, 2025.](https://mlanthology.org/aaai/2025/tajima2025aaai-improving/) doi:10.1609/AAAI.V39I19.34289BibTeX
@inproceedings{tajima2025aaai-improving,
title = {{Improving Private Random Forest Prediction Using Matrix Representation}},
author = {Tajima, Arisa and Wu, Joie and Houmansadr, Amir},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2025},
pages = {20770-20777},
doi = {10.1609/AAAI.V39I19.34289},
url = {https://mlanthology.org/aaai/2025/tajima2025aaai-improving/}
}