no code implementations • 14 Feb 2024 • Ali Saheb Pasand, Reza Moravej, Mahdi Biparva, Ali Ghodsi
A common phenomena confining the representation quality in Self-Supervised Learning (SSL) is dimensional collapse (also known as rank degeneration), where the learned representations are mapped to a low dimensional subspace of the representation space.
no code implementations • 14 Feb 2024 • Ali Saheb Pasand, Reza Moravej, Mahdi Biparva, Raika Karimi, Ali Ghodsi
Our experiments demonstrate that the cost associated with the loss computation can be reduced via node or dimension sampling without lowering the downstream performance.
no code implementations • 1 Sep 2023 • Saeid Asgari Taghanaki, Aliasghar Khani, Ali Saheb Pasand, Amir Khasahmadi, Aditya Sanghi, Karl D. D. Willis, Ali Mahdavi-Amiri
These sentences are then used to extract the most frequent words, providing a comprehensive understanding of the learned features and patterns within the classifier.
no code implementations • COLING 2022 • Mehdi Rezagholizadeh, Aref Jafari, Puneeth Salad, Pranav Sharma, Ali Saheb Pasand, Ali Ghodsi
A case in point is that the best performing checkpoint of the teacher might not necessarily be the best teacher for training the student in KD.
1 code implementation • 6 Sep 2019 • Benyamin Ghojogh, Ali Saheb Pasand, Fakhri Karray, Mark Crowley
This paper proposes a new subspace learning method, named Quantized Fisher Discriminant Analysis (QFDA), which makes use of both machine learning and information theory.
2 code implementations • Proceedings of the AAAI Conference on Artificial Intelligence 2019 • Hadi NekoeiQachkanloo, Benyamin Ghojogh, Ali Saheb Pasand, Mark Crowley
This paper proposes a novel trading system which plays the role of an artificial counselor for stock investment.
Portfolio Optimization Stock Prediction +1 General Finance Computational Engineering, Finance, and Science General Economics Economics