In this work, we propose HC-SMoE (Hierarchical Clustering for Sparsely activated Mixture of Experts), a task-agnostic expert merging framework that reduces SMoE model parameters without retraining.

Abstract: Sparse linear arrays serve as the fundamental basis for sparse signal processing and have demonstrated remarkable direction-of-arrival (DOA) estimation performance. Due to the merit of ...

Pull requests help you collaborate on code with other people. As pull requests are created, they’ll appear here in a searchable and filterable list. To get started, you should create a pull request.

Microsoft is betting big on AI. Starting with integrating Bing with ChatGPT, it has implemented AI capabilities in its products. Microsoft Designer is a new product from Microsoft with AI capabilities ...

Abstract: Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental operation in graph computing and analytics. However, the irregularity of real-world graphs poses significant challenges to ...