EPLB expert selection mechanism #21
Description
I've been experimenting with EPLB and am curious about the expert selection mechanism.
Specifically:
How does the system determine which experts to activate for a given input?
Is there a threshold parameter that controls the minimum confidence required for an expert to be selected?
Are there any recommendations for tuning the number of experts when applying EPLB to different domains or dataset sizes?
I'd appreciate any insights into the design decisions behind these mechanisms, as I'm trying to better understand the tradeoffs between computational efficiency and model performance.