-
Notifications
You must be signed in to change notification settings - Fork 23
Description
Although current systems in place (3% time penalty, model safetensors hash checking) help guard against blatant model copying, there are still potential avenues of exploitation.
The requirements for a solution that can accurately detect model copying are the following:
- The solution can distinguish between "copying" and fine tunes
- The solution is a relatively "fast" computation (ie. does not cost more execution time than the current scope of evaluation)
Further notes on tuning other subnet properties:
-
It is desirable to keep the current temperature at roughly the same range. Although the current number of participants in the subnet may be small, this value can change in the future. Furthermore, there are existing discussions with validators regarding the emissions curve and the current level
-
It is desirable to keep a relatively low registration cost. A low registration cost can encourage newer participants, and there is already an implied cost for miners who are training and evaluating their models offline.
Additional discussion points are welcome and it is expected that this may not result in a concrete solution, but at the very least provide discourse to find a way forward.