You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
threshold=0.9, #min confidence required to consider a trigger
112
113
relaxation_time =0.8#default value ,in seconds
113
114
)
114
115
```
116
+
117
+
The model variable can receive an instance of Resnet_50_Arc_loss or First_Iteration_Siamese
118
+
115
119
relaxation time parameter is used to determine the min time between any 2 triggers, any potential triggers before the relaxation_time will be cancelled
116
120
117
121
The detector operates on a sliding widow approach resulting in multiple triggers for single utterance of a hotword, the relaxation_time parameter can used to control the multiple triggers, in most cases 0.8sec(default) will do
@@ -133,14 +137,25 @@ from eff_word_net import samples_loc
133
137
import os
134
138
from eff_word_net.streams import SimpleMicStream
135
139
from eff_word_net.engine import HotwordDetector
140
+
141
+
from eff_word_net.audio_processing import Resnet50_Arc_loss
print("Say ", " / ".join([x.hotword for x in multi_hotword_detector.detector_collection]))
199
227
200
228
whileTrue :
201
229
frame = mic_stream.getFrame()
202
-
result =multi_hw_engine.findBestMatch(frame)
230
+
result =multi_hotword_detector.findBestMatch(frame)
203
231
if(Nonenotin result):
204
232
print(result[0],f",Confidence {result[1]:0.4f}")
205
233
234
+
206
235
```
207
236
<br>
208
237
209
238
Access documentation of the library from here : https://ant-brain.github.io/EfficientWord-Net/
210
239
240
+
## Change notes from 0.2.2 to v1.0.1
241
+
### New Model Addition Resnet_50_Arc_loss with huge improvements !!
242
+
Trained a new model from scratch using a modified distilled dataset from MLCommons, used Arcloss logic instead of triplet loss logic
243
+
244
+
The resultant model created is stored resnet_50_arcloss
245
+
246
+
The newer model is show casing much better resilience towards background noise and requires fewer samples for good accuracy
247
+
248
+
Minor changes in the api flow to facilitate easy addition of newer models
249
+
250
+
Newer model can handle a fixed window length of 1.5 seconds
251
+
252
+
The old model can still be accessed through first_iteration_siamese
211
253
212
254
## Change notes from v0.1.1 to 0.2.2
213
255
major changes to replace complex friking logic of handling poly triggers per utterance into more simpler logic and more simpler api for programmers
@@ -220,6 +262,7 @@ Introduces breaking changes
220
262
221
263
## FAQ :
222
264
***Hotword Perfomance is bad** : if you are having some issue like this , feel to ask the same in [discussions](https://github.com/Ant-Brain/EfficientWord-Net/discussions/4)
265
+
***Can it run on FPGAs like arduino?** : No , new model Resnet_50_Arcloss is too heavy to run on arduino (Roughly 88Mb) in size, soon we will add support of pruned versions of the model so that it can become light enough to run on tiny devices, for now it should be able to run in Raspberry pi like devices
223
266
224
267
## CONTRIBUTION:
225
268
* If you have an ideas to make the project better, feel free to ping us in [discussions](https://github.com/Ant-Brain/EfficientWord-Net/discussions/3)
@@ -230,8 +273,13 @@ Introduces breaking changes
230
273
* Add audio file handler in streams. PR's are welcome.
231
274
* Remove librosa requirement to encourage generating reference files directly in edge devices
232
275
* Add more detailed documentation explaining slider window concept
276
+
* Add model finetuning support
277
+
* Add support for sparse and finegrained pruning where the resultant models could be used for finetuning (already working on the same)
233
278
234
279
## SUPPORT US:
280
+
235
281
Our hotword detector's performance is notably low when compared to Porcupine. We have thought about better NN architectures for the engine and hope to outperform Porcupine. This has been our undergrad project. Hence your support and encouragement will motivate us to develop the engine. If you loved this project recommend this to your peers, give us a 🌟 in Github and a clap 👏 in [medium](https://link.medium.com/yMBmWGM03kb).
236
282
283
+
Update: Your stars encouraged us to create a new model which is far better , lets make this community grow
0 commit comments