locked
Help: Speech API: Hot Word Detection locally RRS feed

  • Question

  • Hi,

    I started a NodeJS implementation

    • capturing Audio Stream with SoX,
    • using Oxford for Speech2Text
    • using Soundex in French for sentence cleaning
    • then Levenshtein to findout the matching "grammar"

    It seems to work very well BUT I really really need an algorithm to match locally in my stream a hot word like "Hey Cortana".

    I'm looking every where and don't know how to do that :-( How "Hey Cortana", "Ok Google", "Hey SIRI" works ??? Fast Fourier Transform ?

    Can Microsoft or Anyone have a sample implémentation or tips or getting started ?

    Many Thanks !

    Monday, February 29, 2016 11:37 AM

All replies

  • It seems what I'm looking for is called "Keyword Spotting". But I can't find simple implementation ... only research paper.

    • CMUSphinx has an implementation hidden in C code using their local speech engine
    • Ok Google is a deep neaural network trained on 40.000 samples

    I don't understand how people do continous listening with Oxford ? Or How "Hey Cortana" is implemented ?

    SoX allow me to cut speech sample but there is still lots of sample and request to Oxford if I dont filter more ...

    Does Microsoft provide a kind of Keyword Spotting like "Hey Cortana" for us ?

    Monday, February 29, 2016 11:20 PM
  • My code is here:
    https://github.com/JpEncausse/SARAH-Client-NodeJS

    And a working windows démo here:
    https://dl.dropboxusercontent.com/u/255810/Encausse.net/Sarah/releases/SARAH-Client-NodeJS-v0.2.zip

    Yes, as for now i'm targeting French (because SARAH has a large French community) then I'll try to push to other soundex compatible languages 

    Thursday, March 3, 2016 10:13 AM
  • Up

    Google has announce offline Speech2Text:
    http://gizmodo.com/googles-smart-ai-could-move-speech-recognition-offline-1764703382


    Monday, March 14, 2016 6:16 PM