!KOGBGqVOBKJjKLgFUY:matrix.org

Caster

23 Members
Caster is a collection of tools aimed at enabling programming and accessibility entirely by voice built upon the Dragonfly API.20 Servers

Load older messages


SenderMessageTime
28 Nov 2020
@gitter_aschneiderman:matrix.org@gitter_aschneiderman:matrix.org @patricktouchette Nice idea! Do you have a GH repo where you’ve been playing? 00:44:21
@gitter_aschneiderman:matrix.org@gitter_aschneiderman:matrix.org @patricktouchette The more I think about it, the more this seems like the way to go. The syntax looks pretty straightforward, and not onky can you add keyboard shortcuts, you can easily create popup dialog boxes, add links, and maintain state between pages — eg, between a page of a list of user stories or tasks and the page that lets you edit an individual item. You can also create a text box and process what you voice in it, so for example you could say “mark 2, 5, 8” that would put “2,5,8” in the tet 12:28:23
@gitter_aschneiderman:matrix.org@gitter_aschneiderman:matrix.org (edited) ... item. You can also create a text box and process what you voice in it, so for example you could say “mark 2, 5, 8” that would put “2,5,8” in the tet => ... item. I have a little time in the next week to play with it; I’ll post what I learn 12:30:16
@gitter_aschneiderman:matrix.org@gitter_aschneiderman:matrix.org (edited) ... not onky can ... => ... not only can ... 12:30:39
@gitter_itsrainingschmen:matrix.org@gitter_itsrainingschmen:matrix.org Is there a reason why nobody has built any caster commands for wordprocessing programs? Seems like a fairly simple thing to do to get Microsoft Word working with it. If there is no good reason not to do it, I'll likely make that a Christmas break project of mine. 17:52:22
@gitter_alexboche:matrix.org@gitter_alexboche:matrix.orgDragon has some decent select and say commands which work in Word. Main drawback is the excessive required wait time between utterances. 19:42:25
@gitter_alexboche:matrix.org@gitter_alexboche:matrix.orgPersonally, I would encourage people interested in investing in improving Caster to consider working on improved eyetracking capabilities. I believe eyetracking needs to be a part of any handsfree users toolkit and is likely to be more effective and generalizable than other approaches 19:45:23
@gitter_alexboche:matrix.org@gitter_alexboche:matrix.org (edited) ... other approaches => ... other approaches-- there is a good reason that mice are popular 19:45:43
@gitter_alexboche:matrix.org@gitter_alexboche:matrix.org (edited) ... and is likely to be ... => ... and will be ... 19:46:10
@gitter_alexboche:matrix.org@gitter_alexboche:matrix.org (edited) ... other approaches-- there is a good reason that mice are popular => ... other approaches 19:46:47
@gitter_kendonb:matrix.org@gitter_kendonb:matrix.org At one point I had a bunch of things programmed into a Microsoft Word grammar. I got frustrated by the keyboard shortcuts not being stable for some things and now I don't bother on the rare occasions I use Word with voice. But there's no reason not to. We'd certainly consider a PR improving the current msword grammar 19:47:34
29 Nov 2020
@gitter_danesprite:matrix.org@gitter_danesprite:matrix.org

For Word and other Microsoft Office programs, you can use the COM API instead of shortcuts. That might be more stable.

Dragonfly has a special ConnectionGrammar class for this. I haven't used it much myself though.

02:38:04
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org @Danesprite do you know of an example grammar that uses it? 04:02:25
@gitter_danesprite:matrix.org@gitter_danesprite:matrix.org

@LexiconCode Yes, Christo Butcher (t4ngo) has written at least two examples in his dragonfly-modules repository:

Perhaps these should be updated/modernised and put under dragonfly/examples? They are both licensed under LGPL and I doubt t4ngo would mind. That folder should also have a README.rst file.

I know that @quintijn has also written something similar for Excel.

06:27:52
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.orgThanks Dane!09:06:52
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org @Danesprite That's very helpful thank you! 09:12:49
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org (edited) @Danesprite That's very helpful thank you! => Interesting somehow I don't ever remember seeing that! 09:13:08
@gitter_danesprite:matrix.org@gitter_danesprite:matrix.org Yeah, this functionality isn't used very much. 09:28:45
@gitter_danesprite:matrix.org@gitter_danesprite:matrix.orgNo worries :+1:09:28:57
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org https://www.shapeways.com/product/LQJJK2CHQ/pupil-mobile-eye-tracking-headset?optionId=43013976&li=shops 12:27:06
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org Can't tell if this is just a headset or an actual eye tracking system. 12:27:19
2 Dec 2020
@gitter_itsrainingschmen:matrix.org@gitter_itsrainingschmen:matrix.org @kendonB , @alexboche okay thanks for the replies guys. I just seemed like a strange hole in the lineup caster didn't have anything for any sort of word processor. What you guys say make sense though. 17:04:05
3 Dec 2020
@gitter_ileben:matrix.org@gitter_ileben:matrix.org setting up caster on a new PC and ran into this:
Traceback (most recent call last): File "C:\Python27-64bit\lib\runpy.py", line 174, in _run_module_as_main "__main__", fname, loader, pkg_name) File "C:\Python27-64bit\lib\runpy.py", line 72, in _run_code exec code in run_globals File "C:\Python27-64bit\lib\site-packages\dragonfly\__main__.py", line 408, in <module> main() File "C:\Python27-64bit\lib\site-packages\dragonfly\__main__.py", line 403, in main return_code = func(args) File "C:\Python27-64bit\lib\site-packages\dragonfly\__main__.py", line 174, in cli_cmd_load with engine.connection(): File "C:\Python27-64bit\lib\site-packages\dragonfly\engines\base\engine.py", line 50, in __enter__ self._engine.connect() File "C:\Python27-64bit\lib\site-packages\dragonfly\engines\backend_kaldi\engine.py", line 197, in connect reconnect_callback=self._options['audio_reconnect_callback'], File "C:\Python27-64bit\lib\site-packages\dragonfly\engines\backend_kaldi\audio.py", line 228, in __init__ super(VADAudio, self).__init__(**kwargs) File "C:\Python27-64bit\lib\site-packages\dragonfly\engines\backend_kaldi\audio.py", line 75, in __init__ self._connect(start=start) File "C:\Python27-64bit\lib\site-packages\dragonfly\engines\backend_kaldi\audio.py", line 89, in _connect callback=proxy_callback if not self.self_threaded else None, File "C:\Python27-64bit\lib\site-packages\sounddevice.py", line 1153, in __init__ **_remove_self(locals())) File "C:\Python27-64bit\lib\site-packages\sounddevice.py", line 861, in __init__ 'Error opening {0}'.format(self.__class__.__name__)) File "C:\Python27-64bit\lib\site-packages\sounddevice.py", line 2651, in _check raise PortAudioError(errormsg, err, hosterror_info) sounddevice.PortAudioError: Error opening RawInputStream: Unanticipated host error [PaErrorCode -9999]: 'Undefined external error.' [MME error 1]
11:58:59
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org @ileben That looks like a issue with the package sounddevice with kaldi-active-grammar at https://github.com/daanzu/kaldi-active-grammar/issues 12:01:25
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org I haven't seen the error before. What kind of soundcard and microphone? 12:01:51
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org (edited) ... and microphone? => ... and microphone? sounddevice struggles with Bluetooth mics From what I hear 12:02:18
@gitter_lexiconcode:matrix.org@gitter_lexiconcode:matrix.org (edited) ... mics From what ... => ... mics from what ... 12:02:23
@gitter_ileben:matrix.org@gitter_ileben:matrix.org Hmm searching kaldi's issues for "sounddevice" and "portaudio" gives nothing 12:02:26
@gitter_ileben:matrix.org@gitter_ileben:matrix.org It's a crappy cheapo USB headset 12:02:36
@gitter_ileben:matrix.org@gitter_ileben:matrix.orgjust something I was given from work, until I connect all my good stuff12:02:57

Show newer messages


Back to Room ListRoom Version: 1