Vista Speech Recognition for controlling FFXI

[Yinnyth]

I've been spending the past few days attempting to get some sort of speech recognition running for my sister's old character, Ahnge, who I frequently dualbox for events. My first goal is to create a simple speech command where I say "follow" and Ahnge types in "/follow Yinnyth{enter}". However, I haven't found anything that works well yet.

For those that haven't heard about it, Windows Vista (and apparantly 7) come with a relatively powerful Speech Recognition program that allows you to control a lot of basic functions. For FFXI, these functions are somewhat limited... you can tell it to press individual keystrokes to slowly spell out commands, including keystrokes that don't exactly exist on a standard keyboard such as ¼. However, it is incapable of emulating the following keys in FFXI: Enter, Esc, Ctrl, Alt, F1-F12, and numpad keys. Furthermore, the arrow keys can be used to move the cursor through text, but they can't be used to move the cursor through menus or control the camera.

I did testing in other games, and in the POL viewer where these keys (except numpad, since there's apparantly no way to give a voice command to specifically use numpad keys) worked absolutely fine for controlling anything. I did testing with and without windower with the same results. I've also done testing with other voice programs, but their recognition is awful and sluggish. One called Shoot was very customizable, but generally my interactions with it consisted of "Follow. ......FOL-LOW. ....FOLLOW YOU PIECE OF CRAP!!!" Then I sigh, lean back in my chair, my chair squeaks, and Ahnge starts following me.

I found another program on the internet called e-Speaking which adds a sort of "macro" functionality to Vista's Speech Recognition. It allows me to create keywords I can speak and binds a complex set of actions to perform when it hears that keyword. However, it doesn't break Speech Recognition's inability to enter those vital keystrokes into FFXI, so the closest I can get to creating a command is having it type out "/follow Yinnyth" and then hitting enter manually.

So I'm looking for some help to this problem- does anyone know of a way to get Vista Speech Recognition to function better with FFXI? Or at least get the enter key to work?

[Kimiko]

Interesting idea you have there.

[urat]

First off, speech recognition in windows has been around for ages, I believe it was first introduced in XP, maybe even 98.

Second, wtf, I just got around to retuning my laptop to my voice last night and now this is posted on BG, out of my head Yinnith.

Thirdly, the ability to hit a macro by voice command intrigues me. You might want to check out MacroMaster, an unlimited macroing program for ffxi.

The macro UI has 16 (I think) buttons which you label in the script for 'em, so theoretically if you have that window in main view you should just be able to say the name of the macro and SR will hit the button automatically.

....

Holy shit I think it'll work, brb...

[Colenzo]

LIGHTNING BOLT...LIGHTNING BOLT...LIGHTNING BOLT...

[Pikarya]

LIGHTNING BOLT...LIGHTNING BOLT...LIGHTNING BOLT...

10/10

http://i46.tinypic.com/2n2i54.jpg

[urat]

Holy shit!

...

It worked. :O

Im not sure if Id get banned or something for posting a bot/macro program soooo http://www.google.ca/search?rlz=1C1D...xi+macromaster

Kinda hard to miss it.

Anywho... I wonder.

If I rigged up VLC for my laptop and PSP again I can control ffxi through my psp. Mind you the frame rate is ass and there's no sound... BUT

If I add into the equation my wireless bluetooth headset and macromaster, I could theoretically control my character a bit more advanced then button clicks via macros... On my toilet.

O_o

[Stromgarde]

TV Tropes - Calling Your Attacks

Do it.

[Colenzo]

im totally screaming "Bankai" in my mic for sam 2hr

[urat]

I hope FF14 just has this built in as an option.

Just say "cure member2" or "cure madtaruguy" and boom ,your character will cure him.

[Draylo]

That would get really annoying after a while.

[Deimos]

I hope FF14 just has this built in as an option.

Just say "cure member2" or "cure madtaruguy" and boom ,your character will cure him.

Why? That's slower and harder to do than pushing a macro. I always find it funny when people think voice interfaces or "Minority Report" ones where you have to wave your whole arm around will be the future of computer interfaces. They're both terrible ideas.

Yinnyth: Have you tried using windower keybinds to bind certain combinations to commands? Like if you bound Ctrl-F to "/follow Yinnyth", then you could get the speech recognition to press Ctrl-F when you say "follow". Seems like that would work, then there's no enter-key involved.

[urat]

Why? That's slower and harder to do than pushing a macro. I always find it funny when people think voice interfaces or "Minority Report" ones where you have to wave your whole arm around will be the future of computer interfaces. They're both terrible ideas.

Yinnyth: Have you tried using windower keybinds to bind certain combinations to commands? Like if you bound Ctrl-F to "/follow Yinnyth", then you could get the speech recognition to press Ctrl-F when you say "follow". Seems like that would work, then there's no enter-key involved.

Unless of course the members name is something like rinniganingingaruwa and takes forever to type.

You COULD macro cure to be member by member, cept thatd take up a whopping 6 slots per.

Or you could just say "cure member 4" and screw trying to pronounce their name

[Yinnyth]

Why? That's slower and harder to do than pushing a macro. I always find it funny when people think voice interfaces or "Minority Report" ones where you have to wave your whole arm around will be the future of computer interfaces. They're both terrible ideas.

Yinnyth: Have you tried using windower keybinds to bind certain combinations to commands? Like if you bound Ctrl-F to "/follow Yinnyth", then you could get the speech recognition to press Ctrl-F when you say "follow". Seems like that would work, then there's no enter-key involved.

This was one of the ideas I had as well, but unless I find a way to modify the FFXI window or VSR, it doesn't seem capable of inputting Ctrl or Alt unfortunately. It seems to me like all the keyboard commands I can input with VSR only affect the chat log... if I switch to compact keyboard mode and tell it "type w", it confirms receiving my command, but Ahnge doesn't move. If I enter the chatlog and tell it "type w", it confirms, and then there's a w in my chatlog.

So... *headdesk* I'll keep trying for a way to get it to hit Ctrl, Alt or Enter ._.;

[Yinnyth]

Unless of course the members name is something like rinniganingingaruwa and takes forever to type.

You COULD macro cure to be member by member, cept thatd take up a whopping 6 slots per.

Or you could just say "cure member 4" and screw trying to pronounce their name

VSR actually lets you tell it how to understand a word. It'd suck adding a new library entry for every newb you get stuck in a merit party with, but if Rinniganingingaruwa is someone you often do stuff with, you could tell it that you pronounce his name "Rinnig". Though VSR doesn't seem capable of dictation in the FFXI chat window... so I guess that's a moot point.

[urat]

This was one of the ideas I had as well, but unless I find a way to modify the FFXI window or VSR, it doesn't seem capable of inputting Ctrl or Alt unfortunately. It seems to me like all the keyboard commands I can input with VSR only affect the chat log... if I switch to compact keyboard mode and tell it "type w", it confirms receiving my command, but Ahnge doesn't move. If I enter the chatlog and tell it "type w", it confirms, and then there's a w in my chatlog.

So... *headdesk* I'll keep trying for a way to get it to hit Ctrl, Alt or Enter ._.;

I already said ealer Yinn, Apnea's Macro master works great. You just say the name of the macro you have written on the button and vistas SR goes right ahead and clicks on the macro itself. No saying button presses, no saying ctrl, just "ballad" ok now "madrigal" and then "minuet"

I just got out of a pt using it and was like omfg <3 leveling bard just got even easier than I thought possible.

[firewing]

Very nice idea, would just be tricky while using vent, etc. As soon as I can get 10 posts I'll post another automation type tip.

[Yinnyth]

I already said ealer Yinn, Apnea's Macro master works great. You just say the name of the macro you have written on the button and vistas SR goes right ahead and clicks on the macro itself. No saying button presses, no saying ctrl, just "ballad" ok now "madrigal" and then "minuet"

I just got out of a pt using it and was like omfg <3 leveling bard just got even easier than I thought possible.

Yeah, I'm still trying to find a functioning download link for it though. Ironically, one of the top google search results is this very thread <_>;

If you could provide me with a copy, I'd be ever so grateful~

Edit: Think I found one- time to see if I can get this working...

Edit edit: I got version 0.2.0 and it does nothing :/ Plus, it only has 20 macro slots, and I estimate I'll want somewhere on the magnitude of 50 voice commands, but if I can get this working, it'll be 20 more voice commands than I currently have.

[urat]

You can pageup/down your macro books like ffxi =P

I dunno if the SR can page up and down though @_@

Does it have the latest files? Here just lemme upload mine...


Edit:
KAY!!!

https://docs.google.com/uc?id=0BxRQH...download&hl=en

[Yinnyth]

I got VSR to recognize home and end in FFXI, so I'm pretty sure it can pageup/pagedown as well. Which seems to do nothing on my version of macro master, so I'm betting your version is more recent, but the googledocs link appears empty to me ; ;

My problem might actually be the windowerhelper though... trying to figure out how to work it too.

[urat]

What exactly is it in the program that isnt working? @_@