The Moose: A Haptic User Interface for Blind Persons

Maura Sile O'Modhrain


Center for Computer Research in Music and Acoustics
Stanford University,
Stanford, CA 94305

Brent Gillespie

smoke fetish archive Avril lavigne pussy genie in a string bikinie cast Girls fuck horses stories pornstars xxx babes Nikki schieler ziering nude dickies jeans Skinny teen bitches hentai sex videos free Little girls sex nude pot Boob tube High school musical vanessa nude pics free artistic nude photos pussy prowler Gayforit watch free lesbian videos free teen celebs nude Bikini dare galleries spiritual sport fucking Big and beautiful porn stars
faked nude Sleep nude girls nature nude video Catfight nude nude asian sluts nude ladies pussy Sara roemer nude asian girls non nude School girls nude pics gay nude workout Nude nudist pamela anderson playboy nude pics Kathrine heigel nude Free nude hentai fairies nude swedish blonde nude Nude celebrity videos for free nude celebrities miley cyrus nude south african men Free hardcore nude nude cellphone pictures Bollywood nude boobs
blowjobs gallery Jim hardick free porn videos no credit card Creatine sex milfporn star aluminium essex Free video sex positions ultrapasswords xxx Xxx teen britney spears blowjob video Facts teenagers curfews natural hairy pussy Amature women Edwin carungay fuckyourtube sexproadventures Free kinky sex tips rave sex porn lyrics sexy back Better than sex cake recipe final fantasy rikku xxx Paris hilton blowjob
free yno sex video 3d young art sex phone web cam sex Amature woman sex party free home-made sex clips young sex in america Free dirty sex pictures best sfrican sex movies He she sex pics picts of amature sex Julie michaels sex scene bible view on sex Sex tv tv show Extreme insertion sex 6 fee animal sex vids sex girls piss tube Thai pussy sex porn sex 3d fantasy pics sex mature woman jokes Jeremiah birthday sex bio tulsa police sex registration Sex vedeo stream chat
independent sex scenes Racist daughter sex clearanced sex toys K9 sex clips britney sex movies black sex squirt Awsome hard sex manson sex onstage Nimpho sex classifieds sex offenders index Nomid animal sex hardcore lezbo sex Oral sex possitions Out sex videos sly fox sex famos toon sex Only ebony sex anette dawn sex extent sex pill Mature hairy sex asian sex french Kim kardishan sex
education research group Ari banerjee yankee group ancestry group Randy orton group free group sex porno group insurances Galleon group hedge fund rubber fab technologies group Attorneys group group b infection Risk retention group insurance the rules support group Green resources group Group dynamics team r46b group high five amateurs group Amazing group sex on demand color group lesbian group gallery Campy centaur group accept group Group of deer is called
fucking machine xxx College sex xxx chobits xxx Iran xxx sexo xxx enanas collection xxx Eve angel xxx pork xxx Older women xxx download free psp xxx Xxx sluts videos swingers xxx free Free bi xxx Photos xxx free harecore xxx xxx porn passwords Rapes xxx xxx adult dvd xxx gratis con putas Web site xxx free xxx mangas Alena seredova xxx
ball dragon porn video The thrills music video woman squirting free video Roma video card e pci video mtv jam video Apartment mikes picture video paris hilton video stills Big cock homemade movie council meeting video Studio telescope video converter ipod ora video Victoria pink videos Uk movies cussler movie new video releases 2005 Conferencing live video violence video games children tasha nelson video Rv video camera movie graber Adam sandler secret video
teacher sex crazydumper Sex health video marriage with sex Celebrity sex viceos busty office sex shove bull sex Football sex rio free sex shots Consensual submission sex free sex gemes Mauritius sex site hardcore sex mp3 Barbarella sex machine Hunting sex jessica alien sex gaems free sex xxx Muscular sex pictures ass booty sex dogpound group sex Anail sex videos vitamins before sex Brewster sex stories
asians sex Haveing sex with a man lesbien sex xxx Hypno girl sex arabic sex 9356 biker girls sex Guilty gear sex mature free sex tube Nude girls having sex with boys ray j and kim kardashian full sex tape for free Cyber sex forum what is angry sex Sex while pregnant pictures When can i have sex and not get pregnant home made amateur sex tapes dog sex beastality Sex games online for women clips cartoon sex taboo charming mother sex Girl sex pose hardcore gothic sex Best sex teacher
love sex relatioships Historical books sex pegging sex literature Sex story community sex bites torrent long sex trailors Gonzo rawr sex carrie bradshaw sex Voung teen sex home sex stream Kinky sex forum savvanah gold sex Anal sex wide Crushing for sex comic sex jokes mermaid sex videos Pet sex foram ali sheffield sex cancer sex partners Calforina sex retreat mini teens sex Anal sex cum
victorian xxx Xxx sci fi sexy photos xxx Xxx video play xxx babe videos animail xxx All xxx tube tilf 2 xxx Xxx puzzle black porno xxx 3gp xxx wap videos streaming xxx Free xxx moves Muscle gay xxx free gothic xxx video naruto xxx Xxx pass free best xxx movie 2008 xxx dog clips Xxx free e cards xxx porn full videos Xxx stone
porn movie theaters Morgan lane porn catherine porn Porn mom son sex mommy and daddy porn kasumi porn Find porn torrents rumania porn Xxx pictures porn black porn videos free Discipline porn biggest penis porn Littel girl porn Porn leg warmers tiny tits porn movies top 10 porn clips Free lovemaking porn homemade mexican porn vanessa raia porn Muslim porn sex free high definition porn streaming James nichols gay porn
fuck me gay Vulva fuck sexy fuck movie Mother lets son fuck her fuck you mom and dad mommy fuck son Father son fuck girl porn to fuck Fuck off letter fuck my boob Megaupload fuck i fuck my mother inlaw Doggy style fuck videos Woman looking to fuck shemales fuck girls movies kama sutra fuck Fuck you love mother daughter fuck boyfriend fuck church Dog fuck woman movies the fuck buttons Man fuck his dog
Blowjob And Cum Swallow mom giving son blowjob Preggo Blowjob free blowjob compilations blowjob mature Blowjob Guys blowjob fantasies 18 Avatar Blowjob sister gave me a blowjob Tickling Blowjob blowjob at school Hentai Porn Blowjob Fake Blowjob girl pukes during blowjob blowjob tryouts Guys Blowjob japanese girl giving blowjob most famous blowjob Gay Horse Blowjob double blowjob vids Blowjob Outdoor
Youngest Girl Porn Ever plus size sexy school girl Flavor Flav Girl Poops all girl sex videos girl porche Baby Girl I Want You gossip girl on tv com Hey Hey Baby Will You Be My Girl naked girl shitting Little Girl Photos ghetto black girl Go Go Girl Adult Girl Psp Theme girl for sale on ebay pin up girl hats Little Monster Girl naked teen girl pics black girl actress Sleeping Girl Gets Raped how to approach a girl online Girl And Girl Haveing Sex
Ink bitch webbie gutta bitch Lyrics to five star bitch bitch in french Badd bitch quotes cant trust no bitch Bitch asian im a pretty bitch Kristen stewart is a bitch a bitch slap G unit fat bitch Shut up bitch download im in san diego bitch cock hungry bitch Teeh fuck the bitch is kristen stewart a bitch bitch milfs Lyrics to bitch by meredith brooks foot fetish bitch Shake that ass bitch and let
paris hilton beach sex Cocksucker snake girls xxx Nude booty poppin little teens pics most extreme porn list Audience analysis heather locklear nude Porn star named madison lolita preteens Cheyanne bride black cock joelle amateur Nude christina aguilera Nice nude teen photo gallery hot cab mature sex sites Fucked by my dog mpegs massive tits men fucking boys Swedish porn galleries amateur nudes Sexy superheroes
bbw nude women Nude pussy cum naomi nude Nude asian americans courtney smith nude sienna guillory nude Girls basketball nude kate bosworth nude fakes Amateur wife nude photos ukraine nude teen Big black ass nude kiera knightley nude pics Nude russians Sleep nude chris brown rihanna nude photos pic of nude girls Bollywood nude images sexy and nude pics free nude college girl videos Nude dads and daughters ameture nude pictures Serena williams nude pix
1st Anal Sex what is an anal prolapse Types Of Anal Sex gay anal sex technique gay anal fisting videos Why Does Anal Sex Feel Good video double anal Lesbian Teens Anal largest anal dildo Lesbian Anal Toy anal sex poop videos Anal Hidden Cam Amateur Interracial Anal amy amour anal how to anal intercourse Anal Sex Condoms eyaculacion anal free anal streaming Anne Hathaway Loves Anal mini anal Unnatural Anal Insertions
Anal Guest free full anal movies Manual Anal 1st anal video shits herself anal Couple Anal Sex roxy renolds anal Sara Jay First Anal Scene anal destruction casedy Como Hacer El Sexo Anal anal sex effects Anal Cancer Blog Anal Toys Lesbian ice la fox anal scene lesbian anal vid Rough Anal Sex Clips wet anal double anal sex movie Palin Anal really painful anal Shitty Anal Fuck
rodox sex mpg Shower sex how penis breasts sex Sex malam pertama random sex videos exsplicit sex videos Sex lubrication silicone i post sex Sex fat chick celebriies having sex Adult sex animations sex and motorcycles Adult sex therapy Laura cover sex fucking having sex sex vacation caribbean Pool sex orgasm women barbershop sex office sex gay Secretaire office sex black sex vod Rainbow mika sex
Rock cock jock cock robin when your Wife big cock huge cock free pics Mature sucking black cock cock docking clips Hardcore riding cock cock sucking whores Fuck you cock sucker cock fighting rules Big cock hardcore Hubby loans to black cock milf sucking young cock two cock in pussy Cock sucker t shirt two cock fucking cock pierced Tila tequila suck cock largest cock videos White teen black cock
miss teen usa south carolina Fucking boobs thumbnails free videos of gay black me gandbang Senior sex trailer sophie monk nude nude music videos Britney spears porn video maggie grace nude Preteen bikini movies xxx Sexy pamela anderson vanessa new nude photos Aisha tyler nude pics Gametophyte produces male female sex mate plants toothless blowjob monthly membership streaming porn Pinkpanteens preteens in thongs lingerie nudecollege students Fat mature sex teen monologues Ebony muff diving
sex with hookers Free jaybee sex sex with redheads Cartoons about sex usa sex forum retarted girls sex Photo booth sex gay virgin sex Female sex chromosome sex teen candy Teenage sex story sex feet tingle Celebrity sex sces Flex girl sex lesbian sex galerii work at sex Rough sex free roug gangbang sex hypnosis sex best Sex trek 6 teens wating sex Ssecretary sex videos
1st Anal Sex what is an anal prolapse Types Of Anal Sex gay anal sex technique gay anal fisting videos Why Does Anal Sex Feel Good video double anal Lesbian Teens Anal largest anal dildo Lesbian Anal Toy anal sex poop videos Anal Hidden Cam Amateur Interracial Anal amy amour anal how to anal intercourse Anal Sex Condoms eyaculacion anal free anal streaming Anne Hathaway Loves Anal mini anal Unnatural Anal Insertions

Department of Mechanical Engineering
Northwestern University
Evanston, IL 60208



This paper presents our work to date on a haptic interface whose immediate aim is to provide access for blind computer users to graphical user interfaces. In this presentation, we describe the hardware and supporting software which together reinterprets a Microsoft Windows screen for the haptic senses. Screen objects such as windows, buttons, sliders, and pull-down menus are mapped to the workspace of a two-axis haptic interface called the Moose where they emerge as patches and lines of varying resistance. The Moose operates much like a mouse except that it is able to move under its own power and thereby make apparent touchable virtual objects. Thus presented to the hand, interface objects may be located, identified, and even manipulated or activated. Using Microsoft Windows as a test bench, we have proven the feasibility and usefulness of the haptic interface approach for non-visual computer access. Extensions to haptic browsing of the Web are discussed.




1: Introduction

'Haptics' refers to the human tactile (cutaneous) and kinesthetic (muscle movement) senses. A haptic interface is a computer-controlled motorized device to be held in the hand by a user, which displays information to that user's haptic senses. It is an extremely powerful modality for interface design because the same device can be used for both displaying output from the computer and accepting input from the user. Moreover, using haptics significantly reduces the burden on the other senses such as vision and audition, thereby freeing these channels for other tasks. In certain instances it is, we believe, possible to completely substitute haptics for other sensory modalities. In this way, graphical information displayed on a computer's screen can be made accessible to blind persons who at the moment are denied access to standard Graphical User Interfaces (GUIs). For example, by producing forces on the user's hand which are a function of both the user's motions and properties of the icons under the cursor, touchable representations of the screen objects can be created. In particular, we are interested in applying haptics as a sensory substitute for the graphical interfaces of today's desk-top computer applications, including web browsers.

A handful of other research groups are working on powered-mouse type interfaces for GUIs. Christopher Ramstein and Vincent Hayward have designed the Pantograph, a two-axis haptic interface [Ramstein 1994] for which they are presently developing Microsoft Windows access software. They are also interested in blind user access. In Wisconsin, the TRACE Group is developing a computer access tool for the blind based on haptics [Wiker 1991]. At the university of Tokyo, a mouse with both vibrotactile and force feedback has been developed [Akamatsu, Sato 1994]. At Stanford in the 1970s the Optacon was developed by John Linvill to allow blind persons to read printed text. The Optacon consists of a camera and an array of motorized pins, and stands as one of the first commercialized haptic display devices [Linvill 1973]. Other access devices for the blind and deaf-blind based on haptics have also been developed [Loubal 1992], [York 1989] [Frisken-Gibson 1987] [Eberhardt 1993] [Kelly, Salcudean 1994].

2: Our Prototype Interface

We have designed and built a working prototype which serves to prove the concept: the Moose. The Moose has generated quite a bit of enthusiasm from those who have seen (felt) it. It is basically a powered mouse, giving the user the ability to feel the screen objects under the mouse cursor. This mouse is used to navigate the screen like a regular mouse; but by reflecting forces (produced by its motors) back to the user, it presents a haptic representation of the symbols on the screen. In other words, as the puck of the Moose is moved, the mouse cursor moves. If the cursor should alight on an icon, a haptic representation of that icon is presented by the Moose for the user to feel and explore. The edge of a window, for example, is realized haptically as a groove. A check box is represented as a border with a repelling block at one end which becomes an attracting spring when the checkbox is checked. Thus by moving the cursor over haptic objects the user can simultaneously identify their type and check their current status. Once a desired icon has been found, it may be selected using a typical mouse button located on the Moose puck. Thus one can explore a screen, activate 'buttons' from menus, and select other screens which in turn will be mapped and haptically displayed. For text which appears on the screen (file names, button labels, etc.,) we have experimented with integrating a speech synthesizer into the interface.
As well as rendering objects belonging to the existing GUI metaphor, we are exploring the presentation of altogether new information through haptics. For example, the next appropriate user action in a given context can be indicated by causing the powered mouse to gravitate to a particular icon. Through haptics, we can truly represent the drag and drop metaphor by increasing the apparent mass of the Moose's puck when an object is being dragged and decreasing the apparent mass of the puck once the object has been dropped. In this way, we are able to relate the mass added to the puck to the relative size of the object being dragged - the size in bytes of a file, the number of documents in a folder, etc. - information which is not so apparent in standard GUI implementations.

3: Hardware

Figure 1 shows the hardware components of our present planar haptic interface, the Moose. The puck or manipulandum under the user's hand is coupled to two linear voice coil motors through two perpendicularly oriented flexures. The workspace is 3 cm square while the device footprint is 33 cm square and height is 5 cm. The effective mass in each direction is 95 grams while the maximum force output is about 6 Newtons. The workspace of the current Moose is limited by the linear motors. Future designs will utilize rotary motors and capstan drives, realizing large workspaces yet maintaining a low profile package.
The unique feature of our hardware design is this double flexure. On the present prototype, the double flexure is executed in two pairs of 7-cm strips of spring steel. The double flexure conveniently decouples the 2-axis motion of the puck into two single-axis motions at the linear motors. Moments and vertical forces are resisted, yet translations in the horizontal plane are transmitted directly to the motors by the manipulandum. The kinematics of this device are simple and very nearly linear, making forward and inverse kinematic calculations unnecessary. Furthermore, the workspace is flat, square like a mousepad, and free of singularities. The entire workspace is also naturally counterbalanced. Over-limit forces will cause buckling of the flexures, which we consider a safety feature. The only real disadvantage of the double flexure design is added high-frequency structural resonances inherent in the flexures themselves. These resonances will bandlimit the display capabilities. But since they can be chosen high enough by design, they do not interfere with haptic object images.
A simple Digital I/O card provides for PC-bus communication to four 12-bit DACs and four quadrature counters. The voltage outputs of two DACs, ranging +/- 5 Volts, feed to two transconductance amplifiers based on the LM12 power op amp and in turn to the motors. A linear position encoder, 150 lines per inch, reads position on each of the motors while the count circuit maintains an up-to-date binary representation of position. Other digital switch inputs such as buttons can be polled from software.
Finally, a speech synthesizer linked through the serial port is available for text output. Future hardware enhancements will include the following: 1) a Braille display to take the place of the speech synthesizer for text output, 2) the use of Braille cells for shape display, and 3) the use of a small voice coil motor for vibration and texture display [Kontarinis 94].

Figure 1.
Image of the Moose, with hand on the puck.
A portion of one linear motor is visible between the top and bottom plates.

4: Software

Various control routines which create haptic effects such as virtual springs, textures, and buttons have been developed and incorporated into our Windows interface. By combining these primitives we have begun to construct a library of hapticons each of which correspond to a standard Windows icon. For example, our haptic checkbox has a frame surrounding the checkbox text and a detent corresponding to the checkbox state indicator. Just as the state indicator changes color when the checkbox is checked, so also our haptic checkbox state indicator changes from an attracting force field to a repelling field which is immediately apparent when the profile of the checkbox is examined. Our software is divided into three distinct modules:

5: Specific Goals and Extensions to Web Browsing

We are currently experimenting and developing a palette of haptic effects which will be used to explore and allow comparisons among various haptic substitutes for graphic objects- i.e. detents for buttons, solid blocks for inaccessible objects, compliant and non-compliant borders for windows, and so on. We hope that this research will result in a characterization of graphic interface objects and that a corresponding library of haptic effects for representing these objects will be created. In time we hope that a common practice for haptic interface design will arise.

The project has attracted the interest of Neil Scott and his team at Stanford's Center for the Study of Language and Information, who are currently incorporating our work into their Total Access Port (TAP) system. TAP is aimed at developing a generic adaptive interface port through which interface device signals can be intercepted and hence made available to whatever access device a disabled user finds most appropriate. The system's broad goal is to provide the individual with one personalized interface which they can bring with them to whatever computer they need to use. The haptic interface is a very realistic option for conveying the contents of a GUI to a blind person. Scott's team will substitute our icon management module with their own vision recognition routines which will obtain the icon information directly from the video signal rather than from the Windows environment. The advantage of this system is that it will be platform-independent and will thus allow blind people to use the same access device for any number of computers running any type of operating system.

Future work with the Moose includes extensions of our software to haptic browsing of the web. As Microsoft Windows icons on the screen may be queried as to their type, location, and size, so may the elements of a typical web page. Certain properties of images, forms, frames and the like may be ascertained and used to create correlates within the workspace of the Moose. In fact, the pertinent information is quite readily available within the HTML code itself. The creation of a web browser capable of haptic display simply involves re-writing those parts of a web browsing application which draw onto the screen according to the parsed HTML code. Instead, drawing would take place onto the Moose's workspace, using an Application Programmers Interface provided with the Moose much like the Hapticon Management Class described above.

6: Summary

A new motorized mouse takes over the function of the conventional mouse while conjoining the output role of the screen. With our powered mouse, a blind user can navigate and interact through an application's window. Sighted users may also realize advantages in speed and dexterity.

Using Windows Internals, we have transcribed the visual information of the screen and made it available to the haptic senses. The Windows environment enables inquisitive software such as ours to access all information on the screen. Our software simply gathers that information and displays it haptically. HTML code also contains the descriptive information necessary to create a haptic rendering of a web page. The real advantage of our haptic interface over a speech screen reader is that information about the window or web page topology is presented directly and immediately rather than through time-consuming descriptive language.

Haptic icons, like graphic icons, are created entirely in software which means that they can be modified and customized according to the needs of developers and end users. In undertaking this work, it is our hope that the basic building blocks we develop, the haptic icon library, will become the basis of further and much more comprehensive interfaces both for blind computer users and as supplements to existing GUI's for sighted users as well.

References

  1. Akamatsu, M., Sato, S. and MacKenzie, I.S. Multimodal mouse: A mouse-type device with tactile and force display, Presence, Vol 3 No. 1,Winter 1994 pp 73-80.
  2. Eberhardt, S.P., et al. OMAR: a haptic display for speech perception by deaf and deaf-blind individuals, Proceedings of IEEE Virtual Reality Annual International Symposium. Held: Seattle, WA, USA, 18-22 Sept. 1993. p. 195-201
  3. Edwards, A.D.N. Soundtrack: an auditory interface for blind users, Human Computer Interactions vol.4, no.1, 1989 p. 45-66.
  4. Frisken-Gibson, S.F., et al. A 64-solenoid, four-level fingertip search display for the blind, IEEE Trasactions on biomedical engineering. (Dec. 1987) vol.BME-34, no.12, p. 963-5.
  5. Kelly, A.J., and Salcudean, S.E. On the development of a force-feedback mouse and its integration into a graphical user interface, in Proceedings ASME Winter Annual Meeting, DSC-Vol. 55-1, 1994.
  6. Kontarinis, D. A. and Howe, R. D. Tactile display of vibratory information in teleoperation and virtual environments, Presence, 4(4):387-402, 1995.
  7. Linvill, J. Research and development of tactile facsimile reading aid for the blind: the optacon, [Washington] U.S. Dept. of Health, Education and Welfare, Office of Education, Bureau of Education for the Handicapped, 1973.
  8. Loubal, P.S. Fingertip maptracing devices for the blind, Proceedings of Conference on Technology and Persons with Disabilities. Held: Los Angeles, CA, USA, 18-21 March 1992. p. 315-18
  9. Minsky, M. Computational Haptics: Texture, PhD Thesis, MIT Media Labs, 1995.
  10. Ramstein C. and Hayward V. The Pantograph: A large workspace haptic device for a multi-modal human computer interaction, In CHI'94, Conference on Human Factors in Computing Systems ACM/SIGCHI, Boston, MA, April 1994.
  11. Wiker, S.F., et al. Development of tactile mice for blind access to computers: importance of stimulation locus, object size, and vibrotactile display resolution, Proceedings of the human factors society 35th annual meeting. vol.1 Held: San Francisco, CA, USA, 2-6 Sept. 1991. p. 708-12
    12. York, B.W., et al. Tools to support blind programmers, 17th Annual ACM Computer Science Conference. Held: Louisville, KY, USA, 21-23 Feb. 1989. p. 5-11

    Return to Top of Page
    Return to Access Index