Showing posts with label NUI. Show all posts
Showing posts with label NUI. Show all posts

Thursday, January 19, 2012

iPads: iTunesU App, iBooks Textbooks -- Oh, my!


There is a lot of buzz about iPads in education. 


I'm convinced that tablet technology will be adopted by schools at a faster rate than anticipated a year or so ago, now that Apple has launched iBooks Textbooks for iPad and the iTunesU app.


Parents, teachers, students, administrators, and school IT specialists, hold on to your hats!

RELATED
Learning Together: The Evolution of a 1:1 iPad Program
Carolyn Foote, Internet@Schools, 1/1/12
The Swiss-Army Knife of Education
Mr. Hooker, The WIFI--Eanes ISD iPad Pilot Project, 10/3/11
iPads in Education
John Evans, Curator
iBooks Textbooks
iTunesU App

iPad for Art: Sketchbook Express, via the Montlieu Academy of Technology, a public K-5 magnet school that adopted a 1:1 iPad initiative in August, 2011. 


COMMENT
I have been planning on devoting more posts in the future about the iPad and related interactive technologies for learning- and for fun.  When I have a chance to write my mega-post, you won't be disappointed!


Cross-posted on the Interactive Multimedia Technology blog.

Thursday, May 05, 2011

CHI 2011 Workshop Program and Related Links: UI Technologies and Impact on Educational Pedagogy, Related Child-Computer Interaction Papers and Courses

I'll be heading to CHI 2011 for a few days and plan to write a few posts while I'm at the conference. (I'd like to stay for the entire conference, but it is a busy time of year for me at work.)


Below is the program for a workshop I've helped to organize, along with a few related presentations and events that will take place during the course of the conference.


WORKSHOP PROGRAM
CHI 2011 will be held at the Vancouver Convention Centre in Vancouver. The UI Technologies and Pedagogy workshop will be held on Saturday, May 7th,  in the West Building, Level 1, Room 119/120.  PDF versions of the following presentations can be found on the workshop's website.


9:00am – 09:05am Introduction
Edward Tse and Johannes Schöning
9:05am - 10:05am Paper Session I (8 min presentation, 4 min Discussion)
Chair: Yvonne Rogers
Evaluating Pervasive Classrooms
• Son Do-Lenh et al.: Classroom-experience evaluation: An ecological approach to evaluating pervasive technologies in classrooms 
• Kathryn Rounding et al.: Evaluating Interfaces with Children 
• Dan Morris et al.: Using Machine Learning to Scaffold Artistic Creativity in Education
• Tamara Polajnar et al.: Enabling Picture-based Querying and Learning with the JuSe Interface
• Hamed Alavi et al.: Lantern 2.0: A Pervasive Scripting Tool
•Quincy Brown et al.: Mobile Natives: Unlocking the Potential of Educational Technology
10:15am - 11:00am  Coffee Break and Preparation time for short talks
11:00am - 12:10pm  Paper Session II (8min presentation, 4min Discussion)
Chair: Max Mühlhäuser
Collaboration in Math: Fears, Myths, and Insights.
• Nicola Yull et al.: Pass the iPad: Comparing collaboration on paper and screen
• Veronika Irvine et al.: Math Education: A Creative Approach
• Group talk: Math and Embodied Agents
a.Kristina Richter et al.: Bridging Diagnosis and Learning for Mathematics Education in Classroom Setting
b.Lisa Anthony et al.: Handwriting Interaction for Math Tutors: Lessons for HCI in Education
c.Andrew Jensen et al.: Using Embodied Pedagogical Agents and Direct Instruction to Augment Learning for Young Children with Special Needs
• Group talk: Dispelling Myths About the Next Generation Classroom
a. Alex Thayer et al.: The Myth of the Paperless School: Replacing Printed Texts with E-readers
b.Sharon Oviatt: Designing Digital Tools for Thinking, Adaptive Learning and Cognitive Evolution
c.Alexandra Dunn et al.: Designing Classroom Technology to Meet the Needs of All
Group talk: Games, Wearables and Fun Learning.
a.Christiane Moser et al.: Child-Centered Game Development
b.Lizbeth Escobedo et al.: Blue’s Clues: An Augmented Reality Positioning System
c.Si Jung Kim et al.: Wearable Story: A Story Telling Jacket for Young Children to Improve Their Independent Physical and Learning Activities
12:10pm - 1:30pm   Lunch
1:30pm - 2:30pm   Paper Session III (8 min presentation, 4 min Discussion)
Chair: Richard Beckwith
Tangibles and Tabletops
• Izdihar Jamil et al.:    Communication Patterns in Collaborative Peer Learning around Interactive Table
• Aura Pon et al.:   Graspable Music and Vuzik: Music Learning and Creativity using an Interactive Surface
• Ahmed Kharrufa et al.: Learning at interactive surfaces and designing for reflection
• Cristina Sylla et al.: TOK – a Tangible Interface for Storytelling
• Group talk: Tables and Tangibles
a.Robert Sheehan:    Constructionism, Programming and Touch Interfaces
b.Orit Shaer et al.:     Making the Invisible Tangible: Learning Biological Engineering in Kindergarten
c.Sebastien Kubicki: Evaluation of an interactive table with tangible objects: Application with children in a classroom
d.Cristina Emilia Costa et al.:  I-Theatre: developing narratives skills in kindergarten children
e.Wooi Boon Goh et al.:  Potential Challenges in Collaborative Game Design for Inclusive Settings
2:30pm - 3:00pm       Coffee Break
3:00pm - 4:00pm       Breakout Discussion (What are future challenges? Next years workshop?)
4:00pm - 4:45pm   Closing Keynote by Allison Druin: Mining the Imagination from Time Travel to Anti-gravity: The Future of Child-Computer Interaction
"If you’ve ever sat with a child imagining the future of new technologies, you will undoubtedly hear about “anti-gravity machines,” “peace-technologies that work by tickling people,” “backpacks of the future with ice cream makers,” and “time-travel-mobile-phones that when you call someone it takes you back in time.” The question is how can these child-like imagined technologies lead us to real answers for the future?


In my talk I will propose that “data mining” is not enough, that “mining the imagination” is critical to understanding the future. I will describe the “iChild” and the interactive, independent, international, imaginative child we need to consider designing for in the future. If we look for real change, we need to listen to children, not because they know more, but because they can help us question, explore, and push us in true directions for change."


Allison Druin is an Associate Dean for Research in the iSchool at the University of Maryland and is Director of the Human-Computer Interaction Lab. For almost 14 years, she has led an intergenerational research team, where children, ages 7-11 years old partner with an interdisciplinary group of adult researchers to develop new technologies for children. With this team, she has helped to developed new digital library and storytelling tools with such partners as the U.S. National Park Service, Sesame Workshop, Nickelodeon, Nokia, UNICEF, and many others. In 2010, she received with Ben Bederson the SIGCHI Social Impact Award for her work leading the International Children’s Digital Library (www.childrenslibrary.org).
4:45pm - 5:00pm Closing Remarks (All)
7:00pm Optional Workshop Dinner


RELATED CHILD-COMPUTER INTERACTION SESSIONS AT CHI 2011
CHI 2011 will be offering a variety of opportunities for people interested in interaction design and technologies for children.  Detailed information regarding the researchers/ presenters can be found on the IDC-SIG News/Events page.


CHI2011 COURSE - Evaluating Children's Interactive Technology
Monday 9th May 2011 - 16:00
Janet C Read - University of Central Lancashire
Panos Markopoulos - Technical University of Eindhoven
CHI2011 COURSE - New Methods for Designing for and with the iChild: Strategies for Today’s Mobile, Social, and Internet Technologies
Thursday 12th May 2011 - 09:00
Allison Druin - University of Maryland
Jerry Fails - Montclair State University
Mona Leigh Gubler - University of Maryland
CHI2011 Paper Session - Engaging Youth  Thursday 12th May 2011 - 11:00
Exploratory Evaluations of a Computer Game Supporting Cognitive Behavioural Therapy for Adolescents
In the Mood: Engaging Teenagers in Psychotherapy Using Mobile Phones
Breaking Boundaries: Strategies for Mentoring through Textile Computing Workshops
Brick by Brick: Iterating Interventions to Bridge the Achievement Gap with Virtual Peers
CHI2011 - Other IDC Related Papers
Paper Session: Art, Music and  MovementMonday 9th May 2011
MOGCLASS: Evaluation of a Collaborative System of Mobile Devices for Classroom Music Education of Young Children
MoBoogie: Creative Expression Through Whole Body Musical Interaction
Paper Session: Low-cost ICT4D Tuesday 10th May 2011
Utilizing Multimedia Capabilities of Mobile Phones to Support Teaching in Schools in Rural Panama
Infrastructures for low-cost laptop use in Mexican schools
Paper Session: Storytelling and Perceptual Crossing Wednesday 11th May 2011
ShadowStory: Creative and Collaborative Digital Storytelling Inspired by Cultural Heritage
Paper Session: Learning
Practical, Appropriate, Empirically-Validated Guidelines for Designing Educational Games
CHI2011 Paper Session - Families Tuesday 10th May 2011 - 11:00
Learning Patterns of Pick-ups and Drop-offs to Support Busy Family Coordination
Mediated Parent-Child Contact in Work-Separated Families
Hello, is Grandma there? Let’s Read! StoryVisit: Family Video Chat and Connected E-Books
Family Portals: Connecting Families Through A Multifamily Media Space

If these topics interest you, consider making plans to attend IDC 2011!
IDC 2011:  The 10th International Conference on Interaction Design and Children
June 19-23,  University of Michigan

Cross Posted on the Interactive Multimedia Technology blog.

Wednesday, January 12, 2011

Multi-modal Interactive Maps for People With Visual Impairments: Featuring a Stantum multitouch screen with a tactile layer

To learn more about this project, take a look at the video and related publications below. This is a great example of a team that is harnessing emerging technologies to improve the lives of people with disabilities.


Video: "Multimodal Maps for Blind People"


Website


Publications
Anke Brock, Philippe Truillet, Bernard Oriola, Christophe Jouffrai (IRIT CNRS and Universite de Toulouse) Usage of Multimodal Maps for Blind People: Why and How
ITS’10, November 7–10, 2010, Saarbrücken, Germany
Paper: http://www.irit.fr/~Philippe.Truillet/projects/doc/MultimodalMapsForTheBlind-ITS10.pdf
Poster: http://www.irit.fr/~Philippe.Truillet/projects/doc/Poster-ITS10.pdf

Stantum (Multi-touch screen used for the application.)
Ivy Middleware (Used in this application.)

Cross-posted on the Interactive Multimedia Technology blog

Saturday, November 20, 2010

Interactive Puppet Application for the Xbox Kinect, by design.io, creators of Funky Forest

I came across the following video on a post on the  Creative Applications blog about the Theo Watson and Emily Gobeille's  recent work with OpenFrameworks, Kinect, and an interactive puppet prototoype:

Interactive Puppet Prototype with Xbox Kinect from Theo Watson on Vimeo.

I'm not surprised that Theo Watson and Emily (design.io) decided to experiment with the XBox Kinect. I can't wait to see what they will create for Kinect in the future, based on their previous work --   A couple of years ago I wrote a post about their enchanting interactive installation, "Funky Forest":  OpenFrameworks & Interactive Multimedia:  Funky Forest Installation for CinKid


You can see from the video of their Funky Forest installation (2007 CinKid) that they create engaging interactive applications:

Funky Forest - Interactive Ecosystem from Theo Watson on Vimeo.
(Information from Theo Watson's Vimeo site)
"Funky Forest is a wild and crazy ecosystem where children manage the resources to influence the environment around them. By using their bodies or pillow "rocks" and "logs", water flowing from the digital stream on the floor can be dammed and diverted to the forest to make different parts grow. If a tree does not receive enough water it withers away but by pressing their bodies into the forest children create new trees based on their shape and character. As children explore and play they discover that the environment is inhabited by a variety of sonic life forms and creatures who appear and disappear depending on the health of the forest. As the seasons change the creatures also go through a metamorphosis."
Credits:
Theodore Watson
Emily Gobeille
Project Page:
muonics.net/​site_docs/​work.php?id=41
zanyparade.com/​v8/​projects.php?id=12


Note:  A version of Funky Forest, Moomah Edition, is permanently installed in New York City at the Moomah Children's Cafe. This version includes interactive environments related to the four seasons of the year, including an interactive particle system with falling leaves and snow.


FOR THE TECH-CURIOUS
Libfreenect for OX, by Theodore Watson

XBox Kinect running on OS X ( with source code ) from Theo Watson on Vimeo.
The following information and links were taken from the Vimeo description of the above video:  
"This is a port/adaptation of Hector Martin's libfreenect for OS X made by Theodore Watson.
Hector Martin's Libfreenect project page is here:  git.marcansoft.com/​?p=libfreenect.git
Most of the code is unchanged but there are some changes to libusb which was needed to get it running (and a few extra libusb commands) as well as some tweaking of the transfer sizes.
It should be self contained and you shouldn't need to install libusb (the app links it directly ).
Grab the Source Code:
UPDATE:
(Tested on OS X 10.6.3 - 32bit now and with fixes)
theo.tw/​deliver/​kinect/​001-libfreenect-modded-osx-updated.zip
ofxKinect for OF users - thanks Dan!
openframeworks.cc/​forum/​viewtopic.php?p=24948#p24948
Tips:
- Try both usb ports.
- Try not to have too many other devices plugged in (or any)."


(Check the Vimeo website to see if there are updates)


OpenFrameworks Forum
http://www.openframeworks.cc/forum/


RELATED
Presentation about Funky Forest  (ThisHappened)

Emily Gobeille & Theo Watson talk about Funky Forest from This happened – Utrecht on Vimeo.


Cross-posted on the Interactive Multimedia Technology blog.

Thursday, November 11, 2010

NY Times article and Video: iPad Opens World to a Disabled Boy

I meant to post a link to this article a while ago:


iPad Opens World to a Disabled Boy 
Emily B. Hager, New York Times, 10/12/10



Cross posted on the Interactive Multimedia Technology Blog

Tuesday, November 02, 2010

EyeTube for YouTube! Eye-gaze interaction software, free and downloadable from GazeGroup


Gaze interaction systems provide access to computers and the rich content now available on the web for many people with disabilities.  Unfortunately, commercial gaze tracking systems are very expensive and at times, difficult to calibrate.  There is hope!



Following up on my recent post, "Open-source Eye-tracking: The ITU Gaze Tracker 2.0 Beta", I thought I'd share the GazeGroup's EyeTube for YouTube interface.  What is great about EyeTube for YouTube is that it provides two different interfaces. The simplified version looks good for younger children or people with cognitive disorders, and is icon-based.  The second version is appropriate for people who can navigate through more complex visual representations of content. EyeTube requires a Windows-based system and .Net 3.5 at this time. It can be downloaded from the GazeGroup website.  If you plan to download the application, you must also make sure you have a YouTube account. To get the application up and running, you'll need to change the settings (EyeTubeSettings.xml) to match your account.   (If you don't know much about changing settings or xml, ask someone you know who works in IT.)
Below is the icon-based version of the eye-gaze interface for YouTube:
EyeTube - Gaze Interaction for YouTube (simplified version)

Feature-rich version of the EyeTube interface for YouTube:
EyeTube - Gaze Interaction for YouTube

From the GazeGroup site:
"The EyeTube prototype offers a feature rich eye controlled interface for the popular YouTube service. Instead of emulating a mouse pointer and interacting with a web browser the EyeTube interface is especially designed to be driven by gaze input. It offers a wide range of features such as keyword searching, popular video feeds, favorites and social aspects such as subscriptions, friends and commenting on videos.The highly optimized interfaces allows for a streamline interaction which is aleviated from the Midas Touch problem. In most previous gaze interfaces selection is made by a dwell time activator, e.g fixat a button for a specific amount of time and it will execute the function. In the EyeTube interface a fixation on a U.I element will highlight it and a second fixation on the activation button is required to execute the function. This removes the stress of having to constantly move the eyes to avoid unintentional activation."

"The EyeTube also exists in another simplified incarnation developed for users whom are distracted by a larger number of options. It supports basic features such as browsing categories, optional keyword searching and favorites."
RELATED
The GazeGroup
(The individuals mentioned below may be currently working elsewhere, but involved in the gaze research in some way.)
GazeGroup Research Areas
COGAIN (Communication by Gaze Interaction)
ACM CHI Conference Articles
San Agustin, J., Skovsgaard, H., Hansen, J. P., and Hansen, D. W. 2009. Low-cost gaze interaction: ready to deliver the promises. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI EA '09. ACM, New York, NY, 4453-4458. DOI= http://doi.acm.org/10.1145/1520340.1520682
San Agustin, J., Hansen, J. P., Hansen, D. W., and Skovsgaard, H. 2009. Low-cost gaze pointing and EMG clicking. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI EA '09. ACM, New York, NY, 3247-3252. DOI= http://doi.acm.org/10.1145/1520340.1520466 
Tall, M., Alapetite, A., San Agustin, J., Skovsgaard, H. H., Hansen, J. P., Hansen, D. W., and Møllenbach, E. 2009. Gaze-controlled driving. InProceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI EA '09. ACM, New York, NY, 4387-4392. DOI= http://doi.acm.org/10.1145/1520340.1520671

UPDATE
Eye-controlled games and leisure applications from the COGAIN wiki: http://www.cogain.org/wiki/Leisure_Applications
  • EyeArt - EyeArt eye-drawing program, developed by Andre Meyer and Markus Dittmar, Technical University of Dresden, Applied Cognitive Research Unit, Germany.
  • GazeTrain - Gaze-controlled action oriented puzzle game, developed by Lasse Farnung Laursen, Technical University of Denmark
  • Puzzle - Simple puzzle game that can be played with eye movements, developed by Vytautas Vysniauskas, Siauliai University, Lithuania
  • Road to Santiago - Gaze-controlled adventure game (full game), developed by Javier Hernandez Sanchiz, Universidad Publica de Navarra, Spain
  • Snap Clutch - An application that uses eye gaze data to generate key and mouse events for playing games such as World of Warcraft and Second Life.
  • ASE: Accessible Surfing Extension for Firefox - Follow this link to access ASE, an Accessible Surfing Extension for Firefox, developed by Emiliano Castellina and Fulvio Corno at Politecnico di Torino. (Note that this is a beta version.)
  • Eye Gaze Music (SAW Selection Sets) - Point and Play – eye gaze (direct pointing) musical activities, developed by DART. Please note that SAW (Special Access to Windows) framework application is needed to play these 15 music selection sets. SAW is available for free athttp://www.oatsoft.org/Software/SpecialAccessToWindows
  • EyeTube - Gaze interaction for YouTube - Follow this link to get more information and download EyeTube at ITU GazeGroup's web pages
  • Eye3D and other head eye mouse software - Eye3D for education, and a collection of links to free software that works with head or eye mouse. Includes links to downloads and original sites.
  • Gaze-controlled Breakout - Follow this link to access a modified version of the LBreakout2 game which can be operated by an SMI eye tracker, developed by Michael Dorr et al. at University of Luebeck
  • Oleg Spakov's Freeware games for MyTobii - Follow this link to access MyTobii compatible games developed by Oleg Spakov, University of Tampere, Finland
  • Free ITU Gaze Tracker and applications - Download a webcam based open-source gaze tracker and several applications that work with it, developed at IT University of Copenhagen
  • GameBase - Check out the Eye-Gaze Games category at the SpecialEffect GameBase!
  • More information about Gaze-Controlled Games - Follow this link to see a list of online information resources on using gaze for the control of games and other leisure applications



Cross-posted on the Interactive Multimedia Technology blog.

Monday, October 11, 2010

SMARTTable Activities from the SMARTClassroom YouTube Channel


SMARTTable at Wolfe School

Below are links to a variety of videos from the SMARTClassroom YouTube Channel that demonstrate new SMARTTable lessons. 

If you are interested in getting more in-depth SMARTTable training, you can register for certification events via the SMART Learning Center.