This research area is related to my first success when it comes to research grant applications. As I have mentioned in an earlier blog post I drafted a Vinnova application for their call “Digital tools” during my first weeks at Örebro University. The first sentences on that application were actually written during my very first day at the university! The application was entitled “Virtual environments supporting group work between sighted and visually impaired pupils” and focused on designing and evaluating new digital learning environments partly based on the results from observations and interviews with both pupils and teachers during the first part of the project.

This is a perfect continuation of my earlier work within the area – my entire doctoral project was focused on designing and evaluating collaborative virtual environments based on combinations of visual, haptic and auditory feedback. You could say that my research career started here. This article summarizes my earlier work in this area, which included design and evaluation of new learning environments in which sighted and visually impaired pupils could work together to solve tasks related to geometry and the concepts of area and volume. The new learning environments were then evaluated in different elementary schools. You can read more about this earlier study in this blog post. When working with this study I also came into contact with the concept of haptic feedback for the first time and since then I have developed and evaluated several haptic applications that provide feedback to your sense of touch through special hardware. You can read more in my blog series on haptic interaction design.

The Vinnova application was handed in around a month after I started at Örebro University and after a few months of waiting, Vinnova sent us the accept message! I wrote this blog post, where I introduced the project partners, shortly after Vinnova made their decision public. I have really enjoyed working in this project, which is the result of my first ever accepted research grant application (co-applicant). As I write in this blog post we have experienced some problems due to the pandemic (e.g. observations in schools could not be carried out and all interviews needed to be carried out online), but the project was mostly a success. The blog image above actually shows my work set-up at my country side, where I was carrying out all my parts of the project.

My main responsibility in the project was to design and implement one of the project’s new digital collaborative learning environments. My application focused on the coordinate system concept and should be used to teach pupils about for example points and the equation of straight lines. The visual part was not that hard, but the haptic implementation was a real challenge. Let’s take the straight line as an example – how would you design the line so that it is clearly felt and possible to follow while at the same time making sure that it does not interfere too much with the exploration of the coordinate system? Keep in mind that severely visually impaired pupils should be able to use the application. It took several iterations before I ended up with the slightly magnetic line that was used in the final application. I will write more about the many interesting technical aspects in a later blog post, where I will also write about how I worked remotely with my KTH colleague Kjetil Falkenberg to synchronize his sound model with my visual and haptic model. I wasn’t the only one developing applications in the project – my former KTH colleague Jonas Forsslund (now Forsslund Systems AB and Haptikfabriken AB) developed another application based on exploration of maps. Also based on this application we had many interesting design-related discussions about the haptic and audio designs. I will come back to some of those later on as well.

After several iterations of development and user testing with users we ended up with two applications that I think we should be very happy with, especially since the whole idea with the Vinnova call was to develop prototypes and/or proof-of-concepts (not applications that are ready for implementation). I will describe the applications more thoroughly when the first results are about to be published. One risk with Vinnova projects is that they are often a lot more focused on development than on research, but in this case we have plenty of material from the design process and the interviews that we can publish and/or use as a basis for future research. This concerns for example interesting design dilemmas, the overall design process and support for collaboration between visually impaired and sighted pupils in general. All project partners are very interested in continuing to collaborate and I’m quite sure that this Vinnova project will not be the last externally funded project we will be engaged in. This time around, we did not include any colleagues from Örebro University, but I have every intention to include more of my colleagues in future projects in this area.

As I have written earlier, I recently bought new haptic devices to be used in research at my department. I’m still at my countryside due to the pandemic, but as soon as I get back to my office it is time to start discussions on how we can make use of the haptic dimension in our future research!  🙂