More on augmented reality

A couple of new developments to keep an eye on (pun intended):

•  Contact lenses with virtual displays embedded;
• Monkey controls robot’s movement with its thoughts

See also this slightly tongue-in-cheek, but absolutely true all the same, article on 10 ways online gaming will change the future.

Growing replacement organs

It’s very exciting to discover that the day may soon be here when we can grow bespoke replacement organs, using our own cells.

According to the London Times, scientists at the University of Minnesota have chemically stripped cells from a dead animal’s heart. This leaves only the inert protein base structure intact. This can then be used as the base for seeding with fresh, live cells from the patient. At the moment, it’s only been used on animals. However, in the future, we’ll be able to use hearts from cadavers, seed them with stem cells, and pretty rapidly – within weeks – have a functioning heart ready for transplant. It isn’t just hearts, either – almost any organ can be ‘created’ using this procedure.

Of course, the process still needs a real, human heart to provide the base. I suppose that it needn’t be as ‘fresh’ as the hearts currently used for transplant, so by providing a bigger time window between the death of the donor and the time the organ is removed from the cadaver. Also, all issues regarding compatibility and organ rejection become irrelevant.

The scientists who have developed the procedure say that it will be many years before this is ready for use on humans, but I’m not so sure – I think there’s such a huge demand amongst the boomer generation for it that money will be thrown at the problem, and the delivery date will arrive much sooner!

The machines will speak your thoughts

OK, so it’s been a while since I posted, and I’m trying to catch up with a number of things that I’ve bookmarked, and so I’m getting creative with the post titles…

Anyway, the BBC reports that researchers at Boston University have developed a brain implant that is able to read thoughts and translate them into machine-generated speech.

The article reassures us:

“There is a huge difference between a technique like this, which is able to pick up signals the subject wants to be picked up, and being able to delve deep into the mind,” says Professor John Dylan Haynes of the Max Planck Institute for Human Cognitive and Brain Sciences.

However, it wasn’t all that long ago that the technology to control mouse a computer by thought alone also required a chip to be implanted in the brain – now, though, it’s a $15 accessory. In the same way, I suspect that this thought-to-speech technology will also rapidly become a cheap peripheral – and no doubt governments around the world will soon have black labs working on using them in combination with truth drugs…

More biotech news

• Using slime moulds in sensor chips could be more resilient than silicon, as they could self-repair
• Bones could allow data swaps via handshake
• Steer-by-tongue technology

Ankle tech and stomach fat

New body-replacement or augmentation technologies keep on appearing… MIT have developed the first robotic ankle replacement. Unlike previous ankle replacements, this one will allow the wearer to walk with a natural gait. The final paragraph, which outlines what else they’re working on, is also interesting.

Meanwhile, the BBC reports that women who have had mastectomies may be able to grow new breasts using fat removed by liposuction from their own belly. The key is the addition of “concentrated stem cells”, which stimulate the fat to turn into breast tissue, rather than being reabsorbed into the body. The scientists involved aren’t actually sure how it works, but apparently trials in Japan have been very successful.

Surrounded by unseen presences

Last year I wrote a review of Margaret Chan’s book, Ritual is Theatre: Theatre is Ritual, about Chinese Spirit Mediums in Singapore. Here’s an interesting clip that I just found on YouTube:

I’ve been thinking a lot about this lately, probably provoked by reading William Gibson’s latest novel, and by some articles about gaming technology.

Gibson was one of the first to discuss how virtual presences might manifest themselves in the real world. In Count Zero, it was achieved through biochips physically implanted in the brain, allowing a virtual entity to possess a human (a process shown again, using a slightly different technology, in the Matrix sequels, where Agent Smith manages to leave the Matrix and take over a human body).

I ‘m not going quite that far here, but I’m wondering where we’re going with the convergence of:

• virtual communities
• customisable online avatars
• augmented reality (AR)
• ubiquitous wireless access
• unobtrusive personal/mobile computing
• omnipresence

AR and mobile computing are now pretty much ready to go. I find this French clip very interesting for several reasons:

• the computers and goggles that the people in the clip are using are pretty unobtrusive; if they walked past you in the street you wouldn’t necessarily notice anything unusual;
• the “locative art” is multi-user; they are all seeing and interacting with the same virtual objects;
• the virtual ‘life-forms’ don’t do much in this clip… but what could they do?
• the augmentation of reality isn’t confined to adding in objects and entities; it also redraws the location – for example, at the end of the clip, by redrawing the actual walls, adding in water, and so on.

The clip suggests to me that this kind of technology and experience will be mainstream soon. Probably the first steps will be to move gaming, and environments similar to Second Life out into the real world; keyboards and monitors will come to be seen as a temporary aberration.

The extension of Second Life et al into augmented reality is one element of what I find interesting here. In Second Life, I have an avatar – which could look realistic, or not. In augmented reality, I will be physically present in one place, but why should I not have one or more avatars roaming other ‘real’ places. As artists get closer to bridging the uncanny valley, my avatar could be completely realistic. It could potentially use game-style AI to model my real behaviour, even when I was not actively controlling or monitoring it. To someone else immersed in AR, it may not be possible to tell if this is the ‘real’ me without taking off the goggles.

I will also be interacting with avatars. Some will belong to people I know personally in real life. Some will be people I only know from online interaction. Some will be intelligent agents, and others will be AI-driven NPCs. This is where things get a little strange, because the motivations and abilities of all but the first group are essentially unknown. If you and I know each other only from online interactions, then we are each dealing with a construct we ourselves have developed, interpreting the information we have given each other as well as observed behaviour. I cannot know whether you are in fact a real individual. Thus, in Second Life one avatar, Wilde Cunningham, is actually controlled by a group of people; if I were to meet Wilde without knowing this, his behaviour might seem very erratic, and part of my sense-making would be to rationalize and explain variations in his speech and actions. Other, seemingly real, persons may not have any real-world person controlling them; they may be software controlled, but I still may not be able to tell without exiting AR.

This leads me to omnipresence. We’re already accustomed to this: through internet chat like MSN, Skype, Twitter, and so on, our friends are ‘always there’, to be contacted when we need them… IF we can get their attention! How is this going to work in AR? Will be call their name and see their avatar materialise before us? Will we constantly surrounded by their ghostly shapes, which only solidify as they interact with us?

Other issues involve dealing with avatars and agents who have better software, faster connections, wider knowledge, and superior connections… there are a lot of variables here.

Where this leads me is to wonder how behaviour will change once augmented behaviour becomes normal. Believers in voodoo – the metaphor used by Gibson – as well as the tang-ki mediums of the Singaporean Daoists, all believe that we are surrounded by unseen enitities who can be called upon. Some are friendly, some are not; some are predictable, some are not; some are powerful, some are not.

Do these traditional beliefs give us behavioral patterns, metaphors, and tools that we can draw upon as we design systems from e-commerce to e-learning, or social and gaming systems? Will we find that people tend to default to this kind of behaviour and sense-making?

My feeling is yes. Although the pieces for widespread AR are all present today, they haven’t been put together yet. When they are, people are going to find it very strange. After all, to someone from my grandparents’ generation (of that ‘rational’ but un-computerised world), explanations from a traditional spirit medium and from an AR-enabled person, of their respective experience of the world would seem equally incredible and incomprehensible – but sharing many similarities. I suspect that as people try to cope with the very different AR world, they will look backwards for tools and concepts that help their adaptation. I also suspect that unanticipated consequences will result!

Update

This clip gives an excellent introduction; the book it’s introducing is already being advertised on the sides of buses here in Singapore:

NUS nails nano-bone

OK, so I couldn’t think of a better title…

Following the news about artificial muscles, researchers here in Singapore – at the National University of Singapore – have discovered a new way of using nanotechnology to create artificial bone.  Very interesting… our cyborg future gets a bit closer

Cyborg technology

I’ve been saying for a long time that the boomer generation, once it realised its mortality, was going to throw its enormous financial resources at medical technology – and would be the guinea pigs for the outcome. With any luck by the time my generation gets old, the technology to rebuild us and – who knows – maybe even rejuvenate us will be stable, tested and cheap

Latest news flashes on the road to this cyborg future:

• An artificial hand invented by a Scottish NHS worker reaches market. It’s integrated with the patient’s muscles, and controlled by the mind, just like a real hand. There’s a photo gallery of people with these artificial hands here.
• Speaking of muscles, New Scientist reports that nanotubes hold a lot of promise for untiring prosthetic muscles.