What is "body sharing" technology that lets you experience the world from the comfort of your own home?

Game graphics are becoming more and more realistic. The PlayStation 5 Pro, which was announced the other day, has machine power that far surpasses previous models, taking the home gaming experience to the next level. In fact, the PlayStation 5 has a function called haptic feedback built into the controller.

When the character you control in the game runs on sand, you feel the sensation of touching the sand with your hands, and when you grip the grip of a gun, you feel the weight of really pulling the trigger. The impact of combining these systems with a head-mounted display is tremendous.

What would happen if you could feel this excitement as if you were one with your avatar in the metaverse? Or what if you could experience the atmosphere of participating in a distant relatives' gathering that you couldn't attend?

Body sharing expands your online world experience to the fullest.

You've probably heard that the human body is powered by electrical signals. Humans have five senses: vision, hearing, smell, taste, and touch. Many people understand that when these organs receive external stimuli, they switch on, but...

In fact, recent research has shown that humans have more than just a few senses. Stimuli received by the sensory organs are converted into electrical signals and transmitted to the brain through the nerves.

Therefore, if electrical stimuli similar to these electrical signals are given to the human body, in theory, the human will have the illusion that it does not exist in that place, and this sense should be able to expand endlessly.

H2L Inc. is a company that is researching and developing a system to expand personal experiences in this way. H2L has succeeded in digitizing human movements and sensations using its unique muscle displacement sensor.

They are then trying to transmit this data to virtual avatars, robots, or third parties. They call this technology "body sharing."

▶Body sharing technology allows you to recreate and feel the impact and weight of a bird that has landed on your hand in a virtual space.

Actually, I heard that body sharing has already been realized as a variety of services without our knowledge. So I interviewed H2L to find out about the actual development status and what kind of usage they envision.

What kind of usage scenarios did the research on “body sharing” envision in the first place? “It started from the personal desire of our company’s representative, Tamaki,” said Sato, who corresponded with us in the interview, and gave us the details. H2L’s representative director is Tamaki Emi, who also serves as a professor at the Faculty of Engineering at the University of the Ryukyus.

When Tamaki was a teenager, she had been forced to repeatedly go in and out of the hospital due to a chronic illness. At that time, she realized that she could do most things in her room, and she thought that hospital life was quite good.

So Tamaki wondered if she could experience the outdoors while in her hospital room. However, not only could she not find such a service, but there was almost no basic research on it. Tamaki thought that if it didn't exist, he would make it himself, and started researching how to experience traveling indoors.

Tamaki's focus was on "proprioception." Proprioception is the senses received inside the body, such as muscles, tendons, and joints, deeper than the skin that senses antennae, and is also called "deep sense."

Specifically, it refers to senses related to the position and movement of the body, and the amount of force applied, such as the sensation of the weight of an apple when holding it in your hand (= weight sense) and the sensation that the presence of an apple inhibits your grip (= resistance sense).

If this sensation can be transmitted electrically, you can experience the sensation of holding an apple even if there is no apple there. If this is combined with a head-mounted display, you can experience the sensation of experiencing outdoors while indoors.

This research into controlling proprioception has borne fruit, and the system developed by H2L has already begun to be put into practical use.

RaraaS allows people who can no longer move their bodies as they wish due to a disability or illness to share their body with a robotic arm in a remote location and harvest crops in a realistic manner by transmitting the movements of their hands and arms.

The head-mounted display shows the scenery of Okinawa and the participant can hear the sound of the water, so adding the resistance of the oars to that creates a very realistic kayaking experience in the middle of a city or in a hospital room. This technology is not only useful for tourism, but is also expected to be useful in the welfare field, as it allows people who have difficulty working outside to experience going outside.

A "remote-controlled kayak robot" that can remotely control a kayak 700 km away by rowing from a bed while feeling the resistance of the water.

Systems that seem unbelievable, such as a system that applies electrical stimulation to the fingers of patients with paralysis due to spinal cord injuries and other nerve disorders, for use in rehabilitation, are already close to being commercialized.