Optical Camouflage: Altered Reality

Active camouflage provides concealment in two important ways: firstly, it makes the camouflaged object appear not merely similar to its surroundings, but effectively invisible through the use of mimicry; secondly, active camouflage changes the appearance of the object as changes occur in the background. Ideally, active camouflage mimics nearby objects as well as objects as distant as the horizon.

Optical camouflage delivers a similar experience to Harry Potter’s invisibility cloak, but using it requires a slightly complicated arrangement. First, the person who wants to be invisible (let’s call him Harry) dons a garment that resembles a hooded raincoat. The garment is made of a special material that we’ll examine more closely in a moment.

As you can see in this image, the experience closely resembles walking directly in front of a movie projection screen, only with a real background.
Next, an observer (let’s call him Professor Snape) stands before Harry at a specific location. At that location, instead of seeing Harry wearing a hooded raincoat, Snape sees right through the cloak, making Harry appear to be invisible. The above photograph shows you what Snape would see. And if Snape stepped to the side and viewed Harry from a slightly different location? Why, he’d simply see the boy wizard wearing a silver garment. Scowls and detentions would likely follow. Lucky for Harry, his fictional cloak affords 360-degree protection.
Optical camouflage doesn’t work by way of magic. It works by taking advantage of something called augmented-reality technology — a type of technology first pioneered in the 1960s by Ivan Sutherland and his students at Harvard University and the University of Utah. You can read more about augmented reality in How Augmented Reality Works, but a quick recap will be helpful here.

Augmented-reality systems add computer-generated information to a user’s sensory perceptions. Imagine, for example, that you’re walking down a city street. As you gaze at sites along the way, additional information appears to enhance and enrich your normal view. Perhaps it’s the day’s specials at a restaurant or the showtimes at a theater or the bus schedule at the station. What’s critical to understand is that augmented reality is not the same as virtual reality. While virtual reality aims to replace the world, augmented reality merely tries to supplement it with additional, helpful content. Think of it as a heads-up display (HUD) for everyday life.
Most augmented-reality systems require a user to look through a special viewing apparatus to see a real-world scene enhanced with synthesized graphics. They also call for a powerful computer. Optical camouflage requires these things as well, but it also necessitates several other components. Here’s everything needed to make a person appear invisible:
  1. a garment made from highly reflective material
  2. a digital video camera
  3. a computer
  4. a projector
  5. a special, half-silvered mirror called a combiner

More Invisibility Cloak Components :

For the rest of the setup, the video camera needs to be positioned behind the subject to capture the background. The computer takes the captured image from the video camera, calculates the appropriate perspective and transforms the captured image into the picture that will be projected onto the retro-reflective material.
The projector then shines the modified image on the garment, by shining a light beam through an opening controlled by a device called an iris diaphragm. This diaphragm is made of thin, opaque plates, and turning a ring changes the diameter of the central opening. For optical camouflage to work properly, this opening must be the size of a pinhole. Why? This ensures a larger depth of field so that the screen (in this case the cloak) can be located any distance from the projector.
Finally, the overall system requires a special mirror to both reflect the projected image toward the cloak and to let light rays bouncing off the cloak return to the user’s eye. This special mirror is called a beam splitter, or a combiner — a half-silvered mirror that both reflects light (the silvered half) and transmits light (the transparent half).
If properly positioned in front of the user’s eye, the combiner allows the user to perceive both the image enhanced by the computer and light from the surrounding world. This is critical because the computer-generated image and the real-world scene must be integrated fully for the illusion of invisibility to seem realistic. The user has to look through a peephole in this mirror to see the augmented reality.

The Complete Invisibility System :

Now let’s put all of these components together to see how the invisibility cloak appears to make a person transparent. The diagram below shows the typical arrangement of all the various devices and pieces of equipment.
Once a person puts on the cloak made with the retro-reflective material, here’s the sequence of events:
  1. A digital video camera captures the scene behind the person wearing the cloak.
  2. The computer processes the captured image and makes the calculations necessary to adjust the still image or video so it will look realistic when it is projected.
  3. The projector receives the enhanced image from the computer and shines the image through a pinhole-sized opening onto the combiner.
  4. The silvered half of the mirror, which is completely reflective, bounces the projected image toward the person wearing the cloak.
  5. The cloak acts like a movie screen, reflecting light directly back to the source, which in this case is the mirror.
  6. Light rays bouncing off the cloak pass through the transparent part of the mirror and fall on the user’s eyes. Remember that the light rays bouncing off the cloak contain the image of the scene that exists behind the person wearing the cloak.
The person wearing the cloak appears invisible because the background scene is being displayed onto the retro-reflective material. At the same time, light rays from the rest of the world are allowed to reach the user’s eye, making it seem as if an invisible person exists in an otherwise normal-looking world.

Real-world Invisibility Applications :

The words “invisibility cloak” tends to summon images of fantastic adventure, magical espionage and otherworldly deception. The actual applications for optical camouflage, however, are far less out there. You can forget hiding your Romulan starship or hanging out in the lady wizards’ dormitory, but that doesn’t mean there aren’t a number of viable uses for the technology.
For instance, pilots landing a plane could use this technology to make cockpit floors transparent. This would enable them to see the runway and the landing gear simply by glancing down at the floor (which would display the view from the outside of the fuselage) Similarly, drivers wouldn’t have to deal with mirrors and blind spots. Instead, they could just “look through” the entire rear of the vehicle. The technology even boasts potential applications in the medical field, as surgeons could use optical camouflage to see through their hands and instruments for an unobstructed view of the underlying tissue.
Interestingly enough, one possible application of this technology actually revolves around making objects more visible. The concept is called mutual telexistence and essentially involves projecting a remote user’s appearance onto a robot coated in retro-reflective material. Say a surgeon were operating on a patient via remote control robotic surgery. Mutual telexistence would provide the human doctors assisting the procedure with the perception that they’re working with another human instead of a machine.
Right now, mutual telexistence is science fiction, but scientists continue to push the boundaries of the technology. For example, pervasive gaming is already becoming a reality. Pervasive gaming extends gaming experiences out into the real world, whether on city streets or in remote wilderness. Players with mobile displays move through the world while sensors capture information about their environment, including their location. This information delivers a gaming experience that changes according to where users are and what they are doing.
Optical camouflage is just one method of creating the sensation of invisibility.