What Did John Kennedy See?

This new technology is just plain fascinating and a bit scary, too.

....Shree K. Nayar, a professor of computer science and co-director of the Columbia Vision and Graphics Center, took high-resolution photographs of people that include their eyes and, in particular, the transparent part of the eye called the cornea. Then, with a postdoctoral researcher, Ko Nishino, he devised computer algorithms that analyze the images reflected in these natural mirrors, revealing a wealth of information. The system can automatically recover wide-angle views of what people are looking at, including panoramic details to the left, right and even slightly behind them. It can also calculate where people are gazing - for instance, at a single smiling face in a crowd. Because the algorithms can track exactly where a person is looking, the system may one day find use in surveillance cameras that spot suspicious behavior or in interfaces for quadriplegics who use their gaze to operate a computer. Dr. Nishino and Dr. Nayar plan to try their corneal imaging system with archival photographs. "It will be fascinating to go back and look at photographs of important people like John Kennedy," Dr. Nayar said. "From a single image of the eye, we may be able to figure out what was around him and what he was looking at."....