Skip to main content

Research reflects how AI sees through the looking glass


           Things are different on the other side of the mirror.

The text is backward. Clocks run counterclockwise. Cars drive on the wrong side of the road. Right hands become left hands.


Intrigued by how reflection changes images in subtle and not-so-subtle ways, a team of Cornell University researchers used artificial intelligence to investigate what sets originals apart from their reflections. Their algorithms learned to pick up on unexpected clues such as hair parts, gaze direction, and, surprisingly, beards—findings with implications for training machine learning models and detecting faked images.


"The universe is not symmetrical. If you flip an image, there are differences," said Noah Snavely, associate professor of computer science at Cornell Tech and senior author of the study, "Visual Chirality," presented at the 2020 Conference on Computer Vision and Pattern Recognition, held virtually June 14-19. "I'm intrigued by the discoveries you can make with new ways of gleaning information."
Zhiqui Lin is the paper's first author; co-authors are Abe Davis, assistant professor of computer science, and Cornell Tech postdoctoral researcher Jin Sun.


Differentiating between original images and reflections is a surprisingly easy task for AI, Snavely said—a basic deep learning algorithm can quickly learn how to classify if an image has been flipped with 60% to 90% accuracy, depending on the kinds of images used to train the algorithm. Many of the clues it picks up on are difficult for humans to
notice.

Comments

Popular posts from this blog

Super-Resolution Imaging

Researchers at Helmholtz Zentrum München and the Technical University of Munich (TUM) have developed the world’s smallest ultrasound detector. It is based on miniaturized photonic circuits on top of a silicon chip. With a size 100 times smaller than an average human hair, the new detector can visualize features that are much smaller than previously possible, leading to what is known as super-resolution imaging. Since the development of medical ultrasound imaging in the 1950s, the core detection technology of ultrasound waves has primarily focused on using piezoelectric detectors, which convert the pressure from ultrasound waves into electric voltage. The imaging resolution achieved with ultrasound depends on the size of the piezoelectric detector employed. Reducing this size leads to higher resolution and can offer smaller, densely packed one or two-dimensional ultrasound arrays with improved ability to discriminate features in the imaged tissue or material. However, further reducing t

Virus in the Blood Can Predict Severe COVID-19

  A blood test on hospital admission showing the presence or absence of SARS-CoV-2 can identify patients at a high risk of severe COVID-19. Admitted patients without virus in their blood have a good chance of rapid recovery. This according to researchers at Karolinska Institutet and Danderyd Hospital in a new study published in the scientific journal Clinical Infectious Diseases. Blood samples were taken from patients with a confirmed COVID-19 infection within three days of admission to the Department of Infectious Diseases, Danderyd Hospital, Sweden. Patients with measurable levels of the new coronavirus SARS-CoV-2 in their blood were seven times more likely to develop critical symptoms and eight times more likely to die within 28 days. “This readily available test allows us to identify patient groups at high or low risk of severe COVID-19, which enables us to better guide the treatment and monitoring of these patients”, says the study’s lead author Karl Hagman, infectious diseases co

Monsoon and dehydration: Are you drinking enough water?

      Dehydration   i s a common complaint during hot and humid weather. This is because humidity can make you feel hotter. That’s why a 320C can feel like 380C if the humidity level is as high as 65%!  Importance of hydration –   - Our body is made up of 70% water which is concentrated in all our cells. Dehydration strips the cells of water and vital minerals and hence a person feels tired, lethargic, and dizzy. Dehydration during monsoon can happen to anyone of any age. Therefore, it is very important to drink an ample amount of mineral water to replenish the body’s mineral balance and maintain a healthy temperature. - During monsoon, people prefer multiple cups of hot beverages like coffee or tea over plain water and hence they do not realize how little water they have consumed. You may not even realize you are dehydrated until you start feeling giddy or have muscle cramps. Even a 2% decrease in the body’s water weight can lead to problems like forgetfulness, confusion, a