As humans, it’s only natural to take a look at the sky and perceive to see an object, a face, an animal. Computers, too, are capable of this perception. However, they may be capable of finding things that the human eye can’t, or just might not notice.
In a project called “Cloud Face“, Seoul, South Korea-based Shin Seung Back and Kim Yong Hun of aptly-named ‘Shinseungback Kimyonghun‘ have pointed cameras up at the sky and let complex algorithms detect faces in the passing clouds. Read more…
Here’s a tool you may not have heard about but may useful at some time in the future. It’s called Clipping Magic, and it’s designed to remove backgrounds from user-uploaded pictures.
The concept is rather simple, you upload an image, mark the areas in the background you don’t want in red, and mark the areas in the foreground you do want in green. The website’s algorithm takes over and (hopefully) produces a background-free picture. Sounds simple, doesn’t it? But how does it fare when used for an image with a background you actually want to remove? Read more…
Movies and TV shows have a knack for making it seem as if you could take a horrible, low-resolution image and turn it into a high-res masterpiece — the term “enhance” has become almost comical. And for every mention of magical television enhancement, there’s mention of some special algorithm at work that makes it happen.
Well, the University of Texas at Austin’s RCM Tools web app isn’t quite up to cable drama standards, but it’s their attempt to apply special algorithms to image enhancement and denoising, and it’s free for photographers to experiment with. Read more…
Over the past decade, many airports around the world have adopted special thermal cameras that can determine whether or not a passenger has a fever. The goal of these cameras is to prevent infectious diseases from spreading and causing an epidemic (or pandemic). Greek scientists Georgia Koukiou and Vassilis Anastassopoulos recently came up with a similar concept, except their thermal camera is used to detect drunk people instead of contagious people. Read more…
As people snap more and more digital photos, being able to organize those photos into useful sets is becoming increasingly important. Facial recognition algorithms are quickly becoming a standard feature in popular photo origination programs (e.g. iPhoto), but people-sorting is only the tip of the “semantic photo search” iceberg. Cloud photo service EverPix is one company that’s currently working to take photo recognition beyond faces. Sarah Perez of TechCrunch writes,
[...] the eventual goal for Everpix is to become the default way people choose to view and share photos. One development which could help it get there is the image analysis technology the company has been developing in-house. As people’s photo collections grow exponentially over the years, it’s something that will become more valuable in time. Using generalized semantic tagging techniques, Everpix is building algorithms that can identify what the photo is of – meaning, whether it’s a person, a night or day shot, a wide or close shot, a city scene, a nature photo, a photo of a baby, or a vehicle, or a photo of food, among many other things.
What’s important here is that the way they’ve built this to scale. After training the system on a minimal amount of photos, Everpix can then look for other photos in a user’s collection that match that signature without reprocessing the entire photo collection.
In the future, we’ll likely be able to search for photos with photos. Looking for a particular photo that you took at a popular tourist landmark? Just show the app a similar photo found online, and voilà, yours appears.
YouTube just announced a useful new feature: an easy face blur option. The announcement says the feature is aimed for news and human rights agencies to protect privacy and identities especially if posting images of activists who may need to remain anonymous or if minors are present in the videos and privacy is a concern. Read more…
“Super-Resolution From a Single Image” is an interesting research page by computer scientists over at the Weizmann Institute of Science in Israel. It details the group’s efforts to create sharp enlargements of small photographs, and offers comparisons between their algorithm and other popular ones being used and researched (e.g. nearest neighbor, bi-cubic). The large image of the baby seen above was created from the tiny image on the left. See if you can create something more useable using Photoshop.
Here’s a video overview of some interesting research that’s being done in the area of video processing. By taking standard video as an input and doing some fancy technical mojo on it, researchers are able to amplify information in it to reveal things that are virtually invisible to the human eye. For example, you can detect a baby’s heartbeat by simply pointing a camera at his/her face. The method is able to visualize the pulsating flow of blood that fills the face.
What if all advertising photos came with a number that revealed the degree to which they were Photoshopped? We might not be very far off, especially with recent advertising controversies and efforts to get “anti-Photoshop laws” passed. Researchers Hany Farid and Eric Kee at Dartmouth have developed a software tool that detects how much fashion and beauty photos have been altered compared to the original image, grading each photo on a scale of 1-5. The program may eventually be used as a tool for regulation: both publications and models could require that retouchers stay within a certain threshold when editing images.
Xerox is showing off a new tool called Aesthetic Image Search over on Open Xerox (the Xerox equivalent of Google Labs). It’s an algorithm being developed at one of the company’s labs that aims to make judging a photograph’s aesthetics something a computer can do.
Many methods for image classification are based on recognition of parts — if you find some wheels and a road, then the picture is more likely to contain a car than a giraffe. But what about quality? What is it about a picture of a building or a flower or a person that makes the image stand out from the hundreds which are taken with a digital camera every day? Here we tackle the difficult task of trying to learn automatically what makes an image special, and makes photo enthusiasts mark it as high quality.
You can play around with a simple demo of the technology here. Don’t tell the Long Beach Police Department about it though — they might use it against photographers.
