Authors: JordanDuring the opening F8 2018 keynote, Facebook CEO Mark Zuckerberg showed off the company's latest Instagram updates: Spotify integration, AI-based anti-bullying comment filters, AR camera effects and four-way video chat.During the Day 2 keynote, Facebook revealed how your daily Instagram updates are giving its AI technology a deep-learning crash course in image recognitionone thats apparently made its AI even smarter than Googles at categorizing objects in photos.Facebook pulled this off, amazingly enough, by instructing its AI to read photo hashtags and interpret photos subject matter.Using this strategy, called weakly supervised training, Facebook's AI achieved a record 85.4% accuracy rating on an industry-wide test of image recognition, beating out Googles previous record.A Facebook Engineering blog post went into detail on the methods.
Facebook gave the AI 3.5 billion Instagram images to learn from, labeled with 17,000 hashtags for categorization.Facebook then trained the AI to push aside nonvisual or vague tags and focus on ones that provide the most specific categorization.The team was able to train their AI using this method in just a few weeks by spreading the process across 336 GPUs at once.
Compared to the usual method of teaching AIs to categorize photos using visual clues, this method was much faster and less labor-intensive.A supervised learning process often yields the best performance results, the post reads, but hand-labeled data sets are already nearing their functional limits in terms of size.
Scaling up to billions of training images is unfeasible when all supervision is supplied by hand.Thus, while most object recognition software can figure out that a subject in a photo is a bird, Facebooks AI will use hashtags or captions to figure out that its actually, say, a Meadowlark.Facebooks AI potentialSome important things to note, in light of Facebooks recent privacy scandal: Facebooks engineers only used public photos to train its AInothing from private accounts.Plus, the AI is focused on object recognition, not facial recognition.
So, it wont be using hashtags to figure out which of your Facebook friends is your #bff.Instead, itll be using this information to improve automated audio captions for the visually impaired.
And the engineers also foresee using AI to better understand video footage or to change how an image is ranked in Facebook feeds, or to improve the way we resurface Memories on Facebook.Overall, Facebooks AI technology has been a major focus of F8 2018.
On Tuesday, Facebook revealed that its Messenger AI assistant could now automatically translate messages in other languages.And today, Mike Schroepfer, Facebooks Chief Technology Officer, said at F8 that the company uses AI to automatically remove spam, fake accounts and propagandist content from Facebook, including two million pieces of ISIS and al-Qaeda content.