Stock Groups

Facebook announces Ego4D first-person video data set for training A.I.


Mark Zuckerberg, founder and chief executive officer of Facebook Inc., spoke during Wednesday’s hearing before the House Energy and Commerce Committee in Washington, D.C., U.S. on Wednesday, April 11. 2018.

Andrew Harrer | Bloomberg | Getty Images

FacebookOn Thursday, the company announced that it had collected over 2,200 hours from first-person footage around the globe to help train future-generation AI models.

Ego4D is the project name. The Ego4D project could become a crucial part of Facebook’s Reality Labs division. They are currently working on dozens of projects that would benefit from AI models being trained with video footage from the point-of-view human. Smart glasses such as the Ray-Ban Stories smart glasses are one example. released by Facebook last monthSince its $2 billion purchase of Oculus in 2014, Facebook has heavily invested in virtual reality and augmented reality.

It could be used to teach artificial intelligence the ability to recognize or comprehend something in the real or virtual worlds.

Facebook announced that the Ego4D data will be made publicly available for researchers by November.

“This is an open-data set and research challenge that will drive progress not only internally, but externally as well in the academic world. [allow]Other researchers to support these new issues but are now able to do so in a more meaningful and larger scale,” Kristen Grauman (lead research scientist at Facebook) told CNBC.

Grauman stated that the data could be used in AI models to help train robots and other technology to better understand the world.

Grauman stated that robots learn by being able to perform tasks in the real world. They can learn from video from what we’ve done.

Facebook used over 700 volunteers from nine countries in order to create the video. Facebook claims that Ego4D contains more footage hours than any other type of data.

Facebook has many university partners including Carnegie Mellon (USA), the University of Bristol (UK), the National University of Singapore and the University of Tokyo in Japan.

This footage was taken in U.S.A, U.K, Italy, India and Japan. It also included Singapore, Singapore, Saudi Arabia, Singapore, Singapore, and Japan. Facebook indicated that the company hopes to bring the project into more countries including Colombia and Rwanda.

Grauman stated, “A key design decision in this project was we wanted partners who first of all were leading experts in their field, motivated to pursue these problems, and also possess geographic diversity.”

Facebook Ray-Ban Stories Glasses

Sal Rodriguez | CNBC

Facebook announces Ego4D at a very interesting moment.

This company is steadily expanding its hardware business. It released its first smart glasses, the Ray-Ban Stories for $299, last month. There are also in JulyFacebook has announced that a new product team was formed to focus on the “metaverse,” a concept which involves the creation of digital worlds where multiple users can live at once.

Facebook was hit with a torrent of news stories over the last month due to a variety of company internal issues research leaked by Frances HaugenA former Facebook product manager became a whistleblower. The slides showed that Instagram is harmful for the mental health and well-being of teens.

These devices were used to capture the footage. GoProCameras VuzixSmart glasses

Facebook instructed participants to not capture any personal information indoors, in order to protect their privacy. These include people’s faces and their conversations. Facebook claimed it had removed personal identifiable information and blurred the faces of bystanders and their vehicle plates numbers from videos. Facebook also stated that audio had been deleted from many of its videos.

Step No. 1 was completed by the university partners that did the video collection. Grauman stated that it was an intensive process for each of them to develop a collection policy.