Meta has released the MMCSG (Multi-Modal Conversations in Smart Glasses) dataset, featuring two-sided conversations recorded using Aria glasses. The dataset includes multi-channel audio, video, accelerometer, and gyroscope data, and is aimed at supporting research in areas such as automatic speech recognition, activity detection, and speaker diarization. The glasses capture video and audio with seven microphones, along with inertial measurement unit (IMU) measurements. All data was collected from consenting participants and has been anonymized to ensure privacy. The MMCSG dataset could potentially be used for applications like real-time language translation. More information can be found in the related research paper and the dataset is available for download under Meta's Data License.
Meta's Aria smart glasses dataset helps shape the future of AI conversations
Ad
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Sources
News, tests and reports about VR, AR and MIXED Reality.
The new VR shooter from the makers of Ghosts of Tabor is here and we're giving away free keys
Meta Quest Charts: The next big VR release fails to make the top 10
XR weekly round-up: GTA San Andreas gets VR mod, AI world building takes off, and Meta makes Horizon Worlds permanent
MIXED-NEWS.com
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
