Cisco takes video conferencing to a new level
Cisco is using AI and the IoT to take video conferencing to a new, almost Big Brotherish level
At the Cisco research & development labs in Oslo, Norway, the company has made artificial intelligence (AI) the core of its next-generation video collaboration tools by using technology found in self-driving cars.
The Nvidia chips used by Audi and Volvo that recognise people and objects and try to avoid collisions have been adapted for Cisco’s Webex products to focus on facial identification.
Cisco has also developed its own algorithms to identify faces and sounds. Extraneous background noise, like the tapping of keyboards, loud chewing, car alarms or dogs barking can then be automatically eliminated during video conferencing.
Future capabilities include extracting back-end data from a meeting, such as transcripts and translations of what was said.
Snorre Kjesbu, vice-president of Cisco’s collaboration endpoint technology group, believes the quality and quantity of data is central to holding "intelligent" meetings. "It’s about taking a relatively simple thing like telemetry, being able to get information back using the Internet of Things, and combining it with complex stuff like AI and machine learning," says Kjesbu.
Cisco uses telemetry at its R&D facility in Oslo to track the presence and movement of people in meeting rooms and offices, so available rooms can be identified. Data protection laws in Europe allow a company to track numbers of people, but not to identify them individually.
Features that Cisco is working on include the use of intelligent sensors in a room that could register when someone enters or leaves, and start or stop video conferencing accordingly.
The technology could also register if using a smaller room would be more efficient.
John Restrick, chief technology officer for devices at Cisco, says: "We provide the hardware that goes into meeting rooms like cameras, microphones and touch panels, and along with our features that pull both training data and context of a business, we are able to leverage real-time data about what’s happening in a meeting."
The aim is to make the technology "invisible", such as a "one-button-to-push" system that eliminates the need to dial into a conference call and enter a PIN; or using "intelligent views" in video conferencing so that people who are speaking can automatically be framed, zoomed into and followed as they move.
Doing this without a person in the room to choose different cameras requires a lot of intelligence and work, says Restrick, "especially for complicated environments with different speakers and places, or for those pointing to whiteboards; it’s quite a challenge".
He adds: "We are continuing to invest in how we can use intelligence to do more and are testing new features in our labs that are on trial but have not shipped yet." Cisco’s annual R&D spend is $6bn.
"We are moving to identify who people are in meetings, which is opt-in as the end user has to give us permission," Restrick says.
"If you’re meeting with a new group of people, instead of listing everyone in the meeting roster, we can overlay name labels, which would be automated.
"Once the meeting is over, we could then provide private feedback to individuals that they are not getting today, like how much they speak in meetings, whether they interrupt people, or if they get interrupted a lot."
Cisco is working on features such as the ability to extract information from a calendar, look up attendees or recognise their faces, and search for contextual information. This could include their full names, job titles, and articles they have published.
Similarly, Cisco wants to provide support during a video call for account managers so they can see current sales, track orders and shipment information or access customer support.
Restrick says Cisco is working on tools for collaboration that would allow design engineers in two different cities to view a project in 3D, and have the ability to walk around it to make adjustments and interact. "I think the way we interact around content in meetings will continue to grow, and virtual reality and augmented reality will allow us to do a lot more interesting things."
If all of this sounds a little too Big Brother, perhaps it’s time to take a look at what permissions a smartphone has, and pay close attention to social media apps.