Explore chapters and articles related to this topic
Networked Multimedia Protocols
Published in Radhika Ranjan Roy, Handbook of SDP for Multimedia Session Negotiations, 2018
The WebRTC protocol is designed in the Internet Engineering Task Force (IETF) real-time communication on the web (RTCWeb) working group (WG) to allow the use of interactive audio and video in applications that communicate directly between browsers across the Internet. The resulting WebRTC protocol suite is intended to enable all of the applications that are described as required scenarios in the use case document [1] including access and control through a JavaScript (JS) application programming interface (API) in a browser. The purpose of WebRTC components is to help build a strong RTC platform that works across multiple web browsers and multiple platforms. WebRTC uses the web as the setup and endpoint for a call.
Multistream Immersive Telepresence Conferencing Systems
Published in Radhika Ranjan Roy, Handbook on Networked Multipoint Multimedia Conferencing and Multistream Immersive Telepresence using SIP, 2020
This specification relies on the security properties of the WebRTC data channel described in RTCweb data channel [6], including reliance on DTLS. Since CLUE sessions are established using SIP/SDP, protecting the data channel against message modification and recovery requires the use of SIP authentication and authorization mechanisms described in RFC 3261 (also see Section 1.2) for session establishment prior to establishing the data channel.
Predicting developmental language disorders using artificial intelligence and a speech data analysis tool
Published in Human–Computer Interaction, 2023
Eleonora Aida Beccaluva, Fabio Catania, Fabrizio Arosio, Franca Garzotto
MARS is a web application designed to deliver rhythmic tasks and automatically record children’s vocal productions. The application was developed for researchers as a Progressive Web App (PWA) that can be easily used on laptops and mobile devices (smartphones, tablets, etc.), acting as a powerful audio collection and storage device. MARS is built with a client-server model consisting of a web application developed in VueJS and a server based on NodeJS. The front-end application has the ability to collect user media (such as audio) through the use of the RecordRTC library. This uses the latest WebRTC (Web Real-Time Communication) protocol for real-time data acquisition and exchange. In addition, during the experience, a prerecorded audio saved in the buffer is played at first. The recording, once made by the user, is sent to the server where it is processed. Once validated, it is saved on an external Object Storage to be accessible for analysis at a later time. The application receives the incoming audio signal that will be filtered to narrow the spectrum to the range of the human voice, which is between 80 and 1600 Hertz. The sound signal at this point is treated with a noise reduction algorithm developed in Python using the method of “spectral gating,” which is a gate sensitive to noise below the set threshold. The algorithm chosen is non-stationary to continuously update the estimate of the threshold since we cannot know a priori the eventual noise that can occur inside the room. Finally, the volumes are normalized, and the extraction process of the audio feature developed with the latest libraries such as “librosa” and “scipy” for audio algorithm analysis and “numpy” for coding and data extraction.
Efficient video transmission—a critical review of various protocols and strategies
Published in Journal of the Chinese Institute of Engineers, 2021
Ali Siddique, Abdul Rauf Bhatti, Ahmed Bilal Awan, Arslan Dawood Butt, Ali S. Alghamdi, Muhammad Farhan, Nadia Rasheed
Basically, QUIC is being developed in order to overcome the shortcomings of HTTP that is generally run on top of TCP. Moreover, it is deemed to be more secure than traditional protocols. QUIC is also quite suitable for WebRTC. WebRTC (WebRTC 2021) is an open-source project that enables real-time communication in web browsers and mobile applications. However, moving from TCP to QUIC is still a challenging task as most of the current Internet infrastructure is still tuned for TCP.