Explore chapters and articles related to this topic
Programming cobots by voice: a pragmatic, web-based approach
Published in International Journal of Computer Integrated Manufacturing, 2023
Tudor B. Ionescu, Sebastian Schlund
Once enabled, the WSAPI listens to what is being said and converts spoken sequences into words placed, for example, in an array. To implement cobot programming by voice, a script that can be injected into Panda’s web-based HPI using the ‘bookmarklet’ technique was developed. A bookmarklet is a bookmark containing JS commands stored in the browser’s ‘favorites’ bar, which adds ‘one-click’ functionalities to the currently displayed web page. This technique has been effectively used to embed or extend programming environments in existing webpages. The current approach uses the same mechanism to inject JavaScript code into Panda’s HPI, which automates the instantiation, loading, configuration, and execution of apps and tasks in the robot’s native HPI according to the user’s voice commands.