Flexible User Interface Distribution for Ubiquitous Multi-Device Interaction

Flexible User Interface Distribution for Ubiquitous Multi-Device Interaction


< Research Study Group of Teacher Insik Shin (center) >

KAIST scientists have actually established mobile software application platform technology that enables a mobile application (app) to be performed at the same time and more dynamically on several wise gadgets. Its high versatility and broad applicability can assist speed up a shift from the present single-device paradigm to a several one, which allows users to make use of mobile apps in methods formerly unimaginable.

Current patterns in mobile and IoT innovations in this period of 5G high-speed cordless interaction have actually been hallmarked by the introduction of brand-new display screen hardware and wise gadgets such as double screens, collapsible screens, wise watches, wise Televisions, and wise automobiles. Nevertheless, the present mobile app environment is still restricted to the standard single-device paradigm in which users can utilize just one screen on one gadget at a time. Due to this restriction, the genuine capacity of multi-device environments has actually not been totally checked out.

A KAIST research study group led by Teacher Insik Shin from the School of Computing, in partnership with Teacher Steve Ko’s group from the State University of New York City at Buffalo, has actually established mobile software application platform technology called FLUID that can flexibly disperse the interface (UIs) of an app to a variety of other gadgets in genuine time without requiring any adjustments. The proposed technology offers single-device virtualization, and guarantees that the interactions in between the dispersed UI aspects throughout several gadgets stay undamaged.

This flexible multimodal interaction can be recognized in varied ubiquitous user experiences (UX), such as utilizing live video steaming and talking apps consisting of YouTube, LiveMe, and AfreecaTV. FLUID can guarantee that the video is not obscured by the chat window by dispersing and showing them independently on various gadgets respectively, which lets users take pleasure in the chat function while seeing the video at the very same time.

In addition, the UI for the location input on a navigation app can be moved into the guest’s gadget with the assistance of FLUID, so that the location can be quickly and securely gotten in by the guest while the chauffeur is at the wheel.

FLUID can likewise support 5G multi-view apps – the current service that enables sports or video games to be seen from numerous angles on a single gadget. With FLUID, the user can enjoy the occasion at the same time from various perspectives on several gadgets without changing in between perspectives on a single screen.

PhD prospect Sangeun Oh, who is the very first author, and his group executed the model of FLUID on the leading open-source mobile os, Android, and verified that it can effectively provide the brand-new UX to 20 existing tradition apps.

“This new technology can be applied to next-generation products from South Korean companies such as LG’s dual screen phone and Samsung’s foldable phone and is expected to embolden their competitiveness by giving them a head-start in the global market.” stated Teacher Shin.

This research study will exist at the 25th Yearly International Conference on Mobile Computing and Networking (ACM MobiCom 2019) October 21 through 25 in Los Cabos, Mexico. The research study was supported by the National Science Structure (NSF) (CNS-1350883 (PROFESSION) and CNS-1618531).

 Figure 1. Live video streaming and talking app circumstance
 Figure 2. Navigation app circumstance
 Figure 3. 5G multi-view app circumstance

Recommended For You

About the Author: livescience

Leave a Reply

Your email address will not be published. Required fields are marked *