Smartphone (Sensing)
- Home
- Applications
- Mobile
- Smartphone (Sensing)
Overview
Useful and fun smartphone applications are made possible by integrating state-of-the-art sensing technology, such as the back-illuminated Time of Flight (ToF) image sensors, and Sony Semiconductor Solutions Corporation’s imaging technology backed up by years of expertise. With photo assistance such as the background blurring effect, AR-enabled games, and a new mode of communication using spatial expressions, the sensor can create a whole new experience.
AR is a technology to augment the real world visually by superimposing visual information virtually onto the view of the real world captured in a screen using depth information of the objects and structures within the view. Its main applications include entertainment apps for smartphones.
Applications
Mobile VTuber
The sensor that can obtain depth information recognizes facial expressions and movements of the fingers and other parts of the body with precision. It can move your avatar smoothly and naturally by tracking fast movements of the fingers, hands and body.
It facilitates more realistic and entertaining expressions through convincing facial expressions, hand gestures, 3D graphics rendered in the air and more.
Photography (background blurring)
ToF image sensors measure the depth of the field and enables highly technical effects, like blurring the background, for impressive shots just like using an interchangeable lens mirrorless camera.
Sony Semiconductor Solutions Corporation (SSS) offers its ToF (Time of Flight) AR software development kit (SDK) as an open tool for developers.
■
Developer World*1 “ToF AR” release webpage
https://developer.sony.com/ja/develop/tof-ar/
The “ToF AR,” developed by SSS, facilitates the development of applications using Unity*2 to realize the following features, accelerating the development of incredibly immersive apps and AR features.
1.Hand gesture
2.Body movement recognition and smooth rendering
3.Modeling to create 3D data
4.Meshing to build the surrounding geometry based on depth information.
**1) Developer World is a Sony-supported website operated by Sony Europe, compiling development programs. URL:https://developer.sony.com/ja/
*2) Unity is a platform for developing games provided by Unity Technologies. It offers an integrated development environment for game creation, with game engines and execution environment.
Technology
Find out more about the ToF(Time of Flight) used in this field.
Related Products & Solutions
-
Image Sensor
Image Sensor for Mobile “LYTIA”
Find out more about the image sensors for mobile “LYTIA” with this technology.
Contact Us
For inquiries about Sony Semiconductor Solutions Group and products / solutions, specifications, quotation / purchase requests, etc., please contact us using the Inquiry form from the button below.