Jump to content

Visage SDK: Difference between revisions

Add links
From Wikipedia, the free encyclopedia
Browse history interactively
← Previous edit
Content deleted Content added
VisualWikitext
Cydebot (talk | contribs)
6,812,251 edits
m Robot - Moving category OS X programming tools to Category:MacOS programming tools per CFD at Wikipedia:Categories for discussion/Log/2016 October 8.
m Copyedit.
 
(32 intermediate revisions by 25 users not shown)
Line 1: Line 1:
{{short description|Software development kit}}
{{advert|date=February 2018}}
{{Infobox software
{{Infobox software
|logo = [[Image:This is a logo for Visage (software development kit).png|150px]]
|logo = This is a logo for Visage (software development kit).png
|logo size = 150px
|name = Visage SDK
|name = Visage SDK
|developer = [[Visage Technologies AB]]
|developer = [[Visage Technologies AB]]
|latest release version = 7.3.1860
|latest release version = 8.2b2.5242
|latest release date = 31 July 2015
|latest release date = 6 April 2017
|platform = {{unbulleted list
|platform = {{unbulleted list
| [[Windows]]
| [[Windows]]
| [[macOS]]
| [[MacOS]]
| [[iOS]]
| [[iOS]]
| [[Android (operating system)|Android]]
| [[Android (operating system)|Android]]
Line 14: Line 17:
| [[HTML5]]
| [[HTML5]]
| [[Adobe Flash|Flash]]
| [[Adobe Flash|Flash]]
| [[Unity (game engine)|Unity]]
| [[Mashape]]
}}
}}
|genre = [[Software development kit]]
|genre = [[Software development kit]]
Line 19: Line 24:
}}
}}


'''visage|SDK''' is a multiplatform [[software development kit]] (SDK) created by [[Visage Technologies AB]]. visage|SDK allows [[software programmer]]s to build a wide variety of [[Facial motion capture|face and head tracking]] and [[eye tracking]] applications for various [[operating system]]s, [[Mobile computing|mobile]] and [[Tablet computer|tablet]] environments, and [[embedded systems]], using [[computer vision]] and [[machine learning]] algorithms.
'''Visage SDK''' (distributed as '''visage SDK''') is a multi-platform [[software development kit]] (SDK) created by [[Visage Technologies AB]]. Visage SDK allows [[Software programmer|software programmers]] to build [[facial motion capture]] and [[eye tracking]] applications.


== Technology ==
== Technologies ==
[[File:Visage Technologies Face Tracking and Analysis.png|thumbnail|Example of Visage SDK (Visage Technologies' main product) face tracking and analysis (gender, age and [[emotion recognition]])]]


=== Face Track<ref>{{Cite web |title=Face tracking software |url=https://visagetechnologies.com/facetrack/ |access-date=2023-03-29 |website=Visage Technologies |language=en-GB}}</ref> ===
'''FaceTrack'''<ref>[http://www.visagetechnologies.com/products-and-services/visagesdk/facetrack/ Visage Technologies: FaceTrack]</ref> is a [[Facial motion capture|face tracking]] engine that tracks the face and facial features in [[video]] sequences in real time (e.g. 30 frames per seconds) and returns [[3D computer graphics|3D]] head pose, gaze direction, facial feature coordinates and similar outputs. Tracking works in [[color]], [[grayscale]] and [[near-infrared]] video.


Face Track tracks 3D head poses, facial features, and eyes/gaze for multiple faces in a [[camera]] stream or from a [[video]] file. Face Track has configurable packages that include: facial tracking, [[face detection|face and facial landmarks/features detection]], [[head tracking]], and eye tracking.
'''HeadTrack'''<ref>[http://www.visagetechnologies.com/products-and-services/visagesdk/headtrack/ Visage Technologies: HeadTrack]</ref> is aimed at applications that require accurate 3D head pose tracking in video, and returns 3D head translation and rotation, like the FaceTrack kit.


=== Face Analysis<ref>{{Cite web |title=Face Analysis: Age, Gender & Emotion Recognition |url=https://visagetechnologies.com/face-analysis/ |access-date=2023-03-29 |website=Visage Technologies |language=en-GB}}</ref> ===
'''FaceDetect'''<ref>[http://www.visagetechnologies.com/products-and-services/visagesdk/facedetect/ Visage Technologies: FaceDetect]</ref> identifies [[face]]s and facial features in still images containing one or more human faces in roughly frontal poses. The output is a set of [[MPEG-4]] facial features (such as [[lips]] contour, [[nose]], [[eyes]], [[eyebrows]] and [[chin]]). Still images include [[JPEG]], [[GIF]] and other standard [[image format]]s, and can be in color or grayscale, and the algorithm works on near-infrared images as well.
Face Analysis includes machine learning [[algorithms]] to determine [[gender]], [[emotion recognition|emotions]] and age. Face Analysis is compatible with Face Track to find/track faces in images or video, determine gender, emotions, and age for a specified face.


=== Face Recognition<ref>{{Cite web |title=Face Recognition Technology |url=https://visagetechnologies.com/face-recognition/ |access-date=2023-03-29 |website=Visage Technologies |language=en-GB}}</ref> ===
'''FaceAnalysis'''<ref>[https://visagetechnologies.com/products-and-services/visagesdk/faceanalysis/ Visage Technologies: FaceAnalysis]</ref> finds/tracks faces in images or video, and then uses provides the user with gender, age and emotions for the faces in roughly frontal position. Emotions include six [[basic emotions]], and the algorithm returns the probability of every basic emotion. Gender estimation provides the user with male or female estimation, while the age estimation returns the detected age of the user.
Face Recognition is used to identify or verify a person from a digital image or a video source using a pre-stored facial data. Visage SDK's [[face recognition]] algorithms can measure similarities between people and recognize a person’s identity{{cn|date=April 2022}} from a frontal facial image by comparing it to pre-stored faces.


== History ==
== History and application ==


The development of Visage|SDK started in 2002 when [[Visage Technologies AB]] was founded in [[Linköping]], [[Sweden]]. The founders were among the contributors to the [[MPEG-4]] Face and Body Animation International Standard.<ref>Pandžić, Igor and Robert Forchheimer (2002): "The origins of the MPEG-4 Facial Animation standard", in: ''MPEG-4 Facial Animation - The standard, implementations and applications'' (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons (ISBN 0-470-84465-5).</ref><ref>Pandžić, Igor and Robert Forchheimer (2002): "MPEG-4 Facial Animation Framework for the Web and Mobile Platforms", in: ''MPEG-4 Facial Animation - The standard, implementations and applications'' (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons (ISBN 0-470-84465-5)</ref>
The development of Visage SDK began in 2002 when [[Visage Technologies AB]] was founded in [[Linköping]], Sweden. The founders were among the contributors to the [[MPEG-4]] Face and Body Animation International Standard.<ref>Pandžić, Igor and Robert Forchheimer (2002): "The origins of the MPEG-4 Facial Animation standard", in: ''MPEG-4 Facial Animation - The standard, implementations and applications'' (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons ({{ISBN|0-470-84465-5}}).</ref><ref>Pandžić, Igor and Robert Forchheimer (2002): "MPEG-4 Facial Animation Framework for the Web and Mobile Platforms", in: ''MPEG-4 Facial Animation - The standard, implementations and applications'' (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons ({{ISBN|0-470-84465-5}})</ref>

Visage SDK is used in various application fields, such as [[game development]], [[arts]] and [[entertainment]], [[marketing]] and [[retail]], [[marketing research]], [[automotive industry]], [[industrial safety]], [[assistive technologies]], [[health care]], [[biometrics]], [[audio signal processing|audio processing]] and [[robotics]]. Recently, visage SDK has been used to create solutions in [[Virtualization|virtual]] [[makeup|make-up]] and [[3D model|3D face filtering]].


== Features ==
== Features ==


* For each processed [[video]] frame, returns detailed facial information,<ref>[http://www.visagetechnologies.com/products-and-services/visagesdk/ Visage Technologies: Products and main features]</ref> such as:
* Tracks multiple faces and facial features in input [[video]], [[images]] or in real time<ref>[http://visagetechnologies.com/products-and-services/visagesdk/facetrack/ Visage Technologies: Main features]</ref>
⚫
* Returns 2D and 3D head pose, the coordinates of facial feature points (e.g. chin tip, nose tip, lip corners, mouth contour, chin pose, eyebrow contours), fitted 3D face model, and [[eye]] closure and eye rotation (gaze direction)
** [[3D computer graphics|3D]] head pose
* Tracking begins immediately when a face is detected
⚫
** Depending on the configuration, tracker can track the [[mouth]] contour, [[chin]] pose, [[eyebrow]] contours, [[eye]] closure and eye rotation (gaze direction)
* Recovery from fidelity loss due to occlusions, head rotation, or other errors
* Fully automatic operation and instantaneous initialization
** Reinitialization if a new person appears in front of the camera
* Automatic detection of separate people in front of the camera
** Recovers from any losses due to occlusions, face turning away, tracked person coming and going etc.
* Tracks from [[webcam]] or [[Audio Video Interleave|AVI]] video files
* Raw image interface allows tracking from any video source
* Tracks in [[color]] or [[grayscale]] video (internal processing performed on grayscale), and in [[near-infrared]] video
* Minimal size of the face in the video image is approx. 80 pixels wide, minimum input [[video resolution]] is approximately 320×240, while higher resolutions (e.g. 640×480, 800×600) give better results
* Head rotation is tracked up to approximately 50 degrees.


== See also ==
== See also ==
Line 59: Line 63:
* [[Marketing research]]
* [[Marketing research]]
* [[Three-dimensional face recognition]]
* [[Three-dimensional face recognition]]
* [[Motion capture]]


==References==
==References==

Latest revision as of 20:36, 25 April 2024

Visage SDK
Developer(s)Visage Technologies AB
Stable release
8.2b2.5242 / 6 April 2017
Platform
TypSoftware development kit
Websitewww.visagetechnologies.com

Visage SDK (distributed as visage SDK) is a multi-platform software development kit (SDK) created by Visage Technologies AB. Visage SDK allows software programmers to build facial motion capture and eye tracking applications.

Technologies

[edit]
Example of Visage SDK (Visage Technologies' main product) face tracking and analysis (gender, age and emotion recognition)

Face Track[1]

[edit]

Face Track tracks 3D head poses, facial features, and eyes/gaze for multiple faces in a camera stream or from a video file. Face Track has configurable packages that include: facial tracking, face and facial landmarks/features detection, head tracking, and eye tracking.

Face Analysis[2]

[edit]

Face Analysis includes machine learning algorithms to determine gender, emotions and age. Face Analysis is compatible with Face Track to find/track faces in images or video, determine gender, emotions, and age for a specified face.

Face Recognition[3]

[edit]

Face Recognition is used to identify or verify a person from a digital image or a video source using a pre-stored facial data. Visage SDK's face recognition algorithms can measure similarities between people and recognize a person’s identity[citation needed] from a frontal facial image by comparing it to pre-stored faces.

History and application

[edit]

The development of Visage SDK began in 2002 when Visage Technologies AB was founded in Linköping, Sweden. The founders were among the contributors to the MPEG-4 Face and Body Animation International Standard.[4][5]

Visage SDK is used in various application fields, such as game development, arts and entertainment, marketing and retail, marketing research, automotive industry, industrial safety, assistive technologies, health care, biometrics, audio processing and robotics. Recently, visage SDK has been used to create solutions in virtual make-up and 3D face filtering.

Eigenschaften

[edit]
  • Tracks multiple faces and facial features in input video, images or in real time[6]
  • Returns 2D and 3D head pose, the coordinates of facial feature points (e.g. chin tip, nose tip, lip corners, mouth contour, chin pose, eyebrow contours), fitted 3D face model, and eye closure and eye rotation (gaze direction)
  • Tracking begins immediately when a face is detected
  • Recovery from fidelity loss due to occlusions, head rotation, or other errors
  • Automatic detection of separate people in front of the camera

See also

[edit]

References

[edit]
  1. ^ "Face tracking software". Visage Technologies. Retrieved 2023-03-29.
  2. ^ "Face Analysis: Age, Gender & Emotion Recognition". Visage Technologies. Retrieved 2023-03-29.
  3. ^ "Face Recognition Technology". Visage Technologies. Retrieved 2023-03-29.
  4. ^ Pandžić, Igor and Robert Forchheimer (2002): "The origins of the MPEG-4 Facial Animation standard", in: MPEG-4 Facial Animation - The standard, implementations and applications (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons (ISBN 0-470-84465-5).
  5. ^ Pandžić, Igor and Robert Forchheimer (2002): "MPEG-4 Facial Animation Framework for the Web and Mobile Platforms", in: MPEG-4 Facial Animation - The standard, implementations and applications (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons (ISBN 0-470-84465-5)
  6. ^ Visage Technologies: Main features
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=Visage_SDK&oldid=1220772172"