The rst types in use should be extended such that selected objects as well as pointing rays can be identified to a certain tracked posture. This can be done by adding the current index of a the tracked posture to the corresponding pointing ray collections in skeleton-merging.
This way it becomes possible to also identify a person by adding face recognition to the tracked head position or by using other existing person tracking methods. It is highly relevant for multimodal interactions with the system involving multiple persons.