29 Jul

Background Whole question to solve: How to use 3D gesture to change 3D design parameter Break down to two smaller questions: How to map 3D gesture to 3D object geometry How to determine 3D design parameter from object geometry Challenge Ambiguity in gesture Different designs have diff...

22 Jul

Objective: Detect gesture as tuning gesture Find discrete parameter of selected object Use gesture to tune the parameter and update the object Implementation Steps Detect hand gesture as tuning gesture (in our current example, we are using thumb-up gesture, it can be customized, and the o...

20 Jul

Objective: Detect hand gesture as rescaling gesture (need both hands) The scale of selected object changes along with the distance between two palms Implementation Steps Detect hand gesture as rescaling gesture (in our example, defined as palm-to-palm gesture, which can be customized and th...

17 Jul

Objective: When the hand is selecting gesture, cast a ray If the ray hits an object, highlight the object to represent "it is selected" When the hand is confirm gesture, destroy the ray, de-highlight the selected object Usage: only after an object is selected can it be modified Implementa...

13 Jul

Objective: Grab an object when the hand is grabbing and near the object Change object's position and rotation according to hand's position and rotation Release the object when the hand is not grabbing Easy solution (also the method in the previous version of the project): When hand gestu...

08 Jul

Objective: Use gesture to select an auto-generated button Generate new design object from backend compiler Implementation Steps Detect hand gesture at every frame, when current gesture is the gesture defined for creating (in our example case, gesture "point"), ready for creating. Find...

30 Jun

Objective: Automatically obtain a list of available design object from backend compiler (either local or remote compiler) Correspondingly auto generate a list of buttons for generating new objects Auto obtain available design list from compiler In our previous version of the system, the av...

24 Jun

Objective: Define a set of gestures Recognize them from hand models observed by Leapmotion Pre-defined gesture set .column { display: inline-block; width: 25%; padding: 10px; line-height: 0; } .row:after { content: ""; display: table; clear: both; } ...

22 Oct

I attached the Leap Motion device onto HTC Vive headset, and tested Leap Motion's default hand tracking features. The assembled device is shown here: And I recorded a video for hand tracking tests: see from youtube link or mp4 file The technology in Leap Motion camera is infrared detection...

15 Oct

I read six papers suggested by CHI 2019 reviews related to the previous VR-AR in-situ design project: Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. 2014. MixFab: a mixed-reality environment for personal fabrication. In Proceedings of the SIGCHI Conference on Hum...