Changes between Version 1 and Version 2 of Other/Summer/2025/LLM-Based

Timestamp:

Jul 17, 2025, 3:39:39 PM (4 months ago)

Author:

jerryh

Comment:

—

Other/Summer/2025/LLM-Based

@@ -1 +1 @@
 ====== LLM-Based VR Activity Recognition ======
 
-desc goes here
+This project aims to recognize human activities through analyzing sensor data with artificial intelligence (AI) technologies. 
+
+Collecting sensor data from VR headsets & controllers and develop machine learning models to classify human activities
+
+This project will also involve leveraging large language models (LLMs) for sensor data interpretation.
 
 ===== Week 1: [] =====
+
 
 
@@ -9 +14 @@
 
 
-===== Week 3: [] =====
+
+===== Week 3: [https://docs.google.com/presentation/d/10RiVvwob7MiTjVPdoz9zFv8Z5Y2O55E6WgtBuDEMQMU/edit?slide=id.g3704141428e_2_180#slide=id.g3704141428e_2_180|Slides] =====
+
+Studying papers related to activity recognition using motion sensor 
+ - Motion sensor from VR: Real-Time Recognition of In-Place Body Actions and Head Gestures using Only a Head-Mounted Display [1]
+ - Motion sensor from wearable devices: FitCoach: Virtual fitness coach empowered by wearable mobile devices [2]
+
+Studying the concept of Inertial Measurement Unit (IMU)
+ - IMU sensor includes both accelerometer and gyroscope
+ - Accelerometer and gyroscope record the linear acceleration and angular velocity of the device respectively, which can be used for classification
+
+Studying programming using Java/Javascript in Android Studio
+ - Exploring APIs of the IMU sensor from VR headsets
+
+
+===== Week 4: [[https://docs.google.com/presentation/d/1KR095rUYToCB6YsFtAxhQfv84Mugkq0Iz3CxqZKLWIs/edit?slide=id.g36300db7477_0_174#slide=id.g36300db7477_0_174|Slides]] =====
+
+More in depth analysis of papers
+ - Motion sensor from VR: Real-Time Recognition of In-Place Body Actions and Head Gestures using Only a Head-Mounted Display [1]
+ - Motion sensor from wearable devices: FitCoach: Virtual fitness coach empowered by wearable mobile devices [2]
+
+In depth analysis in the inner workings of an IMU sensor
+
+Accelerometer
+ - Takes variance in capacitor charge to determine linear acceleration
+
+ - Measures linear acceleration for 3 axes: x, y, and z 
+
+Gyroscope
+ - Small silicon mass vibrating at high Hertz.  
+
+ - Coriolis effect applies, deflecting the silicon mass perpendicularly
+
+ - Measures angular velocity around 3 axes: pitch, roll, and yaw
+