VibeOut is not just another fitness appโit's your emotional fitness companion. Traditional apps focus solely on physical metrics like steps and calories, but VibeOut adds the critical missing layer: emotional intelligence combined with IoT-powered biometrics.
By integrating cutting-edge AI-driven emotion recognition with IoT-based vitals monitoring, VibeOut creates a genuinely personalized wellness experience that adapts to how you actually feel during workouts.
Our architecture integrates emotion detection AI with ESP32-based IoT sensors to create a full-stack wellness solution:
- IoT Layer: ESP32 with MAX30102 sensor captures real-time heart rate and SpO2 data
- Backend: FastAPI server processes sensor data and AI analysis
- Frontend: React-based UI visualizes biometrics and emotional states
- AI Models: Analyzes facial expressions and voice tones for emotional context
- ๐ Traditional fitness platforms ignore emotional states, leading to burnout and inconsistent results
- ๐ 67% of users cite lack of motivation; over 50% abandon fitness programs within 6 months
- โค๏ธ Intense workouts without proper monitoring can lead to dangerous heart strain
- ๐ง Emotional well-being is essential for long-term fitness successโyet completely overlooked!
- Facial emotion recognition through advanced CNN
- Voice emotion analysis via sophisticated LSTM
- Real-time data capture through device camera and microphone
- Heart rate and SpO2 monitoring via MAX30102 sensor + ESP32
- Real-time visual feedback through integrated OLED display
- Data streaming to ThingSpeak IoT platform for advanced analytics
- Smart workout recommendations based on emotional and physical state
- Prevents overexertion by alerting users to dangerous vital spikes
- Personalized exercise plans adapting to real-time biometrics
- Adjusts for time of day, ambient conditions, and your circadian rhythm
- Correlates emotional states with physical performance metrics
- Creates a holistic wellness profile updated in real-time
- Frontend: React + Tailwind CSS
- Backend: FastAPI (Python)
- AI Models:
- Google Gemini API for video analysis
- CNN (facial), LSTM (voice) models
- Face-api.js for real-time emotion detection
- IoT:
- ESP32 microcontroller
- MAX30102 sensor (Heart rate & SpO2)
- ThingSpeak IoT platform
- APIs: REST, Serial communication for IoT synchronization
- Development: VS Code, Arduino IDE
The heart of our innovation is the IoT integration that provides real-time health metrics:
- Heart Rate Monitoring: Track BPM variations during different workout intensities
- Blood Oxygen: Ensure safe SpO2 levels during high-intensity exercises
- Real-Time Graphing: Visualize vitals over time to identify patterns and trends
- Bridges the emotional gap in traditional fitness routines
- Improves user retention and workout safety through IoT integration
- Promotes mental wellness alongside physical fitness
- Prevents stress-related issues during intense training through real-time monitoring
- Integration with popular wearables (Fitbit, Apple Watch)
- Advanced sentiment NLP for deeper emotional analysis
- Machine learning algorithms to predict optimal workout times based on biometric patterns
- Community challenges based on emotional trends
- Multi-language voice emotion models
- B2B expansion: Offering AI/IoT SDK to fitness apps
- Fitness enthusiasts (18โ45)
- Mental health seekers and recovery patients
- Tech-savvy Gen Z & Millennials
- Sports professionals requiring performance analytics
- B2C (individual users) and B2B (gyms, wellness apps)
- ESP32 connected to MAX30102 sensor
- Serial communication with backend
- Real-time data processing with low latency
- ThingSpeak integration for time-series analysis
- FastAPI server handles IoT data streams
- Video analysis for emotion detection
- JSON-based workout recommendations
- Secure API endpoints for frontend communication
- Node.js & npm
- Python 3.8+
- ESP32 with MAX30102 sensor
- Arduino IDE
# Clone repository
git clone https://github.com/madboy482/VibeOut-IoT.git
# Install backend dependencies
cd backend
pip install -r requirements.txt
# Install frontend dependencies
cd ../frontend
npm install
# Run the application
npm start
Because your workout should understand not just what you do, but how you feel.
This project is licensed under the MIT License - see the LICENSE file for details.