Hanyang HARCO LAB

Development of a Vision Sensor-based Human Motion Estimation Techinque for Golf Swing Dataset Construction in Indoor and Outdoor Environments

Period : 2023-09-01 ~ 2023-12-31 Total Budget : 22,500,000 원


Goal of This Project

  • Technology for building data for AI-based golf swing analysis in indoor and outdoor environments
    • Construction of an environment for collecting user swing video data
    • Construction of a dataset for AI-based user swing analysis
  • Requirements of the Demand Company
    • Extraction of human skeleton information for golf swing analysis

Project Contents

Background and Necessity for Development Technology

  1. The golf industry is expected to reach a size of 9.2 trillion KRW, and it is judged that it can grow in the medium to long term, with the increase in the industry size, the demand for golf trolleys is also growing.
  2. This golf trolley market encompasses 10 countries holding 78% of the world’s golf courses, with a shift from manual to automatic trolleys. The global trolley market is expected to grow at an average annual rate of 8.4% from 2019, reaching $1.406 billion by 2024.
  3. In response to this demand, it is crucial to preempt the development of intelligent golf trolleys. The demand companies are developing a golf trolley that recognizes users and has the capability to analyze golf swings.

Technology Development Content and Methods

  1. Construction of an environment for collecting user swing video data
    • Selection of vision sensors and analysis of renowned training models for extracting a suitable skeleton for the swing
    • Establishment of a cloud-based server environment for extracting skeletons from field shooting videos
  2. Construction of a data structure for AI-based user swing analysis
    • Definition of swing sequences for frame segmentation from videos
    • Annotation techniques for dataset construction

Picture Source : Zhongyu Jiang외 3, “GOLFPOSE: GOLF SWING ANALYSES WITH A 
MONOCULAR CAMERA BASED HUMAN POSE ESTIMATION
Picture Source : Zhongyu Jiang외 3, “GOLFPOSE: GOLF SWING ANALYSES WITH A MONOCULAR CAMERA BASED HUMAN POSE ESTIMATION
유소현 프로 Golf Swing [Video Source](https://www.youtube.com/watch?v=pOjEvVIoYBM&t=140s)
유소현 프로 Golf Swing Video Source
[YOLO-v8x](https://github.com/ultralytics/ultralytics) based Key Point Detection
YOLO-v8x based Key Point Detection
Golf Pose Estimation Results by DTW (Dynamic Time Warping)
Golf Pose Estimation Results by DTW (Dynamic Time Warping)

Participating Researchers


Funding