본문 바로가기

Visual Reasoning for Construction Safety Monitoring

문서 유형
연구출판물 · 학술대회 발표논문
등재
Scopus
피인용
Scopus 0
FWCI (Scopus)
0
ISSN
25089048

저자

  1. 강경남제1저자Department of Architectural Engineering, M.S. Student, Pusan National University, South Korea
  2. Lee, JeonghoonDepartment of Architectural Engineering, Associate Professor, Gyeongsang National University, South Korea
  3. Lee, JeeheeSchool of Architecture & Building Science, Assistant Professor, Chung-Ang University, South Korea
  4. Kim, HyunsooDepartment of Architectural Engineering, Assistant Professor, Dankook University, South Korea
  5. Park, HyunjungDepartment of Architecture, Professor, Silla University, South Korea
  6. 전정호교신저자Department of Architectural Engineering, M.S. Student, Pusan National University, South Korea

초록

The construction industry continues to report high accident rates, with scaffold-related tasks posing significant risks. While computer vision-based object detection has been widely applied to automate hazard identification, conventional approaches remain limited to recognizing isolated objects, lacking holistic reasoning over complex site contexts. Visual Question Answering (VQA) offers a promising alternative by translating explicit safety rules into natural language questions that vision–language models (VLMs) can answer, potentially enabling scene-level compliance checks. However, most existing studies treat each question independently without preserving conversational context, leaving final safety judgments reliant on manual rule aggregation. This study proposes a dialogue-oriented VQA framework for scaffold safety assessment. Seventeen OSHA-derived rules were encoded as sequential natural language questions, and a large scaffold image dataset was annotated with corresponding answers and Safe/Unsafe labels. We fine-tuned a LLaVA-1.5-7B model using LoRA to maintain contextual memory across multiple safety queries. Testing demonstrated a ~19% gain in per-question accuracy and ~15% improvement in holistic Safe/Unsafe classification over the baseline, highlighting the value of internal dialogue tracking for multi-rule assessments. These findings underscore the potential of conversational VLMs to advance automated, explainable safety monitoring in construction

키워드

Construction safetyDialogue reasoningScaffold hazardVision–Language Models (VLM)Visual Question Answering (VQA)

식별자

Scopus EID
2-s2.0-105050283866