Noise-resistant crack segmentation through the application of transfer learning on the Segment Anything Model 2

David Hidde Boerema, Ihsan Engin Bal, Eleni Smyrou

Research output: Chapter in Book/Report/Conference proceedingContribution to conference proceedingAcademicpeer-review

5 Downloads (Pure)

Abstract

Manual crack inspection is labor-intensive and impractical at scale, prompting a shift toward AI-based segmentation methods. We present a novel crack segmentation model that leverages the Segment Anything Model 2 (SAM 2) through transfer learning to detect cracks on masonry surfaces. Unlike prior approaches that rely on encoders pretrained for image classification, we fine-tune SAM 2, originally trained for segmentation tasks, by freezing its Hiera encoder and FPN neck, while adapting its prompt encoder, LoRA matrices, and mask decoder for the crack segmentation task. No prompt input is used during training to avoid detection overhead. Our aim is to increase robustness to noise and enhance generalizability across different surface types. This work demonstrates the potential of foundational segmentation models in enabling more reliable and field-ready AI-based crack detection tools.
Original languageEnglish
Title of host publicationDigitalisation of the Built Environment: 4th 4TU/14UAS Research Day
EditorsIhsan Engin Bal, Amar Bennadji, Jos Arts
Place of Publicationhttps://zenodo.org/records/15162470?token=eyJhbGciOiJIUzUxMiJ9.eyJpZCI6Ijc5OGE3M2ZlLTZjYWItNGJhYy04MDM5LWM3MTc4NDgyM2JjZiIsImRhdGEiOnt9LCJyYW5kb20iOiJlYjc2ODk5YzBiZjczYWZjNWI3N2FkYWU3OTAwNGQxNSJ9.DppyJn-ZPi8puymJ5Ja8PUAXbwwdgkTAiQP42HNrXcuUWnHw9Xtmct1Di1oUMZxDe6fDxQiuOs-f7QS0YgqgiQ
PublisherHanze University of Applied Sciences, Groningen - Research Centre for Built Environment – NoorderRuimte
Pages104-107
ISBN (Electronic)978-90-9040027-3
Publication statusPublished - 9 Apr 2025
EventDigitalisation of the Built Environment: 4th 4TU/14UAS Research Day - Groningen, Netherlands
Duration: 9 Apr 2025 → …
https://www.4tu.nl/bouw/Events/DigitalizationEvents/4th-4tu-14uas-research-day-on-digitalization-of-the-built-enviro/

Conference

ConferenceDigitalisation of the Built Environment: 4th 4TU/14UAS Research Day
Country/TerritoryNetherlands
CityGroningen
Period9/04/25 → …
Internet address

Keywords

  • crack segmentation
  • segment anything model
  • transfer learning

Fingerprint

Dive into the research topics of 'Noise-resistant crack segmentation through the application of transfer learning on the Segment Anything Model 2'. Together they form a unique fingerprint.

Cite this