Data-driven Floor Plan Understanding in Rural Residential Buildings via Deep Recognition

Abstract Automatic understanding of floor plan images is a key component of various applications. Due to the style diversity of rural housing design, the latest learning-based approaches cannot achieve satisfactory recognition results. In this paper, we present a new framework for parsing floor plans of rural residence that combines semantic neural networks with a post-processed room segmentation. First, we take case studies from typical residential buildings in China’s rural areas and provide a novel image dataset, called RuralHomeData, containing 800 rural residence floor plans with accurate man-made annotations. Based on the dataset, we propose a new deep learning-based recognition framework using a joint neural network to predict the geometric elements and text information on the floor plan simultaneously. Our insight is that walls and openings (doors and windows) are the basic elements corresponding to the room boundary that a closed 1D loop must form a certain room. Then the semantic information (e.g., the room function) of room regions can be obtained through text detection and identification. Furthermore, we use the MIQP algorithm to divide the area containing multiple room type texts into multiple room areas. Finally, the input floor plan can be transformed into a room layout graph with room attributes and adjacent relationships. The proposed algorithm has been tested on both urban and rural datasets, and the experimental results demonstrate our efficiency and robustness compared with the state-of-the-art methods.