Overview
RoompicAI is a platform that generates interior designs in various styles using generative AI models. Simply upload an empty or furnished space, choose a style, adjust the creativity level, and voilà—you have your redesigned space.
Technological Challenges
The main challenge of this project was to create designs that preserve the base structure of the space. Key elements such as windows, floors, walls, and ceilings are typically intended to remain unchanged, unless a complete home renovation is desired.
To tackle this complex problem, the initial approach involved using ControlNets with inpainting specifically applied to areas where no changes were desired.
- •Semantic Segmentation: We employed the ADE20k image dataset to perform semantic segmentation, creating precise masks for objects or zones that needed to be preserved.
- •Targeted Inpainting: These masks were then passed to a ControlNet for inpainting, which used only the white pixels as designated areas for adding new elements.
- •Depth Enhancement with MSLD Lines: Additionally, the pipeline included another ControlNet that applied MSLD lines to the image. This step was crucial for adding depth, enabling the model to accurately recognize and maintain the real dimensions of the space without distorting measurements.
Results: This approach successfully prevented modifications to structural elements like windows, ceilings, and walls. However, the challenge remained when applying inpainting to a 3D image. For example, if you want to place a sofa against a wall, part of the wall area must be used for the sofa. Marking the entire wall as unmodifiable limited the model's ability to utilize that space effectively, leading to suboptimal results.
Why the Project Was Discontinued
In the real estate industry, preserving the base structure of a space is vital. Given the complexity of solving this problem and the difficulty in arranging objects correctly within the space, I decided not to continue with the project.
Video Demo
This demonstration showcases RoompicAI's capabilities in transforming interior spaces using AI-generated designs while attempting to preserve structural elements.