Show HN: Generative Fill with AI and 3D

olokobayusuf | 360 points

I am impressed by the tech, but appalled by the possibilities.

Where I live, it is already common practice for real estate 'agents' to photoshop the properties listed for sale to make them look fully renovated and furnished. When in reality the house is empty and in very bad shape.

This tech will make it even harder to judge a property without actually viewing it in real life.

I think we can no longer stop tech like this from being used in ads (because that's effectively what property listings are nowadays). The only solution I think is policies/laws that prevent real-estate marketplaces from showing fake pictures.

That all said, I think the author can make big money from realtors by selling this tech as a subscription model.

LeonM | 2 years ago

The example looks very good. Do you have more images to share? I think more examples would be nice to show off more of what it can handle. Different room types, interiors etc.

Also in that regards: I'm curious about what it can't handle. Any situations where it borks?

matsemann | 2 years ago

Amazing! The inserted objects are renders of textured 3D models and not generated by a diffusion model + ControlNet? Is there a fixed set of textured 3D models available or are they generated on the fly based on the prompt?

reichardt | 2 years ago

My use case for this would be for decorating my apartment.

I’ve got a big empty studio with a bed and couch I’ve already purchased but trying to figure out what to fill in for all the other gaps. Coffee table, media console, tv or UST projector, bar or bookshelf or desk.

Would be nice if there was a way to populate it with items/products that can be purchased and aren’t purely conceptual.

mentos | 2 years ago

Have real estate companies considered leaving a house unfurnished and letting potential buyers put on AR goggles to see what it would look like with their furniture?

RockRobotRock | 2 years ago

Will it work with decks and porches?

I have images of decks and porches that need staging for the construction company's web site.

qingcharles | 2 years ago

I tried the demo, it seems to be buggy and it seems to only allow you to choose existing items from a predefined db.

billconan | 2 years ago

Between Fill3D's architecture that 'path traces to render ultra-realistic results' and fxn.ai transparent deployment capability... I gotta say this is super impressive work. I can use both in a current project, and will be investigating.

bsenftner | 2 years ago

What are you thinking is your business model? I'm a sysadmin at a small MLS, trying to figure out where we'd integrate it. At $2/stage it's something we'd probably have to have you bill the Realtor directly for (I don't think we do any pass-through billing), but could maybe include a couple stages per month per Realtor. I could see a fun use-case where consumers would be able to do their own staging, but there are probably few if any Realtors that will be willing to pay $2/stage for consumers to do that.

linsomniac | 2 years ago

What did you use to create the screencast at https://www.fill3d.ai/?

idank | 2 years ago

Now create a bunch of perspectives, and nerf or guassian splat that, and you've got a fully immersive 3D scene that is better than any rendering.

pedalpete | 2 years ago

The demo looks amazing! Congrats for your first show HN. Quick question on the technical side, do you generate the (added) objects in 3D directly or generate them in 2D and deproject it to 3D? If former, which foundation model are you using?

sourabh03agr | 2 years ago

Is there any way to remove objects from an initial image, so that then it can be utilized for staging?

aantix | 2 years ago

Pretty awesome for first Show HN. Multimodal search is very fascinating. I am using SDXL + LoRa model over here https://news.ycombinator.com/item?id=37696033

tinytera | 2 years ago

Live the project, great work! can you think about adding some ethical clauses to your license. Something to allow people to use it for good wholesome purposes, but to avoid letting it be used for scammers faking AirBnB listings for example

kderbyma | 2 years ago

> virtual staging in real estate media If you can make this work with exteriors, Landscaping design is huge. Maybe start with something simple like desert landscaping (which is really just rocks, turf, Pavers, maybe small palm trees)

ralfhn | 2 years ago

It looks like a cloud-only app. If it doesn't run entirely locally, it's useless to me. Shipping my data to an external data processor is a security risk I'm not allowed to take.

philipov | 2 years ago

Could you speak more to the "deprojection" step? What is that?

blovescoffee | 2 years ago

Wow, nice. I hope you charge realtors a fat price for this

artursapek | 2 years ago

You realise this is the role of entire teams at certain companies right? If you automate enough parts you'd do able to automate the work of 30 people per company doing this. Not the first to work this out either.

https://investor.wayfair.com/news/news-details/2023/Wayfair-...

moritonal | 2 years ago

Can this be used to replace objects in a scene? In your demo example you place a bed, but what if I want to replace my bed with yours?

ugh123 | 2 years ago

Really can't generate the object I need to place. Few that don't work 1. terrarium 2. fish tank 3. bunk bed

frozenport | 2 years ago

I like it, but should have added some free tier to test it out.

tamimio | 2 years ago

Nice! Like your landing page.

How well does it work on non-room images?

prashp | 2 years ago

Very cool! The challenge is now filling spaces with different lighting, i.e. sunlight entering a window in a mostly dark room while a lamp illuminates a wall.

readyplayernull | 2 years ago

> Right now, you need an image of an empty room

I needed an image of an empty room recently. I just took a photo of my very not empty room, ran it through a canny algorithm, painted out the objects with black, and then used stable diffusion with canny controlnet to generate an empty room. Worked pretty well. Did not look that much like the original room, but it was certainly good enough to check furniture placement etc.

voiceblue | 2 years ago

This kind of stuff is the future of film making.

Imagine adding "yourself" into a scene like this, moving around as you were/are from a video you just created of yourself. As in: film yourself walking around your bedroom with your phone. Then use an app like this to add you and your movement (cropped from the video) to a different background scene.

Goodbye, Hollywood elites!

ugh123 | 2 years ago

That's an awfully brown colored pink bed in the demo :)

The tech itself looks amazing though, well done.

SeanAnderson | 2 years ago

Very brave to show us that ugly brown bed generated from the prompt "pink bed".

RIMR | 2 years ago

Love the "No need for nasty YAMLs or Dockerfiles" copy on the Function website. Plus ca change plus c'est la meme chose. HTMX, SQLite, Postgres are hip. Building giant supercomputers is back in, fuck the edge. Even starting to see a new XML wave.

Today watched a video about gravelbike touring where some young whippersnapper was getting mad excited about the idea of putting a rack and panniers on the back of their bike - just like in the good old days. What a world we live in. I'm 100% old af

pjs_ | 2 years ago

[dead]

lee101 | 2 years ago

[flagged]

noduerme | 2 years ago

Video is nauseating

tantalor | 2 years ago

I gasped. This is what will make it trivial to simply highlight a persons swimwear and tell the AI to remove.

xwdv | 2 years ago