edward Posted August 11, 2009 Share Posted August 11, 2009 A fun paper I did using Houdini. The paper is cool because it's done simply using Mean Value Coordinates (MVC) as discussed many times here. http://www.cs.huji.ac.il/~danix/mvclone/files/mvc-final-opt.pdf Coordinates for Instant Image Cloning Zeev Farbman (The Hebrew University ), Gil Hoffer (Tel-Aviv University), Yaron Lipman (Princeton University), Daniel Cohen-Or (Tel-Aviv University), Dani Lischinski (The Hebrew University ) (SIGGRAPH 2009) seamless.mov 1 Quote Link to comment Share on other sites More sharing options...
sibarrick Posted August 12, 2009 Share Posted August 12, 2009 Interesting stuff, sadly i can't get those links to load. I watch the movie but there's a big leap between calculating the MVC coordinates and just adding them to the source image.... can you confirm the links work? Quote Link to comment Share on other sites More sharing options...
pclaes Posted August 12, 2009 Share Posted August 12, 2009 The links were down yesterday, seems to be working now. Interesting stuff, I will probably have a more in depth look at this at a later time as there MVC seem to come back quite a bit. Quote Link to comment Share on other sites More sharing options...
edward Posted August 13, 2009 Author Share Posted August 13, 2009 I watch the movie but there's a big leap between calculating the MVC coordinates and just adding them to the source image.... The MVC coordinates are used to interpolate the color differences at the boundary of the source image between it and the target image. These interpolated differences are then simply added back to the source image. So really, it isn't a big leap at all. Although it's not mentioned in my video, this paper only uses 2D MVC coordinates so it's extremely simple. Quote Link to comment Share on other sites More sharing options...
edward Posted August 13, 2009 Author Share Posted August 13, 2009 Here's an update, I've since added seamless texture tiling and and matting. I also tried an adaptive mesh scheme through PolyReduce and seems to work ok. EDIT: I've added both a H.264 QuickTime and an Xvid .avi file. The .avi file is about the same quality at nearly half the size! seamless.mov seamless.avi Quote Link to comment Share on other sites More sharing options...
edward Posted August 13, 2009 Author Share Posted August 13, 2009 I will probably have a more in depth look at this at a later time as there MVC seem to come back quite a bit. This reminds me. I should mention that they show a failure case in their paper that looks to me like it's due to non-positive mean value coordinates. So another extension is to use Simon's Houdini implementation of PMVC for this paper instead and see if their failure case can be avoided. Quote Link to comment Share on other sites More sharing options...
sibarrick Posted August 13, 2009 Share Posted August 13, 2009 The MVC coordinates are used to interpolate the color differences at the boundary of the source image between it and the target image. These interpolated differences are then simply added back to the source image. So really, it isn't a big leap at all. Although it's not mentioned in my video, this paper only uses 2D MVC coordinates so it's extremely simple. Oh I see it's far simpler than I imagined, it looked from the images like it had done something clever to matte around the fur, it must just be that the background colours of both images were pretty similar so some nice blending was all that was needed. Still good though. Quote Link to comment Share on other sites More sharing options...
edward Posted August 14, 2009 Author Share Posted August 14, 2009 Yep, so I did carefully pick out two pictures so that the result looked good. If there is too much "boundary" or "texture" around the object that you are pasting, then it can look bad. However, in a lot of cases it's used more like a better "clone tool" from Photoshop. In fact, this is just like Photoshop's "patch tool" except faster as discussed in the paper. For background, see also Poisson Image Editing and this course page. If you check out my second video, I have an example of estimating an alpha matte as well. So in theory, you could apply a matting technique first and then do the seamless cloning. Quote Link to comment Share on other sites More sharing options...
Jason Posted August 20, 2009 Share Posted August 20, 2009 This is excellent, thanks Edward! SESI should do a little thing on it! Quote Link to comment Share on other sites More sharing options...
itriix Posted August 20, 2009 Share Posted August 20, 2009 wow this is pretty crazy stuff! thanks for sharing! cheers, Jonathan Quote Link to comment Share on other sites More sharing options...
edward Posted August 20, 2009 Author Share Posted August 20, 2009 SESI should do a little thing on it! Er, what do you mean? I guess I can post my .hip files but they were rather quick and dirty so that I could quickly clobber together a video. Quote Link to comment Share on other sites More sharing options...
michael Posted August 21, 2009 Share Posted August 21, 2009 how about an Old School Blog...a description of the scene file, a video and an example file... Quote Link to comment Share on other sites More sharing options...
symek Posted August 22, 2009 Share Posted August 22, 2009 I guess I can post my .hip files Pretty please! Quote Link to comment Share on other sites More sharing options...
edward Posted August 22, 2009 Author Share Posted August 22, 2009 Here's a rough package of my files. I made no HDAs, copy/pasted nodes everywhere, and made liberal use of magic constants. seamless_cloning.zip Quote Link to comment Share on other sites More sharing options...
mrice Posted August 23, 2009 Share Posted August 23, 2009 Here's a rough package of my files. I made no HDAs, copy/pasted nodes everywhere, and made liberal use of magic constants. Thanks! Quote Link to comment Share on other sites More sharing options...
edward Posted August 28, 2009 Author Share Posted August 28, 2009 Please see how Edward implements “Seamless Image Cloning” in DOPs from this SIGGRAPH paper Er, no DOPs. Try SOPs. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.