It is currently Sat Apr 20, 2024 6:29 am


All times are UTC - 5 hours [ DST ]



Post new topic Reply to topic  [ 159 posts ]  Go to page Previous  1, 2, 3, 4, 5 ... 8  Next
Author Message
 Post subject: FAQ
PostPosted: Tue Sep 20, 2011 3:24 am  (#31) 
Offline
GimpChat Member

Joined: Sep 20, 2011
Posts: 5
Hello there! I'm rggjan, one of the authors (obviously ;) ) of this portable. I'm currently studying computer science at the ETH in Zurich.

After seeing that my branch created so much Buzz here (thanks to Partha), I decided to create a little FAQ here.

FAQ

  • What is the RGGJAN portable?
    It is a branch of the original gimp, where the foreground extraction tool was exchanged. I always felt that this tool was next to useless in its current state in gimp (reasons see below). Therefore I looked for the best current foreground extraction algorithm (http://www.alphamatting.com/eval_25.php) and implemented that in Gimp as a semester project.

  • Whats the difference to the old foreground extraction tool?
    The old algorithm, implemented after an older paper (http://www.siox.org/), has the main problem that it generates only a binary alpha matte. The problems with that is that you can have severe "color bleeding" of the background color into the foreground at borders. For example, fine black hair on a green background gets darkish green. Also, you don't have any transparancy or antialiasing at borders, each pixel is either foreground or background.

    The new algorithm, on the other hand, tries to find out the foreground AND the background color of each pixel, and with that, it can calculate a semitransparent alpha value. This also means that the background color can be removed from the final extracted pixel, what gives, in general, much better results.

    More details here:
    Attachment:
    FinalReport.pdf [2.13 MiB]
    Downloaded 901 times


  • In what state is it?
    As mentioned, it was realised as a semester project at ETH on e relatively tight time schedule. That means, it is currently more like a proof-of-concept than a real alpha or beta version. This is mainly because the user interface is in a very early stage, and it is not very well tested. It surely contains quite a few bugs.

  • Do you have some examples of the result?
    You can find some pictures in the attached report. There's also a video on youtube:
    http://www.youtube.com/watch?v=kkQ1r5g49d4

  • How can I try it out?
    Partha was kind enough to create windows binaries for it on http://partha.com/. However, you can also find the source code here, where you can build it yourself on any platform:
    https://github.com/rggjan/Gimp-Matting
    (be sure to check out the "new_layer" branch...)

    What you can see in the video above is the version that is on github and in parthas branch, so you should be able to make the exact same thing work.

  • What are the hardware requirements?
    In the video, I work on my (not too new) laptop, with an Intel Core 2 Duo CPU. I use a 64-bit linux and have 2 GB of RAM. The extraction of the example image takes about 10 seconds.

    When I remember correctly, the algorithm should not use more RAM for bigger pictures, however it will take more time. Also, the time used for the calculation increases very fast when you have many unknown pixels, so try to mark as much as possible as foreground or background!

  • How does it work?
    You can see here a live demonstration of it:
    http://www.youtube.com/watch?v=kkQ1r5g49d4

    Generally, you must mark as much as possible foreground and background with the respective color, then it will calculate the color and alpha value for all the unknown pixels. However, this takes very long if there are many unknown pixels, and is also not very accurate. Therefore you can set in the gui that it only starts the real algorithm after you marked a certain amount of pixels (like 70%). Once that happened, it will calculate the unknown pixels and show the result in the same preview colors. Upon pressing enter, a new layer gets created with the extracted image. It contains the calculated foreground colors and the alpha values.

  • Will it be merged into mainline gimp?
    I contacted the authors of gimp about that. The main problem is that this was our first real gimp project, and we used the old foreground extraction tool as guide. However, this used depreciated functions (more specifically, we have all only 8-bit colors and we do not use gegl).
    To get it included into upstream gimp, all of this would have to adapted first.

  • Is it still under active development?
    Currently, not really. Right now, I'm updating it to the newest available gimp version. Beyond that, I'm not sure how much time I'll have to work on it myself. I would love to do it, and then also see it in the "real" gimp, but I can make no promises.

    However, if anyone is interested in working on it, I'll be glad to explain what we did and how we did it, so that someone else can also work on the project.

So long, thanks for your interest in our branch. If you have more questions, just write in the forum or contact me: rggjan@gmail.com


Last edited by rggjan on Tue Sep 20, 2011 4:12 am, edited 1 time in total.

Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Tue Sep 20, 2011 3:28 am  (#32) 
Offline
Retired Staff
User avatar

Joined: May 22, 2008
Posts: 6947
Location: Somewhere in GIMP
Wow! Straight from you to us. :welcome to Gimp Chat rggjan and thank you for your very detailed explanations.

:yes :clap :gimp

_________________
Image
World War IV will be fought with sticks and stones. - Albert Einstein


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Tue Sep 20, 2011 4:08 am  (#33) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
Double wow. I would love to have this tool for extracting background from hair, it does an amazing job.
Welcome to the forum rggjan and thank you for the great and detailed explanation above.

_________________
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Tue Sep 20, 2011 4:35 am  (#34) 
Offline
GimpChat Member

Joined: Mar 14, 2011
Posts: 998
molly wrote:
Double wow. I would love to have this tool for extracting background from hair, it does an amazing job.
Welcome to the forum rggjan and thank you for the great and detailed explanation above.

Well, give it a shot. :) Since it's a portable, it should not interact with your system. Do remember that there are bugs and also it may not work in some complex situations. One obvious way to tell that it didn't work is if you don't see the extraction tool spin button, something went wrong.

Thanks,
Partha


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Tue Sep 20, 2011 6:16 am  (#35) 
Offline
GimpChat Member

Joined: Apr 12, 2010
Posts: 5870
@ rggjan

glad to see you here,and to see that your was not intended to be a fork but a contribution to gimp.
I hope you didn't find my words rude but i was talking in general, and about fork

well i see from the FAQ that we agree also on some point , as the tool be a proof of concept ,fascinating but not yet ready for pratical use , and on the problems about future development and merging in the main gimp branch.

But i really hope that problems may be solved in a close future because have a similar tool integrated in gimp ( even if in a beta stage ) will be simply great !! :coolthup

so i wish the best success and i hope that all this buzz will help you to find contributors for the Gegl-gimp porting

_________________
My 3D Gallery on Deviantart http://photocomix2.deviantart.com/
Main gallery http://www.flickriver.com/photos/photocomix-mandala/
Mandala and simmetry http://www.flickriver.com/photos/photocomix_mandala/

Image

Mrs Wilbress


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Tue Sep 20, 2011 8:03 am  (#36) 
Offline
GimpChat Member
User avatar

Joined: May 16, 2010
Posts: 14709
Location: USA
Welcome to the forum RGGJAN!
Thanks for posting all that information for the Foreground Tool also. :)

_________________
Image
Edmund Burke nailed it when he said, "The only thing necessary for the triumph of evil is for good men to do nothing."


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Sat Sep 24, 2011 5:18 pm  (#37) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
I didn't get any errors at all but the foreground removal tool doesn't seem to be doing its job. I went back and watched the tutorial 3 times and I am pretty sure I did it exactly the same way. It removed the background, at least most of it but left the white all around the hair. drats, I was counting on this tool.
Image Image

_________________
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Sat Sep 24, 2011 8:16 pm  (#38) 
Offline
GimpChat Member
User avatar

Joined: May 16, 2010
Posts: 14709
Location: USA
I didn't get errors either Molly it just never selected anything. :)
Did you actually see it make a selection for you? (marching ants)
Also try moving the slider to about 27.

_________________
Image
Edmund Burke nailed it when he said, "The only thing necessary for the triumph of evil is for good men to do nothing."


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 5:19 am  (#39) 
Offline
GimpChat Member

Joined: Sep 20, 2011
Posts: 5
molly wrote:
I didn't get any errors at all but the foreground removal tool doesn't seem to be doing its job. I went back and watched the tutorial 3 times and I am pretty sure I did it exactly the same way. It removed the background, at least most of it but left the white all around the hair. drats, I was counting on this tool.


Hi Molly

I just tried it with your image, and it worked quite well:
This was my selection:
Attachment:
File comment: My selection
Screenshot2.png
Screenshot2.png [ 333.62 KiB | Viewed 9955 times ]

The selection after the algorithm ran:
Attachment:
File comment: Selection after algorithm
Screenshot1.png
Screenshot1.png [ 331.89 KiB | Viewed 9955 times ]

The final image:
Attachment:
File comment: Final image
Screenshot3.png
Screenshot3.png [ 318.47 KiB | Viewed 9955 times ]


Maybe you selected some wrong foreground/background pixels. It is important that no foreground pixels are marked as background, and no background pixels are marked as foreground, otherwise it will not work at all.

In your image I see a cut of the neck, so you have probably marked all the pixels at the lower end of the neck as background...


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 6:37 am  (#40) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
Wow, that is perfect, I will try it again until I get it...I will screen shot your selections to see what I am not doing. thank you. RGGJAN

Edit: I finally got it. I just love this new foreground tool.
Image

_________________
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 10:10 am  (#41) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
Had to try this one...a few leftover artifacts but not too bad.ImageImage

_________________
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 11:04 am  (#42) 
Offline
GimpChat Member

Joined: Aug 05, 2011
Posts: 606
Location: limestone,ny
Donald the Chump..good one Molly
I tried selecting just part of this image
Image
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 11:08 am  (#43) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
good job, that one is pretty tricky being that it is so close to the other horse. Nice work, alc59

_________________
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 11:21 am  (#44) 
Offline
GimpChat Member

Joined: Sep 20, 2011
Posts: 5
alc59 wrote:
Donald the Chump..good one Molly
I tried selecting just part of this image


Yep, again the same problem... we have "horse colors" in the background, what makes it really hard for the algorithm... I bet if you select both the horses as foreground it works much better :)


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 11:23 am  (#45) 
Offline
GimpChat Member
User avatar

Joined: Sep 24, 2010
Posts: 12516
molly wrote:
Had to try this one...a few leftover artifacts but not too bad.ImageImage


Nearly fell out of my chair when I saw this one Molly. lol

:)

_________________
Lyle

Psalm 109:8

Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 11:49 am  (#46) 
Offline
GimpChat Member

Joined: Aug 05, 2011
Posts: 606
Location: limestone,ny
cone flower in my yard
Image
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 11:55 am  (#47) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
Hey you guys are good.

_________________
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 12:11 pm  (#48) 
Offline
GimpChat Member
User avatar

Joined: Sep 24, 2010
Posts: 12516
Can I say Wow already. Now for this extraction, I did do a few additional things, but still, w.r.t. the old extraction tool, it's miles ahead of it. Thanks RGGJAN and also for compiling and linking the info Partha. :)

ref (my boy): http://img827.imageshack.us/img827/4683/l1000005.jpg (hosted by ImageShack)


Attachments:
L1000005_edt.png
L1000005_edt.png [ 846.89 KiB | Viewed 2982 times ]

_________________
Lyle

Psalm 109:8

Image
Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 12:40 pm  (#49) 
Offline
GimpChat Member

Joined: Aug 05, 2011
Posts: 606
Location: limestone,ny
I agree..Thanks RGGJAN and Partha
i did a little erasing around the front legs but this is working great
Image


Top
 Post subject: Re: The RGGJAN Portable
PostPosted: Mon Sep 26, 2011 12:42 pm  (#50) 
Offline
Global Moderator
User avatar

Joined: Apr 07, 2010
Posts: 14182
very good, they are almost kissing.

@Lyle, Love your cat.

_________________
Image


Last edited by molly on Mon Sep 26, 2011 1:17 pm, edited 1 time in total.

Top
Post new topic Reply to topic  [ 159 posts ]  Go to page Previous  1, 2, 3, 4, 5 ... 8  Next

All times are UTC - 5 hours [ DST ]


   Similar Topics   Replies 
No new posts Attachment(s) GIMP Portable

11

No new posts Attachment(s) Samj released portable Gimp 2.10.18

2

No new posts Attachment(s) Samj has released 2.10.21 v2 portable for windows

1

No new posts Attachment(s) Partha has released a new Portable Ver Gimp 2.10.10

0

No new posts Attachment(s) GIMP Portable and File Associations

2



* Login  



Powered by phpBB3 © phpBB Group