It is currently Tue Aug 18, 2026 2:19 pm


All times are UTC - 5 hours [ DST ]



Post new topic Reply to topic  [ 40 posts ]  Go to page Previous  1, 2
Author Message
 Post subject: Re: Fully-automatic noise detection
PostPosted: Tue Sep 27, 2016 8:45 am  (#21) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
Rod, I know the extreme compact style of David, for him it's certainly not a matter of massive coding (only of feasibility in GMIC).
Unfortunately, he did not yet enter this discussion, likely busy.
Another G'MIC noise expert is Iain, if he reads from time to time Gimp-chat posts maybe he can enter the discussion.

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Tue Sep 27, 2016 11:21 am  (#22) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
Dinasset, do you want a fast filter (almost real-time) or a filter that takes a quarter of an hour?

Rod, altough I'm not a programmer, I think this is really difficult and a lot of coding. Estimating a noise curve from a single image isn't simple. We'll bet? ;) After estimating the curve, the curve has to control (steer?) a filter (which one?), also complex. So I'm curious too. :lol


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Tue Sep 27, 2016 12:00 pm  (#23) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
what I would like to have from a performance viewpoint?
more or less: one minute delay per megapixel of input image
id est:
- 1 minute for an image 1000x1000
- 4 minutes for an image 2000x2000
- 9 minutes for an image 3000x3000
Is that reasonable?
(with an average PC, obviously, not with a 24mbRAM high performer monstre; for instance a PC with Intel Core I5 and 8mbRAM

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 6:18 am  (#24) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
Dinasset,

In G'MIC, there is a command:

#@gmic noise_std
#@gmic : Estimate the noise variance
#@gmic : $ image.jpg -noise 10 sigma={round(${-noise_std},.1)} -text_outline "Noise std:"$sigma,5,5,30,1
noise_std :
-e[^-1] "Compute noise std."
-v - --laplacian -if {{0,d}==1}  -u {${-mad[-1]}/sqrt(20.0)} -else -u {${-mad[-1]}/sqrt(42.0)} -endif -rm[-1]
-v +


So, this command is for some kind of noise estimation, I suppose. It is used in the following filters:

Repair>Smooth [iuwt]
Repair>Smooth [block pca]
Repair>Smooth [wiener] (David, Jérôme, does this filter work correctly?)

Of course you have to adjust the values. But with every noise reduction sofware you have to do that, to your personal taste. (Also if they promote it is fully automatic)


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 6:30 am  (#25) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
In my theoretical view, some G'MIC expert should then able to write a filter which:
1) runs that command
2) according to the results, calls the most appropriate G'MIC Smooth filter (one of the existing ones or a "compilation")
If this is not possible, for me this means that the estimation does not really "understand" which denoising method is to be preferred.
In G'MIC we have so many...

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 7:23 am  (#26) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
Dinasset,

Maybe you can test the "Smooth [block pca]" filter with a lot of images. This filter is fast enough to give a chance (faster then patch-pca), I think. It is very advanced.

Perhaps, with the correct setting, it does what you want.
I would love to have a tutorial for that filter.


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 7:41 am  (#27) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
iarga, can you provide a set of noisy images?
my collection has not many, because I do not use normally high ISO.

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 7:57 am  (#28) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
Dinasset, I can't, because I don't have really good images to test with. I'm so sorry. Maybe a search on internet can provide something?

Also you can test with adding noise yourself, with noise generators.


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 8:29 am  (#29) 
Offline
Script Coder
User avatar

Joined: Jun 22, 2010
Posts: 1171
Location: Here and there
dinasset wrote:
iarga, can you provide a set of noisy images?
my collection has not many, because I do not use normally high ISO.


I could probably take a few, my Pentax K10D is old and quite happy to add noise :)

Kevin


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 8:35 am  (#30) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
done some tests, "Smooth [block pca]" behaves badly IMO.
I guess it's a loss of time, there are better G'MIC smoothing filters IMO (for instance the most famous: anisotropic, which is also very quick)

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 8:55 am  (#31) 
Offline
GimpChat Member

Joined: Jul 11, 2010
Posts: 349
FWIW I tried playing with the "Smooth [block pca]" filter when it first came out. I couldn't see any difference using the filter. I had started playing with Linux at the time and decided to try Gimp in my Linux VM. Here the same filter worked and did an great job. I have never been able to get this filter working with Win7. Probably something with my system, but it is something to keep in mind.


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 9:13 am  (#32) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
bilbo, did you set this strange behaviour to the attention of David?
G'mic should behave OS independently

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 9:33 am  (#33) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
Dinasset, The preview isn't comparable with the result. So don't watch the preview. I did some testing. I think this is a nice filter. But it gives wrong colors. Maybe with YCbCr [luminance] or Lab [lightness] it would be better?

I will try.

I also think that this is (much :hehe ) too slow for your purposes.


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 9:59 am  (#34) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
I didn't talk based on preview, I tested it.
Look at these 3 examples of outcomes (source is a noisy image on Google)

block-pca with default parms
Attachment:
blockpca-dft.jpg
blockpca-dft.jpg [ 65.95 KiB | Viewed 3518 times ]


block-pca with parameters values almost doubled
Attachment:
blockpca-doubledvalues.jpg
blockpca-doubledvalues.jpg [ 67.07 KiB | Viewed 3518 times ]


anisotropic with default values
Attachment:
anisotropic-dft.jpg
anisotropic-dft.jpg [ 57.61 KiB | Viewed 3518 times ]


up to you to judge (IMO anisotropic, even w/o tuning, is much better, but that's my opinion)

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 11:00 am  (#35) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
Dinasset, with such big images I won't dare to try block-pca ;) . The default anisotropic filtering is nice, maybe a bit smooth, but I understand what you want to show. In this image without tuning, it is okay, but with more noise, you have to tune. With eye, hand, mouse, monitor and human brain, you then can do a nice job.

I did some testing:
With only YCbCr [luminance], "block-pca" does a better job. But I now see different patches. I don't know how to have a better overlap.

After some testing, I prefer Smooth [uiwt], for general purpose (from the "noise_std" filters).
I tested this filter with extreme noise, a scan from a printed image. In the code I changed the maximum treshold. After that, with this kind of images, the result is very good.

original:
Image

block pca :
Image

uiwt:
Image

gaussian blur, radius 16:
Image

anisotropic:
Image

The noise estimation in this filters is different from what you mean. Your question isn't answered. "Is full automatic noise reduction possible in G'MIC?"
And I think another question: "Is there a possibility to automatic control the "Smooth [anisotropic] filter" or other filters in G'MIC with some kind of noise estimation?


Last edited by iarga on Wed Sep 28, 2016 11:19 am, edited 1 time in total.

Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 11:13 am  (#36) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
yes, iuwt is nice
your last question is exactly my open unanswered question
no G'mic people entered this topic so far

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection
PostPosted: Wed Sep 28, 2016 11:22 am  (#37) 
Offline
GimpChat Member
User avatar

Joined: Mar 28, 2016
Posts: 312
Location: Netherlands
I think uiwt with that treshold is about the same as a gaussian blur( see above) So I think uiwt has to work with a lower treshold. :) :oops:

Of course this isn't a good test-image at all. You better take Barbara or Lena. :lick :hehe


Top
 Post subject: Re: Fully-automatic noise detection (an opinion David?)
PostPosted: Thu Oct 20, 2016 9:22 am  (#38) 
Offline
GimpChat Member
User avatar

Joined: Jan 20, 2013
Posts: 14831
Location: roma, italy
I changed the title to ask David whether he has an opinion on the possibility for G'MIC (which has a lot of excellent denoising filters) to create a sort of a front-end to "understand" the noise present in the input image then call the (approx) best G'MIC solution (filter and parameters).
Thanks

_________________
"Where am I ?"


Top
 Post subject: Re: Fully-automatic noise detection (an opinion David?)
PostPosted: Thu Oct 20, 2016 11:38 am  (#39) 
Offline
GimpChat Member

Joined: Sep 29, 2011
Posts: 9
I would have a look on Neat Image.

They seem to employ a simple denoising algorithm yet have great results due to their Noise Profiling.

I guess Noise Profiling is all about locating good patches with no edges in them, calculate their Mean Value and their STD.
If the algorithm found many different patches with different Mean values a Noise Curve can be generated.

If one can create "Optimal" parameters of the denoising algorithm given the Noise STD than this curve can make the output significantly better.

Actually this means the algorithm spatially adaptive to the pixels.


Top
 Post subject: Re: Fully-automatic noise detection (an opinion David?)
PostPosted: Fri Oct 21, 2016 2:34 am  (#40) 
Offline
GimpChat Member
User avatar

Joined: Jan 03, 2011
Posts: 1656
dinasset wrote:
I changed the title to ask David whether he has an opinion on the possibility for G'MIC (which has a lot of excellent denoising filters) to create a sort of a front-end to "understand" the noise present in the input image then call the (approx) best G'MIC solution (filter and parameters).
Thanks


Yes, there are probably ways to do this in G'MIC. I'm sure of that.
Now, as always, is there a contributor with enough time to tackle this issue ? Definitely not sure :)


Top
Post new topic Reply to topic  [ 40 posts ]  Go to page Previous  1, 2

All times are UTC - 5 hours [ DST ]



* Login  



Powered by phpBB3 © phpBB Group