[Castor-users] castor benchmark test

[Simon Stute]

Hi !

At first, we implemented these difference-tests to track the development 
and to spot any changes in the code that could significantly affect the 
results.

The quite "strong" threshold values used here were adjusted based on all 
the tests we performed inside the development team, based on different 
computers and OS.

If you take a look at your values, the maximum absolute difference 
difference in a given voxel is 0.3%, which is rather insignificant. But 
still, it is higher than the values we experienced.

What is your computer hardware and your OS ? What is your compiler ?

Did you try to look at both images at the same time (the reference and 
the challenger) to see if there is any visible pattern, line artifact or 
something ?

Do the other benchmarks run well ?

Cheers
Simon


Le 06/06/2017 à 16:48, 韩匆 a écrit :
> Dear all,
>
> I have just installed CASToR and tried the PET benchmark histogram by 
> running the bash script. But I got an error message below ( the log 
> file is also attached in the email). What can I do to avoid this? Many 
> thanks.
> /
> /
> /==================================================================================================================/
> /Check benchmark results (compare reconstructed image with the 
> reference one)/
> /==================================================================================================================/
> /  --> !!!!! The mean relative difference over the whole image is 
> 7.48915e-05 !/
> /            It is supposed to be between -5e-07 and 5e-07 !/
> /  --> !!!!! The mean relative difference for each slice has a maximum 
> absolute value of 0.00888242 !/
> /            It is supposed to be between -5e-05 and 5e-05 !/
> /            The test failed for 39 slices !/
> /  --> !!!!! The maximum absolute relative difference is 0.00321392 !/
> /            It is supposed to be below 0.0001 !/
> /
> /
> /  --> !!!!! Benchmark tests failed (3 problems found) !/
>
>
>
> Best wishes,
>
> /Hancong Xu/
>
> /Institution of Neuroscience and Medicine (INM4)//
> /
>
> /Forschungzentrum Juelich, Germany/
>
>
>
> ------------------------------------------------------------------------------------------------
> ------------------------------------------------------------------------------------------------
> Forschungszentrum Juelich GmbH
> 52425 Juelich
> Sitz der Gesellschaft: Juelich
> Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
> Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher
> Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
> Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
> Prof. Dr. Sebastian M. Schmidt
> ------------------------------------------------------------------------------------------------
> ------------------------------------------------------------------------------------------------
>
>
>
> _______________________________________________
> Castor-users mailing list
> Castor-users at lists.castor-project.org
> http://lists.castor-project.org/listinfo/castor-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.castor-project.org/pipermail/castor-users/attachments/20170606/5787087b/attachment.html>