http://www.reproducibleresearch.net/blog/2008/09/20/data-set-competitions/ Ideas, interesting papers and news items around reproducible research Sat, 28 Jan 2012 14:11:59 +0100 http://wordpress.org/?v=2.8.4 hourly 1 http://www.reproducibleresearch.net/blog/2008/09/20/data-set-competitions/comment-page-1/#comment-59 Xiaolin Fri, 24 Oct 2008 14:21:54 +0000 http://blog.pixeltje.be/?p=60#comment-59 I certainly agree with your thought about the data set problem, since I encountered the same difficulty in my research. When I wanted to compare my algorithm with others for video coding, it is almost impossible for me to find a common test set that others used. And most of the algorithms proposed can not be found on the authors' websites, which makes comparison very difficult. I really think research should be made more 'transparent' and open to competition! So I like your idea of 'data set competition'. Although not only the 'best' algorithms should be appreciated, new concept/trial/idea can also be promoted, providing benchmark is definitely something useful to do.:) I certainly agree with your thought about the data set problem, since I encountered the same difficulty in my research. When I wanted to compare my algorithm with others for video coding, it is almost impossible for me to find a common test set that others used. And most of the algorithms proposed can not be found on the authors’ websites, which makes comparison very difficult. I really think research should be made more ‘transparent’ and open to competition!
So I like your idea of ‘data set competition’. Although not only the ‘best’ algorithms should be appreciated, new concept/trial/idea can also be promoted, providing benchmark is definitely something useful to do.:)

]]>