Travelling with Style Feedback Thread

Discussion in 'GPGPU Technology & Programming' started by AlexV, Jun 17, 2012.

  1. AlexV

    AlexV Heteroscedasticitate
    Moderator Veteran

    Joined:
    Mar 15, 2005
    Messages:
    2,535
    Likes Received:
    144
    Hello Naurava,
    • Bernd's solver doesn't currently solve any of the ATSP instances within an acceptable correctness tolerance (everything that's more than 30% off is tagged as invalid, hence the double strikethrough);
    • Eh no, that is an error in the graph that I will correct (pun accidental but probably convenient) now; the charts are symmetric so the performance measurements and correctness measurements are taken with the same sample;
    • That is correct bar one exception (one larger instance may or may not be included);
    • Your default knobs were used - it is the contestant's responsibility to setup the solver to do its best, after all:smile:
    Good luck with the faster version! A few notes about the tests: they were taken on a machine with 16 GB of RAM, an FX-8150 processor, Radeon 7970 Video card with a Tahiti GPU (normal edition, not GHz), Windows 8 final with all updates and Visual Studio 2012 with Quarterly update 1 CTP 3 installed.
     
  2. AlexV

    AlexV Heteroscedasticitate
    Moderator Veteran

    Joined:
    Mar 15, 2005
    Messages:
    2,535
    Likes Received:
    144
    Also, please note that you have up until the coming Sunday for implementing tweaks and refinements - we have pushed the term forward given that there was a delay in bringing about the rankings.

    In tandem with this, I'll unveil the identity of the third contestant, whilst mentioning that there are some problems with the submission that for the time being prevent us from including it in the grading process. The gentleman's name is Niels Fröhling (Etathron on these forums), and if he ships us an updated submission that takes care of the issue he'll be competing with you for the gold as well.
     
  3. Ethatron

    Regular Subscriber

    Joined:
    Jan 24, 2010
    Messages:
    948
    Likes Received:
    417
    LOL, haven't been called a gentleman before (though my nickname in the beginning of the 90's was gENtLe [uhm, apparent where I learned assembler?]) :D

    I think though, having helped AMD fix/find a bug in their shader-compiler will stay my only contribution. I learned a lot of course, besides.
     
    #63 Ethatron, Oct 23, 2012
    Last edited by a moderator: Oct 23, 2012
  4. Bernd Paradies

    Newcomer

    Joined:
    Sep 3, 2012
    Messages:
    54
    Likes Received:
    0
    @Alex: thanks for posting the rankings! I find the charts a bit hard to read. I understand that my ATSP results are disqualified. But it is unclear to me who is leading in the TSP category.
    Veikko, because my ATSP results are disqualified?

    For example, who is better at 500/600 TSP?:
    My solution is faster (1.988 vs 40) but Veikko's solution is closer (5.21% vs 6.42%)
    Can I assume that I lead the TSP category?

    Thanks,

    - Bernd
     
  5. Bernd Paradies

    Newcomer

    Joined:
    Sep 3, 2012
    Messages:
    54
    Likes Received:
    0
    @Veikko: I didn't know your real name. Sorry for addressing you as Nauvara. Are you from Finland?

    Good luck, may the penalty functions be ever in your favor!

    - Bernd
     
  6. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    No need to apologize, that's my nick here (I just assume you and Niels are German speaking, though the joke probably requires knowing Finnish :)). Yep, I'm from Finland.

    Likewise! And be warned, I have have twice as fast TSP solver now, which also factors markedly to route quality (and I need to check my defaults since the results were rather poor even to my crippled version). :)

    Let's hope you come up something with your ATSP part too. :)
     
  7. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    Hmm, does that mean I can turn on AVX optimizations and the binary won't crash on test machines because of missing instructions? :)

    I don't have a machine with AVX intruction set to test performance, but I came curious. :p
     
  8. AlexV

    AlexV Heteroscedasticitate
    Moderator Veteran

    Joined:
    Mar 15, 2005
    Messages:
    2,535
    Likes Received:
    144
    Bernd: It would appear that my chart making skills have grown rusty - sorry for that one:sad: Your assumption about leadership in the TSP category is correct, as is the one about the state of things in the ATSP case.

    Veikko: Your code has been verified to compile with AVX turned on just fine, so yes if you want to turn that on by default you definitely can. On the topic of your defaults (and this applies to both contestants), my humble suggestion is that you set them up yourself to the best of your ability so that for the measurements one needs but compile and run (in the extreme), with perhaps only one or two lines added to hook into the test harness. Nobody knows your code better than you do, so you're the ones that can make sure that it does its best!
     
  9. Bernd Paradies

    Newcomer

    Joined:
    Sep 3, 2012
    Messages:
    54
    Likes Received:
    0
    @Alex: I think, my chart *reading* skills are more rusty than your chart *marking* skills!
    So if I sent you an updated version today, will you then update the charts as soon as possible?
    Will Veikko and I get (more or less) immediate feedback on our tweaks?

    - Bernd
     
  10. Bernd Paradies

    Newcomer

    Joined:
    Sep 3, 2012
    Messages:
    54
    Likes Received:
    0
    @Veikko: yeah, my ATSP code used to work but then broke. I'll fix it.
    And, yes: I am a German. But I live in the US now.

    Your solver is now twice as fast? That's impressive! But are you also closer?
    The charts look really funny to me: My accuracy is stable at around 8% but my running time declines while your running time is stable at around 40secs but your accuracy declines as the problem set grows.

    That tells me that you are probably using some sort of a Generational Algorithm (GA) where you i.e. let some ants crawl around. I tried one of those too. But the problem was, though, that I didn't know when to stop. I found myself forced to set arbitrary stops - like I suspect you did in your case with 40 seconds.

    There is a different class of algorithms (not necessarily better, just different), that work more like optimizers. Those algorithms optimize as best as they can and naturally stop when they can't find anything to optimize anymore.

    I am using two of those. That's why the comparison chart looks so funny in my opinion.

    Cheers,

    - Bernd
     
  11. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    Easily closer (even within that 40 seconds seen in the charts). :)

    In my case that's only because the solver has a time limit and it looks like it was set to 40 seconds. Longer routes required more crunching, but especially that part should be alleviated now.

    Quite the opposite...

    ... I think we are on the same page here, though now I have a faster version coming. Let's see if I get it done today. :)

    The problem still is about stopping, though. But if time isn't that much of an issue here, I can set a higher stopping time or disable it altogether. :)
     
  12. AlexV

    AlexV Heteroscedasticitate
    Moderator Veteran

    Joined:
    Mar 15, 2005
    Messages:
    2,535
    Likes Received:
    144
    Results are updated as versions get sent in (bar the lag needed for the testing, of course). Feedback is also as rapid as possible. Nice to see you gentlemen exchanging ideas:smile:
     
  13. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    Or just teasing out details. ;) If Bernd's (general) approach indeed is the same as mine, I'd be interested to know how fast his ATSP code will be as that's my weak point -- or I thought it was.

    Well, it all will be public when this competition is over and everyone will see there are huge improvement possibilities on my GPU code, and other accelerating stuff can be easily added. I think I just concentrate on fixing the most glaring flaws now and seeing what I can do stop the solver appropriately. Question: How many seconds is too much? I see 1500 seconds looks like being allrightish still.

    Hmm, I think I need to modify my "knobs" a bit, most likely disable them. They are good to exist if one knows it's a, say, clustered instance coming and behave accordingly, but alas, that's not the case here. :)
     
  14. AlexV

    AlexV Heteroscedasticitate
    Moderator Veteran

    Joined:
    Mar 15, 2005
    Messages:
    2,535
    Likes Received:
    144
    Well, nobody will be shot over run-time, but ask yourself what are the odds of winning with such a long solve. Also, for a source of motivation, peek at how fast Concorde is with code from 2000 something, running on a single core, and using a publically available and currently discontinued LP package (not eve CPlex!). Now, we can't really hope to beat up Concorde in one fell swoop, but still, we can't allow ourselves to be utterly embarrassed by it, can we?:smile:
     
  15. Bernd Paradies

    Newcomer

    Joined:
    Sep 3, 2012
    Messages:
    54
    Likes Received:
    0
    @Veikko: at least your ATSP is working :)
     
  16. Bernd Paradies

    Newcomer

    Joined:
    Sep 3, 2012
    Messages:
    54
    Likes Received:
    0
    @Alex: so speaking of knobs. The accuracy of my solver is at around 8%. What should be the accuracy for a solver that is 4x slower to make the switch worth while?
    (This is not a trick question, this is a real question I am facing.)

    Thanks!
     
  17. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    If you have a feeling you won't get your ATSP fixed, I think I can lend you a hand with that. At least give some ideas. I suspect you have random restarts there or something, if I guess your approach correctly. :)
     
  18. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    Or Lin-Kernighan for that matter! And that code isn't that unpenetrable (well, I haven't worked with C or C++ in ages) and for what I understood from taking a quick glimpses, Concorde is probably rather unstable numerically too (if one puts in floating point values). :)

    No we can't! With GPUs and all! Given a bit time, I'd add your ants here, but alas, I put maybe 1-2 hours an evening to this and the function of my skills and code needed has a serious discontinuity. :p

    But in all seriousness, I'd like to win, of course, and running my solver for few minutes will arrive at a rather acceptable solution (clearly less than 1.3 times above optimum), but not as good as Bernd's. Though I haven't run this more than a few minutes. :)
     
    #78 Naurava kulkuri, Oct 23, 2012
    Last edited by a moderator: Oct 23, 2012
  19. AlexV

    AlexV Heteroscedasticitate
    Moderator Veteran

    Joined:
    Mar 15, 2005
    Messages:
    2,535
    Likes Received:
    144
    Your accuracy seems fine to my eye, in context (well excluding the ATSP case, of course), given that Veikko is pretty much in the same neighbourhood (excluding the larger cases where it would appear that he'll need to give himself some more time). What I'd do (and note that I'm not on the refereeing board or anything, so just take it as 2c), is focus on gaining some more speed in the large instances, whilst holding my accuracy constant(ish). Again, that's just me.
     
  20. Naurava kulkuri

    Newcomer

    Joined:
    Aug 12, 2012
    Messages:
    67
    Likes Received:
    0
    I submitted a new version, with the performance parameters harcoded now. Usage and parameters as before.

    This was mostly to get the new version going before further tweaking. I just hope it won't explode. :)

    Now off to sleep...
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...