jshriver wrote:I finished generating the full 3-4-5-6 men set in both WDL and DTZ. With an i7-3770 with 32gigs RAM it took 14 days, followed by just under 4 days to do a verify.
(...) To download the complete 3-4-5 as a single file use this:
(...)
Kirill Kryukov wrote:I finally had the time to try your generator. I could build the 3-4-5 piece tablebases without problems, and all checksums matched yours. However "rtbgen" crashes every time I try to build any 6-piece tablebase - both standalone and via "run.pl". It crashes instantly with no useful diagnostics.
0 [main] rtbgen 7224 open_stackdumpfile: Dumping stack trace to rtbgen.exe.stackdump
Did you try the very latest code? It has worked for others, at least with (MingW) gcc-4.7.2.
Does rtbgen.exe.stackdump contain anything?
Another point, GCC printed a bunch or warnings. I humbly suggest that it's perhaps good idea to try and eliminate all warnings, so that the code will give better impression and inspire more confidence.
All array bounds warnings are a bug of gcc-4.8.x. The solution is to add -Wno-array-bounds. The "may be used uninitialized" warnings are all bogus.
I never saw this warning. I suppose the line could/should be removed.
I will try to build it with MinGW around weekend and see if it works better.
Ah! I never tested with cygwin. It probably can't deal with very large memory allocations.
I recompiled your generator with MinGW GCC 4.8.1 (actually it is also from cygwin64 distribution), and it seems working so far. I generated KQQQQvK successfully. After my other computation completes I'm going to proceed generating all 6-piece tablebases, I'll then report on my progress or any issues.
Ronald, are you interested in setting up any centralized distribution for these tablebases? E.g., a torrent, for those who can't (or don't want to) generate them? I could contribute bandwidth or perhaps host the tracker. (Actually anyone other than Ronald is also welcome to comment / participate).
Kirill Kryukov wrote:
Ronald, are you interested in setting up any centralized distribution for these tablebases? E.g., a torrent, for those who can't (or don't want to) generate them? I could contribute bandwidth or perhaps host the tracker. (Actually anyone other than Ronald is also welcome to comment / participate).
I'm going to see if I can host them via http. If not I was going to lean toward running my own torrent tracker, and then seeding them from 1-2 sources.
Due to work and some family health concerns I'm a bit tied up till this weekend.
Kirill Kryukov wrote:
Ronald, are you interested in setting up any centralized distribution for these tablebases? E.g., a torrent, for those who can't (or don't want to) generate them? I could contribute bandwidth or perhaps host the tracker. (Actually anyone other than Ronald is also welcome to comment / participate).
I'm going to see if I can host them via http. If not I was going to lean toward running my own torrent tracker, and then seeding them from 1-2 sources.
Due to work and some family health concerns I'm a bit tied up till this weekend.
Josh, that would be very nice. I prefer a torrent rather than http so that others (like myself) can contribute. 151 GB is a lot to host by yourself.
Kirill Kryukov wrote:
Josh, that would be very nice. I prefer a torrent rather than http so that others (like myself) can contribute. 151 GB is a lot to host by yourself.
Kirill Kryukov wrote:
Josh, that would be very nice. I prefer a torrent rather than http so that others (like myself) can contribute. 151 GB is a lot to host by yourself.
This is my first time really doing this. But willing to give it a try. Creating a torrent file now of the sbases345.tar.gz
Looks good, but you should share the actual tablebase files instead of the tar.bz2 archive. This way people may keep sharing after downloading them. Any huge archive will be certainly deleted by users after downloading, defeating the purpose of torrent-sharing.
Hope to see 6 pieces also like that guys..so that we can start download them!
Kind regards,
JP.
Thanks, having to learn as I go. Looks like seeding the big tarball is working, but the folder with multiple files is acting quirky. So will try and get that working. Once that show's successful, it should be easy to create one for the huge 6 piece set.
BTW would someone try downloading that sbases from my torrent? Curious how well this works on a smaller file. This is the same server I run OICS so I don't want to stress it to much.
Curious about the webseeding though. When I created the torrent for all the 3-4-5 "individual files" I also gave it the address to where I'm hosting them via the web, though it doesn't seem to be pulling them in.
Hope to see 6 pieces also like that guys..so that we can start download them!
Kind regards,
JP.
Thanks, having to learn as I go. Looks like seeding the big tarball is working, but the folder with multiple files is acting quirky. So will try and get that working. Once that show's successful, it should be easy to create one for the huge 6 piece set.
BTW would someone try downloading that sbases from my torrent? Curious how well this works on a smaller file. This is the same server I run OICS so I don't want to stress it to much.
Curious about the webseeding though. When I created the torrent for all the 3-4-5 "individual files" I also gave it the address to where I'm hosting them via the web, though it doesn't seem to be pulling them in.
I am downloading both sbases345.tar.bz2 and syzygy right now from your torrent page. Seems to work pretty good - can't wait for the 6 pieces.
