The most stupid idea by the Stockfish Team

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

mar
Posts: 2554
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: The most stupid idea by the Stockfish Team

Post by mar »

I wonder why they didn't at least compress the data? a simple LZ compressor can reduce the net from 21 to 13.6MB and with
a simple byte-slicing filter (data is 16-bit, so simply group even and odd bytes together) to 12.5MB, that's 60% of the original
still trivial to decompress and also very fast
Martin Sedlak
syzygy
Posts: 5557
Joined: Tue Feb 28, 2012 11:56 pm

Re: The most stupid idea by the Stockfish Team

Post by syzygy »

mar wrote: Mon Aug 31, 2020 3:28 am I wonder why they didn't at least compress the data? a simple LZ compressor can reduce the net from 21 to 13.6MB and with
a simple byte-slicing filter (data is 16-bit, so simply group even and odd bytes together) to 12.5MB, that's 60% of the original
still trivial to decompress and also very fast
Because it is even more trivial to just zip the executable.
syzygy
Posts: 5557
Joined: Tue Feb 28, 2012 11:56 pm

Re: The most stupid idea by the Stockfish Team

Post by syzygy »

corres wrote: Mon Aug 31, 2020 2:34 am
corres wrote: Sun Aug 30, 2020 11:29 pm Concerning the compilation of SF+NNUE I mentioned the SF developer forgot to name the Windows compiler what appropriate to their "simple" Make file and to SF+NNUE non-embedded.
I think if you, Mr. "syzygy" publish this information, there would be many people who would thank you for help.
This is my text without sarcasm.
So which Windows compiler is good for SF+NNUE without embedding??
Excluding Visual Studio.
If you want to compile SF, install MSYS2.
https://github.com/glinscott/fishtest/w ... on-Windows
Instead of executing the "bash script", just do this (cd src; make help, etc.):
https://github.com/official-stockfish/S ... he-sources
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: The most stupid idea by the Stockfish Team

Post by Dann Corbit »

Here is the problem that is probably unique for me, I have lots of machines of different kinds.
I have Intel and Amd and 20 year old machines and brand new machines.
Now, I also get all of Mike's stuff like Bluefish, etc. So multiply that machine hardware type by the number of build types.
Let's add in Corchess, Crystal, Cfish and similar things, because I simply can't live without them.

Yes, I can probably hand edit all the makefiles and figure out all the changes I need to make with each and every new build (and just saving the old makefile does not work, because makefiles change as often as the code does)

Here is the strange thing. If I build the SF version before embedding and the nnue file is not there it is automatically downloaded. Why can't they do the same thing when I am using it and not building it?
Or just have a batch file that looks for the file and if it does not see it call wget

I know I am a big whiner. But if you had the same perverse chess tendencies that I do, you would understand
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
arunsoorya1309
Posts: 214
Joined: Tue Nov 03, 2015 4:55 pm

Re: The most stupid idea by the Stockfish Team

Post by arunsoorya1309 »

Why not have a packaged version with the bin file and one without
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: The most stupid idea by the Stockfish Team

Post by Dann Corbit »

I guess that the makefile will become much more complex if they double the build types.
And I only do profile builds so if they have a normal build without the binary that won't help me any.
I suspect that the bundling of the binary is a complex process, but I did not look into it yet.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: The most stupid idea by the Stockfish Team

Post by corres »

syzygy wrote: Mon Aug 31, 2020 3:49 am
corres wrote: Mon Aug 31, 2020 2:34 am
corres wrote: Sun Aug 30, 2020 11:29 pm Concerning the compilation of SF+NNUE I mentioned the SF developer forgot to name the Windows compiler what appropriate to their "simple" Make file and to SF+NNUE non-embedded.
I think if you, Mr. "syzygy" publish this information, there would be many people who would thank you for help.
This is my text without sarcasm.
So which Windows compiler is good for SF+NNUE without embedding??
Excluding Visual Studio.
If you want to compile SF, install MSYS2.
https://github.com/glinscott/fishtest/w ... on-Windows
Instead of executing the "bash script", just do this (cd src; make help, etc.):
https://github.com/official-stockfish/S ... he-sources
Many thanks for you and for Glinscott.
I did not know this spring.
For my luckiness I found a resolving to the present time with msys 1.0 and mingw, and I can reach the same speed as the official release has, but I am happy to know the general solution.
So many thanks for it.
User avatar
yurikvelo
Posts: 710
Joined: Sat Dec 06, 2014 1:53 pm

Re: The most stupid idea by the Stockfish Team

Post by yurikvelo »

corres wrote: Mon Aug 31, 2020 2:34 am So which Windows compiler is good for SF+NNUE without embedding??
Excluding Visual Studio.
Fishtest is 1-click environment setup

https://github.com/glinscott/fishtest/w ... dows#msys2
Gabor Szots
Posts: 1362
Joined: Sat Jul 21, 2018 7:43 am
Location: Szentendre, Hungary
Full name: Gabor Szots

Re: The most stupid idea by the Stockfish Team

Post by Gabor Szots »

AndrewGrant wrote: Sun Aug 30, 2020 12:04 pm There is utility in packaging them together. The vast majority of Stockfish users are not people who frequent any forums like this.

If you really want to be ahead of the curve, just compile your own Stockfishs yourself.
There is a glitch in that, at least for me: the dev compile is 4 times as fast as mine. OK, I admit am totally new to compiling.
Gabor Szots
CCRL testing group
AndrewGrant
Posts: 1750
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: The most stupid idea by the Stockfish Team

Post by AndrewGrant »

Gabor Szots wrote: Mon Aug 31, 2020 12:17 pm
AndrewGrant wrote: Sun Aug 30, 2020 12:04 pm There is utility in packaging them together. The vast majority of Stockfish users are not people who frequent any forums like this.

If you really want to be ahead of the curve, just compile your own Stockfishs yourself.
There is a glitch in that, at least for me: the dev compile is 4 times as fast as mine. OK, I admit am totally new to compiling.
That would be because you selected a suboptimal make target. It is far more complex now that there are a dozen different targets to account for the vector maths that some processors have. If you told me your CPU, I could probably look at the makefile and tell you the right one, but I've not followed all the changes :)
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )