Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
MuQSS - The Multiple Queue Skiplist Scheduler
View unanswered posts
View posts from last 24 hours

Goto page 1, 2, 3  Next  
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Sun Oct 02, 2016 2:28 pm    Post subject: MuQSS - The Multiple Queue Skiplist Scheduler Reply with quote

Con Kolivas has rewritten his scheduler and I have written an ebuild for it.

Code:
# layman -a hnaparst
# USE=muqss emerge >=ck-sources-4.7.5-r1


For information, please see Con's blog:

http://ck-hack.blogspot.com/2016/10/muqss-multiple-queue-skiplist-scheduler.html

He is producing new versions of the scheduler almost daily, and I am trying to keep up by releasing new versions of the ebuild. I have been running the new scheduler personally without problems. The performance is practically indistinguishable from BFS -- perhaps 1% faster.


Last edited by ycUygB1 on Tue Oct 11, 2016 11:27 pm; edited 1 time in total
Back to top
View user's profile Send private message
Ant P.
Watchman
Watchman


Joined: 18 Apr 2009
Posts: 5881

PostPosted: Sun Oct 02, 2016 5:16 pm    Post subject: Reply with quote

This sounds exciting. I think I'll wait a few weeks for the rough edges to get sorted first, BFS49x has been more crashy than I'm used to.

The fixed handling of huge process tables is a good thing, considering how modern software likes to create hundreds of threads per process...
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Sun Oct 02, 2016 5:23 pm    Post subject: Reply with quote

This uses BFS 502 and patches it. It is pretty stable, I would encourage you to try it. I am running ck-sources-4.7.5-r1, which uses version 102 of the MuQSS patch. That is very stable for me. But now I have even produced ck-sources-4.7.5-r2, which uses Con's version 103 of the MuQSS patch. He says that is even better....
Back to top
View user's profile Send private message
thunderrd
n00b
n00b


Joined: 20 Aug 2010
Posts: 58

PostPosted: Sun Oct 09, 2016 11:19 am    Post subject: Reply with quote

FWIW, I've crossposted this thread into the stickied thread for ck-sources here:
https://forums.gentoo.org/viewtopic-t-941030-postdays-0-postorder-asc-start-0.html

It might get more visibility there, since it's in the Kernel and Hardware Forum.

I've got 4.8 running now, I've tried with MuQSS .108 and without [BFS .512 no MuQSS], and both have been problem-free as of now.

Thank you for making this stuff available. Con seems to be on a run, back to hacking as in the days of the original -ck kernels.
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Sun Oct 09, 2016 3:42 pm    Post subject: Reply with quote

4.8 is probably the last series where both BFS and MuQSS will be available. The intention is to replace BFS with MuQSS. This is both a rewrite and a name change. BFS is being renamed MuQSS because some people found the name BFS offensive.

The use flags are certainly in flux right now. I would expect that in 4.9 both the muqss and bfsonly flags will be removed. I have not seen anyone who wanted only to apply the scheduler patch and not the other patches.

For full disclosure, ck-sources-4.8.0 included MuQSS v.0.107. ck-sources-4.8.1 includes MuQSS 0.108, which is supposed to be a more dramatic change and possibly less stable.
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Tue Oct 11, 2016 7:54 pm    Post subject: Reply with quote

I have removed the bfsonly and muqss flags from sys-kernel/ck-sources::hnaparst. The ebuild uses the muqss scheduler. BFS is no longer an option. The latest version of muqss is 110.
Back to top
View user's profile Send private message
Kajan
Guru
Guru


Joined: 23 Dec 2004
Posts: 321
Location: Warsaw, Poland

PostPosted: Wed Oct 12, 2016 8:06 am    Post subject: Reply with quote

Hello hnaparst,
BTW - thank you for your work.
I have one question, your ebuild does not include BFQ patches ?
_________________
Powered By Gentoo Linux !!!
Back to top
View user's profile Send private message
Juippisi
Developer
Developer


Joined: 30 Sep 2005
Posts: 362
Location: /home

PostPosted: Wed Oct 12, 2016 10:02 am    Post subject: Reply with quote

Kajan wrote:
I have one question, your ebuild does not include BFQ patches ?


I believe -ck sources only includes patches written by Con Kolivas, when BFQ is done by a different person.
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Wed Oct 12, 2016 3:35 pm    Post subject: Reply with quote

Kajan wrote:
Hello hnaparst,
BTW - thank you for your work.
I have one question, your ebuild does not include BFQ patches ?


BFQ is included in the Gentoo experimental patchset, which should have been included by my ebuild.
The fact that it was not is my mistake. I will attempt to fix this for you and push a new version.

BFQ is getting pretty close to making it into the mainline kernel anyway, but it has taken many years...
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Wed Oct 12, 2016 7:27 pm    Post subject: Reply with quote

After further investigation, it seems that BFQ is not included in the Gentoo experimental patchset yet for kernel 4.8. There seems to be a delay sometimes when new kernel series are released. See for instance this:

https://forums.gentoo.org/viewtopic-t-1048962-start-0.html

Here are the patches included in gentoo-sources-4.8.1, which I am including as well:

Individual Patch Descriptions:
--------------------------------------------------------------------------

Patch: 1000_linux-4.8.1.patch
From: http://www.kernel.org
Desc: Linux 4.8.1

Patch: 1500_XATTR_USER_PREFIX.patch
From: https://bugs.gentoo.org/show_bug.cgi?id=470644
Desc: Support for namespace user.pax.* on tmpfs.

Patch: 1510_fs-enable-link-security-restrictions-by-default.patch
From: http://sources.debian.net/src/linux/3.16.7-ckt4-3/debian/patches/debian/fs-enable-link-security-restrictions-by-default.patch/
Desc: Enable link security restrictions by default.

Patch: 2900_dev-root-proc-mount-fix.patch
From: https://bugs.gentoo.org/show_bug.cgi?id=438380
Desc: Ensure that /dev/root doesn't appear in /proc/mounts when bootint without an initramfs.

Patch: 4400_alpha-sysctl-uac.patch
From: Tobias Klausmann (klausman@gentoo.org) and https://bugs.gentoo.org/show_bug.cgi?id=217323
Desc: Enable control of the unaligned access control policy from sysctl

Patch: 4567_distro-Gentoo-Kconfig.patch
From: Tom Wijsman <TomWij@gentoo.org>
Desc: Add Gentoo Linux support config settings and defaults.

Patch: 5000_enable-additional-cpu-optimizations-for-gcc.patch
From: https://github.com/graysky2/kernel_gcc_patch/
Desc: Kernel patch enables gcc < v4.9 optimizations for additional CPUs.

Patch: 5010_enable-additional-cpu-optimizations-for-gcc.patch
From: https://github.com/graysky2/kernel_gcc_patch/
Desc: Kernel patch enables gcc >= v4.9 optimizations for additional CPUs.
Back to top
View user's profile Send private message
thunderrd
n00b
n00b


Joined: 20 Aug 2010
Posts: 58

PostPosted: Thu Oct 13, 2016 5:10 am    Post subject: Reply with quote

I spoke with Con some weeks ago on IRC about BFQ. IIRC, it wasn't available in the 4.6.x sources, so this conversation was when BFQ became available in the Gentoo patchset in 4.7, and he said something to the effect that "I don't use it myself, and I don't include it in my patchset, so I really can't knowledgeably recommend it."

His advice to me was to stay with the default Deadline I/O Scheduler.

That being said, I know there are a lot of BFQ + ck users, in spite of Con's advice.
Back to top
View user's profile Send private message
thunderrd
n00b
n00b


Joined: 20 Aug 2010
Posts: 58

PostPosted: Mon Oct 17, 2016 8:15 am    Post subject: MuQSS version .112 available Reply with quote

For everyone's information, there are several important bugfixes included in the latest MuQSS [.112], available today: https://ck-hack.blogspot.com.au/2016/10/

I was having significantly decreased throughput on the Folding@Home client when using MuQSS, and Con helped troubleshoot that on IRC yesterday. The temporary fix for my specific SCHED_YIELD issue was to disable kernel.interactive, but Con told me this morning the fix is now included in .112.

It appears to be a good idea for everyone to patch up.
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Mon Oct 17, 2016 2:28 pm    Post subject: Reply with quote

MuQSS 0.112 is included in my overlay sys-kernel/ck-sources-4.8.2::hnaparst
Thanks for the heads-up!
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Mon Oct 17, 2016 8:56 pm    Post subject: Re: MuQSS version .112 available Reply with quote

thunderrd wrote:
For everyone's information, there are several important bugfixes included in the latest MuQSS [.112], available today: https://ck-hack.blogspot.com.au/2016/10/

I was having significantly decreased throughput on the Folding@Home client when using MuQSS, and Con helped troubleshoot that on IRC yesterday. The temporary fix for my specific SCHED_YIELD issue was to disable kernel.interactive, but Con told me this morning the fix is now included in .112.

It appears to be a good idea for everyone to patch up.


Ah - so you also were having sched_yield issues ? :o


Anyway, is it just me or is emerge really significantly faster with .112 MuQSS ?

(even emerge -pv) 8O
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
thunderrd
n00b
n00b


Joined: 20 Aug 2010
Posts: 58

PostPosted: Tue Oct 18, 2016 3:19 am    Post subject: Re: MuQSS version .112 available Reply with quote

kernelOfTruth wrote:
Ah - so you also were having sched_yield issues ? :o


Anyway, is it just me or is emerge really significantly faster with .112 MuQSS ?

(even emerge -pv) 8O


Yeah, it was quite debilitating as well - Con had all kinds of sever stalling on his machine, too, when running the Folding@Home client. Apparently it uses sched_yield in an unusual/different way. MuQSS 112 has it all solved, though, and yes, I think it's the fastest version yet, too.

Did you get your 'time taskset 1 eix-update' issue fixed? (That was me who left you the workaround on his blog)
Back to top
View user's profile Send private message
Ant P.
Watchman
Watchman


Joined: 18 Apr 2009
Posts: 5881

PostPosted: Tue Oct 18, 2016 4:22 pm    Post subject: Reply with quote

I'll have to see that for myself, here's zen-kernel 4.8.1 (BFS 0.512) numbers:
Code:
\time emerge -DptvuN --with-bdeps=y @world
52.29user 0.97system 1:05.87elapsed 80%CPU (0avgtext+0avgdata 233288maxresident)k
0inputs+0outputs (0major+126290minor)pagefaults 0swaps
Back to top
View user's profile Send private message
mir3x
Guru
Guru


Joined: 02 Jun 2012
Posts: 431

PostPosted: Tue Oct 18, 2016 5:23 pm    Post subject: Reply with quote

I got the same results,
its not possible that it could be much faster rather.
_________________
Installation aborted to prevent system self-destruction
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Tue Oct 18, 2016 9:13 pm    Post subject: Re: MuQSS version .112 available Reply with quote

thunderrd wrote:
kernelOfTruth wrote:
Ah - so you also were having sched_yield issues ? :o


Anyway, is it just me or is emerge really significantly faster with .112 MuQSS ?

(even emerge -pv) 8O


Yeah, it was quite debilitating as well - Con had all kinds of sever stalling on his machine, too, when running the Folding@Home client. Apparently it uses sched_yield in an unusual/different way. MuQSS 112 has it all solved, though, and yes, I think it's the fastest version yet, too.

Did you get your 'time taskset 1 eix-update' issue fixed? (That was me who left you the workaround on his blog)


I wasn't using taskset in the meantime anymore (besides testing after Con confirmed that it was fixed) but just tested it again

and it worked :)


Thanks for the workaround ;)



Well, I'm not saying that it's possible to turn back time or emerge your whole system (with 1100+ packages) in less than half a day,

but it is very well possible that BFS and BFS VRQ were running with some regressions and with fixing of it and (as Con's benchmarks proof) some slight improvement over CFS

that the perception of emerge processing now is significantly faster compared to before (which might be close to what is happening now)
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
thunderrd
n00b
n00b


Joined: 20 Aug 2010
Posts: 58

PostPosted: Wed Oct 19, 2016 3:35 am    Post subject: Reply with quote

Here is the first set of benchmarks for MuQSS:

https://ck-hack.blogspot.com.au/2016/10/first-muqss-throughput-benchmarks.html#comment-form

And when I refer to 'faster' I'm only talking about the way the machine 'feels' for me; I have no quantitative proof for this. I do feel that my MuQSS machine is noticeably more responsive now that my issues are worked out.
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Fri Oct 21, 2016 5:23 am    Post subject: Reply with quote

The latest version ck-sources-4.8.2-r1, includes BFQ as well. The MuQSS version is 0.114. Con Kolivas is no longer maintaining BFS; MuQSS is considered his best available scheduler.
Back to top
View user's profile Send private message
Juippisi
Developer
Developer


Joined: 30 Sep 2005
Posts: 362
Location: /home

PostPosted: Fri Oct 21, 2016 6:47 am    Post subject: Reply with quote

hnaparst wrote:
The latest version ck-sources-4.8.2-r1, includes BFQ as well.


Thanks, will try it when nvidia catches to 4.8 kernel.
Back to top
View user's profile Send private message
i4dnf
Apprentice
Apprentice


Joined: 18 Sep 2005
Posts: 265
Location: Bucharest, Romania

PostPosted: Fri Oct 21, 2016 8:01 am    Post subject: Reply with quote

x11-drivers/nvidia-drivers-370.28 works just fine with 4.8.x kernel (no extra patching needed)
_________________
"The only difference between me and a madman is that I am not MAD" (SALVATOR DALI)
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Fri Oct 21, 2016 2:59 pm    Post subject: Reply with quote

The just released 375.10 surely also will work with 4.8

http://www.nvidia.com/download/driverResults.aspx/109739/en-us


It includes 2 nice bug fixes

Quote:
- Fixed a bug that caused long delays when leaving the VT or disabling a display device while an OpenGL application is running.
- Improved console restore behavior on systems that use the UEFI Graphics Output Protocol, and most vesafb modes.

_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
Ant P.
Watchman
Watchman


Joined: 18 Apr 2009
Posts: 5881

PostPosted: Fri Oct 21, 2016 6:34 pm    Post subject: Reply with quote

Wanted to get some MuQSS numbers now that zen has it, but the machine I got those BFS ones on just gets stuck in a no-output reboot loop with it. I really don't have the patience to go debugging stuff like this right now so looks like I'm going to be stuck running 4.8.1 for a few weeks...
Back to top
View user's profile Send private message
ycUygB1
Apprentice
Apprentice


Joined: 27 Jul 2005
Posts: 276
Location: Portland, Oregon

PostPosted: Fri Oct 21, 2016 7:22 pm    Post subject: Reply with quote

I have uploaded ck-sources-4.8.3 now to my overlay, hnaparst.
I was able to contact github by using OpenDNS.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Goto page 1, 2, 3  Next
Page 1 of 3

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum