Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Official thread: "zen-sources" - Part 7
View unanswered posts
View posts from last 24 hours

Goto page 1, 2, 3 ... 10, 11, 12  Next  
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Fri Aug 21, 2009 10:14 pm    Post subject: Official thread: "zen-sources" - Part 7 Reply with quote

This is Part 7 of the gentoo-related zen-sources thread,

what is zen-sources ?

Quote:
Zen-Sources is a collaborative effort of kernel hackers and enthusiasts to provide the best Linux kernel possible. We include code that is not yet found in the mainline kernel in an attempt to support the latest hardware, new features, security fixes, optimizations, etc. We are generally more up to date than your favorite distro's default kernel. If there is something you would like included in a future Zen kernel just ask and we will try to include it. Zen-Sources is NOT a "patchset" like many of you are used to. Zen-Sources is a Linux kernel. We do all of our development in a git repository, and most of the code we inluced gets pulled from other git repos. Since we rarely interact with patches these days, we are not going to go out of our way to provide "broken-out patches". The only patch you will get from us is a monolithic patch applied on top of some vanilla kernel base; we prefer you to use git. If you need a "broken-out patch" use gitweb or 'git diff'.


source http://www.zen-sources.org/content/about

questions and problems with zen-sources should be discussed at its official homepage: http://www.zen-sources.org/ in the section Forums


the installation instructions in this post are provided for your convenience to get you started with the git-provided approach

for a more detailed view on the ways to install zen-sources see: Installation-Instructions on zen-sources.org


in general you should take a look at zen-sources.org for more up-to-date information and instruction



checking the sources out

First Time

1) for zen-sources
Code:
Code:
cd /usr/src
git clone git://zen-sources.org/zen/zen.git zen-sources
cd zen-sources
make menuconfig


2) for mmotm ("mmotm" is the "-mm tree of the moment" tree. The -mm patch pile, updated
usually more than once per day.) (see: http://lwn.net/Articles/311677/)
Code:
Code:
cd /usr/src
git clone git://zen-sources.org/zen/mmotm.git mmotm
cd mmotm
make menuconfig


3) for zenrt-sources (doesn't exist yet / anymore)
Code:
Code:
cd /usr/src
git clone git://zen-sources.org/zen/kernel/zenrt.git zen-sources
cd zen-sources
make menuconfig


creating a patch
example:
Code:

git diff v2.6.24 v2.6.24-zen1 > 2.6.24-zen1.patch


you can also do most of this stuff graphically (GUI !) with qgit:
Code:
emerge qgit

or
Code:
apt-cache search qgit

then
Code:
sudo apt-get install qgit
(if that's the exact package name on apt/deb-based systems)

update sources (inside the directory)
Code:
Update
Code:

cd /usr/src/zen-sources
git pull
(called "merging")

you are in the middle of a conflicted merge:
output could be:
Quote:
git pull
Auto-merged .gitignore
Auto-merged MAINTAINERS
Auto-merged Makefile
CONFLICT (content): Merge conflict in Makefile
Removed arch/mips/lasat/sysctl.h
Auto-merged drivers/ata/libata-scsi.c
Auto-merged drivers/char/Kconfig
Auto-merged drivers/char/drm/ati_pcigart.c
Auto-merged drivers/char/drm/drm.h
Auto-merged drivers/char/drm/drm_drv.c
CONFLICT (content): Merge conflict in drivers/char/drm/drm_drv.c
...
Automatic merge failed; fix conflicts and then commit the result.

rmh3093 wrote:
This usually happens when the branch you are trying to update has been rebased. The easiest way to get around this is to checkout a new copy of the branch. For example, if you are currently on the master branch you would do something like the following:


first try:
Code:
git checkout -f && git pull

if that doesn't help, then:

Code:
git reset --hard; git branch -M master master-old; git checkout -b master origin/master; git branch -D master-old; git checkout -f


you need to change to another branch ?
example:
Code:
# git checkout master-devel


if the branch doesn't exist in your directory (
Code:
git branch
)
e.g. master-light, then enter
Code:
git branch master-light origin/master-light && git checkout master-light


you want to check out a specific version?
Code:
git checkout v2.6.25-rc5-zen0



speeding up merge (download) of zen-sources (during first time)
1) checkout the linux-2.6 branch of linus (git.eu.kernel.org or git.kernel.org)

Code:
git clone git://git.eu.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git


or

Code:
git clone git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git


2) then merge both (e.g. it's in /usr/src/sources/linux-2.6)
Code:
 git clone --reference /usr/src/sources/linux-2.6/ git://zen-sources.org/zen/zen.git zen-sources



*click* for a link to the Portage repo for zen kernel ebuilds



what branches of kernel-sources are there?
currently (december 2008), there are 2 different patchsets and branches used in those are (see):

( heads (zen-sources) ):
( heads (mmotm) ):
( heads (zenrt-sources) ): (not available right now)

- master (git checkout master) (e.g. v2.6.24-zen3)

sometime there's also master-new or similar for testing / rebasing purposes

the other "head"s are branches which are added to the main tree

the project's site can be reached over at:
www.zen-sources.org

the repo is reachable via:
http://git.zen-sources.org/?p=zen.git;a=summary (zen-sources)
and/or
http://git.zen-sources.org/?p=mmotm.git;a=summary (mmotm-sources)
and/or
http://zen-sources.org/cgi-bin/gitweb.cgi?p=kernel-rt.git;a=summary (zenrt-sources) (not available right now)

as of August 2008 there's a zenhardened-sources planned with no ETA known yet (as of August 2009, this is still pending / stalled)


for those who are interested there is other (non-kernel related) stuff on the zen git-server:
* THE portage overlay.... random ebuilds not found the Gentoo portage overlay...
* A C++ library for communicating with Drupal Services.
* A portage overlay with ebuilds relating to embedded systems
* A desktop agnostic gui for Obex Push Protocol and Obex File Transfer Protocol.
* Cross development toolchain creator for paludis.






update:
removed reiser4-repository links

update2:
added instruction on how to git-clone linus' repository and using that for reference to update to the zen-sources repo

update3:
updated adresses to the new overlay/servers

update4:
updated the git-addresses for zen-sources and mmotm (mm-sources) of the new zen-sources server

update5:
corrected zenmm -> mmotm
since the zenmm doesn't exist right now

update6:
added info about some other repositories
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
Kollin
Veteran
Veteran


Joined: 25 Feb 2006
Posts: 1137
Location: Sofia/Bulgaria

PostPosted: Sat Aug 22, 2009 6:05 am    Post subject: Reply with quote

Could you update the the zen-overlay with the latest.30-zen* please ? :roll:
_________________
"Dear Enemy: may the Lord hate you and all your kind, may you be turned orange in hue, and may your head fall off at an awkward moment."
"Linux is like a wigwam - no windows, no gates, apache inside..."
Back to top
View user's profile Send private message
cheater1034
Veteran
Veteran


Joined: 09 Sep 2004
Posts: 1558

PostPosted: Sun Aug 23, 2009 5:52 pm    Post subject: Reply with quote

In git master and 2.6.30 now:
- Some nice value changes - some other tweaks to default settings, hrtick fix and enabled hrtick and double_tick
^^ will make a more responsive desktop :D

and i'm rebasing and updating master to .31-rc7

i don't have gentoo installed so i can't update the overlay.

it would be really great for someone to make a kernel overlay and include zen :(
_________________
IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land.
Back to top
View user's profile Send private message
Ant P.
Watchman
Watchman


Joined: 18 Apr 2009
Posts: 5733

PostPosted: Sun Aug 23, 2009 10:22 pm    Post subject: Reply with quote

Here's hoping vanilla -rc7 doesn't crash trying to run my wifi any more...
Back to top
View user's profile Send private message
AaronPPC
Guru
Guru


Joined: 29 May 2005
Posts: 522
Location: Tucson, AZ

PostPosted: Mon Aug 24, 2009 8:10 am    Post subject: Reply with quote

I just booted into .31-rc7. It didn't take long either. These modern kernels boot fast!
_________________
--Aaron
Back to top
View user's profile Send private message
ponciarello
Apprentice
Apprentice


Joined: 22 Jul 2008
Posts: 223
Location: beach of slack

PostPosted: Mon Aug 24, 2009 3:37 pm    Post subject: Reply with quote

thanx for the brainfuck scheduler, I'll try it on my gaming notebook at first release :)
Back to top
View user's profile Send private message
pappy_mcfae
Watchman
Watchman


Joined: 27 Dec 2007
Posts: 5997
Location: Pomona, California.

PostPosted: Tue Aug 25, 2009 8:32 am    Post subject: Reply with quote

I'm running 2.6.30-zen4 on everything. It's even working with an Intel GPU. Will wonders ever cease! Keep up the good work!

Blessed be!
Pappy
_________________
This space left intentionally blank, except for these ASCII symbols.
Back to top
View user's profile Send private message
ponciarello
Apprentice
Apprentice


Joined: 22 Jul 2008
Posts: 223
Location: beach of slack

PostPosted: Tue Aug 25, 2009 4:34 pm    Post subject: Reply with quote

tried 2.6.30-bfs (with bfs 014) and it works fine :D
not able to find related kernel config option, tough.
there's just a little thing: I'm connecting with an internet usb key using wvdial, when I hang up the connection with ctrl-c I have an hard freeze :o
If you have any suggestion on how to debug it I'll be happy to do it (strace on wvdial doesn't work) :)
in the meantime I'll try the new 016 ;)
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Tue Aug 25, 2009 5:18 pm    Post subject: Reply with quote

ponciarello wrote:
thanx for the brainfuck scheduler, I'll try it on my gaming notebook at first release :)


I can't believe you guys are reviving the SD scheduler !

Miguel, Brandon, Ryan, ... you guys rock *big time* !

Thank you sooo much :D

@ponciarello:

how is its "performance" / interactivity compared to the CFS ?
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
cheater1034
Veteran
Veteran


Joined: 09 Sep 2004
Posts: 1558

PostPosted: Tue Aug 25, 2009 9:40 pm    Post subject: Reply with quote

kernelOfTruth wrote:
ponciarello wrote:
thanx for the brainfuck scheduler, I'll try it on my gaming notebook at first release :)


I can't believe you guys are reviving the SD scheduler !

Miguel, Brandon, Ryan, ... you guys rock *big time* !

Thank you sooo much :D

@ponciarello:

how is its "performance" / interactivity compared to the CFS ?


It's con's re-write of SD - we don't write it :O

Performs better than SD and CFS?

http://omploader.org/vMjdmaA/bootchart.png
http://img220.imageshack.us/img220/4541/pwned2.png
http://img134.imageshack.us/img134/5337/pwned3.png
_________________
IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Tue Aug 25, 2009 10:12 pm    Post subject: Reply with quote

cheater1034 wrote:
kernelOfTruth wrote:
ponciarello wrote:
thanx for the brainfuck scheduler, I'll try it on my gaming notebook at first release :)


I can't believe you guys are reviving the SD scheduler !

Miguel, Brandon, Ryan, ... you guys rock *big time* !

Thank you sooo much :D

@ponciarello:

how is its "performance" / interactivity compared to the CFS ?


It's con's re-write of SD - we don't write it :O

Performs better than SD and CFS?

http://omploader.org/vMjdmaA/bootchart.png
http://img220.imageshack.us/img220/4541/pwned2.png
http://img134.imageshack.us/img134/5337/pwned3.png


really impressive ! :)

it seems to perform much better for lower numbers of workloads if I interpret the graphs correctly (?)

but according to your git and bfs release-numbers it's a work-in-progress so I'm confident it will outperform CFS in all cases soon :twisted:

BFS go go go ! :mrgreen:

Welcome Back Con ! :D
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D


Last edited by kernelOfTruth on Tue Aug 25, 2009 10:16 pm; edited 2 times in total
Back to top
View user's profile Send private message
ponciarello
Apprentice
Apprentice


Joined: 22 Jul 2008
Posts: 223
Location: beach of slack

PostPosted: Tue Aug 25, 2009 10:13 pm    Post subject: Reply with quote

cheater1034 wrote:
t's con's re-write of SD - we don't write it :O

are you joking? con is back? :D

i'm so happy, i can't believe it :)

@kot: not much testing on my side for now but it works :mrgreen:
Back to top
View user's profile Send private message
tranquilcool
Veteran
Veteran


Joined: 25 Mar 2005
Posts: 1159

PostPosted: Tue Aug 25, 2009 11:34 pm    Post subject: Reply with quote

ponciarello wrote:
tried 2.6.30-bfs (with bfs 014) and it works fine :D
not able to find related kernel config option, tough.
there's just a little thing: I'm connecting with an internet usb key using wvdial, when I hang up the connection with ctrl-c I have an hard freeze :o
If you have any suggestion on how to debug it I'll be happy to do it (strace on wvdial doesn't work) :)
in the meantime I'll try the new 016 ;)



how did you git checkout 2.6.30-bfs?
_________________
this is a strange strange world.
Back to top
View user's profile Send private message
cheater1034
Veteran
Veteran


Joined: 09 Sep 2004
Posts: 1558

PostPosted: Tue Aug 25, 2009 11:52 pm    Post subject: Reply with quote

tranquilcool wrote:
ponciarello wrote:
tried 2.6.30-bfs (with bfs 014) and it works fine :D
not able to find related kernel config option, tough.
there's just a little thing: I'm connecting with an internet usb key using wvdial, when I hang up the connection with ctrl-c I have an hard freeze :o
If you have any suggestion on how to debug it I'll be happy to do it (strace on wvdial doesn't work) :)
in the meantime I'll try the new 016 ;)



how did you git checkout 2.6.30-bfs?


git fetch; git checkout -b 2.6.30-bfs origin/master-2.6.30-bfs
_________________
IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land.
Back to top
View user's profile Send private message
ponciarello
Apprentice
Apprentice


Joined: 22 Jul 2008
Posts: 223
Location: beach of slack

PostPosted: Wed Aug 26, 2009 5:46 am    Post subject: Reply with quote

if you need a patch to apply to vanilla 2.6.30 you can, from the zen git folder

Code:
git diff v2.6.30 origin/master-2.6.30-bfs | lzma -z -c > /tmp/2.6.30-zen-bfs.patch.lzma


then apply in the vanilla 2.6.30 tree with

Code:
tar jxf linux-2.6.30.tar.bz2
mv linux-2.6.30 linux-2.6.30-zen-bfs
cd linux-2.6.30-zen-bfs
lzma -d -c /tmp/2.6.30-zen-bfs.patch.lzma | patch -p1


Last edited by ponciarello on Wed Aug 26, 2009 5:48 am; edited 1 time in total
Back to top
View user's profile Send private message
MageSlayer
Apprentice
Apprentice


Joined: 26 Jul 2007
Posts: 250
Location: Ukraine

PostPosted: Wed Aug 26, 2009 5:47 am    Post subject: Reply with quote

cheater1034 wrote:

It's con's re-write of SD - we don't write it :O


It's interesting indeed. I can't find any mention of Con Kolivas on google though. Maybe your could post a link on bfs scheduler?
Back to top
View user's profile Send private message
tranquilcool
Veteran
Veteran


Joined: 25 Mar 2005
Posts: 1159

PostPosted: Wed Aug 26, 2009 10:48 am    Post subject: Reply with quote

ponciarello wrote:
if you need a patch to apply to vanilla 2.6.30 you can, from the zen git folder

Code:
git diff v2.6.30 origin/master-2.6.30-bfs | lzma -z -c > /tmp/2.6.30-zen-bfs.patch.lzma


then apply in the vanilla 2.6.30 tree with

Code:
tar jxf linux-2.6.30.tar.bz2
mv linux-2.6.30 linux-2.6.30-zen-bfs
cd linux-2.6.30-zen-bfs
lzma -d -c /tmp/2.6.30-zen-bfs.patch.lzma | patch -p1


thanks!
_________________
this is a strange strange world.
Back to top
View user's profile Send private message
ponciarello
Apprentice
Apprentice


Joined: 22 Jul 2008
Posts: 223
Location: beach of slack

PostPosted: Wed Aug 26, 2009 8:49 pm    Post subject: Reply with quote

as first impression on bfs (using 019 now), on my dual core notebook firefox has never been so responsive and fast (and I'm compiling kernel with -j4 :o ).
Back to top
View user's profile Send private message
tranquilcool
Veteran
Veteran


Joined: 25 Mar 2005
Posts: 1159

PostPosted: Wed Aug 26, 2009 9:50 pm    Post subject: Reply with quote

ponciarello wrote:
as first impression on bfs (using 019 now), on my dual core notebook firefox has never been so responsive and fast (and I'm compiling kernel with -j4 :o ).



kinda cryptic. where do you get the bfs-019?
do you patch the kernel yourself?
thanks!
_________________
this is a strange strange world.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Wed Aug 26, 2009 10:32 pm    Post subject: Reply with quote

tranquilcool wrote:
ponciarello wrote:
as first impression on bfs (using 019 now), on my dual core notebook firefox has never been so responsive and fast (and I'm compiling kernel with -j4 :o ).



kinda cryptic. where do you get the bfs-019?
do you patch the kernel yourself?
thanks!


take a look at the heads of master-2.6.30-bfs: http://git.zen-sources.org/?p=zen.git;a=shortlog;h=refs/heads/master-2.6.30-bfs

and then re-pull the overlay if you like what you see :wink:
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
cheater1034
Veteran
Veteran


Joined: 09 Sep 2004
Posts: 1558

PostPosted: Wed Aug 26, 2009 10:34 pm    Post subject: Reply with quote

Guys, afaik there is no documentation on bfs yet.

the patches can be found at ck.kolivas.org, or you can use zen which updates every time bfs does (bfs has had fixes every day since the first working patch)

And why would you patch from the git tree? just checkout master-2.6.30-bfs and use it
_________________
IRC!: #zen-sources on irc.rizon.net
zen-kernel.org
--
Lost in android development land.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 6108
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Wed Aug 26, 2009 10:39 pm    Post subject: Reply with quote

cheater1034 wrote:
Guys, afaik there is no documentation on bfs yet.

the patches can be found at ck.kolivas.org, or you can use zen which updates every time bfs does (bfs has had fixes every day since the first working patch)

And why would you patch from the git tree? just checkout master-2.6.30-bfs and use it


thanks for the pointer cheater1034 !

here we go:

Quote:
Ultra low latency and excellent desktop performance.
Not recommended for 4096 cpus.


so his goal Con's goal isn't to have a scheduler which scales well on every platform but solely supreme on desktop

nice !

finally a scheduler which cares about the desktop crowd again :D

It's sad that Linus doesn't want to include more than one cpu scheduler in the kernel. I can't understand why those guys more or less neglect desktop-related optimizations :(

I nevertheless hope that Linus will - one day in the near future - change his mind :P
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004 :D
Back to top
View user's profile Send private message
darklegion
Guru
Guru


Joined: 14 Nov 2004
Posts: 468

PostPosted: Thu Aug 27, 2009 3:54 am    Post subject: Reply with quote

Wow, I'm impressed with BFS! Wine has a bug with it's quartz driver, that causes long delays when transitioning between field music to battle music with Oblivion.With CFS these delays are up to 10 seconds, and are usually 5+ seconds.With BFS, these are .5 seconds, at most, and are usually close to instant.
Back to top
View user's profile Send private message
AaronPPC
Guru
Guru


Joined: 29 May 2005
Posts: 522
Location: Tucson, AZ

PostPosted: Thu Aug 27, 2009 5:21 am    Post subject: Reply with quote

kernelOfTruth wrote:
I can't understand why those guys more or less neglect desktop-related optimizations

This probably isn't the right thread to debate this, but I wouldn't say he is ignoring the desktop. It is just that the Linux world is bigger than the desktop. The Linux Foundation has corporate backers that who care about servers and routers and not the desktop. I don't mean to imply that there is some corporate conspiracy. My point is that Linus has more things to worry about and he seems very opposed to forking the kernel into "home" and "server" products.
_________________
--Aaron
Back to top
View user's profile Send private message
MageSlayer
Apprentice
Apprentice


Joined: 26 Jul 2007
Posts: 250
Location: Ukraine

PostPosted: Thu Aug 27, 2009 6:13 am    Post subject: Reply with quote

Guys, again

Can somebody post some REAL numbers on your experience?
Not super-puper boost/increase/decrease, but something that can be compared.
Interbench (http://users.on.net/~ckolivas/interbench/) numbers are ok, I think.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Goto page 1, 2, 3 ... 10, 11, 12  Next
Page 1 of 12

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum