Monday September 11, 2006 Weblog
Monday September 11, 2006 Now that the NUMA observability tools are integrated, I made some progress on the CPU caps. I was mostly scribbling documentation and produced a few useful pages:
I also managed to do some actual coding and fixed the nasty locking issue which could leave threads left on the wait queues forever when caps are disabled. I still have a few more issues to attack.
In the process I filed a few new resource management bugs/RFEs:
- 6466380
- Project resource set callbacks are needlessly called on every fork()
- 6468003
- prctl should support the notion of default and infinity
- 6468451
- Errors from setting resource controls should propagate to the caller
NUMA observability tools are now in the gate!
Previows wednesday the NUMA observability tools were finally integrated into Solaris Nevada build 49 and should be available soon on OpenSolaris!
The tools include:
- lgrpinfo(1) – Perl script that displays lgroup hierarchy, contents, and characteristics
- plgrp(1): proc tool for observing and affecting home lgroup and lgroup affinities
- pmadvise(1): proc tool for applying advice with madvise(3C)
- pmap(1) extensions to display lgroup containing physical memory backing given virtual address in specified process
- Solaris::Lgrp: Perl module that makes lgroup API available to Perl scripts to use
- ps(1) extensions for lgroups (show home lgroup with -H option and filter by lgroup with -h)
- prstat(1M) extensions for lgroups (show home lgroup with -H option and more)
Also, we added a field for the home lgroup of a thread to the lwpsinfo structure in /proc, so it can be gotten through /proc. This is used by plgrp(1), ps(1), and prstat(1M) to get the home lgroup of a thread. Here is the new proc(4) man page and the man page diffs documenting the change.
The tools provide a lot of observability and control to the inner workings of the NUMA subsystem.
( Sep 11 2006, 05:23:55 PM PDT ) Permalink
