+A  Click here to enlarge/reduce to/back from full screen 
Paul Scherrer Institut PSI AIT LINUX Support

PSI Home |  LOG Home |  AIT Home |  Search |  Helpdesk |  Contact Us | 





SGE Cluster Configuration


Using qconf Command

To view the basic cluster and host configuration use the qconf -sconf command:

   qconf -sconf  [global]
   qconf -sconf  host_name

Example:

qconf -sconf
global:
execd_spool_dir              /opt/sge/n1ge6/default/spool
mailer                       /bin/mail
xterm                        /usr/bin/X11/xterm
load_sensor                  none
prolog                       none
epilog                       none
shell_start_mode             posix_compliant
login_shells                 sh,ksh,csh,tcsh
min_uid                      0
min_gid                      0
user_lists                   none
xuser_lists                  none
projects                     none
xprojects                    none
enforce_project              false
enforce_user                 auto
load_report_time             00:00:40
max_unheard                  00:05:00
reschedule_unknown           00:00:00
loglevel                     log_warning
administrator_mail           none
set_token_cmd                none
pag_cmd                      none
token_extend_time            none
shepherd_cmd                 none
qmaster_params               none
execd_params                 none
reporting_params             accounting=true reporting=false \
                             flush_time=00:00:15 joblog=false sharelog=00:00:00
finished_jobs                100
gid_range                    50700-50800
qlogin_command               telnet
qlogin_daemon                /usr/sbin/in.telnetd
rlogin_daemon                /usr/sbin/in.rlogind
max_aj_instances             2000
max_aj_tasks                 75000
max_u_jobs                   0
max_jobs                     0
auto_user_oticket            0
auto_user_fshare             0
auto_user_default_project    none
auto_user_delete_time        86400
delegated_file_staging       false
reprioritize                 0
qconf -sconf merlin09
merlin09:
mailer                       /bin/mail
xterm                        /usr/bin/X11/xterm
qlogin_daemon                /usr/sbin/in.telnetd
rlogin_daemon                /usr/sbin/in.rlogind
qconf -shgrpl
@allhosts

To modify the basic cluster or host specific configuration use the following commands:

   qconf -mconf  global
   qconf -mconf  host_name

Complex Resources

qconf -sc
#name               shortcut   type        relop requestable consumable default  urgency 
#----------------------------------------------------------------------------------------
arch                a          RESTRING    ==    YES         NO         NONE     0
calendar            c          RESTRING    ==    YES         NO         NONE     0
cpu                 cpu        DOUBLE      >=    YES         NO         0        0
h_core              h_core     MEMORY      <=    YES         NO         0        0
h_cpu               h_cpu      TIME        <=    YES         NO         0:0:0    0
h_data              h_data     MEMORY      <=    YES         NO         0        0
h_fsize             h_fsize    MEMORY      <=    YES         NO         0        0
h_rss               h_rss      MEMORY      <=    YES         NO         0        0
h_rt                h_rt       TIME        <=    YES         NO         0:0:0    0
h_stack             h_stack    MEMORY      <=    YES         NO         0        0
h_vmem              h_vmem     MEMORY      <=    YES         NO         0        0
hostname            h          HOST        ==    YES         NO         NONE     0
load_avg            la         DOUBLE      >=    NO          NO         0        0
load_long           ll         DOUBLE      >=    NO          NO         0        0
load_medium         lm         DOUBLE      >=    NO          NO         0        0
load_short          ls         DOUBLE      >=    NO          NO         0        0
mem_free            mf         MEMORY      <=    YES         NO         0        0
mem_total           mt         MEMORY      <=    YES         NO         0        0
mem_used            mu         MEMORY      >=    YES         NO         0        0
min_cpu_interval    mci        TIME        <=    NO          NO         0:0:0    0
np_load_avg         nla        DOUBLE      >=    NO          NO         0        0
np_load_long        nll        DOUBLE      >=    NO          NO         0        0
np_load_medium      nlm        DOUBLE      >=    NO          NO         0        0
np_load_short       nls        DOUBLE      >=    NO          NO         0        0
num_proc            p          INT         ==    YES         NO         0        0
qname               q          RESTRING    ==    YES         NO         NONE     0
rerun               re         BOOL        ==    NO          NO         0        0
s_core              s_core     MEMORY      <=    YES         NO         0        0
s_cpu               s_cpu      TIME        <=    YES         NO         0:0:0    0
s_data              s_data     MEMORY      <=    YES         NO         0        0
s_fsize             s_fsize    MEMORY      <=    YES         NO         0        0
s_rss               s_rss      MEMORY      <=    YES         NO         0        0
s_rt                s_rt       TIME        <=    YES         NO         0:0:0    0
s_stack             s_stack    MEMORY      <=    YES         NO         0        0
s_vmem              s_vmem     MEMORY      <=    YES         NO         0        0
seq_no              seq        INT         ==    NO          NO         0        0
slots               s          INT         <=    YES         YES        1        1000
swap_free           sf         MEMORY      <=    YES         NO         0        0
swap_rate           sr         MEMORY      >=    YES         NO         0        0
swap_rsvd           srsv       MEMORY      >=    YES         NO         0        0
swap_total          st         MEMORY      <=    YES         NO         0        0
swap_used           su         MEMORY      >=    YES         NO         0        0
tmpdir              tmp        RESTRING    ==    NO          NO         NONE     0
virtual_free        vf         MEMORY      <=    YES         NO         0        0
virtual_total       vt         MEMORY      <=    YES         NO         0        0
virtual_used        vu         MEMORY      >=    YES         NO         0        0

To view and change the setup of hosts use qconf -XY [file] with the following options:

   =================================================================
                     HOST   execution   admin     submit  host_group 
                       Y      e          h          s
    ACTION        X 
   ----------------------------------------------------------------- 
   add (edit)     a           *          *          *         *
   add (file)     A           *                               *
   delete         d           *          *          *         *
   modify (edit)  m           *                               *
   modify (file)  M           *                               *
   show           s           *          *          *         *
   show list      sYl         *                               *
   ================================================================

SGE Types

Some SGE command line switches and file attributes are types that are explained in man sge_types:

pattern
       When ever patterns are used the following definition applies:
       "*"     matches any character and any number of characters
               (between 0 and inv).
       "?"     matches any character. It cannot be no character
       "."     is the character ".". It has no other meaning
       "\"     escape character. "\\" = "\", "\*" = "*", "\?" = "?"
       "[xx]"  specifies an array or a range of allowed
               characters for one character at a specific position
       The pattern itself should be put into double quotes to ensure, 
       that the clients get the pattern. The or | operator is not supported.
  
   wc_host
       A  wildcard host specification is a wildcard expression which might match 
       one or more hosts used in the cluster, e.g.:
              *            all hosts
       That string never contains an at-character @ even if the expression begins with a wildcard character.
   
   wc_hostgroup
       A wildcard hostgroup specification, e.g.:
              @*           all hostgroups in the cluster
   
   wc_queue
       wc_queue := wc_cqueue | wc_qdomain | wc_qinstance
       A wildcard queue expression, e.g.:
              all.q
              all.q@mode01
              *@node01
   
   wc_cqueue
       A  wildcard cluster queue specification is a wildcard expression which might 
       match one or more cluster queues used in the cluster, e.g.:
              *            all cluster queues
              a*           all cluster queues beginning with an a

   wc_qinstance
       wc_qinstance := wc_cqueue "@" wc_host
       wc_qinstance expressions are used to address a group of queue instances 
       whose underlaying hostname matches the given pattern, e.g.:
              *@*          all queue instances in the cluster
              *@b*         all queue instances whose hostname begins with b
  
   wc_qdomain
       wc_qdomain := wc_cqueue "@" wc_hostgroup
       A  wildcard  queue  domain specification, e.g.:
              *@@*         all queue instances whose underlaying
                           host is part of at least one hostgroup
   wc_queue_list
       Comma separated list of wildcard queue expressions.


Tasks

Find the master hostname:

   cat $SGE_ROOT/$SGE_CELL/common/act_qmaster
   merlinf1

Configure the cell wide default submit options:

   emacs $SGE_ROOT/$SGE_CELL/common/sge_request

Files

  $SGE_ROOT
     |-- $SGE_CELL
         |-- common
         |   |-- act_qmaster          Master hostname 
         |   |-- sge_request          Cell wide default submit options
         |   |-- configuration        Do not edit manually!  See qconf -sconf
         |   |-- sched_configuration  Do not edit manually!
         |   |-- 
         |   |-- 
         |   |-- 


 
 


Last modified: 2006-05-26 V.M.