How to replace CMC with dummy CMC2

There is a dummy CMC2 provided by Gridservices2. This service response any request from Nodehandler with a fake positive answer. For example, when Nodehandler inquiry dummy CMC2 the status of specific nodes, dummy CMC2 will always tell Nodehandler the nodes are on even no node is on in the testbed. In this situation, dummy CMC2 is not able to reset, boot or turn off nodes and detect the real status of nodes like CMC does.

In case you don't have CM cards installed on nodes, you can use dummy CMC2 to make Nodehandler work and manually reboot or nodes.

To enable dummy CMC2, you need create a file named "cmcStub.yaml" under "/etc/gridservices2/enabled" or make a symbol link named "cmcStub.yaml" under this path to a real configuration file. Then edit this file like following.

  1 ---
  2 cmc:
  3   # listAll: return array of x/y coodinates of all nodes in '[x,y]' form.
  4   # listStatus: return array of x/y coodinates of all nodes in '[x, y, STAT    US]' form.
  5   #
  6   testbed:
  7
  8     # These are the configuration parameters for the default testbed
  9     # Currently the default testbed is the "indoor" one
 10     default:
 11       listAll: |
 12         (1..10).to_a.map {|i| [i, 2]}
 13       listStatus: |
 14         (1..10).to_a.map {|i| [i, 2, 'POWERON']}
 15
 16     # These are the configuration parameters for the "outdoor" testbed
 17     outdoor:
 18       listAll: |
 19         (100..107).to_a.map {|i| [i,0]}
 20       listStatus: |
 21         (100..107).to_a.map {|i| [i, 0, 'POWERON']}

Dummy CMC2 supports node's IP like "10.10.x.2", which means only x can be changed to represent different nodes. You can set the other three number according your testbed configuration, such as 198.168.x.4.
Line 12 and 14 define the range of testbed which is from node1-2 to node10-2. You can change "10" to the actual number of nodes in your testbed.

You also need to edit the configuration of DHCP and DNS to match nodes' name and IP address, you can refer link here and here. Some examples are posted below.

/etc/bind/zone.orbit

  1
  2 $TTL 3600
  3 @           IN SOA services.grid.poly.edu. root.services.grid.poly.edu. (
  4                                            2008021817    ; serial
  5                                            28800    ; refresh (8hours)
  6                                            900      ; retry (15 mins)
  7                                            604800   ; expire (1 week)
  8                                            86400    ; minimum (1 day)
  9                                     );
 10 @              IN    NS              services.grid.poly.edu.
 11 $ORIGIN in-addr.arpa.
 12 $ORIGIN 10.in-addr.arpa.
 13 $ORIGIN 0.10.10.in-addr.arpa.
 14 $TTL 129600
 15 10     IN  PTR    services.grid.poly.edu.
 16 10     IN  PTR    console.grid.poly.edu.
 17
 18 $ORIGIN 1.10.10.in-addr.arpa.
 19 9     IN  PTR   rxwarp.grid.poly.edu.
 20 8     IN  PTR   windows.grid.poly.edu.
 21 1     IN  PTR   node1-1.grid.poly.edu.
 22 2     IN  PTR   node1-2.grid.poly.edu.
 23 3     IN  PTR   node1-3.grid.poly.edu.
 24
 25
 26 2.2.10.10.in-addr.arpa. IN PTR node2-2.grid.poly.edu.
 27 2.3.10.10.in-addr.arpa. IN PTR node3-2.grid.poly.edu.
 28
 29 $ORIGIN 200.1.10.in-addr.arpa.
 30 1     IN  PTR   cmc.grid.poly.edu.

/etc/bind/orbit.zone

  1 $TTL 3600
  2 @ IN  SOA services.grid.poly.edu.  root.services.grid.poly.edu. (
  3                           2008072501 ; serial
  4                           3600       ; refresh (1 hour)
  5                           600        ; retry (10 min)
  6                           10000      ; expire (2 hours)
  7                           3600    );
  8                                     ;
  9 @        IN    NS        services.grid.poly.edu.
 10 $ORIGIN grid.poly.edu.
 11 $TTL 129600
 12 windows      IN   A       10.10.1.8
 13 rxwarp       IN   A       10.10.1.9
 14 node1-2      IN   A       10.10.1.2
 15 node2-2      IN   A       10.10.2.2
 16 node3-2      IN   A       10.10.3.2
 17
 18 console      IN   A      10.10.0.10
 19 cmc          IN   A      10.1.200.1
 20
 21 services     IN   CNAME  console.grid.poly.edu.
 22 dhcp         IN   CNAME  console.grid.poly.edu.
 23 frisbee      IN   CNAME  console.grid.poly.edu.
 24 pxe          IN   CNAME  console.grid.poly.edu.
 25 oml          IN   CNAME  console.grid.poly.edu.
 26 repository   IN   CNAME  console.grid.poly.edu.
 27 repository1  IN   CNAME  console.grid.poly.edu.
 28 repository2  IN   CNAME  console.grid.poly.edu.
 29 ntp          IN   CNAME  console.grid.poly.edu.
 30 loghost      IN   CNAME  console.grid.poly.edu.
 31 idb1         IN   CNAME  console.grid.poly.edu.
 32 idb2         IN   CNAME  console.grid.poly.edu.

/etc/dhcp3/dhcpd.conf

# The ddns-updates-style parameter controls whether or not the server will
# attempt to do a DNS update when a lease is confirmed. We default to the
# behavior of the version 2 packages ('none', since DHCP v2 didn't
# have support for DDNS.)
ddns-update-style interim;
use-host-decl-names on;

allow booting;
allow bootp;

# option definitions common to all supported networks...
option domain-name "grid.poly.edu";

default-lease-time 259200;
max-lease-time 259200;

# If this DHCP server is the official DHCP server for the local
# network, the authoritative directive should be uncommented.
#authoritative;

# Use this to send dhcp log messages to a different log file (you also
# have to hack syslog.conf to complete the redirection).
log-facility local7;

subnet 10.10.0.0 netmask 255.255.0.0 {
   range 10.10.1.1 10.10.255.254;
   option domain-name "grid.poly.edu";
   ddns-updates off;
   ddns-domainname "grid.poly.edu";
   ddns-rev-domainname "in-addr.arpa";
   option domain-name-servers 10.10.0.10;
   next-server 10.10.0.10;
   
   host services {hardware ethernet 00:1B:2F:BE:EF:94; fixed-address services.grid.poly.edu;}
   host console {hardware ethernet 00:1B:2F:BE:DF:6E; fixed-address console.grid.poly.edu;}

  filename "/tftpboot/pxelinux.bin";

#node 10.10.x.y

   group {
       host node1-2 {
       hardware ethernet 00:03:2D:08:19:FE;
       fixed-address node1-2.grid.poly.edu;
       }

       host node2-2 {
       hardware ethernet  00:03:2D:08:19:EE;
       fixed-address node2-2.grid.poly.edu;
       }

       host node3-2 {
       hardware ethernet 00:03:2D:07:67:CE;
       fixed-address node1-3.grid.poly.edu;
       }
   }
}

After all configuration is done, you need stop Gridservice and reset Gridservice2. You may also verify if dummy CMC2 is working by opening this URL in web browser.
​http://cmc:5022/cmc/allStatus

If you use dummy CMC2 to replace CMC, you will not be able to reboot or turn on nodes. Alternatively, you can boot nodes by hand or reboot them with command like "ssh root@10.10.1.2 'reboot'". If nodeagent4 is launched on nodes, a more effective way to reboot them is executing a small experiment script with command "omf exec reboot". The script looks like following.

reboot.rb

defGroup('mygroup',[1..10,2])
whenAllUp() {
  allGroups.exec("/sbin/reboot")
  wait 2 # wait 2 sec
  Experiment.done
}

Those scripts reboot 10 nodes, from node1-2 to node10-2 , at once.

---

The authors of this page would like to thank Thierry Rakotoarivelo for his help with the dummy CMC2 codes.