McGill Docker Containers

At McGill, there are three 3 ways to which docker containers can be utilised. Since its is a shared site, the use of containers to adopt individual project needs is becoming significant. For the ATLAS project container use can be viewed from 3 aspects;

  1. For a T3 setting using udocker
  2. A T2 setting with an sl6 container that runs on a sl7 host where the middleware is a tarball in GPFS.
  3. A T2 setting with an sl6 container and emi-WN middleware also included.
T2 here means that the jobs to the containers are sent from the grid through panda queues and received by the production CEs. At McGill we run Moab/Torque (Moab 7, Torque-5.1.1).

Docker host hardware and set Up

  • Two nodes (sw-4r03-n29 and sw-4r03-n30) running on CentOS 7.2
  • IBM iDataPlex dx360 M4 Servers 2 sockets 16 cores (per server) Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Total mem 64GB
  • DISK: SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s). 1 x 500 GB SATA II
  • Network: 1 x 1 Gb Ethernet, 1 x 40 Gb/sec (InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02))
  • GPFS mount for direct file access of data. Localscratch partition for running jobs.
  • cvmfs-2.2.3-1.el7 installed on the host and mounted onto the docker container.
  • docker-1.9.1-40.el7 installed.
Container (2) configuration
  • an sl6.6 OS
  • HEP libs rpm
  • Pool accounts in LDAP
  • Mounts host's: cvmfs, home directories for pool accounts (/sb), localscratch, GPFS data partition (/lb).
  • Mounts the tarball area (/sb)
  • sources glite-env scripts in gpfs.
Container (3) configuration (ongoing)
  • an sl6.6 OS
  • HEP libs rpm
  • emisl6-WN rpms and WN yaim configuration
  • Pool accounts in LDAP
  • Mounts host's: cvmfs, home directories for pool accounts (/sb), localscracth, GPFS data partation (/lb).
  • Mounts the tarball area (/sb)

Panda queues

Panda queues are defined and active for these docker containers

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r6 - 2016-09-19 - SimonNderitu
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback