Skip to content

Extreme-scale Scientific Software Stack (E4S)

The Extreme-scale Scientific Software Stack (E4S) is a curated software stack from the Spack ecosystem that is continuously built and tested on several pre-exascale systems. E4S is composed of many open-source projects, including xSDK, dev-tools, math-libraries, compilers, and more. For a complete product list see here.

E4S is shipped as a container (Docker, Singularity, Shifter, CharlieCloud), a buildcache, or a Spack manifest (spack.yaml). Currently, we focus on building E4S from source using a spack.yaml file provided by the E4S team from https://github.com/E4S-Project/e4s.

Note

We install as many packages from E4S provided in spack.yaml as possible. Some packages were intentionally skipped such as specs tied to develop branches or packages built for GPUs. Some additional packages couldn't be installed or had concretization issues with our base compiler.

Access via Modules

In order to access e4s you can load module e4s/20.10, which will set up a Spack environment and activate the Spack environment e4s-2010.

$ module load e4s/20.10
$ spack env list
==> 1 environments
    e4s-2010  
$ spack env st
==> In environment e4s-2010
$ spack --version
0.15.4-1620-e1e0bbb4c

E4S 20.10 Stack

Note

The E4S 20.10 stack is built for the Haswell architecture.

Note

E4S 20.10 stack is built with the intel/19.1.2.254 compiler and cray-mpich/7.7.10 MPI wrapper. We don't plan to build the stack with every compiler + MPI permutation.

Note

e4s/20.10 stack is built with spack version 0.15.4-1620-e1e0bbb4c.

You can run spack find to see installed specs in E4S 20.10 release. Shown below are the root specs provided by Spack.

$ spack find
==> In environment e4s-2010
==> Root specs
-- cray-cnl7-haswell / intel@19.1.2.254 -------------------------
adios2@2.6.0%intel@19.1.2.254 
aml@0.1.0%intel@19.1.2.254 
arborx@0.9-beta%intel@19.1.2.254 +openmp
bolt@1.0%intel@19.1.2.254 
caliper@2.4.0%intel@19.1.2.254 
darshan-runtime@3.2.1%intel@19.1.2.254 +slurm
darshan-util@3.2.1%intel@19.1.2.254 +bzip2
flit@2.1.0%intel@19.1.2.254 
gasnet@2020.3.0%intel@19.1.2.254 +udp
ginkgo@1.2.0%intel@19.1.2.254 
globalarrays@5.7%intel@19.1.2.254 +blas+lapack+scalapack
gotcha@1.0.3%intel@19.1.2.254 +test
hdf5@1.10.6%intel@19.1.2.254 +cxx+debug+fortran+hl+szip+threadsafe
hypre@2.20.0%intel@19.1.2.254 +mixedint
kokkos@3.2.00%intel@19.1.2.254 +compiler_warnings+debug+debug_dualview_modify_check+examples+hwloc+memkind+numactl+openmp+pic+tests
kokkos-kernels@3.2.00%intel@19.1.2.254 +mkl+openmp
libnrm@0.1.0%intel@19.1.2.254 
libquo@1.3.1%intel@19.1.2.254 
mercury@1.0.1%intel@19.1.2.254 +udreg
mfem@4.1.0%intel@19.1.2.254 +examples+gnutls+gslib+lapack+libunwind+openmp+pumi+threadsafe+umpire
ninja@1.10.1%intel@19.1.2.254 
openpmd-api@0.12.0%intel@19.1.2.254 
papi@6.0.0.1%intel@19.1.2.254 +example+static_tools
parallel-netcdf@1.12.1%intel@19.1.2.254 
pdt@3.25.1%intel@19.1.2.254 +pic
petsc@3.14.0%intel@19.1.2.254 
pumi@2.2.2%intel@19.1.2.254 +fortran
py-libensemble@0.7.0%intel@19.1.2.254 +mpi+nlopt+scipy
py-petsc4py@3.13.0%intel@19.1.2.254 
qthreads@1.14%intel@19.1.2.254 ~hwloc
raja@0.12.1%intel@19.1.2.254 
slepc@3.14.0%intel@19.1.2.254 
stc@0.8.3%intel@19.1.2.254 
sundials@5.4.0%intel@19.1.2.254 +examples-cxx+examples-f2003~examples-f77+f2003+hypre+klu+lapack+openmp
superlu@5.2.1%intel@19.1.2.254 
superlu-dist@6.3.1%intel@19.1.2.254 
swig@4.0.2%intel@19.1.2.254 
sz@2.1.10%intel@19.1.2.254 +fortran+hdf5+netcdf+pastri+python+random_access+time_compression
tasmanian@7.3%intel@19.1.2.254 +blas+fortran+mpi+python+xsdkflags
turbine@1.2.3%intel@19.1.2.254 +hdf5+python
umap@2.1.0%intel@19.1.2.254 +tests
umpire@4.0.1%intel@19.1.2.254 +fortran+numa+openmp
upcxx@2020.3.0%intel@19.1.2.254 
veloc@1.4%intel@19.1.2.254 
zfp@0.5.5%intel@19.1.2.254 

==> 135 installed packages
-- cray-cnl7-haswell / intel@19.1.2.254 -------------------------
adiak@0.1.1      c-blosc@1.17.0         globalarrays@5.7      kokkos@3.2.00          libszip@2.1.1        netcdf-c@4.7.4          pdt@3.25.1            py-scipy@1.5.3        suite-sparse@5.7.2  umpire@4.0.1
adios2@2.6.0     caliper@2.4.0          gmake@4.2.1           kokkos@3.2.00          libtool@2.4.6        nettle@3.4.1            perl@5.30.3           py-setuptools@50.1.0  sundials@5.4.0      umpire@4.0.1
adlbx@0.9.2      cmake@3.16.5           gmp@6.1.2             kokkos-kernels@3.2.00  libunwind@1.4.0      ninja@1.10.1            petsc@3.13.6          py-toml@0.10.0        superlu@5.2.1       upcxx@2020.3.0
aml@0.1.0        darshan-runtime@3.2.1  gnutls@3.6.14         kvtree@1.0.2           libuuid@1.0.3        nlohmann-json@3.9.1     petsc@3.14.0          python@3.8.6          superlu-dist@6.3.0  veloc@1.4
ant@1.10.7       darshan-util@3.2.1     gotcha@1.0.3          libbsd@0.10.0          libzmq@4.3.2         nlopt@2.6.1             pkg-config@0.29.2     qthreads@1.14         superlu-dist@6.3.1  xz@5.2.5
arborx@0.9-beta  diffutils@3.7          gslib@1.0.6           libfabric@1.11.0       lz4@1.9.2            numactl@2.0.12          pumi@2.2.2            raja@0.12.1           swig@4.0.2          zfp@0.5.5
argobots@1.0     er@0.0.3               hdf5@1.10.6           libffi@3.3             m4@1.4.18            openjdk@11.0.2          pumi@2.2.2            rankstr@0.0.2         sz@2.0.2.0          zlib@1.2.11
arpack-ng@3.7.0  exmcutils@0.5.7        hdf5@1.10.7           libiconv@1.16          memkind@1.7.0        openpmd-api@0.12.0      py-cython@0.29.21     readline@8.0          sz@2.1.10           zsh@5.8
autoconf@2.69    expat@2.2.9            hdf5@1.10.7           libnrm@0.1.0           mercury@1.0.1        openssl@1.1.1g          py-libensemble@0.7.0  redset@0.0.3          tasmanian@7.3       zstd@1.4.5
automake@1.16.2  flit@2.1.0             hwloc@2.2.0           libpfm4@4.11.0         metis@5.1.0          papi@6.0.0.1            py-mpi4py@3.0.3       shuffile@0.0.3        tcl@8.6.10
axl@0.3.0        gasnet@2020.3.0        hypre@2.18.2          libpng@1.6.37          mfem@4.1.0           papi@6.0.0.1            py-numpy@1.19.2       slepc@3.14.0          texinfo@6.5
bolt@1.0         gdbm@1.18.1            hypre@2.20.0          libpthread-stubs@0.4   mpark-variant@1.4.0  parallel-netcdf@1.12.1  py-petsc4py@3.13.0    snappy@1.1.8          turbine@1.2.3
boost@1.74.0     gettext@0.21           hypre@2.20.0          libquo@1.3.1           mpich@3.1            parmetis@4.0.3          py-pybind11@2.5.0     sqlite@3.31.1         turbine@1.2.3
bzip2@1.0.8      ginkgo@1.2.0           intel-mkl@19.1.2.254  libsodium@1.0.18       ncurses@6.2          pcre@8.44               py-pyelftools@0.26    stc@0.8.3             umap@2.1.0

You can use module load or spack load to load the Spack packages in your user shell. Shown below are the modulefiles that correspond to the Spack packages.

--------------------------------------------------------------------- /global/common/software/spackecp/e4s-20.10/modules/cray-cnl7-haswell/ ----------------------------------------------------------------------
adiak/0.1.1-intel-19.1.2.254-mthjgtd2            hdf5/1.10.6-intel-19.1.2.254-rsmkvdoy            mpich/3.1-intel-19.1.2.254-wcezuimd              qthreads/1.14-intel-19.1.2.254-txp7dp43
adios2/2.6.0-intel-19.1.2.254-n4dtk4qs           hdf5/1.10.7-intel-19.1.2.254-eiobyugs            ncurses/6.2-intel-19.1.2.254-g46l7apt            raja/0.12.1-intel-19.1.2.254-clqqli2d
adlbx/0.9.2-intel-19.1.2.254-xlbmanu5            hdf5/1.10.7-intel-19.1.2.254-pak7dug3            netcdf-c/4.7.4-intel-19.1.2.254-rhqjykkt         rankstr/0.0.2-intel-19.1.2.254-vcnlhhbr
aml/0.1.0-intel-19.1.2.254-plk72jlf              hwloc/2.2.0-intel-19.1.2.254-2gyzs5sq            nettle/3.4.1-intel-19.1.2.254-2jcug5xh           readline/8.0-intel-19.1.2.254-ngqzpr6g
ant/1.10.7-intel-19.1.2.254-l4thkax6             hypre/2.18.2-intel-19.1.2.254-bsglrarm           ninja/1.10.1-intel-19.1.2.254-r72lgss7           redset/0.0.3-intel-19.1.2.254-bscvmphb
arborx/0.9-beta-intel-19.1.2.254-dyxgypgb        hypre/2.20.0-intel-19.1.2.254-pok5xpdu           nlohmann-json/3.9.1-intel-19.1.2.254-a4rrsbub    shuffile/0.0.3-intel-19.1.2.254-mibevhqg
argobots/1.0-intel-19.1.2.254-attdurbf           hypre/2.20.0-intel-19.1.2.254-rexbzxrs           nlopt/2.6.1-intel-19.1.2.254-wpao7epm            slepc/3.14.0-intel-19.1.2.254-vvdrsxyf
arpack-ng/3.7.0-intel-19.1.2.254-mgnqvw4p        intel-mkl/19.1.2.254-intel-19.1.2.254-3qgi4fgi   numactl/2.0.12-intel-19.1.2.254-fnfircl5         snappy/1.1.8-intel-19.1.2.254-24xez3cd
autoconf/2.69-intel-19.1.2.254-a4qx443y          kokkos/3.2.00-intel-19.1.2.254-4ofwm6dx          openjdk/11.0.2-intel-19.1.2.254-qil7jsta         sqlite/3.31.1-intel-19.1.2.254-iuxytzwg
automake/1.16.2-intel-19.1.2.254-n45gaypf        kokkos/3.2.00-intel-19.1.2.254-jamijalq          openpmd-api/0.12.0-intel-19.1.2.254-udgolvev     stc/0.8.3-intel-19.1.2.254-bz4n47ji
axl/0.3.0-intel-19.1.2.254-r2fck4xo              kokkos-kernels/3.2.00-intel-19.1.2.254-p2araoex  openssl/1.1.1g-intel-19.1.2.254-we2bo3po         suite-sparse/5.7.2-intel-19.1.2.254-3x5kozds
bolt/1.0-intel-19.1.2.254-ymgdfuke               kvtree/1.0.2-intel-19.1.2.254-ob5jw5ci           papi/6.0.0.1-intel-19.1.2.254-3hfse4rg           sundials/5.4.0-intel-19.1.2.254-242wjqcw
boost/1.74.0-intel-19.1.2.254-e7zdgsa2           libbsd/0.10.0-intel-19.1.2.254-w4tvpvc2          papi/6.0.0.1-intel-19.1.2.254-u4n73q6y           superlu/5.2.1-intel-19.1.2.254-lmqmz7ov
bzip2/1.0.8-intel-19.1.2.254-5uwgsvyl            libfabric/1.11.0-intel-19.1.2.254-rilhzysw       parallel-netcdf/1.12.1-intel-19.1.2.254-tzhf2347 superlu-dist/6.3.0-intel-19.1.2.254-ws2nqrqd
c-blosc/1.17.0-intel-19.1.2.254-426olrob         libffi/3.3-intel-19.1.2.254-plapxdrp             parmetis/4.0.3-intel-19.1.2.254-pjltphmg         superlu-dist/6.3.1-intel-19.1.2.254-flp5bkyt
caliper/2.4.0-intel-19.1.2.254-msrwlvgo          libiconv/1.16-intel-19.1.2.254-hidqyej2          pcre/8.44-intel-19.1.2.254-eozxjzaz              swig/4.0.2-intel-19.1.2.254-xdqcts7d
cmake/3.16.5-intel-19.1.2.254-zmyp2sa4           libnrm/0.1.0-intel-19.1.2.254-lqmtrfxi           pdt/3.25.1-intel-19.1.2.254-snfwngyt             sz/2.0.2.0-intel-19.1.2.254-xqpf6msr
darshan-runtime/3.2.1-intel-19.1.2.254-pxw7io3x  libpfm4/4.11.0-intel-19.1.2.254-53jyek3i         perl/5.30.3-intel-19.1.2.254-e7wxeve6            sz/2.1.10-intel-19.1.2.254-c2juglm6
darshan-util/3.2.1-intel-19.1.2.254-zcw5xq6e     libpng/1.6.37-intel-19.1.2.254-emjubioq          petsc/3.13.6-intel-19.1.2.254-expurd2b           tasmanian/7.3-intel-19.1.2.254-7rmkges7
diffutils/3.7-intel-19.1.2.254-6gqao3ig          libpthread-stubs/0.4-intel-19.1.2.254-azmwahqt   petsc/3.14.0-intel-19.1.2.254-3sfdqh37           tcl/8.6.10-intel-19.1.2.254-4oofcvju
er/0.0.3-intel-19.1.2.254-fcfjscln               libquo/1.3.1-intel-19.1.2.254-znhzfnct           pkg-config/0.29.2-intel-19.1.2.254-nxb62ywk      texinfo/6.5-intel-19.1.2.254-snawrbph
exmcutils/0.5.7-intel-19.1.2.254-bpoijynb        libsodium/1.0.18-intel-19.1.2.254-l4lmt4z2       pumi/2.2.2-intel-19.1.2.254-nrkupeqc             turbine/1.2.3-intel-19.1.2.254-pfwk2pgn
expat/2.2.9-intel-19.1.2.254-7zsw6ohk            libszip/2.1.1-intel-19.1.2.254-pqwulucm          pumi/2.2.2-intel-19.1.2.254-u7ra5bw2             turbine/1.2.3-intel-19.1.2.254-w4oqxhaj
flit/2.1.0-intel-19.1.2.254-6ufrb2kb             libtool/2.4.6-intel-19.1.2.254-w2kuzsym          py-cython/0.29.21-intel-19.1.2.254-yjdamuq7      umap/2.1.0-intel-19.1.2.254-edgoxhxd
gasnet/2020.3.0-intel-19.1.2.254-5nbbm7ww        libunwind/1.4.0-intel-19.1.2.254-dycdrifr        py-libensemble/0.7.0-intel-19.1.2.254-bn6b6rft   umpire/4.0.1-intel-19.1.2.254-fzo7wz7a
gdbm/1.18.1-intel-19.1.2.254-yzrxncmk            libuuid/1.0.3-intel-19.1.2.254-o532npji          py-mpi4py/3.0.3-intel-19.1.2.254-uprarn3p        umpire/4.0.1-intel-19.1.2.254-jxoi4b3o
gettext/0.21-intel-19.1.2.254-bqwcqalw           libzmq/4.3.2-intel-19.1.2.254-y4oux2w3           py-numpy/1.19.2-intel-19.1.2.254-yb6jdj2c        upcxx/2020.3.0-intel-19.1.2.254-fy3g3xtz
ginkgo/1.2.0-intel-19.1.2.254-i47x2ykg           lz4/1.9.2-intel-19.1.2.254-hiecokwj              py-petsc4py/3.13.0-intel-19.1.2.254-kkpcajdr     veloc/1.4-intel-19.1.2.254-rqqesf7e
globalarrays/5.7-intel-19.1.2.254-r3tzykgy       m4/1.4.18-intel-19.1.2.254-ws5y7ojc              py-pybind11/2.5.0-intel-19.1.2.254-pqflmoh4      xz/5.2.5-intel-19.1.2.254-5wcxpivv
gmake/4.2.1-intel-19.1.2.254-btxjbfbo            memkind/1.7.0-intel-19.1.2.254-gepq4n7u          py-pyelftools/0.26-intel-19.1.2.254-dpismpc4     zfp/0.5.5-intel-19.1.2.254-j5jmvakn
gmp/6.1.2-intel-19.1.2.254-tpii7i4j              mercury/1.0.1-intel-19.1.2.254-uetearts          py-scipy/1.5.3-intel-19.1.2.254-fi7tpgqt         zlib/1.2.11-intel-19.1.2.254-54rpg6zv
gnutls/3.6.14-intel-19.1.2.254-7hewruks          metis/5.1.0-intel-19.1.2.254-lzrewviy            py-setuptools/50.1.0-intel-19.1.2.254-psdd3j7c   zsh/5.8-intel-19.1.2.254-65ncemzz
gotcha/1.0.3-intel-19.1.2.254-nrye7psr           mfem/4.1.0-intel-19.1.2.254-ddu6klv6             py-toml/0.10.0-intel-19.1.2.254-sufxlrxs         zstd/1.4.5-intel-19.1.2.254-r27ln7zo
gslib/1.0.6-intel-19.1.2.254-gw3cc5gu            mpark-variant/1.4.0-intel-19.1.2.254-q2drubnz    python/3.8.6-intel-19.1.2.254-7b664mwe

We provide a buildcache to allow users to install specs in their user environment without reinstalling the spec from source. In order to use buildcache one needs to configure a GPG key.

By default, Spack stores the GPG key at $SPACK_ROOT/opt/spack/gpg which is not the ideal location for non-staff users, since they don't have write permissions to the central Spack instance. Instead we recommend you set SPACK_GNUPGHOME to an alternate path, preferably your default GPG location ($HOME/.gnupg). This will enable Spack to trust your GPG key. To get started you can set SPACK_GNUPGHOME as follows:

# bash/sh/zsh users
export SPACK_GNUPGHOME=$HOME/.gnupg

# tcsh/csh users
setenv SPACK_GNUPGHOME $HOME/.gnupg

Next, we need to trust the public key e4s2010.pub by running the spack gpg trust command.

This will make Spack trust the public key, which is needed to install specs from the buildcache, because they are signed by the public key.

$ spack gpg trust /global/common/software/spackecp/gpgkeys/e4s2010.pub   
gpgconf: socketdir is '/run/user/92503/gnupg'
gpg: key 0140A256659E0CBD: public key "Spack GPG Key (Spack E4S GPG Key) <shahzebsiddiqui@lbl.gov>" imported
gpg: Total number processed: 1
gpg:               imported: 1

You can confirm if the GPG key is imported by running the following:

$ spack gpg list
gpgconf: socketdir is '/run/user/92503/gnupg'
/global/cscratch1/sd/siddiq90/spack/opt/spack/gpg/pubring.kbx
-------------------------------------------------------------
pub   rsa2048 2020-09-22 [SCEA]
      EA172EB6343D30750A56522F0140A256659E0CBD
uid           [ unknown] Spack GPG Key (Spack E4S GPG Key) <shahzebsiddiqui@lbl.gov>
sub   rsa2048 2020-09-22 [SEA]

Redeploying the stack

If you want an exact replica of the E4S stack, you should recreate a spack environment from the spack.lock file.

For this example we will create a Spack environment in our home directory since as a user, you don't have permission to create an environment in the Spack instance. First we navigate to the e4s-2010 environment and create an environment using spack.lock.

spack cd -e e4s-2010
spack env create -d $HOME/e4s-2010-user spack.lock

Next, we navigate to the user environment directory and we see a spack.lock and spack.yaml. We can activate the Spack environment using spack env activate command.

$ cd $HOME/e4s-2010-user
$ ls
spack.lock  spack.yaml
$ spack env activate .
$ spack env st
==> Using spack.yaml in current directory: /global/u1/s/siddiq90/e4s-2010-user

We should add the buildcache mirror so we can install from the buildcache. This can be done by running:

spack mirror add e4s2010 /global/common/software/spackecp/mirrors/e4s-2020-10/

Let's confirm our active mirrors by running:

$ spack mirror list
spack-public    https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/
e4s2010         file:///global/common/software/spackecp/mirrors/e4s-2020-10

Now we can install from the mirror. This operation will take some time as it will install all the packages from spack.lock.

spack install --cache-only

Once you have installed everything, you can run spack find and see the available specs in your Spack environment. Now you are ready to install any additional specs in your environment to satisfy your build dependency.

$ spack find
==> In environment /global/u1/s/siddiq90/e4s-2010-user
==> Root specs
-- cray-cnl7-haswell / intel@19.1.2.254 -------------------------
adios2@2.6.0%intel@19.1.2.254 
aml@0.1.0%intel@19.1.2.254 
arborx@0.9-beta%intel@19.1.2.254 +openmp
bolt@1.0%intel@19.1.2.254 
caliper@2.4.0%intel@19.1.2.254 
darshan-runtime@3.2.1%intel@19.1.2.254 +slurm
darshan-util@3.2.1%intel@19.1.2.254 +bzip2
flit@2.1.0%intel@19.1.2.254 
gasnet@2020.3.0%intel@19.1.2.254 +udp
ginkgo@1.2.0%intel@19.1.2.254 
globalarrays@5.7%intel@19.1.2.254 +blas+lapack+scalapack
gotcha@1.0.3%intel@19.1.2.254 +test
hdf5@1.10.6%intel@19.1.2.254 +cxx+debug+fortran+hl+szip+threadsafe
hypre@2.20.0%intel@19.1.2.254 +mixedint
kokkos@3.2.00%intel@19.1.2.254 +compiler_warnings+debug+debug_dualview_modify_check+examples+hwloc+memkind+numactl+openmp+pic+tests
kokkos-kernels@3.2.00%intel@19.1.2.254 +mkl+openmp
libnrm@0.1.0%intel@19.1.2.254 
libquo@1.3.1%intel@19.1.2.254 
mercury@1.0.1%intel@19.1.2.254 +udreg
mfem@4.1.0%intel@19.1.2.254 +examples+gnutls+gslib+lapack+libunwind+openmp+pumi+threadsafe+umpire
ninja@1.10.1%intel@19.1.2.254 
openpmd-api@0.12.0%intel@19.1.2.254 
papi@6.0.0.1%intel@19.1.2.254 +example+static_tools
parallel-netcdf@1.12.1%intel@19.1.2.254 
pdt@3.25.1%intel@19.1.2.254 +pic
petsc@3.14.0%intel@19.1.2.254 
pumi@2.2.2%intel@19.1.2.254 +fortran
py-libensemble@0.7.0%intel@19.1.2.254 +mpi+nlopt+scipy
py-petsc4py@3.13.0%intel@19.1.2.254 
qthreads@1.14%intel@19.1.2.254 ~hwloc
raja@0.12.1%intel@19.1.2.254 
slepc@3.14.0%intel@19.1.2.254 
stc@0.8.3%intel@19.1.2.254 
sundials@5.4.0%intel@19.1.2.254 +examples-cxx+examples-f2003~examples-f77+f2003+hypre+klu+lapack+openmp
superlu@5.2.1%intel@19.1.2.254 
superlu-dist@6.3.1%intel@19.1.2.254 
swig@4.0.2%intel@19.1.2.254 
sz@2.1.10%intel@19.1.2.254 +fortran+hdf5+netcdf+pastri+python+random_access+time_compression
tasmanian@7.3%intel@19.1.2.254 +blas+fortran+mpi+python+xsdkflags
turbine@1.2.3%intel@19.1.2.254 +hdf5+python
umap@2.1.0%intel@19.1.2.254 +tests
umpire@4.0.1%intel@19.1.2.254 +fortran+numa+openmp
upcxx@2020.3.0%intel@19.1.2.254 
veloc@1.4%intel@19.1.2.254 
zfp@0.5.5%intel@19.1.2.254 

==> 135 installed packages
-- cray-cnl7-haswell / intel@19.1.2.254 -------------------------
adiak@0.1.1      darshan-runtime@3.2.1  hdf5@1.10.6            libpfm4@4.11.0        mpich@3.1               perl@5.30.3           qthreads@1.14       sz@2.1.10
adios2@2.6.0     darshan-util@3.2.1     hdf5@1.10.7            libpng@1.6.37         ncurses@6.2             petsc@3.13.6          raja@0.12.1         tasmanian@7.3
adlbx@0.9.2      diffutils@3.7          hdf5@1.10.7            libpthread-stubs@0.4  netcdf-c@4.7.4          petsc@3.14.0          rankstr@0.0.2       tcl@8.6.10
aml@0.1.0        er@0.0.3               hwloc@2.2.0            libquo@1.3.1          nettle@3.4.1            pkg-config@0.29.2     readline@8.0        texinfo@6.5
ant@1.10.7       exmcutils@0.5.7        hypre@2.18.2           libsodium@1.0.18      ninja@1.10.1            pumi@2.2.2            redset@0.0.3        turbine@1.2.3
arborx@0.9-beta  expat@2.2.9            hypre@2.20.0           libszip@2.1.1         nlohmann-json@3.9.1     pumi@2.2.2            shuffile@0.0.3      turbine@1.2.3
argobots@1.0     flit@2.1.0             hypre@2.20.0           libtool@2.4.6         nlopt@2.6.1             py-cython@0.29.21     slepc@3.14.0        umap@2.1.0
arpack-ng@3.7.0  gasnet@2020.3.0        intel-mkl@19.1.2.254   libunwind@1.4.0       numactl@2.0.12          py-libensemble@0.7.0  snappy@1.1.8        umpire@4.0.1
autoconf@2.69    gdbm@1.18.1            kokkos@3.2.00          libuuid@1.0.3         openjdk@11.0.2          py-mpi4py@3.0.3       sqlite@3.31.1       umpire@4.0.1
automake@1.16.2  gettext@0.21           kokkos@3.2.00          libzmq@4.3.2          openpmd-api@0.12.0      py-numpy@1.19.2       stc@0.8.3           upcxx@2020.3.0
axl@0.3.0        ginkgo@1.2.0           kokkos-kernels@3.2.00  lz4@1.9.2             openssl@1.1.1g          py-petsc4py@3.13.0    suite-sparse@5.7.2  veloc@1.4
bolt@1.0         globalarrays@5.7       kvtree@1.0.2           m4@1.4.18             papi@6.0.0.1            py-pybind11@2.5.0     sundials@5.4.0      xz@5.2.5
boost@1.74.0     gmake@4.2.1            libbsd@0.10.0          memkind@1.7.0         papi@6.0.0.1            py-pyelftools@0.26    superlu@5.2.1       zfp@0.5.5
bzip2@1.0.8      gmp@6.1.2              libfabric@1.11.0       mercury@1.0.1         parallel-netcdf@1.12.1  py-scipy@1.5.3        superlu-dist@6.3.0  zlib@1.2.11
c-blosc@1.17.0   gnutls@3.6.14          libffi@3.3             metis@5.1.0           parmetis@4.0.3          py-setuptools@50.1.0  superlu-dist@6.3.1  zsh@5.8
caliper@2.4.0    gotcha@1.0.3           libiconv@1.16          mfem@4.1.0            pcre@8.44               py-toml@0.10.0        swig@4.0.2          zstd@1.4.5
cmake@3.16.5     gslib@1.0.6            libnrm@0.1.0           mpark-variant@1.4.0   pdt@3.25.1              python@3.8.6          sz@2.0.2.0

Point of Contact

If you need assistance with E4S 20.10 on Cori please file a ticket at https://help.nersc.gov/.

If you would like to see your package in E4S, please contact the E4S team: