Skip to content

Instantly share code, notes, and snippets.

@iamc
Last active August 29, 2015 14:02

Revisions

  1. iamc revised this gist May 30, 2014. 1 changed file with 30 additions and 0 deletions.
    30 changes: 30 additions & 0 deletions easybuild-13.eb
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,30 @@
    #easybuild-13.eb
    easyblock = 'EB_EasyBuildMeta'

    name = 'EasyBuild'
    version = '1.13.0'

    homepage = 'http://hpcugent.github.com/easybuild/'
    description = """EasyBuild is a software build and installation framework
    written in Python that allows you to install software in a structured,
    repeatable and robust way."""

    toolchain = {'name': 'dummy', 'version': 'dummy'}

    source_urls = [
    'http://pypi.python.org/packages/source/e/easybuild-framework/',
    'http://pypi.python.org/packages/source/e/easybuild-easyblocks/',
    'http://pypi.python.org/packages/source/e/easybuild-easyconfigs/',
    ]
    # order matters a lot, to avoid having dependencies auto-resolved (--no-deps easy_install option doesn't work?)
    sources = [
    'easybuild-framework-%(version)s.tar.gz',
    'easybuild-easyblocks-%(version)s.tar.gz',
    'easybuild-easyconfigs-%(version)s.0.tar.gz',
    ]

    # EasyBuild is a (set of) Python packages, so it depends on Python
    # usually, we want to use the system Python, so no actual Python dependency is listed
    allow_system_deps = [('Python', SYS_PYTHON_VERSION)]

    moduleclass = 'tools'
  2. iamc revised this gist May 30, 2014. 1 changed file with 2 additions and 0 deletions.
    2 changes: 2 additions & 0 deletions install_process
    Original file line number Diff line number Diff line change
    @@ -1,3 +1,5 @@
    # cat /etc/redhat-release
    CentOS release 6.3 (Final)
    # pip install --user easybuild
    # export PATH=$HOME/.local/bin:$PATH
    # ml lmod/5.6
  3. iamc revised this gist May 30, 2014. 3 changed files with 69 additions and 1 deletion.
    60 changes: 60 additions & 0 deletions easybuild-I9alSY.log
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,60 @@
    == 2014-05-30 12:50:30,620 main INFO This is EasyBuild 1.13.0 (framework: 1.13.0, easyblocks: 1.13.0) on host rocks.sn.ehu.es.
    == 2014-05-30 12:50:30,622 main INFO Command line: --installpath=/software --modules-tool=Lmod easybuild-13.eb
    == 2014-05-30 12:50:30,623 main INFO Using /tmp/easybuild-YjkGq3 as temporary directory
    == 2014-05-30 12:50:30,630 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle init with modifications to support oldstyle options
    == 2014-05-30 12:50:30,631 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle_init filename /home/inigo/.local/lib/python2.6/site-packages/easybuild/easybuild_config.py kwargs {}
    == 2014-05-30 12:50:30,631 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle_read_configuration filename /home/inigo/.local/lib/python2.6/site-packages/easybuild/easybuild_config.py
    == 2014-05-30 12:50:30,635 main.config WARNING Deprecated functionality, will no longer work in v2.0: Adapt code to use read_environment from easybuild.tools.utilities and do not use oldstyle environment variables
    == 2014-05-30 12:50:30,635 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key build_path usage found, replacing with newkey buildpath
    == 2014-05-30 12:50:30,635 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key module_classes usage found, replacing with newkey moduleclasses
    == 2014-05-30 12:50:30,636 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key source_path usage found, replacing with newkey sourcepath
    == 2014-05-30 12:50:30,636 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key install_path usage found, replacing with newkey installpath
    == 2014-05-30 12:50:30,636 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key repository_path usage found, replacing with newkey repositorypath
    == 2014-05-30 12:50:30,636 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key log_dir usage found, replacing with newkey tmp_logdir
    == 2014-05-30 12:50:30,637 main.config WARNING Deprecated functionality, will no longer work in v2.0: oldstyle key log_format usage found, replacing with newkey logfile_format
    == 2014-05-30 12:50:30,639 main.Lmod INFO Prepended list of module paths with path used by EasyBuild: /software/modules/all
    == 2014-05-30 12:50:30,640 main.Lmod INFO $MODULEPATH set based on list of module paths: /software/modules/all:/software/modulefiles/Linux:/software/modulefiles/Core:/software/lmod/lmod/modulefiles/Core
    == 2014-05-30 12:50:30,640 main.filetools INFO Command /software/lmod/lmod/libexec/lmod found at /software/lmod/lmod/libexec/lmod
    == 2014-05-30 12:50:30,640 main.Lmod INFO Full path for module command is /software/lmod/lmod/libexec/lmod, so using it
    == 2014-05-30 12:50:30,757 main.Lmod INFO Found version 5.6
    == 2014-05-30 12:50:30,806 main.Lmod WARNING Ignoring non-existing module path in $MODULEPATH: /software/modulefiles/Core
    == 2014-05-30 12:50:30,807 main.Lmod WARNING Ignoring non-existing module path in $MODULEPATH: /software/modulefiles/Linux
    == 2014-05-30 12:50:30,807 main.Lmod WARNING Ignoring non-existing module path in $MODULEPATH: /software/modules/all
    == 2014-05-30 12:50:30,860 main.EasyConfig INFO Obtained list of valid module classes: ['base', 'bio', 'cae', 'chem', 'compiler', 'data', 'debugger', 'devel', 'geo', 'ide', 'lang', 'lib', 'math', 'mpi', 'numlib', 'perf', 'phys', 'system', 'toolchain', 'tools', 'vis']
    == 2014-05-30 12:50:30,876 main.easyconfig.easyconfig INFO Derived full easyblock module path for EB_EasyBuildMeta: easybuild.easyblocks.easybuildmeta
    == 2014-05-30 12:50:30,877 main.easyconfig.easyconfig INFO Successfully obtained class 'EB_EasyBuildMeta' for easyblock 'EB_EasyBuildMeta' (software name 'EasyBuild')
    == 2014-05-30 12:50:30,877 main.easyblock.<module> WARNING Deprecated functionality, will no longer work in v2.0: Returning list of tuples rather than a dict as return value of extra_options
    == 2014-05-30 12:50:30,877 main.EasyConfig WARNING Deprecated functionality, will no longer work in v2.0: Specified extra_options should be of type 'dict', found type '<type 'list'>'
    == 2014-05-30 12:50:30,882 main.easyconfig.format.pyheaderconfigobj WARNING Deprecated functionality, will no longer work in v2.0: Magic 'global' easyconfigs variables like shared_lib_ext should no longer be used
    == 2014-05-30 12:50:30,885 main.EasyConfig INFO setting config option toolchain: value {'version': 'dummy', 'name': 'dummy'} (type: <type 'dict'>)
    == 2014-05-30 12:50:30,885 main.EasyConfig INFO setting config option moduleclass: value tools (type: <type 'str'>)
    == 2014-05-30 12:50:30,885 main.EasyConfig INFO setting config option toolchain: value {'version': 'dummy', 'name': 'dummy'} (type: <type 'dict'>)
    == 2014-05-30 12:50:30,886 main.EasyConfig INFO setting config option name: value EasyBuild (type: <type 'str'>)
    == 2014-05-30 12:50:30,886 main.EasyConfig INFO setting config option allow_system_deps: value [('Python', '2.6.6')] (type: <type 'list'>)
    == 2014-05-30 12:50:30,886 main.easyconfig.easyconfig WARNING Unable to resolve template value easybuild-framework-%(version)s.tar.gz with dict {'versionprefix': '', 'versionsuffix': '', 'toolchain_name': 'dummy', 'toolchain_version': 'dummy'}
    == 2014-05-30 12:50:30,886 main.easyconfig.easyconfig WARNING Unable to resolve template value easybuild-easyblocks-%(version)s.tar.gz with dict {'versionprefix': '', 'versionsuffix': '', 'toolchain_name': 'dummy', 'toolchain_version': 'dummy'}
    == 2014-05-30 12:50:30,887 main.easyconfig.easyconfig WARNING Unable to resolve template value easybuild-easyconfigs-%(version)s.0.tar.gz with dict {'versionprefix': '', 'versionsuffix': '', 'toolchain_name': 'dummy', 'toolchain_version': 'dummy'}
    == 2014-05-30 12:50:30,887 main.easyconfig.easyconfig WARNING Unable to resolve template value easybuild-framework-%(version)s.tar.gz with dict {'versionprefix': '', 'versionsuffix': '', 'toolchain_name': 'dummy', 'toolchain_version': 'dummy'}
    == 2014-05-30 12:50:30,887 main.easyconfig.easyconfig WARNING Unable to resolve template value easybuild-easyblocks-%(version)s.tar.gz with dict {'versionprefix': '', 'versionsuffix': '', 'toolchain_name': 'dummy', 'toolchain_version': 'dummy'}
    == 2014-05-30 12:50:30,887 main.easyconfig.easyconfig WARNING Unable to resolve template value easybuild-easyconfigs-%(version)s.0.tar.gz with dict {'versionprefix': '', 'versionsuffix': '', 'toolchain_name': 'dummy', 'toolchain_version': 'dummy'}
    == 2014-05-30 12:50:30,888 main.EasyConfig INFO setting config option sources: value ['easybuild-framework-%(version)s.tar.gz', 'easybuild-easyblocks-%(version)s.tar.gz', 'easybuild-easyconfigs-%(version)s.0.tar.gz'] (type: <type 'list'>)
    == 2014-05-30 12:50:30,888 main.EasyConfig INFO setting config option version: value 1.13.0 (type: <type 'str'>)
    == 2014-05-30 12:50:30,888 main.EasyConfig INFO setting config option source_urls: value ['http://pypi.python.org/packages/source/e/easybuild-framework/', 'http://pypi.python.org/packages/source/e/easybuild-easyblocks/', 'http://pypi.python.org/packages/source/e/easybuild-easyconfigs/'] (type: <type 'list'>)
    == 2014-05-30 12:50:30,888 main.EasyConfig INFO setting config option easyblock: value EB_EasyBuildMeta (type: <type 'str'>)
    == 2014-05-30 12:50:30,889 main.EasyConfig INFO setting config option homepage: value http://hpcugent.github.com/easybuild/ (type: <type 'str'>)
    == 2014-05-30 12:50:30,889 main.EasyConfig INFO setting config option description: value EasyBuild is a software build and installation framework
    written in Python that allows you to install software in a structured,
    repeatable and robust way. (type: <type 'str'>)
    == 2014-05-30 12:50:30,891 main.environment INFO Environment variable EBROOTPYTHON set to Python
    == 2014-05-30 12:50:30,891 main.environment INFO Environment variable EBVERSIONPYTHON set to 2.6.6
    == 2014-05-30 12:50:30,892 main.EasyConfig INFO Validating easy block
    == 2014-05-30 12:50:30,892 main.EasyConfig INFO Checking OS dependencies
    == 2014-05-30 12:50:30,892 main.EasyConfig INFO OS dependencies ok: []
    == 2014-05-30 12:50:30,892 main.EasyConfig INFO Checking skipsteps
    == 2014-05-30 12:50:30,892 main.EasyConfig INFO Checking build option lists
    == 2014-05-30 12:50:30,893 main.EasyConfig INFO Checking licenses
    == 2014-05-30 12:50:30,893 main.EasyConfig WARNING Deprecated functionality, will no longer work in v2.0: Mandatory license not enforced
    == 2014-05-30 12:50:30,925 main.Lmod INFO Prepended list of module paths with path used by EasyBuild: /software/modules/all
    == 2014-05-30 12:50:30,925 main.Lmod INFO $MODULEPATH set based on list of module paths: /software/modules/all:/software/lmod/5.6/modulefiles/Core:/software/modulefiles/Linux:/software/modulefiles/Core:/software/lmod/lmod/modulefiles/Core
    == 2014-05-30 12:50:30,925 main.filetools INFO Command /software/lmod/lmod/libexec/lmod found at /software/lmod/lmod/libexec/lmod
    == 2014-05-30 12:50:30,925 main.Lmod INFO Full path for module command is /software/lmod/lmod/libexec/lmod, so using it
    3 changes: 2 additions & 1 deletion eb-13-lmod5.6.out
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,7 @@
    # eb easybuild-13.eb --installpath=/software --modules-tool=Lmod
    == temporary log file in case of crash /tmp/easybuild-YjkGq3/easybuild-I9alSY.log
    ERROR: Changing environment as dictated by module failed: name 'false' is not defined (stdout: os.environ['LOADEDMODULES'] = 'lmod/5.6';

    (stdout: os.environ['LOADEDMODULES'] = 'lmod/5.6';
    os.environ['MODULEPATH'] = '/software/modules/all:/software/lmod/5.6/modulefiles/Core:/software/modulefiles/Linux:/software/modulefiles/Core:/software/lmod/lmod/modulefiles/Core';
    os.environ['PATH'] = '/software/lmod/lmod/libexec:/home/inigo/.local/bin:/usr/lib64/qt-3.3/bin:/usr/NX/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/inigo/bin';
    os.environ['_LMFILES_'] = '/software/lmod/5.6/modulefiles/Core/lmod/5.6.lua';
    7 changes: 7 additions & 0 deletions install_process
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,7 @@
    # pip install --user easybuild
    # export PATH=$HOME/.local/bin:$PATH
    # ml lmod/5.6
    # export LMOD_IGNORE_CACHE=1
    # eb easybuild-13.eb --installpath=/software --modules-tool=Lmod

    ERROR: Changing environment as dictated by module failed: name 'false' is not defined
  4. iamc created this gist May 30, 2014.
    24 changes: 24 additions & 0 deletions eb-13-lmod5.6.out
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,24 @@
    # eb easybuild-13.eb --installpath=/software --modules-tool=Lmod
    == temporary log file in case of crash /tmp/easybuild-YjkGq3/easybuild-I9alSY.log
    ERROR: Changing environment as dictated by module failed: name 'false' is not defined (stdout: os.environ['LOADEDMODULES'] = 'lmod/5.6';
    os.environ['MODULEPATH'] = '/software/modules/all:/software/lmod/5.6/modulefiles/Core:/software/modulefiles/Linux:/software/modulefiles/Core:/software/lmod/lmod/modulefiles/Core';
    os.environ['PATH'] = '/software/lmod/lmod/libexec:/home/inigo/.local/bin:/usr/lib64/qt-3.3/bin:/usr/NX/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/inigo/bin';
    os.environ['_LMFILES_'] = '/software/lmod/5.6/modulefiles/Core/lmod/5.6.lua';
    os.environ['LOADEDMODULES'] = 'lmod/5.6';
    os.environ['MODULEPATH'] = '/software/modules/all:/software/lmod/5.6/modulefiles/Core:/software/modulefiles/Linux:/software/modulefiles/Core:/software/lmod/lmod/modulefiles/Core';
    os.environ['PATH'] = '/software/lmod/lmod/libexec:/home/inigo/.local/bin:/usr/lib64/qt-3.3/bin:/usr/NX/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/inigo/bin';
    os.environ['_LMFILES_'] = '/software/lmod/5.6/modulefiles/Core/lmod/5.6.lua';
    os.environ['_ModuleTable001_'] = 'X01vZHVsZVRhYmxlXz17WyJhY3RpdmVTaXplIl09MSxiYXNlTXBhdGhBPXsiL3NvZnR3YXJlL2xtb2QvNS42L21vZHVsZWZpbGVzL0NvcmUiLCIvc29mdHdhcmUvbW9kdWxlcy9hbGwiLCIvc29mdHdhcmUvbW9kdWxlZmlsZXMvTGludXgiLCIvc29mdHdhcmUvbW9kdWxlZmlsZXMvQ29yZSIsIi9zb2Z0d2FyZS9sbW9kL2xtb2QvbW9kdWxlZmlsZXMvQ29yZSIsfSxbImNfcmVidWlsZFRpbWUiXT1mYWxzZSxbImNfc2hvcnRUaW1lIl09ZmFsc2UsZmFtaWx5PXt9LGluYWN0aXZlPXt9LG1UPXtsbW9kPXtbIkZOIl09Ii9zb2Z0d2FyZS9sbW9kLzUuNi9tb2R1bGVmaWxlcy9Db3JlL2xtb2QvNS42Lmx1YSIsWyJkZWZhdWx0Il09MSxbImZ1bGxOYW1lIl09Imxtb2QvNS42IixbImxv';
    os.environ['_ModuleTable002_'] = 'YWRPcmRlciJdPTEscHJvcFQ9e30sWyJzaG9ydCJdPSJsbW9kIixbInN0YXR1cyJdPSJhY3RpdmUiLH0sfSxtcGF0aEE9eyIvc29mdHdhcmUvbW9kdWxlcy9hbGwiLCIvc29mdHdhcmUvbG1vZC81LjYvbW9kdWxlZmlsZXMvQ29yZSIsIi9zb2Z0d2FyZS9tb2R1bGVmaWxlcy9MaW51eCIsIi9zb2Z0d2FyZS9tb2R1bGVmaWxlcy9Db3JlIiwiL3NvZnR3YXJlL2xtb2QvbG1vZC9tb2R1bGVmaWxlcy9Db3JlIix9LFsic3lzdGVtQmFzZU1QQVRIIl09Ii9zb2Z0d2FyZS9tb2R1bGVmaWxlcy9MaW51eDovc29mdHdhcmUvbW9kdWxlZmlsZXMvQ29yZTovc29mdHdhcmUvbG1vZC9sbW9kL21vZHVsZWZpbGVzL0NvcmUiLFsidmVyc2lvbiJdPTIsfQ==';
    os.environ['_ModuleTable_Sz_'] = '2';
    false
    , stderr:
    Lmod Warning: The environment MODULEPATH has been changed in unexpected ways.
    Lmod is unable to use given MODULEPATH. It is using:
    "/software/lmod/5.6/modulefiles/Core:/software/modules/all:/software/modulefiles/Linux:/software/modulefiles/Core:/software/lmod/lmod/modulefiles/Core".
    Please use "module use ..." to change MODULEPATH instead.

    Due to MODULEPATH changes the following have been reloaded:
    1) lmod/5.6

    )