Metadata-Version: 1.1
Name: gridmap
Version: 0.10.3
Summary: Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).
Home-page: http://github.com/EducationalTestingService/gridmap
Author: Daniel Blanchard
Author-email: dblanchard@ets.org
License: GPL
Description: Grid Map
        -----------
        
        .. image:: https://pypip.in/d/gridmap/badge.png
           :target: https://crate.io/packages/gridmap
           :alt: PyPI downloads
        
        .. image:: https://pypip.in/v/gridmap/badge.png
           :target: https://crate.io/packages/gridmap
           :alt: Latest version on PyPI
        
        .. image:: https://d2weczhvl823v0.cloudfront.net/EducationalTestingService/gridmap/trend.png
           :alt: Bitdeli badge
           :target: https://bitdeli.com/free
        
        
        A module to allow you to easily create jobs on the cluster directly from Python.
        You can directly map Python functions onto the cluster without needing to write
        any wrapper code yourself.
        
        This is the ETS fork of an older project called Python Grid. It's a lot simpler
        than the original version, because we use a Redis database for storing the
        inputs/outputs for each job instead of the ZeroMQ-based method they were using.
        The main benefit of this approach is you never run into issues with exceeding
        the message length when you're parallelizing a huge job.
        
        For some examples of how to use it, check out ``map_reduce.py`` (for a simple
        example of how you can map a function onto the cluster) and ``manual.py`` (for
        an example of how you can create list of jobs yourself) in the examples folder.
        
        For complete documentation go
        `here <http://htmlpreview.github.io/?http://github.com/EducationalTestingService/gridmap/blob/master/doc/index.html>`__.
        
        *NOTE*: You cannot use Grid Map on a machine that is not allowed to submit jobs
        (e.g., slave nodes).
        
        Requirements
        ~~~~~~~~~~~~
        
        -  `redis-py <https://github.com/andymccurdy/redis-py>`__
        -  `drmaa-python <http://drmaa-python.github.io/>`__
        -  Python 2.6+
        
        Recommended
        ~~~~~~~~~~~
        
        -  `hiredis <https://pypi.python.org/pypi/hiredis>`__
        
        License
        ~~~~~~~
        
        -  GPLv3
        
        Changelog
        ~~~~~~~~~
        
        -  0.10.3
        
           + Fix issue where ``clean_path`` wasn't being called on the working
             directory, which was causing ETS-specific issues.
           + Add a couple workarounds for issues with setting environment variables in
             Python 3.
           + Made examples into unit tests and added first attempt at getting Travis
             setup with SGE.
        
        -  0.10.2
        
           + Working directory is now correctly set for each job.
           + Simplified handling of environment variables. Should now all be passed on
             properly.
        
        -  0.10.1
        
           + Can now import ``JobException`` directly from ``gridmap`` package instead
             of having to import from ``gridmap.job``.
        
        -  0.10.0
        
           + Now raise a ``JobException`` instead of an ``Exception`` when one of the
             jobs has crashed.
           + Fixed potential pip installation issue from importing package for version
             number.
        
        -  0.9.9
        
           + Changed way job results are retrieved to be a bit more efficient in cases
             of errors.
           + All job metadata is now retrieved before job output is, which should
             hopefully alleviate issues where we can't get the metadata because its been
             flushed too quickly by the grid engine.
        
        -  0.9.8
        
           + Fixed a bug where only the first error was still showing because of an
             extra exception caused by job_output being undefined.
           + Fixed unhandled Exception with error code 24 (since somehow that is not an
             InvalidJobException, but just an Exception in drmaa-python).
        
        -  0.9.7
        
           + No longer dies with InvalidJobException when failing to retrieve job
             metadata from DRMAA service.
           + Now print all exceptions encountered for jobs submitted instead of just
             exiting after first one.
           + Die via exception instead of sys.exit when there were problems with some of
             the submitted jobs.
        
        -  0.9.6
        
           + Fixed bug where jobs were being aborted before they ran.
        
        -  0.9.5
        
           + Fixed bug where ``GRID_MAP_USE_MEM_FREE`` would only be interpretted as true if
             spelled 'True'.
           + Added documentation describing how to override constants.
        
        -  0.9.4
        
           +  Added support for overriding the default queue and other constants via
              environment variables. For example, to change the default queue, just set
              the environment variable ``GRID_MAP_DEFAULT_QUEUE``.
           +  Substantially more information is given about crashing jobs when we fail
              to unpickle the results from the Redis database.
        
        -  0.9.3
        
           +  Fixed serious bug where gridmap could not be imported in some instances.
           +  Refactored things a bit so there is no longer one large module with all of
              the code in it. (Doesn't change package interface)
        
Keywords: drmaa sge cluster distributed parallel
Platform: UNKNOWN
Classifier: Intended Audience :: Science/Research
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
Classifier: Programming Language :: Python
Classifier: Topic :: Software Development
Classifier: Topic :: Scientific/Engineering
Classifier: Operating System :: POSIX
Classifier: Operating System :: Unix
Classifier: Operating System :: MacOS
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.3
