Package starcluster :: Package plugins :: Module hadoop :: Class Hadoop

Class Hadoop

Configures Hadoop using Cloudera packages on StarCluster

Instance Methods

__init__(self, hadoop_tmpdir='/mnt/hadoop')
x.__init__(...) initializes x; see x.__class__.__doc__ for signature source code

_get_java_home(self, node)

source code

_get_alternatives_cmd(self, node)

source code

_setup_hadoop_user(self, node, user)

source code

_install_empty_conf(self, node)

source code

_configure_env(self, node)

source code

_configure_mapreduce_site(self, node, cfg)

source code

_configure_core(self, node, cfg)

source code

_configure_hdfs_site(self, node, cfg)

source code

_configure_masters(self, node, master)

source code

_configure_slaves(self, node, node_aliases)

source code

_setup_hdfs(self, node, user)

source code

_setup_dumbo(self, node)

source code

_configure_hadoop(self, master, nodes, user)

source code

_setup_hadoop_dir(self, node, path, user, group, permission='775') source code

_start_datanode(self, node)

source code

_start_tasktracker(self, node)

source code

_start_hadoop(self, master, nodes)

source code

_open_ports(self, master)

source code

run(self, nodes, master, user, user_shell, volumes)
Run this plugin's setup routines

source code

Inherited from clustersetup.ClusterSetup: on_add_node, on_remove_node, on_restart, on_shutdown

Inherited from object: __delattr__, __format__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __sizeof__, __str__, __subclasshook__

Properties

[hide private]

pool

Inherited from object: __class__

Method Details

[hide private]

init(self, hadoop_tmpdir=`'/mnt/hadoop'`)
(Constructor)

source code

x.__init__(...) initializes x; see x.__class__.__doc__ for signature

Overrides: object.__init__: (inherited documentation)

run(self, nodes, master, user, user_shell, volumes)

source code

Run this plugin's setup routines

This method gets executed after the default cluster setup routines have been performed

Overrides: clustersetup.ClusterSetup.run: (inherited documentation)

Property Details

[hide private]

pool

Get Method:: unreachable.pool(self)

Class Hadoop

__init__(self, hadoop_tmpdir='/mnt/hadoop') (Constructor)

run(self, nodes, master, user, user_shell, volumes)

pool

init(self, hadoop_tmpdir=`'/mnt/hadoop'`)
(Constructor)