LocalCluster module

Cluster implementation for the local machine.

class LocalCluster.LocalCluster(configfile)

Bases: cloudflow.cluster.Cluster.Cluster

Implementation of the Cluster interface for the local machine.

platform

This will always be ‘Local’ for this implementation.

Type

str

nodeType

The uname operating system for this machine.

Type

str

nodeCount

Number of instances in this cluster.

Type

int

PPN

Number of processors (physical cores) per node.

Type

int

daskscheduler

a reference to the Dask scheduler process started on the cluster

Type

Popen

daskworker

a reference to the Dask worker process started on the cluster

Type

Popen

getCoresPN()

Get the number of cores per node in this cluster. Assumes a heterogenous cluster.

getHosts()

Get the list of hosts in this cluster.

getHostsCSV()

Get a comma separated list of hosts in this cluster.

getState()

Get the cluster state.

parseConfig(cfDict)

Parse the cluster configuration. This might contain parameters that are required by specific cloud providers.

Parameters

cfDict (dict) – Dictionary containing this cluster parameterized settings.

readConfig(configfile)

Read the cluster configuration.

setState(state)

Set the cluster state.

start()

Start the cluster.

terminate()

Terminate the cluster.