TestProgs.util

Class BeehiveAppLoader

java.lang.Object

TestProgs.util.BeehiveAppLoader

public abstract class BeehiveAppLoader
extends Object

This class is responsible for connecting this Beehive server to the validator, constructing its LocalWorkpoolServer, and loading its nodes into its StorageSystem. How each node loads its nodes into its StorageSystem is dependent on the FileLoader configuration:

• With a Distributed loader the master server is responsible for assigning each node to one of the servers in the cluster. Once that is done, the master server issues a call on the remote server to load its assigned nodes.
• With a Parallel loader, each server in the cluster reads the same file, but only loads a subset of the nodes present in the file. Each server is responsible for determining whether each node should be stored on its own StorageSystem
• With a Bucketized loader, the overall file should be initially be bucketized into individual files, one for each server in the cluster, by the user prior to starting the Application. Each server is then responsible for reading one of the files; no file can be read by more than one server.

If a server is assigned the role of the master, it is responsible for ensuring that each server in the cluster is fully loaded and started before the Application can start.

Once Application has fully initialized, it is then responsible for creating its Workers and starting them

Constructor Summary

Constructors

Constructor and Description
BeehiveAppLoader()

Method Summary

Modifier and Type	Method and Description
Vector<String>	createHostList(String myHostname) Constructs a list of the hostnames of its peers in the cluster.
StorageSystem	getDataStorage()
String	getHostlistFile()
String	getLocation()
int	getMyId()
int	getNumNodes()
int	getNumThreads()
LocalWorkpoolImpl	getWorkpool()
void	init(String[] args, String classname, HashMap<Byte,String> nodeClassNameMap, HashMap<Byte,Class> nodeClassMap) This is run on each Beehive server in the cluster.
boolean	isMaster()
boolean	isRecordStats()
boolean	isUseCaching()
boolean	isUseNodeData()
boolean	isWriteThroughCache()
abstract void	loadGraphData(String input_file, HashtableServer server, int numNodes, StorageSystem dataStorage) Each Application is responsible for defining how it is to load its graph file into the Beehive System.
void	printToResultFile(String[] args, int numThreads, String classname)
void	readConfigParams(Config configParams)
void	setDataStorage(StorageSystem dataStorage)
void	setHostlistFile(String hostlistFile)
void	setLocation(String location)
void	setMaster(boolean master)
void	setMyId(int myId)
void	setNumNodes(int numNodes)
void	setNumThreads(int numThreads)
void	setRecordStats(boolean recordStats)
void	setUseCaching(boolean useCaching)
void	setUseNodeData(boolean useNodeData)
void	setWorkpool(LocalWorkpoolImpl workpool)
void	setWriteThroughCache(boolean writeThroughCache)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeehiveAppLoader

public BeehiveAppLoader()

Method Detail

init

public void init(String[] args,
                 String classname,
                 HashMap<Byte,String> nodeClassNameMap,
                 HashMap<Byte,Class> nodeClassMap)
          throws Exception

This is run on each Beehive server in the cluster.

Parameters:

args - Arguments provided at runtime. Includes the following in the corresponding order:

1. A file containing the hostnames of all of the Beehive Servers in the given cluster
2. The configuration file
3. The hostname of the server running the ValidationService
4. The file containing the graph that is to be loaded
5. The number of nodes in the graph that is to be loaded
6. A file to which the results of the Application will be written to

classname - The name of the Application that is being run

nodeClassNameMap - A mapping from a unique byte identifier to the name of each subclass of Node, including Node itself, that is to be used in the Application.

nodeClassMap - A mapping from a unique byte identifier to the Class object of each subclass of Node, including Node itself, that is to be used in the Application. It is not required that the byte identifier be identical to that in classname.

Throws:

Exception - Thrown if the application could not connect to the cluster and/or validator

loadGraphData

public abstract void loadGraphData(String input_file,
                                   HashtableServer server,
                                   int numNodes,
                                   StorageSystem dataStorage)

Each Application is responsible for defining how it is to load its graph file into the Beehive System.

Parameters:

input_file - The file containing the graph that is to be loaded at this particular Beehive server

server - The local HashtableServer to this Beehive server

numNodes - The total number of nodes in the input_file

dataStorage - The local StorageSystem to this Beehive server

createHostList

public Vector<String> createHostList(String myHostname)

Constructs a list of the hostnames of its peers in the cluster.

Parameters:

myHostname - This server's hostname so that it can be excluded from the list of peer hostnames

Returns:

The hostnames of its peers in the cluster.

printToResultFile

public void printToResultFile(String[] args,
                              int numThreads,
                              String classname)
                       throws Exception

Throws:

Exception

readConfigParams

public void readConfigParams(Config configParams)

isUseCaching

public boolean isUseCaching()

setUseCaching

public void setUseCaching(boolean useCaching)

isRecordStats

public boolean isRecordStats()

setRecordStats

public void setRecordStats(boolean recordStats)

isWriteThroughCache

public boolean isWriteThroughCache()

setWriteThroughCache

public void setWriteThroughCache(boolean writeThroughCache)

getMyId

public int getMyId()

setMyId

public void setMyId(int myId)

getHostlistFile

public String getHostlistFile()

setHostlistFile

public void setHostlistFile(String hostlistFile)

getWorkpool

public LocalWorkpoolImpl getWorkpool()

setWorkpool

public void setWorkpool(LocalWorkpoolImpl workpool)

getDataStorage

public StorageSystem getDataStorage()

setDataStorage

public void setDataStorage(StorageSystem dataStorage)

getLocation

public String getLocation()

setLocation

public void setLocation(String location)

getNumNodes

public int getNumNodes()

setNumNodes

public void setNumNodes(int numNodes)

isUseNodeData

public boolean isUseNodeData()

setUseNodeData

public void setUseNodeData(boolean useNodeData)

isMaster

public boolean isMaster()

setMaster

public void setMaster(boolean master)

getNumThreads

public int getNumThreads()

setNumThreads

public void setNumThreads(int numThreads)