public class IterativeDeployer extends InstanceDeployer
Constructor and Description |
---|
IterativeDeployer(java.util.Properties streamingProperties)
Initializes the deployer.
|
Modifier and Type | Method and Description |
---|---|
StageTwo[] |
initializeStageTwos(StageOne stageOne,
StageThree stageThree,
int numOfStageTwos,
java.lang.String filenameBase,
int numOfFiles)
Initialize a set of
StageTwo s. |
static void |
main(java.lang.String[] args) |
void |
prepareInstancesAndDeploy(int numOfStageTwos,
java.lang.String filenameBase,
int numOfFiles)
Prepares and deploys an iterative pipeline comprising one
StageOne and StageThree instances, and the
specified number of StageTwo s. |
completedExecution, completedSuccessfully, completedWithErrors, createJobIdentifier, deployOperations, deployOperations, deployOperations, getStatus, initialize, initialize, initialize, killJob, refreshStatus, refreshStatus, resetTrackers, setStartTime, startedExecution
public IterativeDeployer(java.util.Properties streamingProperties) throws CommunicationsException, java.io.IOException, MarshallingException, DeploymentException
streamingProperties
- The properties for streamingCommunicationsException
- If there are network problems during communicationsjava.io.IOException
- If there are IO problemsMarshallingException
- If there are marshalling errosDeploymentException
- If there are deployment related problemspublic StageTwo[] initializeStageTwos(StageOne stageOne, StageThree stageThree, int numOfStageTwos, java.lang.String filenameBase, int numOfFiles) throws DatasetException, MapReduceException
StageTwo
s. Each of the
StageTwo
instances have inputs from StageOne
and send their outputs to the StageThree
instance.stageOne
- The StageOne
instancestageThree
- The StageThree
instancenumOfStageTwos
- The number of StageTwo
s that need to be
initialized.filenameBase
- The directory in which the files are stored.numOfFiles
- The total number of files that need to be processedDatasetException
- If there are problems initializing/using the datasetsMapReduceException
- If there are problems related to Map/Reduce roles within the
application.public void prepareInstancesAndDeploy(int numOfStageTwos, java.lang.String filenameBase, int numOfFiles) throws MapReduceException, CommunicationsException, DeploymentException, MarshallingException, DatasetException, java.lang.InterruptedException
StageOne
and StageThree
instances, and the
specified number of StageTwo
s.numOfStageTwos
- The number of StageTwo
s that need to be
initialized.filenameBase
- The directory in which the files are stored.numOfFiles
- The total number of files that need to be processedDatasetException
- If there are problems initializing the datasetsMapReduceException
- If there is a MapReduceExcecution because of problems when
setting up the roles.java.io.IOException
- If there are IO problems.CommunicationsException
- If there are network problems during communicationsDeploymentException
- If there are deployment related problemsMarshallingException
- If there are marshalling problems.java.lang.InterruptedException
- If there are problems sleepingpublic static void main(java.lang.String[] args)
args
-