ds.granules.streaming.core

Class Job

java.lang.Object

ds.granules.streaming.core.Job

public class Job
extends Object

Represents a streaming job. Several stream sources and stream processing elements are wired together through a job to form a stream processing topology. Users can instantiate elements in a stream processing topology link them via streams, define grouping techniques for streams through this class.

Author:

: Thilina Buddhika

Constructor Summary

Constructors

Constructor and Description
Job(String jobId) Initialize a new Job.

Method Summary

Methods

Modifier and Type	Method and Description
void	addLink(String sourceElem, String destElem, String streamId, int partitioningScheme) Adds a link connecting two stream processors/sources.
void	addStreamProcessor(String name, Class processorClass, int parallelism) Adds a new stream processing element to the job.
void	addStreamSource(String name, Class sourceClass, int parallelism) Adds a new stream source to the job.
void	deploy() Deploy the current job in the Granules runtime.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Job

public Job(String jobId)

Initialize a new Job.

Parameters:

jobId - Identifier for the job which should be unique for a given Granules runtime.

Method Detail

addStreamSource

public void addStreamSource(String name,
                   Class sourceClass,
                   int parallelism)
                     throws StreamingGraphConfigurationException

Adds a new stream source to the job.

Parameters:

name - Identifier of the stream source.

sourceClass - Class object of the Stream Source implementation.

parallelism - Number of instances

Throws:

StreamingGraphConfigurationException - In case of duplicate identifier.

addStreamProcessor

public void addStreamProcessor(String name,
                      Class processorClass,
                      int parallelism)
                        throws StreamingGraphConfigurationException

Adds a new stream processing element to the job.

Parameters:

name - Identifier of the processing element.

processorClass - Class object of the stream Processor implementation.

parallelism - Number of instances to run

Throws:

StreamingGraphConfigurationException - In case of duplicate identifier

addLink

public void addLink(String sourceElem,
           String destElem,
           String streamId,
           int partitioningScheme)
             throws StreamingGraphConfigurationException

Adds a link connecting two stream processors/sources.

Parameters:

sourceElem - Source element which can be either a StreamSource or a StreamProcessor

destElem - Destination element which should be a StreamProcessor.

Throws:

StreamingGraphConfigurationException - Configuration error in the streaming graph

deploy

public void deploy()
            throws StreamingGraphConfigurationException

Deploy the current job in the Granules runtime. Granules runtime should be up and running when this method is invoked.

Throws:

StreamingGraphConfigurationException - Error the definition of the streaming graph.