ds.granules.dataset

Interface StreamDataset

All Superinterfaces:

Dataset, ds.funnel.data.format.FormatMarshaller

All Known Implementing Classes:

DirectCommStreamDatasetImpl, FunnelStreamDatasetImpl

public interface StreamDataset
extends Dataset

The interface which augments the Dataset interface to support streaming capabilities.

Author:

Shrideep Pallickara

Nested Class Summary

Nested classes/interfaces inherited from interface ds.granules.dataset.Dataset

Dataset.DatasetType

Method Summary

Methods

Modifier and Type	Method and Description
int	addInputStream(ds.funnel.topic.Topic topic) Add an input stream to this dataset.
int	addInputStream(ds.funnel.topic.Topic topic, String instanceIdentifier) Add an input stream to the data set
int	addInputStreams(Collection<ds.funnel.topic.Topic> topics) Adds a set of input streams to this dataset.
int	addOutputStream(ds.funnel.topic.Topic topic) Add an output stream to this dataset.
int	addOutputStreams(Collection<ds.funnel.topic.Topic> topics) Adds a set of output streams to this dataset.
Collection<ds.funnel.topic.Topic>	getInputStreams() Retrieve a collection of the constituent input streams.
int	getNumberOfInputStreams() Retrieve the number of input streams in this dataset
int	getNumberOfOutputStreams() Retrieve the number of output streams in this dataset.
Collection<ds.funnel.topic.Topic>	getOutputStreams() Retrieve a collection of the constituent output streams.
ds.funnel.topic.TopicDataEvent	getStreamingData() Retrieves a portion of the streaming dataset when data is available.
boolean	hasInputStream(ds.funnel.topic.Topic topic) Check to see if this dataset has a specified input stream.
boolean	hasInputStreams() Check to see if this dataset has any registered input streams.
boolean	hasOutputStream(ds.funnel.topic.Topic topic) Check to see if this dataset has a specified output stream.
boolean	hasOutputStreams() Check to see if this dataset has any registered output streams.
int	removeInputStream(ds.funnel.topic.Topic topic) Removes an input stream from this dataset.
int	removeInputStreams(Collection<ds.funnel.topic.Topic> topics) Removes a set of input streams from this dataset.
int	removeOutputStream(ds.funnel.topic.Topic topic) Removes an output stream from this dataset.
int	removeOutputStreams(Collection<ds.funnel.topic.Topic> topics) Removes a set of output streams from this dataset.
void	setDatasetDescription(String description) Sets the dataset description
void	setDatasetIdentifier(String identifier) Sets the dataset identifier
void	unmarshall(ds.funnel.data.format.FormatReader reader)
void	writeStreamingData(ds.funnel.topic.Topic topic, byte[] payload) This method writes data to the output dataset.
void	writeStreamingData(ds.funnel.topic.TopicDataEvent mtdEvent) This method writes data to the output dataset.
void	writeStreamingDataAsBatch(ds.funnel.topic.Topic topic, StreamEvent event)

Methods inherited from interface ds.granules.dataset.Dataset

close, getDataAvailabilityNotifier, getDatasetIdentifier, getDatasetType, getDescription, getLastModificationTime, initializeDataset, isAvailable, isDataAvailable, isInitialized, supportsDataAvailabilityNotifications

Methods inherited from interface ds.funnel.data.format.FormatMarshaller

marshall

Method Detail

getStreamingData

ds.funnel.topic.TopicDataEvent getStreamingData()
                                                throws DatasetException

Retrieves a portion of the streaming dataset when data is available. This method will return a NULL if data is not available. In general, this method should be used in tandem with the DataAvailabilityNotifier.

Returns:

A fragment of the streaming dataset

Throws:

DatasetException - If there are problems performing the operation

writeStreamingData

void writeStreamingData(ds.funnel.topic.TopicDataEvent mtdEvent)
                        throws DatasetException

This method writes data to the output dataset. This method throws an exception if the Stream producers have not been configured appropriately.

Parameters:

mtdEvent - The stream fragment that needs to be written

Throws:

DatasetException - If there are problems performing the operation

writeStreamingData

void writeStreamingData(ds.funnel.topic.Topic topic,
                      byte[] payload)
                        throws DatasetException

This method writes data to the output dataset. This method throws an exception if the Stream producers have not been configured appropriately.

Parameters:

topic - The stream being written to

payload - The payload for the individual stream fragments

Throws:

DatasetException - If there are problems performing the operation

writeStreamingDataAsBatch

void writeStreamingDataAsBatch(ds.funnel.topic.Topic topic,
                             StreamEvent event)
                               throws DatasetException

Throws:

DatasetException

addInputStream

int addInputStream(ds.funnel.topic.Topic topic)
                   throws DatasetException

Add an input stream to this dataset.

Parameters:

topic - The topic of the stream to be added

Returns:

The total number of input streams in this dataset

Throws:

DatasetException - If there are problems adding this stream to the set of managed streams

addInputStream

int addInputStream(ds.funnel.topic.Topic topic,
                 String instanceIdentifier)
                   throws DatasetException

Add an input stream to the data set

Parameters:

topic - Topic of the data stream to be added.

instanceIdentifier - Instance identifier of the operation base

Returns:

The total number of input streams.

Throws:

DatasetException - If there are problems adding this stream to the set of managed streams

removeInputStream

int removeInputStream(ds.funnel.topic.Topic topic)
                      throws DatasetException

Removes an input stream from this dataset.

Parameters:

topic - The topic of the stream to be removed

Returns:

The total number of input streams that remain in this dataset

Throws:

DatasetException - If there are problems removing this stream from the set of managed streams

addInputStreams

int addInputStreams(Collection<ds.funnel.topic.Topic> topics)
                    throws DatasetException

Adds a set of input streams to this dataset.

Parameters:

topics - A collection of streams to be added

Returns:

The total number of input streams in this dataset

Throws:

DatasetException - If there are problems adding these streams to the set of managed streams

NullPointerException - If the specified set of streams is NULL.

removeInputStreams

int removeInputStreams(Collection<ds.funnel.topic.Topic> topics)
                       throws DatasetException

Removes a set of input streams from this dataset.

Parameters:

topics - A collection of streams to be removed

Returns:

The total number of input streams in this dataset

Throws:

DatasetException - If there are problems removing these streams to the set of managed streams

NullPointerException - If the specified set of streams is NULL.

hasInputStreams

boolean hasInputStreams()

Check to see if this dataset has any registered input streams.

Returns:

true if this dataset has any registered input streams;false otherwise.

hasInputStream

boolean hasInputStream(ds.funnel.topic.Topic topic)

Check to see if this dataset has a specified input stream.

Returns:

true if this dataset has the specified input stream;false otherwise.

getNumberOfInputStreams

int getNumberOfInputStreams()

Retrieve the number of input streams in this dataset

Returns:

The number of input streams in this dataset

getInputStreams

Collection<ds.funnel.topic.Topic> getInputStreams()

Retrieve a collection of the constituent input streams.

Returns:

The collection of the constituent input streams.

addOutputStream

int addOutputStream(ds.funnel.topic.Topic topic)
                    throws DatasetException

Add an output stream to this dataset.

Parameters:

topic - The topic of the stream to be added

Returns:

The total number of output streams in this dataset

Throws:

DatasetException - If there are problems adding this stream to the set of managed streams

removeOutputStream

int removeOutputStream(ds.funnel.topic.Topic topic)
                       throws DatasetException

Removes an output stream from this dataset.

Parameters:

topic - The topic of the stream to be removed

Returns:

The total number of output streams that remain in this dataset

Throws:

DatasetException - If there are problems removing this stream from the set of managed streams

addOutputStreams

int addOutputStreams(Collection<ds.funnel.topic.Topic> topics)
                     throws DatasetException

Adds a set of output streams to this dataset.

Parameters:

topics - A collection of streams to be added

Returns:

The total number of output streams in this dataset

Throws:

DatasetException - If there are problems adding these streams to the set of managed streams

NullPointerException - If the specified set of streams is NULL.

removeOutputStreams

int removeOutputStreams(Collection<ds.funnel.topic.Topic> topics)
                        throws DatasetException

Removes a set of output streams from this dataset.

Parameters:

topics - A collection of streams to be removed

Returns:

The total number of output streams in this dataset

Throws:

DatasetException - If there are problems removing these streams from the set of managed streams

NullPointerException - If the specified set of streams is NULL.

hasOutputStreams

boolean hasOutputStreams()

Check to see if this dataset has any registered output streams.

Returns:

true if this dataset has any registered output streams;false otherwise.

hasOutputStream

boolean hasOutputStream(ds.funnel.topic.Topic topic)

Check to see if this dataset has a specified output stream.

Returns:

true if this dataset has the specified output stream;false otherwise.

getNumberOfOutputStreams

int getNumberOfOutputStreams()

Retrieve the number of output streams in this dataset.

Returns:

The number of output streams in this dataset.

getOutputStreams

Collection<ds.funnel.topic.Topic> getOutputStreams()

Retrieve a collection of the constituent output streams.

Returns:

The collection of the constituent output streams.

setDatasetDescription

void setDatasetDescription(String description)

Sets the dataset description

Parameters:

description - Description

setDatasetIdentifier

void setDatasetIdentifier(String identifier)

Sets the dataset identifier

Parameters:

identifier - identifier

unmarshall

void unmarshall(ds.funnel.data.format.FormatReader reader)
                throws ds.funnel.data.format.FormatException

Throws:

ds.funnel.data.format.FormatException