com.yahoo.bard.webservice.metadata

Class DataSourceMetadataService

java.lang.Object

com.yahoo.bard.webservice.metadata.DataSourceMetadataService

@Singleton
public class DataSourceMetadataService
extends Object

Defines a wrapper class around the container that holds the segment metadata of all the physical tables.

Constructor Summary

Constructors

Constructor and Description
DataSourceMetadataService() Creates a service to store segment metadata.

Method Summary

Modifier and Type	Method and Description
Map<String,SimplifiedIntervalList>	getAvailableIntervalsByDataSource(DataSourceName dataSourceName) Get a set of intervals available for each column in the data source.
Set<SortedMap<org.joda.time.DateTime,Map<String,SegmentInfo>>>	getSegments(Set<DataSourceName> dataSourceNames) Get all the segments associated with the given Set of data source names.
protected static Map<String,SimplifiedIntervalList>	groupIntervalByColumn(DataSourceMetadata metadata) Group interval in segment metadata by column.
protected static ConcurrentSkipListMap<org.joda.time.DateTime,Map<String,SegmentInfo>>	groupSegmentByTime(DataSourceMetadata metadata) Group segment metadata by date time.
protected static Collector<SegmentInfo,?,Map<String,SegmentInfo>>	partitionsToMapCollector() A collector to aggregate all partitions of a segment into a map.
void	update(DataSourceName dataSourceName, DataSourceMetadata metadata) Update the information with respect to the segment metadata of a particular data source.
void	update(PhysicalTable table, DataSourceMetadata metadata) Deprecated. Pass the DataSourceName directly, rather than via the PhysicalTable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataSourceMetadataService

public DataSourceMetadataService()

Creates a service to store segment metadata.

Method Detail

getSegments

public Set<SortedMap<org.joda.time.DateTime,Map<String,SegmentInfo>>> getSegments(Set<DataSourceName> dataSourceNames)

Get all the segments associated with the given Set of data source names.

Parameters:

dataSourceNames - A Set of physical data source names

Returns:

A set of segments associated with the given data sources

getAvailableIntervalsByDataSource

public Map<String,SimplifiedIntervalList> getAvailableIntervalsByDataSource(DataSourceName dataSourceName)

Get a set of intervals available for each column in the data source.

Parameters:

dataSourceName - The data source for which to get the availability by column

Returns:

a map of column name to a set of available intervals

update

@Deprecated
public void update(PhysicalTable table,
                               DataSourceMetadata metadata)

Deprecated. Pass the DataSourceName directly, rather than via the PhysicalTable

Update the information with respect to the segment metadata of a particular data source. This operation should be atomic per dataSourceName.

Parameters:

table - The physical table to which the metadata are referring to.

metadata - The updated datasource metadata.

update

public void update(DataSourceName dataSourceName,
                   DataSourceMetadata metadata)

Update the information with respect to the segment metadata of a particular data source. This operation update both segment mappings for the dataSourceName.

Parameters:

dataSourceName - The data source to which the metadata refer.

metadata - The updated datasource metadata.

partitionsToMapCollector

protected static Collector<SegmentInfo,?,Map<String,SegmentInfo>> partitionsToMapCollector()

A collector to aggregate all partitions of a segment into a map.

Returns:

The collector

groupSegmentByTime

protected static ConcurrentSkipListMap<org.joda.time.DateTime,Map<String,SegmentInfo>> groupSegmentByTime(DataSourceMetadata metadata)

Group segment metadata by date time.

Parameters:

metadata - Metadata containing the druid segments information

Returns:

map of column name to set of intervals

groupIntervalByColumn

protected static Map<String,SimplifiedIntervalList> groupIntervalByColumn(DataSourceMetadata metadata)

Group interval in segment metadata by column.

Parameters:

metadata - Metadata containing the druid segments information

Returns:

map of data time to a map of segment id to segment info