com.yahoo.bard.webservice.util

Class FilterTokenizer

java.lang.Object

com.yahoo.bard.webservice.util.FilterTokenizer

public class FilterTokenizer
extends Object

Utility class to tokenize Strings based on CSV properties.

Constructor Summary

Constructors

Constructor and Description
FilterTokenizer()

Method Summary

Modifier and Type	Method and Description
protected static com.fasterxml.jackson.databind.ObjectReader	init(com.fasterxml.jackson.dataformat.csv.CsvSchema filterCsvSchema) Initialize the tokenizer.
protected static com.fasterxml.jackson.databind.ObjectReader	initDefault() Initialize an ObjectReader.
protected static com.fasterxml.jackson.databind.ObjectReader	initRaw() Initialize an ObjectReader that does not quote things.
static List<String>	split(String input) Split a string into tokens based on CSV rules.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FilterTokenizer

public FilterTokenizer()

Method Detail

initDefault

protected static com.fasterxml.jackson.databind.ObjectReader initDefault()

Initialize an ObjectReader.

Returns:

an initialized ObjectReader

initRaw

protected static com.fasterxml.jackson.databind.ObjectReader initRaw()

Initialize an ObjectReader that does not quote things.

Returns:

an initialized ObjectReader

init

protected static com.fasterxml.jackson.databind.ObjectReader init(com.fasterxml.jackson.dataformat.csv.CsvSchema filterCsvSchema)

Initialize the tokenizer.

Parameters:

filterCsvSchema - Schema to initialize the tokenizer for

Returns:

an initialized ObjectReader

split

public static List<String> split(String input)
                          throws IllegalArgumentException

Split a string into tokens based on CSV rules. The CSV parsing defined here uses comma as a delimeter, double quotes for escaping characters, including comma and double quote itself, and does not use a special character for escaping (such as '\'). If double quotes need to be escaped inside the field, then the whole field needs to be double quoted (see Examples below).

Examples: Foo, Bar corresponds to ["Foo", "Bar"] "Foo, Bar and Baz",Qux corresponds to ["Foo, Bar and Baz", "Qux"] Foo,"2'10""" corresponds to ["Foo", "2'10\""] Foo,,Bar is invalid. Empty string was not quoted

Parameters:

input - the string to split

Returns:

list of tokens. The size of this list is fixed.

Throws:

IllegalArgumentException - if the input has empty items