org.apache.phoenix.pig

Class PhoenixHBaseStorage

java.lang.Object

org.apache.phoenix.pig.PhoenixHBaseStorage

All Implemented Interfaces:

org.apache.pig.StoreFuncInterface

public class PhoenixHBaseStorage
extends Object
implements org.apache.pig.StoreFuncInterface

StoreFunc that uses Phoenix to store data into HBase. Example usage: A = load 'testdata' as (a:chararray, b:chararray, c:chararray, d:chararray, e: datetime); STORE A into 'hbase://CORE.ENTITY_HISTORY' using org.apache.bdaas.PhoenixHBaseStorage('localhost','-batchSize 5000'); The above reads a file 'testdata' and writes the elements to HBase. First argument to this StoreFunc is the server, the 2nd argument is the batch size for upserts via Phoenix. Alternative usage: A = load 'testdata' as (a:chararray, b:chararray, e: datetime); STORE A into 'hbase://CORE.ENTITY_HISTORY/ID,F.B,F.E' using org.apache.bdaas.PhoenixHBaseStorage('localhost','-batchSize 5000'); The above reads a file 'testdata' and writes the elements ID, F.B, and F.E to HBase. In this example, ID is the row key, and F is the column family for the data elements. First argument to this StoreFunc is the server, the 2nd argument is the batch size for upserts via Phoenix. In this case, less than the full table row is required. For configuration message, look in the info log file. Note that Pig types must be in sync with the target Phoenix data types. This StoreFunc tries best to cast based on input Pig types and target Phoenix data types, but it is recommended to supply appropriate schema.

Constructor Summary

Constructors

Constructor and Description
PhoenixHBaseStorage(String server)
PhoenixHBaseStorage(String server, String optString)

Method Summary

Modifier and Type	Method and Description
void	checkSchema(org.apache.pig.ResourceSchema s)
void	cleanupOnFailure(String location, org.apache.hadoop.mapreduce.Job job)
void	cleanupOnSuccess(String location, org.apache.hadoop.mapreduce.Job job)
org.apache.hadoop.mapreduce.OutputFormat	getOutputFormat()
void	prepareToWrite(org.apache.hadoop.mapreduce.RecordWriter writer)
void	putNext(org.apache.pig.data.Tuple t)
String	relToAbsPathForStoreLocation(String location, org.apache.hadoop.fs.Path curDir)
void	setStoreFuncUDFContextSignature(String signature)
void	setStoreLocation(String location, org.apache.hadoop.mapreduce.Job job) Parse the HBase table name and configure job

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PhoenixHBaseStorage

public PhoenixHBaseStorage(String server)
                    throws org.apache.commons.cli.ParseException

Throws:

org.apache.commons.cli.ParseException

PhoenixHBaseStorage

public PhoenixHBaseStorage(String server,
                           String optString)
                    throws org.apache.commons.cli.ParseException

Throws:

org.apache.commons.cli.ParseException

Method Detail

setStoreLocation

public void setStoreLocation(String location,
                             org.apache.hadoop.mapreduce.Job job)
                      throws IOException

Parse the HBase table name and configure job

Specified by:

setStoreLocation in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

prepareToWrite

public void prepareToWrite(org.apache.hadoop.mapreduce.RecordWriter writer)
                    throws IOException

Specified by:

prepareToWrite in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

putNext

public void putNext(org.apache.pig.data.Tuple t)
             throws IOException

Specified by:

putNext in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

setStoreFuncUDFContextSignature

public void setStoreFuncUDFContextSignature(String signature)

Specified by:

setStoreFuncUDFContextSignature in interface org.apache.pig.StoreFuncInterface

cleanupOnFailure

public void cleanupOnFailure(String location,
                             org.apache.hadoop.mapreduce.Job job)
                      throws IOException

Specified by:

cleanupOnFailure in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

cleanupOnSuccess

public void cleanupOnSuccess(String location,
                             org.apache.hadoop.mapreduce.Job job)
                      throws IOException

Specified by:

cleanupOnSuccess in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

relToAbsPathForStoreLocation

public String relToAbsPathForStoreLocation(String location,
                                           org.apache.hadoop.fs.Path curDir)
                                    throws IOException

Specified by:

relToAbsPathForStoreLocation in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

getOutputFormat

public org.apache.hadoop.mapreduce.OutputFormat getOutputFormat()
                                                         throws IOException

Specified by:

getOutputFormat in interface org.apache.pig.StoreFuncInterface

Throws:

IOException

checkSchema

public void checkSchema(org.apache.pig.ResourceSchema s)
                 throws IOException

Specified by:

checkSchema in interface org.apache.pig.StoreFuncInterface

Throws:

IOException