io.cdap.plugin.cloudsql.postgres

Class CloudSQLPostgreSQLSource

java.lang.Object

io.cdap.cdap.etl.api.batch.BatchConfigurable<io.cdap.cdap.etl.api.batch.BatchSourceContext>

io.cdap.cdap.etl.api.batch.BatchSource<KEY_IN,VAL_IN,OUT>

io.cdap.plugin.common.ReferenceBatchSource<org.apache.hadoop.io.LongWritable,DBRecord,io.cdap.cdap.api.data.format.StructuredRecord>

io.cdap.plugin.db.source.AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

io.cdap.plugin.cloudsql.postgres.CloudSQLPostgreSQLSource

All Implemented Interfaces:

io.cdap.cdap.etl.api.Destroyable, io.cdap.cdap.etl.api.PipelineConfigurable, io.cdap.cdap.etl.api.StageLifecycle<io.cdap.cdap.etl.api.batch.BatchRuntimeContext>, io.cdap.cdap.etl.api.SubmitterLifecycle<io.cdap.cdap.etl.api.batch.BatchSourceContext>, io.cdap.cdap.etl.api.Transformation<io.cdap.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.LongWritable,DBRecord>,io.cdap.cdap.api.data.format.StructuredRecord>

public class CloudSQLPostgreSQLSource
extends AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

Batch source to read from a CloudSQL PostgreSQL instance database.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig CloudSQL PostgreSQL source config.

Nested classes/interfaces inherited from class io.cdap.plugin.db.source.AbstractDBSource

AbstractDBSource.DBSourceConfig, AbstractDBSource.GetSchemaRequest

Field Summary

Fields inherited from class io.cdap.plugin.db.source.AbstractDBSource

driverClass, sourceConfig

Fields inherited from class io.cdap.cdap.etl.api.batch.BatchSource

FORMAT_PLUGIN_TYPE, PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
CloudSQLPostgreSQLSource(CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig cloudsqlPostgresqlSourceConfig)

Method Summary

Modifier and Type	Method and Description
void	configurePipeline(io.cdap.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
protected String	createConnectionString()
protected Class<? extends org.apache.hadoop.mapreduce.lib.db.DBWritable>	getDBRecordType()
protected String	getErrorDetailsProviderClassName()
protected String	getExternalDocumentationLink()
protected LineageRecorder	getLineageRecorder(io.cdap.cdap.etl.api.batch.BatchSourceContext context)
protected SchemaReader	getSchemaReader()

Methods inherited from class io.cdap.plugin.db.source.AbstractDBSource

destroy, getConnectionConfigAccessor, getSchema, getSchema, initialize, prepareRun, transform

Methods inherited from class io.cdap.plugin.common.ReferenceBatchSource

recordLineage

Methods inherited from class io.cdap.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CloudSQLPostgreSQLSource

public CloudSQLPostgreSQLSource(CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig cloudsqlPostgresqlSourceConfig)

Method Detail

configurePipeline

public void configurePipeline(io.cdap.cdap.etl.api.PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface io.cdap.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

getSchemaReader

protected SchemaReader getSchemaReader()

Overrides:

getSchemaReader in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

getDBRecordType

protected Class<? extends org.apache.hadoop.mapreduce.lib.db.DBWritable> getDBRecordType()

Overrides:

getDBRecordType in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

getExternalDocumentationLink

protected String getExternalDocumentationLink()

Overrides:

getExternalDocumentationLink in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

getErrorDetailsProviderClassName

protected String getErrorDetailsProviderClassName()

Overrides:

getErrorDetailsProviderClassName in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

createConnectionString

protected String createConnectionString()

Specified by:

createConnectionString in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>

getLineageRecorder

protected LineageRecorder getLineageRecorder(io.cdap.cdap.etl.api.batch.BatchSourceContext context)

Overrides:

getLineageRecorder in class AbstractDBSource<CloudSQLPostgreSQLSource.CloudSQLPostgreSQLSourceConfig>