com.datasift.client.push.connectors

Class S3

java.lang.Object

com.datasift.client.push.connectors.BaseConnector<S3>

com.datasift.client.push.connectors.S3

All Implemented Interfaces:

PushConnector<S3>

public class S3
extends BaseConnector<S3>

Official docs

Author:

Courtney Robinson

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	S3.S3OutputFormat

Field Summary

Fields inherited from class com.datasift.client.push.connectors.BaseConnector

params, PREFIX, required

Constructor Summary

Constructors

Constructor and Description
S3()

Method Summary

Methods

Modifier and Type	Method and Description
S3	accessKey(String key)
S3	acl(String acl) The access level of the file after it is uploaded to S3: private (Owner-only read/write) public-read (Owner read/write, public read) public-read-write (Public read/write) authenticated-read (Owner read/write, authenticated read) bucket-owner-read (Bucket owner read) bucket-owner-full-control (Bucket owner full control) * @param acl
S3	bucket(String bucket)
S3	compression(String format)
S3	deliveryFrequency(int frequency) The minimum number of seconds you want DataSift to wait before sending data again: 0 (continuous delivery) 10 (10 seconds) 30 (30 seconds) 60 (1 minute) 300 (5 minutes) In reality, a stream might not have data available after the wait.
S3	directory(String directory) optionally set a directory within the configured bucked
S3	filePrefix(String prefix) An optional prefix to the filename.
S3	format(S3.S3OutputFormat format) Sets the output format for your data
S3	gzip()
S3	maxSize(int maxSize) The maximum amount of data that DataSift will send in a single batch: 102400 (100KB) 256000 (250KB) 512000 (500KB) 1048576 (1MB) 2097152 (2MB) 5242880 (5MB) 10485760 (10MB) 20971520 (20MB) 52428800 (50MB) 104857600 (100MB) 209715200 (200MB)
S3	secretKey(String secret)

Methods inherited from class com.datasift.client.push.connectors.BaseConnector

exists, fromMap, parameters, putAll, setParam, setup, type

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3

public S3()

Method Detail

format

public S3 format(S3.S3OutputFormat format)

Sets the output format for your data

Parameters:

format - one of the allowed S3 formats, defaults to json_meta

Returns:

this

accessKey

public S3 accessKey(String key)

Parameters:

key - The access key for the S3 account that DataSift will send to. Make sure that this value is properly encoded, otherwise your /push/create request will fail.

Returns:

this

secretKey

public S3 secretKey(String secret)

Parameters:

secret - The secret key for the S3 account that DataSift will send to. Make sure that this value is properly encoded, otherwise your /push/create request will fail.

Returns:

this

deliveryFrequency

public S3 deliveryFrequency(int frequency)

The minimum number of seconds you want DataSift to wait before sending data again: 0 (continuous delivery) 10 (10 seconds) 30 (30 seconds) 60 (1 minute) 300 (5 minutes) In reality, a stream might not have data available after the wait. Typically this happens in streams that have very tight filtering constraints, so the wait time might be longer than you specify. Amazon's S3 is capable of handling large amounts of incoming data, so we recommend you use continuous delivery.

Parameters:

frequency - an int representative of what is desribed above

Returns:

this

maxSize

public S3 maxSize(int maxSize)

The maximum amount of data that DataSift will send in a single batch: 102400 (100KB) 256000 (250KB) 512000 (500KB) 1048576 (1MB) 2097152 (2MB) 5242880 (5MB) 10485760 (10MB) 20971520 (20MB) 52428800 (50MB) 104857600 (100MB) 209715200 (200MB)

Parameters:

maxSize - max size as described

Returns:

this

bucket

public S3 bucket(String bucket)

Parameters:

bucket - The bucket within that account into which DataSift will deposit the file

Returns:

this

directory

public S3 directory(String directory)

optionally set a directory within the configured bucked

Returns:

this

filePrefix

public S3 filePrefix(String prefix)

An optional prefix to the filename. Each time DataSift delivers a file, it constructs a name in this format: file_prefix + subscription id + timestamp.json

Returns:

this

acl

public S3 acl(String acl)

The access level of the file after it is uploaded to S3: private (Owner-only read/write) public-read (Owner read/write, public read) public-read-write (Public read/write) authenticated-read (Owner read/write, authenticated read) bucket-owner-read (Bucket owner read) bucket-owner-full-control (Bucket owner full control) * @param acl

Returns:

this

gzip

public S3 gzip()

compression

public S3 compression(String format)