com.ebay.lightning.core.workers

Class SocketBasedHTTPWorker

java.lang.Object

com.ebay.lightning.core.workers.SocketBasedHTTPWorker

All Implemented Interfaces:

Worker

public class SocketBasedHTTPWorker
extends java.lang.Object
implements Worker

SocketBasedHTTPWorker is a java nio based implementation of Worker for URL execution. The class rely on the single Selector to read from multiple channels to execute parallel URL tasks asynchronously at high speed. This Worker uses the InetSocketAddressCache to speed up the connection phase. The read process only reads the data required instead of the full response there by saving considerable execution time. The list of URL tasks are executed in batches and the metrics are aggregated batch wise and for the full task list. The result is stored in ExecutionDataStore for audit purpose. The class also has retry mechanism to execute failed URL tasks again with higher timeout values.

Author:

shashukla

See Also:

InetSocketAddressCache, ExecutionDataStore

Constructor Summary

Constructors

Constructor and Description
SocketBasedHTTPWorker(InetSocketAddressCache inetCache, ExecutionDataStore store, SystemConfig systemConfig) Initialized the SocketBasedHTTPWorker with the required parameters.
SocketBasedHTTPWorker(InetSocketAddressCache inetCache, ExecutionDataStore store, SystemConfig systemConfig, RequestConfig requestConfig) Initialized the SocketBasedHTTPWorker with the required parameters.

Method Summary

Modifier and Type	Method and Description
LightningCoreConstants.WorkerState	execute(java.lang.String sessionId) Execute the list of tasks for the request.
int	getConnectAccuracyPercent() Get the minimum threshold for successful connect to total request percent.
LightningCoreConstants.WorkerState	getCurrentState() Get the state of the Worker.
int	getReadAccuracyPercent() Get the minimum threshold for successful read to connect percentage
int	getSlowUrlsConnectTimeoutMillis() Get the connection timeout for failed URL tasks.
int	getSlowUrlsReadWriteTimeoutMillis() Get the read/write timeout for failed URL tasks.
RequestConfig	getTaskConfig() Get the configuration for the current tasks.
void	setConnectAccuracyPercent(int connectAccuracyPercent) Set the minimum threshold for successful connect to total request percent.
void	setReadAccuracyPercent(int readAccuracyPercent) Set the minimum threshold for successful read to connect percentage
void	setRequestConfig(RequestConfig taskConfig) Set the configuration for the current tasks.
void	setSlowUrlsConnectTimeoutMillis(int slowUrlsConnectTimeoutMillis) Set the connection timeout for failed URL tasks.
void	setSlowUrlsReadWriteTimeoutMillis(int slowUrlsReadWriteTimeoutMillis) Set the read/write timeout for failed URL tasks.
void	startWorker() Deprecated.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SocketBasedHTTPWorker

public SocketBasedHTTPWorker(InetSocketAddressCache inetCache,
                             ExecutionDataStore store,
                             SystemConfig systemConfig)

Initialized the SocketBasedHTTPWorker with the required parameters.

Parameters:

inetCache - the InetSocketAddressCache to speed the connection phase

store - to store the results of the execution

systemConfig - configuration related to cache, retention policy, audit etc

SocketBasedHTTPWorker

public SocketBasedHTTPWorker(InetSocketAddressCache inetCache,
                             ExecutionDataStore store,
                             SystemConfig systemConfig,
                             RequestConfig requestConfig)

Initialized the SocketBasedHTTPWorker with the required parameters.

Parameters:

inetCache - the InetSocketAddressCache to speed the connection phase

store - to store the results of the execution

systemConfig - configuration related to cache, retention policy, audit etc

requestConfig - configuration for URL task like timeout, proxy host etc

Method Detail

getSlowUrlsConnectTimeoutMillis

public int getSlowUrlsConnectTimeoutMillis()

Get the connection timeout for failed URL tasks.

Returns:

the connection timeout for failed URL tasks

setSlowUrlsConnectTimeoutMillis

public void setSlowUrlsConnectTimeoutMillis(int slowUrlsConnectTimeoutMillis)

Set the connection timeout for failed URL tasks.

Parameters:

slowUrlsConnectTimeoutMillis - the connection timeout for failed URL tasks

getSlowUrlsReadWriteTimeoutMillis

public int getSlowUrlsReadWriteTimeoutMillis()

Get the read/write timeout for failed URL tasks.

Returns:

the read/write timeout for failed URL tasks

setSlowUrlsReadWriteTimeoutMillis

public void setSlowUrlsReadWriteTimeoutMillis(int slowUrlsReadWriteTimeoutMillis)

Set the read/write timeout for failed URL tasks.

Parameters:

slowUrlsReadWriteTimeoutMillis - the read/write timeout for failed URL tasks

getReadAccuracyPercent

public int getReadAccuracyPercent()

Get the minimum threshold for successful read to connect percentage

Returns:

successful read to connect percentage minimum threshold

setReadAccuracyPercent

public void setReadAccuracyPercent(int readAccuracyPercent)

Set the minimum threshold for successful read to connect percentage

Parameters:

readAccuracyPercent - successful read to connect percentage minimum threshold

getConnectAccuracyPercent

public int getConnectAccuracyPercent()

Get the minimum threshold for successful connect to total request percent.

Returns:

the minimum threshold for successful connect to total request percent

setConnectAccuracyPercent

public void setConnectAccuracyPercent(int connectAccuracyPercent)

Set the minimum threshold for successful connect to total request percent.

Parameters:

connectAccuracyPercent - the minimum threshold for successful connect to total request percent

startWorker

@Deprecated
 @PostConstruct
public void startWorker()

Deprecated.

Initialize the worker.

execute

public LightningCoreConstants.WorkerState execute(java.lang.String sessionId)

Execute the list of tasks for the request.

Specified by:

execute in interface Worker

Parameters:

sessionId - the session Id corresponding to the request

Returns:

the state of the working thread after the execution

getCurrentState

public LightningCoreConstants.WorkerState getCurrentState()

Get the state of the Worker.

Returns:

the current state of Worker

getTaskConfig

public RequestConfig getTaskConfig()

Get the configuration for the current tasks.

Returns:

the task configuration

setRequestConfig

public void setRequestConfig(RequestConfig taskConfig)

Set the configuration for the current tasks.

Parameters:

taskConfig - the task configuration