gov.usgs.volcanoes.winston.in.ew

Class ImportEW

java.lang.Object

java.lang.Thread

gov.usgs.volcanoes.winston.in.ew.ImportEW

All Implemented Interfaces:

Runnable

public class ImportEW
extends Thread

The new ImportEW.

Author:

Dan Cervelli, Richard Guest, Tom Parker

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

Thread.State, Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<String,Map<String,String>>	channelMetadata
protected Map<String,Options>	channelOptions
protected Map<String,ChannelStatus>	channelStatus
protected gov.usgs.volcanoes.core.configfile.ConfigFile	config
protected String	configFilename
protected DateFormat	dateFormat
static int	DEFAULT_BACKLOG_THRESHOLD
static String	DEFAULT_CONFIG_FILENAME
static String	DEFAULT_DRIVER
static int	DEFAULT_DROP_TABLE_DELAY
static boolean	DEFAULT_ENABLE_VALARM_VIEW
static int	DEFAULT_EXPECTED_HEARTBEAT_INTERVAL
static int	DEFAULT_HEARTBEAT_INTERVAL
static String	DEFAULT_HOST
static String	DEFAULT_LOG_FILE
static int	DEFAULT_LOG_FILE_SIZE
static String	DEFAULT_LOG_LEVEL
static int	DEFAULT_LOG_NUM_FILES
static int	DEFAULT_MAX_BACKLOG
static int	DEFAULT_MAX_DAYS
static int	DEFAULT_PORT
static String	DEFAULT_RECEIVE_ID
static int	DEFAULT_REPAIR_RETRY_INTERVAL
static int	DEFAULT_RSAM_DELTA
static int	DEFAULT_RSAM_DURATION
static boolean	DEFAULT_RSAM_ENABLE
static String	DEFAULT_SEND_ID
static int	DEFAULT_STATUS_INTERVAL
static String	DEFAULT_TABLE_ENGINE
static double	DEFAULT_TIME_THRESHOLD
static int	DEFAULT_TIMEOUT
protected Options	defaultOptions
protected int	dropTableDelay
protected boolean	enableValarmView
protected gov.usgs.earthworm.ImportGeneric	importGeneric
protected Date	importStartTime
protected gov.usgs.volcanoes.core.CodeTimer	inputTimer
static String	JSAP_EXPLANATION_PREFACE
static String	JSAP_PROGRAM_NAME
protected String	logFile
protected int	logNumFiles
protected int	logSize
protected List<OptionsFilter>	optionFilters
protected int	totalTraceBufs
protected int	totalTraceBufsAccepted
protected int	totalTraceBufsDropped
protected int	totalTraceBufsFailed
protected int	totalTraceBufsRejected
protected int	totalTraceBufsWritten
protected List<TraceBufFilter>	traceBufFilters
protected DateFormat	winstonDateFormat

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
ImportEW() Sets up all the standard private member variables, the logger and instantiates a ConfigFile using configFilename.
ImportEW(String fn)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	addTraceBufToQueue(gov.usgs.earthworm.message.TraceBuf tb)
static void	consoleInputManager(ImportEW im) Manage the console input.
protected void	fatalError(String msg) Logs a severe message and exits uncleanly.
static com.martiansoftware.jsap.JSAPResult	getArguments(String[] args) Find and parse the command line arguments.
protected Options	getOptions(gov.usgs.earthworm.message.TraceBuf tb)
void	handleOutOfMemoryError(OutOfMemoryError e) Try to recover from an OutOfMemoryError by dropping all TraceBufs from the processing queue.
static void	main(String[] args)
protected TraceBufFilter	matchFilter(gov.usgs.earthworm.message.TraceBuf tb) Tests the TraceBuf against each filter, stopping at first match.
void	printChannels(String s)
static void	printKeys()
void	printStatus()
protected void	processConfigFile() Processes logger, import and winston config, plus options, default options and filters.
protected void	processDefaultOptions()
protected void	processFilters()
protected void	processImportConfig() Extracts generalised configuration information.
protected void	processLoggerConfig() Extracts logging configuration information.
protected void	processOptions()
protected void	processWinstonConfig() Extracts configuration information specific to Winston DB and instantiates a Winston DB connection.
void	quit()
void	run()

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

DEFAULT_CONFIG_FILENAME

public static final String DEFAULT_CONFIG_FILENAME

See Also:

Constant Field Values

DEFAULT_HOST

public static final String DEFAULT_HOST

See Also:

Constant Field Values

DEFAULT_PORT

public static final int DEFAULT_PORT

See Also:

Constant Field Values

DEFAULT_TIMEOUT

public static final int DEFAULT_TIMEOUT

See Also:

Constant Field Values

DEFAULT_HEARTBEAT_INTERVAL

public static final int DEFAULT_HEARTBEAT_INTERVAL

See Also:

Constant Field Values

DEFAULT_EXPECTED_HEARTBEAT_INTERVAL

public static final int DEFAULT_EXPECTED_HEARTBEAT_INTERVAL

See Also:

Constant Field Values

DEFAULT_STATUS_INTERVAL

public static final int DEFAULT_STATUS_INTERVAL

See Also:

Constant Field Values

DEFAULT_RECEIVE_ID

public static final String DEFAULT_RECEIVE_ID

See Also:

Constant Field Values

DEFAULT_SEND_ID

public static final String DEFAULT_SEND_ID

See Also:

Constant Field Values

DEFAULT_DRIVER

public static final String DEFAULT_DRIVER

See Also:

Constant Field Values

DEFAULT_TABLE_ENGINE

public static final String DEFAULT_TABLE_ENGINE

See Also:

Constant Field Values

DEFAULT_MAX_DAYS

public static final int DEFAULT_MAX_DAYS

See Also:

Constant Field Values

DEFAULT_MAX_BACKLOG

public static final int DEFAULT_MAX_BACKLOG

See Also:

Constant Field Values

DEFAULT_LOG_LEVEL

public static final String DEFAULT_LOG_LEVEL

See Also:

Constant Field Values

DEFAULT_LOG_FILE

public static final String DEFAULT_LOG_FILE

See Also:

Constant Field Values

DEFAULT_LOG_NUM_FILES

public static final int DEFAULT_LOG_NUM_FILES

See Also:

Constant Field Values

DEFAULT_LOG_FILE_SIZE

public static final int DEFAULT_LOG_FILE_SIZE

See Also:

Constant Field Values

DEFAULT_ENABLE_VALARM_VIEW

public static final boolean DEFAULT_ENABLE_VALARM_VIEW

See Also:

Constant Field Values

DEFAULT_TIME_THRESHOLD

public static final double DEFAULT_TIME_THRESHOLD

See Also:

Constant Field Values

DEFAULT_BACKLOG_THRESHOLD

public static final int DEFAULT_BACKLOG_THRESHOLD

See Also:

Constant Field Values

DEFAULT_RSAM_ENABLE

public static final boolean DEFAULT_RSAM_ENABLE

See Also:

Constant Field Values

DEFAULT_RSAM_DELTA

public static final int DEFAULT_RSAM_DELTA

See Also:

Constant Field Values

DEFAULT_RSAM_DURATION

public static final int DEFAULT_RSAM_DURATION

See Also:

Constant Field Values

DEFAULT_DROP_TABLE_DELAY

public static final int DEFAULT_DROP_TABLE_DELAY

See Also:

Constant Field Values

DEFAULT_REPAIR_RETRY_INTERVAL

public static final int DEFAULT_REPAIR_RETRY_INTERVAL

See Also:

Constant Field Values

JSAP_PROGRAM_NAME

public static String JSAP_PROGRAM_NAME

JSAP_EXPLANATION_PREFACE

public static String JSAP_EXPLANATION_PREFACE

configFilename

protected String configFilename

config

protected gov.usgs.volcanoes.core.configfile.ConfigFile config

importGeneric

protected gov.usgs.earthworm.ImportGeneric importGeneric

logFile

protected String logFile

logNumFiles

protected int logNumFiles

logSize

protected int logSize

inputTimer

protected final gov.usgs.volcanoes.core.CodeTimer inputTimer

totalTraceBufsWritten

protected int totalTraceBufsWritten

totalTraceBufs

protected int totalTraceBufs

totalTraceBufsDropped

protected int totalTraceBufsDropped

totalTraceBufsAccepted

protected int totalTraceBufsAccepted

totalTraceBufsRejected

protected int totalTraceBufsRejected

totalTraceBufsFailed

protected int totalTraceBufsFailed

channelStatus

protected final Map<String,ChannelStatus> channelStatus

importStartTime

protected final Date importStartTime

dateFormat

protected final DateFormat dateFormat

winstonDateFormat

protected final DateFormat winstonDateFormat

dropTableDelay

protected int dropTableDelay

enableValarmView

protected boolean enableValarmView

defaultOptions

protected Options defaultOptions

channelOptions

protected final Map<String,Options> channelOptions

channelMetadata

protected Map<String,Map<String,String>> channelMetadata

traceBufFilters

protected List<TraceBufFilter> traceBufFilters

optionFilters

protected List<OptionsFilter> optionFilters

Constructor Detail

ImportEW

public ImportEW(String fn)

ImportEW

public ImportEW()

Sets up all the standard private member variables, the logger and instantiates a ConfigFile using configFilename.

Method Detail

handleOutOfMemoryError

public void handleOutOfMemoryError(OutOfMemoryError e)

Try to recover from an OutOfMemoryError by dropping all TraceBufs from the processing queue. Ideally, OutOfMemoryErrors should be prevented by aggressive tuning; this is a last-gasp effort to allow the program to continue running.

fatalError

protected void fatalError(String msg)

Logs a severe message and exits uncleanly.

processConfigFile

protected void processConfigFile()

Processes logger, import and winston config, plus options, default options and filters.

processLoggerConfig

protected void processLoggerConfig()

Extracts logging configuration information.

processImportConfig

protected void processImportConfig()

Extracts generalised configuration information.

processWinstonConfig

protected void processWinstonConfig()

Extracts configuration information specific to Winston DB and instantiates a Winston DB connection.

processDefaultOptions

protected void processDefaultOptions()

processOptions

protected void processOptions()

processFilters

protected void processFilters()

matchFilter

protected TraceBufFilter matchFilter(gov.usgs.earthworm.message.TraceBuf tb)

Tests the TraceBuf against each filter, stopping at first match.

Parameters:

tb - the TraceBuf to test

Returns:

filter that matched, null if no match

addTraceBufToQueue

protected void addTraceBufToQueue(gov.usgs.earthworm.message.TraceBuf tb)

run

public void run()

Specified by:

run in interface Runnable

Overrides:

run in class Thread

getOptions

protected Options getOptions(gov.usgs.earthworm.message.TraceBuf tb)

quit

public void quit()

printStatus

public void printStatus()

printChannels

public void printChannels(String s)

getArguments

public static com.martiansoftware.jsap.JSAPResult getArguments(String[] args)

Find and parse the command line arguments.

Parameters:

args - The command line arguments.

printKeys

public static void printKeys()

consoleInputManager

public static void consoleInputManager(ImportEW im)

Manage the console input.

Parameters:

im - The Winston importer.

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException