uk.ac.ed.epcc.safe.accounting.parsers

Class LSFParser

java.lang.Object

uk.ac.ed.epcc.safe.accounting.update.AbstractPropertyContainerUpdater

uk.ac.ed.epcc.safe.accounting.update.AbstractPropertyContainerParser

uk.ac.ed.epcc.safe.accounting.update.BaseParser

uk.ac.ed.epcc.safe.accounting.update.BatchParser

uk.ac.ed.epcc.safe.accounting.parsers.LSFParser

All Implemented Interfaces:

PropertyContainerParser, PropertyContainerUpdater, uk.ac.ed.epcc.webapp.Contexed

public class LSFParser
extends BatchParser
implements PropertyContainerParser, uk.ac.ed.epcc.webapp.Contexed

Field Summary

Fields

Modifier and Type	Field and Description
static PropertyRegistry	lsf
static PropertyTag<java.lang.String>	LSF_BATCH_COMMAND_PROP
static PropertyTag<java.lang.Number>	LSF_CPU_TIME_PROP
static PropertyTag<java.lang.String>	LSF_EXEC_HOSTS_PROP
static PropertyTag<java.lang.String>	LSF_HOSTNAME_PROP
static PropertyTag<java.lang.Integer>	LSF_JOB_ARRAY_INDEX
static PropertyTag<java.lang.Integer>	LSF_JOBEXIT_PROP
static PropertyTag<java.lang.Integer>	LSF_JOBID_PROP
static PropertyTag<java.lang.String>	LSF_JOBNAME_PROP
static PropertyTag<java.util.Date>	LSF_LOGDATE_PROP
static PropertyTag<java.lang.Integer>	LSF_MAXPROCESSORS_PROP
static PropertyTag<java.lang.Number>	LSF_MEMORYUSED_PROP
static PropertyTag<java.lang.Integer>	LSF_NUM_EXECHOSTS_PROP
static PropertyTag<java.lang.Integer>	LSF_NUMPROCESSORS_PROP
static PropertyTag<java.lang.String>	LSF_PROJECT_PROP
static PropertyTag<java.lang.String>	LSF_QUEUE_PROP
static PropertyTag<java.util.Date>	LSF_STARTED_PROP
static PropertyTag<java.util.Date>	LSF_SUBMITTED_PROP
static PropertyTag<java.lang.String>	LSF_USERNAME_PROP
static PropertyTag<java.lang.Number>	LSF_VIRTUALMEMORYUSED_PROP
static PropertyTag<java.lang.Number>	LSF_WALLCLOCK_PROP

Fields inherited from class uk.ac.ed.epcc.safe.accounting.update.BatchParser

ACCOUNT_PROP, batch, BATCH_SCRIPT_PROP, CPU_WAIT_PROP, EXPECTED_FINISH, JOB_ID_PROP, JOB_NAME_PROP, NODE_COUNT_PROP, PARTITION_PROP, PROC_COUNT_PROP, QUEUE_PROP, REQUEST_ACCURACY_PROP, REQUESTED_CPUS_PROP, REQUESTED_WALLCLOCK_PROP, RESIDENCY_PROP, SERIAL_PROP, SLOWDOWN_PROP, SUBJOB_PROP, SUBMITTED_PROP, SUBMITTED_TIMESTAMP, SUCCESS_PROP, TIME_PROP, WAIT_PROP, WALLCLOCK_PROP

Fields inherited from class uk.ac.ed.epcc.safe.accounting.update.AbstractPropertyContainerParser

DUPLICATE_KEY

Constructor Summary

Constructors

Constructor and Description
LSFParser(uk.ac.ed.epcc.webapp.AppContext c)

Method Summary

Methods

Modifier and Type	Method and Description
uk.ac.ed.epcc.webapp.AppContext	getContext()
PropExpressionMap	getDerivedProperties(PropExpressionMap previous) return a set of derived property definitions.
PropertyFinder	initFinder(uk.ac.ed.epcc.webapp.AppContext conn, PropertyFinder prev, java.lang.String table) Generate a PropertyFinder that will find any PropertyTag generated by this class.
boolean	parse(PropertyMap r, java.lang.String record) Parse a String representation of the UsageRecord.
java.util.Iterator<java.lang.String>	splitRecords(java.lang.String update) split a multiple record update into individual records in the way appropriate to this accountng scheme.
void	startParse(PropertyContainer defaults) Start a batch parse.

Methods inherited from class uk.ac.ed.epcc.safe.accounting.update.BaseParser

readDouble, readInteger, readLong, readTime

Methods inherited from class uk.ac.ed.epcc.safe.accounting.update.AbstractPropertyContainerParser

getDefaultUniqueProperties, modifyDefaultTableSpecification, unique

Methods inherited from class uk.ac.ed.epcc.safe.accounting.update.AbstractPropertyContainerUpdater

endParse

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface uk.ac.ed.epcc.safe.accounting.update.PropertyContainerParser

getDefaultUniqueProperties

Methods inherited from interface uk.ac.ed.epcc.safe.accounting.update.PropertyContainerUpdater

endParse, modifyDefaultTableSpecification

Field Detail

lsf

public static final PropertyRegistry lsf

LSF_QUEUE_PROP

@AutoTable
public static final PropertyTag<java.lang.String> LSF_QUEUE_PROP

LSF_HOSTNAME_PROP

public static final PropertyTag<java.lang.String> LSF_HOSTNAME_PROP

LSF_USERNAME_PROP

@AutoTable
public static final PropertyTag<java.lang.String> LSF_USERNAME_PROP

LSF_JOBNAME_PROP

@AutoTable(length=4096)
public static final PropertyTag<java.lang.String> LSF_JOBNAME_PROP

LSF_BATCH_COMMAND_PROP

public static final PropertyTag<java.lang.String> LSF_BATCH_COMMAND_PROP

LSF_JOBID_PROP

@AutoTable(unique=true)
public static final PropertyTag<java.lang.Integer> LSF_JOBID_PROP

LSF_JOB_ARRAY_INDEX

@AutoTable(unique=true)
public static final PropertyTag<java.lang.Integer> LSF_JOB_ARRAY_INDEX

LSF_JOBEXIT_PROP

@AutoTable
public static final PropertyTag<java.lang.Integer> LSF_JOBEXIT_PROP

LSF_SUBMITTED_PROP

@AutoTable
public static final PropertyTag<java.util.Date> LSF_SUBMITTED_PROP

LSF_LOGDATE_PROP

@AutoTable(unique=true)
public static final PropertyTag<java.util.Date> LSF_LOGDATE_PROP

LSF_STARTED_PROP

@AutoTable
public static final PropertyTag<java.util.Date> LSF_STARTED_PROP

LSF_WALLCLOCK_PROP

@AutoTable
public static final PropertyTag<java.lang.Number> LSF_WALLCLOCK_PROP

LSF_PROJECT_PROP

@AutoTable
public static final PropertyTag<java.lang.String> LSF_PROJECT_PROP

LSF_CPU_TIME_PROP

@AutoTable
public static final PropertyTag<java.lang.Number> LSF_CPU_TIME_PROP

LSF_MEMORYUSED_PROP

public static final PropertyTag<java.lang.Number> LSF_MEMORYUSED_PROP

LSF_VIRTUALMEMORYUSED_PROP

public static final PropertyTag<java.lang.Number> LSF_VIRTUALMEMORYUSED_PROP

LSF_MAXPROCESSORS_PROP

@AutoTable(target=java.lang.Integer.class)
public static final PropertyTag<java.lang.Integer> LSF_MAXPROCESSORS_PROP

LSF_NUMPROCESSORS_PROP

@AutoTable(target=java.lang.Integer.class)
public static final PropertyTag<java.lang.Integer> LSF_NUMPROCESSORS_PROP

LSF_NUM_EXECHOSTS_PROP

public static final PropertyTag<java.lang.Integer> LSF_NUM_EXECHOSTS_PROP

LSF_EXEC_HOSTS_PROP

public static final PropertyTag<java.lang.String> LSF_EXEC_HOSTS_PROP

Constructor Detail

LSFParser

public LSFParser(uk.ac.ed.epcc.webapp.AppContext c)

Method Detail

splitRecords

public java.util.Iterator<java.lang.String> splitRecords(java.lang.String update)
                                                  throws AccountingParseException

Description copied from class: AbstractPropertyContainerParser

split a multiple record update into individual records in the way appropriate to this accountng scheme. Usually records are one per line but some schmemes may use other formats like XML

Specified by:

splitRecords in interface PropertyContainerParser

Overrides:

splitRecords in class AbstractPropertyContainerParser

Throws:

AccountingParseException - If a problem occurs while splitting the records

Parameters:

update - string containing multiple records

Returns:

Iterator

parse

public boolean parse(PropertyMap r,
            java.lang.String record)
              throws AccountingParseException

Description copied from interface: PropertyContainerParser

Parse a String representation of the UsageRecord. If the parse needs to be aborted throw and AccountingParseException. If the parse cannot succeed but no error needs to be reported (e.g. an empty or comment line) this method can return false

Specified by:

parse in interface PropertyContainerParser

Throws:

AccountingParseException

Parameters:

r - PropertyMap to add quantities

Returns:

true if parse ok

startParse

public void startParse(PropertyContainer defaults)
                throws uk.ac.ed.epcc.webapp.jdbc.exception.DataException,
                       InvalidPropertyException

Description copied from interface: PropertyContainerUpdater

Start a batch parse. This allocates any temporary state appropriate to the policy. Some properties may be set globally for all records in the parse rather than provided record by record. The startParse method is passed all known properties of this type as they may be useful in setting up the parse. There is no requirement to process these in any way.

Specified by:

startParse in interface PropertyContainerUpdater

Overrides:

startParse in class AbstractPropertyContainerUpdater

Throws:

uk.ac.ed.epcc.webapp.jdbc.exception.DataException

InvalidPropertyException

Parameters:

defaults - properties constant for this accounting run.

getContext

public uk.ac.ed.epcc.webapp.AppContext getContext()

Specified by:

getContext in interface uk.ac.ed.epcc.webapp.Contexed

initFinder

public PropertyFinder initFinder(uk.ac.ed.epcc.webapp.AppContext conn,
                        PropertyFinder prev,
                        java.lang.String table)

Description copied from interface: PropertyContainerUpdater

Generate a PropertyFinder that will find any PropertyTag generated by this class. This call should be treated as a secondary constructor and should be called before any other method from this interface.

All properties defined at run-time should have their PropertyTag objects constructed by the time the first call to this method returns. As some parsers properties will generate different things depending on the other properties already in scope this method is passed a PropertyFinder for any properties that may already be in scope. This will include any default parameters specified when the data was uploaded and any properties generated from the database meta-data. Though it is perfectly legal to return a PropertyFinder that returns a superset of the generated properties the only requirement is that the returned finder can find any property that this classes parse method may actually generate values for. So Normally the contents of the super-finder are not included in the result unless these values are actually generated by the parse. If values are generated then a MultiFinder can be populated with the PropertyRegistrys from the generated properties

Specified by:

initFinder in interface PropertyContainerUpdater

Overrides:

initFinder in class BaseParser

prev - PropertyFinder for the higher levels in the call chain.

table - String name of the destination table in case per-table customisation is needed

Returns:

PropertyFinder or null

getDerivedProperties

public PropExpressionMap getDerivedProperties(PropExpressionMap previous)

Description copied from interface: PropertyContainerUpdater

return a set of derived property definitions. Each derived property is defined in terms of a simple expression over other properties (that may themselves be derived properties).

Definitions are allowed for properties that are also generated directly in the parse phase. In this case the parse value should always be used by preference and the derived definition only provides a fall-back implementation if the parse value is unavailable. For example if not persisted in the database layer. This allows one parser/policy to specify a default implementation as a derived property definition which is then overridden by having the same property generated in a parse method of a different policy/parser

Specified by:

getDerivedProperties in interface PropertyContainerUpdater

Overrides:

getDerivedProperties in class BatchParser

Parameters:

previous - Previous definitions

Returns:

Map modified map