ml.shifu.guagua.yarn

Class GuaguaYarnClient

java.lang.Object

org.apache.hadoop.conf.Configured

ml.shifu.guagua.yarn.GuaguaYarnClient

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class GuaguaYarnClient
extends org.apache.hadoop.conf.Configured

GuaguaYarnClient is used to submit master-workers computation app on yarn cluster.

TODO clean app resources in HDFS no matter successful or not

Constructor Summary

Constructors

Constructor and Description
GuaguaYarnClient() Default constructor.
GuaguaYarnClient(org.apache.hadoop.conf.Configuration conf) Constructor with Configuration setting.

Method Summary

Methods

Modifier and Type	Method and Description
static void	addInputPath(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path)
String	getAmQueue()
org.apache.hadoop.yarn.api.records.ApplicationId	getAppId()
String	getAppName()
long	getStartTime()
boolean	init(String[] args)
static void	main(String[] args)
int	run(String[] args) To submit an app to yarn cluster and monitor the status.
void	setAmQueue(String amQueue)
void	setAppId(org.apache.hadoop.yarn.api.records.ApplicationId appId)
void	setAppName(String appName)
void	setStartTime(long startTime)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GuaguaYarnClient

public GuaguaYarnClient()

Default constructor. Use YarnConfiguration as default conf setting.

GuaguaYarnClient

public GuaguaYarnClient(org.apache.hadoop.conf.Configuration conf)

Constructor with Configuration setting.

Method Detail

addInputPath

public static void addInputPath(org.apache.hadoop.conf.Configuration conf,
                org.apache.hadoop.fs.Path path)
                         throws IOException

Throws:

IOException

run

public int run(String[] args)
        throws Exception

To submit an app to yarn cluster and monitor the status.

Throws:

Exception

init

public boolean init(String[] args)

getAppId

public org.apache.hadoop.yarn.api.records.ApplicationId getAppId()

setAppId

public void setAppId(org.apache.hadoop.yarn.api.records.ApplicationId appId)

getAppName

public String getAppName()

setAppName

public void setAppName(String appName)

getAmQueue

public String getAmQueue()

setAmQueue

public void setAmQueue(String amQueue)

getStartTime

public long getStartTime()

setStartTime

public void setStartTime(long startTime)

main

public static void main(String[] args)