Hoffman2:WEKA - Revision history

Dmargolis at 20:10, 26 May 2017

2017-05-26T20:10:17Z

← Older revision		Revision as of 20:10, 26 May 2017
Line 10:		Line 10:

	There are sample data sets that can be found on Hoffman2 at		There are sample data sets that can be found on Hoffman2 at
	/u/~~home~~/~~FMRI~~/apps/weka/current/data		/u/project/CCN/apps/weka/current/data
	and most of these are used in the introductory materials.		and most of these are used in the introductory materials.

Line 18:		Line 18:
	# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]		# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]
	# Run the command		# Run the command
	#: <pre>$ java -jar /u/~~home~~/~~FMRI~~/apps/weka/current/weka.jar</pre>		#: <pre>$ java -jar /u/project/CCN/apps/weka/current/weka.jar</pre>
	# And the current version of WEKA should start up and the GUI will appear.		# And the current version of WEKA should start up and the GUI will appear.

	=== Command Line ===		=== Command Line ===
	Calling any of the usual WEKA command line tools will work in submitted jobs so long as you properly reference the WEKA jar file at:		Calling any of the usual WEKA command line tools will work in submitted jobs so long as you properly reference the WEKA jar file at:
	/u/~~home~~/~~FMRI~~/apps/weka/current/weka.jar		/u/project/CCN/apps/weka/current/weka.jar
	A sample command would be		A sample command would be
	$ java -Xmx2g -cp /u/~~home~~/~~FMRI~~/apps/weka/current/weka.jar weka.classifiers.functions.SMO -o -t awesome_train_file.arff -T awesome_test_file.arff		$ java -Xmx2g -cp /u/project/CCN/apps/weka/current/weka.jar weka.classifiers.functions.SMO -o -t awesome_train_file.arff -T awesome_test_file.arff
	where		where
	;-Xmx2g		;-Xmx2g
Line 53:		Line 53:
	===Command Line===		===Command Line===
	Calling any of the usual MOA command line tools will work in submitted jobs so long as you properly reference the MOA jar file at:		Calling any of the usual MOA command line tools will work in submitted jobs so long as you properly reference the MOA jar file at:
	/u/~~home~~/~~FMRI~~/apps/weka/current/weka.jar		/u/project/CCN/apps/weka/current/weka.jar
	A sample command would be		A sample command would be
	$ java -Xmx4g -cp /u/~~home~~/~~FMRI~~/apps/moa/current/moa.jar -javaagent:sizeofag.jar moa.DoTask "EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000"		$ java -Xmx4g -cp /u/project/CCN/apps/moa/current/moa.jar -javaagent:sizeofag.jar moa.DoTask "EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000"
	where		where
	;-Xmx4g		;-Xmx4g

Ccn admin: 14 revisions

2014-01-16T03:15:13Z

14 revisions

← Older revision	Revision as of 03:15, 16 January 2014
(No difference)

Elau at 01:55, 13 April 2012

2012-04-13T01:55:23Z

← Older revision		Revision as of 01:55, 13 April 2012
Line 18:		Line 18:
	# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]		# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]
	# Run the command		# Run the command
	$ java -jar /u/home/FMRI/apps/weka/current/weka.jar		#: <pre>$ java -jar /u/home/FMRI/apps/weka/current/weka.jar</pre>
	# And the current version of WEKA should start up and the GUI will appear.		# And the current version of WEKA should start up and the GUI will appear.

Line 48:		Line 48:
	# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]		# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]
	# Run the command		# Run the command
	$ moa.sh		#: <pre>$ moa.sh</pre>
	# The current version of MOA should start up and the GUI will appear.		# The current version of MOA should start up and the GUI will appear.

Elau at 01:54, 13 April 2012

2012-04-13T01:54:32Z

← Older revision		Revision as of 01:54, 13 April 2012
Line 1:		Line 1:
			[[Hoffman2\|Back to all things Hoffman2]]

			WEKA is a machine learning program built by the Kiwis down in New Zealand. It has an extensive library of machine learning algorithms.



	==WEKA==		==WEKA==
	===Getting Started with WEKA===		===Getting Started with WEKA===
	Introductory material and full manuals can be found [http://www.cs.waikato.ac.nz/ml/weka/index_documentation.html here].		Introductory material and full manuals can be found [http://www.cs.waikato.ac.nz/ml/weka/index_documentation.html here].

	There are sample data sets that can be found on Hoffman2 at:		There are sample data sets that can be found on Hoffman2 at
	~~<code><pre>~~/u/home/FMRI/apps/current/data~~</pre></code>~~		/u/home/FMRI/apps/weka/current/data
	and most of these are used in the introductory materials.		and most of these are used in the introductory materials.

	=== GUI ===		=== GUI ===
	To run the WEKA GUI from Hoffman2		To run the WEKA GUI from Hoffman2
	~~<ol>~~		# [[Hoffman2:Accessing the Cluster#SSH - Command Line\|SSH into Hoffman2]] making sure you have X11 forwarding enabled ("-X" flag)
	~~<li>Make~~ sure ~~that~~ you ~~enabled~~ X11 forwarding ~~by including the~~ -Y flag ~~in your SSH command: <br />~~		# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]
	~~<code><pre> $ ssh -Y joebruin@hoffman2.idre.ucla.edu </pre></code>~~		# Run the command
	~~</li>~~		$ java -jar /u/home/FMRI/apps/weka/current/weka.jar
	~~<li> Request an~~ [~~http~~:~~//www.ats.ucla.edu/clusters/hoffman2/~~computing~~/sge_qrsh.htm interactive node] to run on with the following command: <br />~~		# And the current version of WEKA should start up and the GUI will appear.
	~~<code><pre> $ qrsh -l i </pre></code>~~
	~~</li>~~
	~~<li> Wait for the new~~ node ~~to appear. Your prompt will change from: <br />~~
	~~<code><pre> [joebruin@login4 ~~~] ~~$ </pre></code>~~
	~~to something like <br />~~
	~~<code><pre> [joebruin@n1234 ~~~] ~~$ </pre></code>~~
	~~</li>~~
	~~<li>~~Run the command:
	~~<code><pre>~~ $ java -jar /u/home/FMRI/apps/weka/current/weka.jar ~~</pre></code>~~
	And the current version of WEKA should start up and the GUI will appear.
	~~</li>~~
	~~</ol>~~


	=== Command Line ===		=== Command Line ===
	Calling any of the usual WEKA command line tools will work in submitted jobs so long as you properly reference the WEKA jar file at: ~~<br />~~		Calling any of the usual WEKA command line tools will work in submitted jobs so long as you properly reference the WEKA jar file at:
	~~<code><pre>~~/u/home/FMRI/apps/weka/current/weka.jar~~</pre></code>~~		/u/home/FMRI/apps/weka/current/weka.jar
	A sample command would be~~<br />~~		A sample command would be
	~~<code><pre>~~$ java -Xmx2g -cp /u/home/FMRI/apps/weka/current/weka.jar weka.classifiers.functions.SMO -o -t awesome_train_file.arff -T awesome_test_file.arff~~</pre></code>~~		$ java -Xmx2g -cp /u/home/FMRI/apps/weka/current/weka.jar weka.classifiers.functions.SMO -o -t awesome_train_file.arff -T awesome_test_file.arff
	where		where
	;-Xmx2g		;-Xmx2g
Line 44:		Line 37:
	:is an optional testing file for the model		:is an optional testing file for the model
	:if this option is not provided, 10 fold cross validation will be done using Training data		:if this option is not provided, 10 fold cross validation will be done using Training data



	== Massive Online Analysis (MOA) ==		== Massive Online Analysis (MOA) ==
			MOA is an extension of WEKA to help with larger datasets.

	===GUI===		===GUI===
	To run the MOA GUI from Hoffman2		To run the MOA GUI from Hoffman2
	~~<ol>~~		# [[Hoffman2:Accessing the Cluster#SSH - Command Line\|SSH into Hoffman2]] making sure you have X11 forwarding enabled ("-X" flag)
	~~<li>Make~~ sure ~~that~~ you ~~enabled~~ X11 forwarding ~~by including the~~ -Y flag ~~in your SSH command: <br />~~		# [[Hoffman2:Interactive Sessions\|Check out an interactive computing node]]
	~~<code><pre> $ ssh -Y joebruin@hoffman2.idre.ucla.edu </pre></code>~~		# Run the command
	~~</li>~~		$ moa.sh
	~~<li> Request an~~ [~~http~~:~~//www.ats.ucla.edu/clusters/hoffman2/~~computing~~/sge_qrsh.htm interactive~~ node] ~~to run on with the following command: <br />~~		# The current version of MOA should start up and the GUI will appear.
	~~<code><pre> $ qrsh -l i </pre></code>~~
	~~</li>~~
	~~<li> Wait for the new node to appear. Your prompt will change from: <br />~~
	~~<code><pre> [joebruin@login4 ~] $ </pre></code>~~
	~~to something like <br />~~
	~~<code><pre> [joebruin@n1234 ~~~] ~~$ </pre></code>~~
	~~</li>~~
	~~<li>~~Run the command:
	~~<code><pre>~~ $ moa.sh ~~</pre></code>~~
	~~And the~~ current version of MOA should start up and the GUI will appear.
	~~</li>~~
	~~</ol>~~


	===Command Line===		===Command Line===
	Calling any of the usual MOA command line tools will work in submitted jobs so long as you properly reference the MOA jar file at: ~~<br />~~		Calling any of the usual MOA command line tools will work in submitted jobs so long as you properly reference the MOA jar file at:
	~~<code><pre>~~/u/home/FMRI/apps/weka/current/weka.jar~~</pre></code>~~		/u/home/FMRI/apps/weka/current/weka.jar
	A sample command would be~~<br />~~		A sample command would be
	~~<code><pre>~~$ java -Xmx4g -cp /u/home/FMRI/apps/moa/current/moa.jar -javaagent:sizeofag.jar moa.DoTask "EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000" ~~</pre></code>~~		$ java -Xmx4g -cp /u/home/FMRI/apps/moa/current/moa.jar -javaagent:sizeofag.jar moa.DoTask "EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000"
	where		where
	;-Xmx4g		;-Xmx4g
Line 78:		Line 62:
	; EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000		; EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000
	:is the MOA command to execute		:is the MOA command to execute



			==External Links==
			*[http://www.cs.waikato.ac.nz/ml/weka/ Official WEKA page]
			*[http://moa.cs.waikato.ac.nz/details/ Official MOA page]

Elau: moved How to run WEKA on Hoffman to Hoffman2:WEKA: Restructuring

2012-04-13T01:45:05Z

moved How to run WEKA on Hoffman to Hoffman2:WEKA: Restructuring

← Older revision	Revision as of 01:45, 13 April 2012
(No difference)

Elau: /* Getting Started with Weka */

2011-08-10T05:49:21Z

Getting Started with Weka

← Older revision		Revision as of 05:49, 10 August 2011
Line 1:		Line 1:
	==WEKA==		==WEKA==
	===Getting Started with ~~Weka~~===		===Getting Started with WEKA===
	Introductory material and full manuals can be found [http://www.cs.waikato.ac.nz/ml/weka/index_documentation.html here].		Introductory material and full manuals can be found [http://www.cs.waikato.ac.nz/ml/weka/index_documentation.html here].

Line 6:		Line 6:
	<code><pre>/u/home/FMRI/apps/current/data</pre></code>		<code><pre>/u/home/FMRI/apps/current/data</pre></code>
	and most of these are used in the introductory materials.		and most of these are used in the introductory materials.


	=== GUI ===		=== GUI ===

Elau: /* WEKA */

2011-08-10T05:48:52Z

WEKA

New page

==WEKA==
===Getting Started with Weka===
Introductory material and full manuals can be found [http://www.cs.waikato.ac.nz/ml/weka/index_documentation.html here].

There are sample data sets that can be found on Hoffman2 at:
<code><pre>/u/home/FMRI/apps/current/data</pre></code>
and most of these are used in the introductory materials.

=== GUI ===
To run the WEKA GUI from Hoffman2
<ol>
<li>Make sure that you enabled X11 forwarding by including the -Y flag in your SSH command: 
<code><pre> $ ssh -Y joebruin@hoffman2.idre.ucla.edu </pre></code>
</li>
<li> Request an [http://www.ats.ucla.edu/clusters/hoffman2/computing/sge_qrsh.htm interactive node] to run on with the following command: 
<code><pre> $ qrsh -l i </pre></code>
</li>
<li> Wait for the new node to appear. Your prompt will change from: 
<code><pre> [joebruin@login4 ~] $ </pre></code>
to something like 
<code><pre> [joebruin@n1234 ~] $ </pre></code>
</li>
<li>Run the command:
<code><pre> $ java -jar /u/home/FMRI/apps/weka/current/weka.jar </pre></code>
And the current version of WEKA should start up and the GUI will appear.
</li>
</ol>

=== Command Line ===
Calling any of the usual WEKA command line tools will work in submitted jobs so long as you properly reference the WEKA jar file at: 
<code><pre>/u/home/FMRI/apps/weka/current/weka.jar</pre></code>
A sample command would be 
<code><pre>$ java -Xmx2g -cp /u/home/FMRI/apps/weka/current/weka.jar weka.classifiers.functions.SMO -o -t awesome_train_file.arff -T awesome_test_file.arff</pre></code>
where
;-Xmx2g
:calls for 2GB of memory
:-Xmx256m calls for 256MB of memory
;-o
:suppresses the model output
;-t awesome_train_file.arff
:specifies the training file
;-T awesome_test_file.arff
:is an optional testing file for the model
:if this option is not provided, 10 fold cross validation will be done using Training data

== Massive Online Analysis (MOA) ==
===GUI===
To run the MOA GUI from Hoffman2
<ol>
<li>Make sure that you enabled X11 forwarding by including the -Y flag in your SSH command: 
<code><pre> $ ssh -Y joebruin@hoffman2.idre.ucla.edu </pre></code>
</li>
<li> Request an [http://www.ats.ucla.edu/clusters/hoffman2/computing/sge_qrsh.htm interactive node] to run on with the following command: 
<code><pre> $ qrsh -l i </pre></code>
</li>
<li> Wait for the new node to appear. Your prompt will change from: 
<code><pre> [joebruin@login4 ~] $ </pre></code>
to something like 
<code><pre> [joebruin@n1234 ~] $ </pre></code>
</li>
<li>Run the command:
<code><pre> $ moa.sh </pre></code>
And the current version of MOA should start up and the GUI will appear.
</li>
</ol>

===Command Line===
Calling any of the usual MOA command line tools will work in submitted jobs so long as you properly reference the MOA jar file at: 
<code><pre>/u/home/FMRI/apps/weka/current/weka.jar</pre></code>
A sample command would be 
<code><pre>$ java -Xmx4g -cp /u/home/FMRI/apps/moa/current/moa.jar -javaagent:sizeofag.jar moa.DoTask "EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000" </pre></code>
where
;-Xmx4g
:calls for 4GB of memory
:-Xmx256m calls for 256MB of memory
; EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000
:is the MOA command to execute

Elau at 02:16, 10 August 2011

2011-08-10T02:16:39Z

← Older revision		Revision as of 02:16, 10 August 2011
Line 39:		Line 39:


	== Massive Online Analysis (MOA) ~~GUI~~==		== Massive Online Analysis (MOA) ==
	===GUI===		===GUI===
	To run the MOA GUI from Hoffman2		To run the MOA GUI from Hoffman2

Elau: /* Command Line */

2011-08-10T01:31:08Z

Command Line

← Older revision		Revision as of 01:31, 10 August 2011
Line 71:		Line 71:
	:-Xmx256m calls for 256MB of memory		:-Xmx256m calls for 256MB of memory
	; EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000		; EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000
	;is the MOA command to execute		:is the MOA command to execute

Elau at 01:30, 10 August 2011

2011-08-10T01:30:55Z

← Older revision		Revision as of 01:30, 10 August 2011
Line 62:		Line 62:

	===Command Line===		===Command Line===
	~~I'm not familiar with this yet, soon to~~ be ~~added~~.		Calling any of the usual MOA command line tools will work in submitted jobs so long as you properly reference the MOA jar file at: <br />
			<code><pre>/u/home/FMRI/apps/weka/current/weka.jar</pre></code>
			A sample command would be<br />
			<code><pre>$ java -Xmx4g -cp /u/home/FMRI/apps/moa/current/moa.jar -javaagent:sizeofag.jar moa.DoTask "EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000" </pre></code>
			where
			;-Xmx4g
			:calls for 4GB of memory
			:-Xmx256m calls for 256MB of memory
			; EvaluatePrequential -l HoeffdingTree -i 1000000 -w 10000
			;is the MOA command to execute