Enter Job ID:

 

Job Found

Program output is shown as following:

1386016377
eucarc = default
eucaImageEmi = 8b058f02-acb1-45a2-927b-98d59ad6c571
instanceType = 3
pubkey = default
numOfNodes = 4
applicationType = TwisterKmeans
Job start Time = 1386016377461

[INFO] Getting cloud mode configuration parameters
[INFO] getting chef cloud parameters.
/home/taklwu/taklwu-sierraKey.pem
/var/www/salsadpi/apps/Twister-Kmeans-0.9.jar
/var/www/salsadpi/input/twisterKmeansInput.tar.gz
/var/www/salsadpi/input/twisterKmeans_init_clusters.txt
[INFO] Amount of running instances(s): 4
Job ID = baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Cloud mode start VM(s) with using chef
[INFO] configured with recipe: recipe[twisterCloud]
[INFO] Knife commands: knife openstack server create -a -I 8b058f02-acb1-45a2-927b-98d59ad6c571 -f 3 -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens -S taklwu-sierraKey -x root -i /home/taklwu/taklwu-sierraKey.pem --insecure -r recipe[twisterCloud]
[INFO] Knife commands: knife openstack server create -a -I 8b058f02-acb1-45a2-927b-98d59ad6c571 -f 3 -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens -S taklwu-sierraKey -x root -i /home/taklwu/taklwu-sierraKey.pem --insecure -r recipe[twisterCloud]
[INFO] Knife commands: knife openstack server create -a -I 8b058f02-acb1-45a2-927b-98d59ad6c571 -f 3 -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens -S taklwu-sierraKey -x root -i /home/taklwu/taklwu-sierraKey.pem --insecure -r recipe[twisterCloud]
[INFO] Knife commands: knife openstack server create -a -I 8b058f02-acb1-45a2-927b-98d59ad6c571 -f 3 -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens -S taklwu-sierraKey -x root -i /home/taklwu/taklwu-sierraKey.pem --insecure -r recipe[twisterCloud]
4 VM(s) are starting.................................
..............................
..............................
..............................
..............................
..............................
..............................
..............................
..............................
..............................
All VMs have been started
[INFO] Node 0 information 943d9ab4-1496-4bf4-b4b3-d115b3f3804a
[INFO] Node 1 information ddcf835d-d1ac-4545-9b8d-30fdf3b19c54
[INFO] Node 2 information b769470a-d853-4841-b06a-a069fcf7e725
[INFO] Node 3 information 4610aa05-e33e-4ad1-a197-584f1e4893ee
[INFO] Total started VM = 4
[INFO] Cloud VM startup plus Chef preparation time = 309.782 Seconds
[INFO] Copying ssh information
[INFO] Setting VM Environment.
[INFO] Connecting to 198.202.121.21
sudo hostname os-5042027228808751
[INFO] uploading data from /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8_hosts to VM's/etc/hosts
[INFO] uploading data from /home/taklwu/taklwu-sierraKey.pem to VM's/root/.ssh/id_rsa
chmod 600 /root/.ssh/id_rsa
[INFO] uploading data from salsaDPI.jar to VM's/root/salsaDPI.jar
mkdir -p /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Uploading Binary and Input
[INFO] /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar /var/www/salsadpi/input/twisterKmeansInput.tar.gz
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeansInput.tar.gz to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeans_init_clusters.txt to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Connecting to 198.202.121.24
sudo hostname os-9156776498168185
[INFO] uploading data from /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8_hosts to VM's/etc/hosts
[INFO] uploading data from /home/taklwu/taklwu-sierraKey.pem to VM's/root/.ssh/id_rsa
chmod 600 /root/.ssh/id_rsa
[INFO] uploading data from salsaDPI.jar to VM's/root/salsaDPI.jar
mkdir -p /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Uploading Binary and Input
[INFO] /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar /var/www/salsadpi/input/twisterKmeansInput.tar.gz
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeansInput.tar.gz to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeans_init_clusters.txt to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Connecting to 198.202.121.25
sudo hostname os-320912645432322
[INFO] uploading data from /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8_hosts to VM's/etc/hosts
[INFO] uploading data from /home/taklwu/taklwu-sierraKey.pem to VM's/root/.ssh/id_rsa
chmod 600 /root/.ssh/id_rsa
[INFO] uploading data from salsaDPI.jar to VM's/root/salsaDPI.jar
mkdir -p /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Uploading Binary and Input
[INFO] /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar /var/www/salsadpi/input/twisterKmeansInput.tar.gz
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeansInput.tar.gz to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeans_init_clusters.txt to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Connecting to 198.202.121.22
sudo hostname os-17917431383688576
[INFO] uploading data from /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8_hosts to VM's/etc/hosts
[INFO] uploading data from /home/taklwu/taklwu-sierraKey.pem to VM's/root/.ssh/id_rsa
chmod 600 /root/.ssh/id_rsa
[INFO] uploading data from salsaDPI.jar to VM's/root/salsaDPI.jar
mkdir -p /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Uploading Binary and Input
[INFO] /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar /var/www/salsadpi/input/twisterKmeansInput.tar.gz
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/apps/Twister-Kmeans-0.9.jar to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeansInput.tar.gz to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] copying data from local client to VMs
[INFO] uploading data from /var/www/salsadpi/input/twisterKmeans_init_clusters.txt to VM's/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[INFO] Cloud Program input preparation time = 56.622 Seconds
End of Copying ssh information
[INFO] starting with recipes service recipe[twisterCloud]
Application Type = TWISTER
Running Twister application, Type: TWISTER
prefix km_data
get TWISTER_HOME and JAVA_HOME
[REMOTE Msg] /tmp/twister-0.9
/tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8_ips /tmp/twister-0.9/bin/nodes
[INFO] uploading data from /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8_ips to VM's/tmp/twister-0.9//bin/nodes
cd /tmp/twister-0.9/bin/; ./TwisterPowerMakeUp.sh
[REMOTE Msg] use normal MultiNode Setup
no special processing to nodes
ActiveMQ uri=failover:(tcp://10.35.23.97:61616)
nodes_file=/tmp/twister-0.9/bin/nodes
daemons_per_node=1
workers_per_daemon=2
app_dir=/tmp/twister-0.9/apps
[REMOTE Msg] 10.35.23.77:/tmp/twister-0.9/data created.
10.35.23.93:/tmp/twister-0.9/data created.
10.35.23.111:/tmp/twister-0.9/data created.
10.35.23.97:/tmp/twister-0.9/data created.
data_dir=/tmp/twister-0.9/data
Change max memory to 2636 MB
[REMOTE Msg] copied to 10.35.23.77:/tmp/twister-0.9
copied to 10.35.23.93:/tmp/twister-0.9
copied to 10.35.23.111:/tmp/twister-0.9
copied to 10.35.23.97:/tmp/twister-0.9
Auto configuration is done.
cd /tmp/twister-0.9/bin/; echo 'uri = failover\:(tcp\://10.35.23.77\:61616)' > amq.properties
cd /tmp/twister-0.9/bin/; scp amq.properties 10.35.23.93:/tmp/twister-0.9//bin/;
cd /tmp/twister-0.9/bin/; scp stimr.sh 10.35.23.93:/tmp/twister-0.9//bin/;
cd /tmp/twister-0.9/bin/; scp amq.properties 10.35.23.97:/tmp/twister-0.9//bin/;
cd /tmp/twister-0.9/bin/; scp stimr.sh 10.35.23.97:/tmp/twister-0.9//bin/;
cd /tmp/twister-0.9/bin/; scp amq.properties 10.35.23.111:/tmp/twister-0.9//bin/;
cd /tmp/twister-0.9/bin/; scp stimr.sh 10.35.23.111:/tmp/twister-0.9//bin/;
[REMOTE Msg] /tmp/apache-activemq-5.4.2
cd /tmp/apache-activemq-5.4.2/bin/; ./activemq start &
[REMOTE Msg] INFO: Using default configuration
(you can configure options in one of these file: /etc/default/activemq /root/.activemqrc)

INFO: Invoke the following command to create a configuration file
./activemq setup [ /etc/default/activemq | /root/.activemqrc ]

INFO: Using java '/tmp/jdk1.6.0_33//bin/java'
INFO: Starting - inspect logfiles specified in logging.properties and log4j.properties to get details
INFO: pidfile created : '/tmp/apache-activemq-5.4.2/data/activemq.pid' (pid '4490')
cd /tmp/twister-0.9/bin/; nohup ./start_twister.sh > nohup.txt &
[INFO] ssh exeAndQuit connection run;
[INFO] Twister Started
[REMOTE Msg] /tmp/twister-0.9
cd /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8;tar -zxvf twisterKmeansInput.tar.gz; cd /tmp/twister-0.9/bin ; ./twister.sh mkdir baf7f9d2-311b-466f-b69f-8f2daab6b7c8; ./twister.sh put /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data baf7f9d2-311b-466f-b69f-8f2daab6b7c8 km_data 1 1;
[REMOTE Msg] data/
data/km_data16.txt
data/km_data7.txt
data/km_data14.txt
data/km_data50.txt
data/km_data77.txt
data/km_data24.txt
data/km_data20.txt
data/km_data6.txt
data/km_data29.txt
data/km_data23.txt
data/km_data62.txt
data/km_data48.txt
data/km_data61.txt
data/km_data64.txt
data/km_data65.txt
data/km_data43.txt
data/km_data74.txt
data/km_data53.txt
data/km_data46.txt
data/km_data76.txt
data/km_data26.txt
data/km_data21.txt
data/km_data30.txt
data/km_data33.txt
data/km_data59.txt
data/km_data22.txt
data/km_data41.txt
data/km_data31.txt
data/km_data3.txt
data/km_data8.txt
data/km_data45.txt
data/km_data66.txt
data/km_data52.txt
data/km_data51.txt
data/km_data39.txt
data/km_data49.txt
data/km_data9.txt
data/km_data44.txt
data/km_data63.txt
data/km_data12.txt
data/km_data25.txt
data/km_data60.txt
data/km_data35.txt
data/km_data17.txt
data/km_data56.txt
data/km_data5.txt
data/km_data38.txt
data/km_data19.txt
data/km_data79.txt
data/km_data2.txt
data/km_data47.txt
data/km_data71.txt
data/km_data54.txt
data/km_data34.txt[REMOTE Msg]
data/km_data72.txt
data/km_data68.txt
data/km_data70.txt
data/km_data40.txt
data/km_data55.txt
data/km_data28.txt
data/km_data73.txt
data/km_data58.txt
data/km_data36.txt
data/km_data1.txt
data/km_data11.txt
data/km_data78.txt
data/km_data13.txt
data/km_data67.txt
data/km_data4.txt
data/km_data69.txt
data/km_data15.txt
data/km_data75.txt
data/km_data18.txt
data/km_data42.txt
data/km_data57.txt
data/km_data37.txt
data/km_data32.txt
data/km_data27.txt
data/km_data0.txt
data/km_data10.txt
[REMOTE Msg] 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8 created.
[REMOTE Msg] 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8 created.
[REMOTE Msg] 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8 created.
[REMOTE Msg] 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8 created.
[REMOTE Msg] Number of files to copy = 80
Number of nodes = 4
Destintion Directory =/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data18.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data71.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data19.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data28.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data47.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data12.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data69.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data55.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data63.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data79.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data33.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data52.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data64.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data72.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data45.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data13.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data60.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data50.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data8.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data77.txt to 10.35.23.77:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data31.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data73.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data37.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data54.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data16.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data35.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data67.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data70.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data11.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data74.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data32.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data24.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data65.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data78.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data29.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data7.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data59.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data42.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data14.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data66.txt to 10.35.23.93:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data23.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data39.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data2.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data48.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data76.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data9.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data58.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data41.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data20.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data61.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data57.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data75.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data68.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data56.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data53.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data3.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data46.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data1.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data17.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data51.txt to 10.35.23.111:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data43.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data22.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data49.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data5.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data4.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data44.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data40.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data21.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data0.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data62.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data10.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data6.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data25.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data36.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data30.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data15.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data38.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data34.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data26.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] INPUT :Copying /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/data/km_data27.txt to 10.35.23.97:/tmp/twister-0.9/data/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
[REMOTE Msg] Total Data Copy Time = 67.132 Seconds.
mv /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/Twister-Kmeans-0.9.jar /tmp/twister-0.9/apps/ ;
ssh 10.35.23.93 'mv /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/Twister-Kmeans-0.9.jar /tmp/twister-0.9//apps/; '
ssh 10.35.23.97 'mv /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/Twister-Kmeans-0.9.jar /tmp/twister-0.9//apps/; '
ssh 10.35.23.111 'mv /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/Twister-Kmeans-0.9.jar /tmp/twister-0.9//apps/; '
[REMOTE Msg] /tmp/twister-0.9
mkdir -p ~/baf7f9d2-311b-466f-b69f-8f2daab6b7c8
cd /tmp/twister-0.9/bin/; ./create_partition_file.sh baf7f9d2-311b-466f-b69f-8f2daab6b7c8/ km_data partition.pf; cp partition.pf /tmp/twister-0.9/samples/kmeans/bin
[REMOTE Msg] Partition file created.
cd /tmp/twister-0.9/samples/kmeans/bin; ./run_kmeans.sh /tmp/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/twisterKmeans_init_clusters.txt 80 partition.pf > ~/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/baf7f9d2-311b-466f-b69f-8f2daab6b7c8.txt
/var/www/salsadpi/./salsaDPI_output/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/output/
Creates the directory : true
[INFO] Download file/dir name .
[INFO] Download file/dir name baf7f9d2-311b-466f-b69f-8f2daab6b7c8.txt
[INFO] Download file/dir name ..
[REMOTE Msg] /tmp/twister-0.9
cd /tmp/twister-0.9/bin/; ./stop_twister.sh
[REMOTE Msg] 10.35.23.77
0 [main] DEBUG cgl.imr.script.StopDaemons - Stopping daemon on port number: 12500
13 [main] DEBUG cgl.imr.script.StopDaemons - Finished sending the term signal to daemons in host: 10.35.23.77
[REMOTE Msg] 10.35.23.93
[REMOTE Msg] 0 [main] DEBUG cgl.imr.script.StopDaemons - Stopping daemon on port number: 12501
8 [main] DEBUG cgl.imr.script.StopDaemons - Finished sending the term signal to daemons in host: 10.35.23.93
[REMOTE Msg] 10.35.23.111
0 [main] DEBUG cgl.imr.script.StopDaemons - Stopping daemon on port number: 12502
7 [main] DEBUG cgl.imr.script.StopDaemons - Finished sending the term signal to daemons in host: 10.35.23.111
[REMOTE Msg] 10.35.23.97
0 [main] DEBUG cgl.imr.script.StopDaemons - Stopping daemon on port number: 12503
7 [main] DEBUG cgl.imr.script.StopDaemons - Finished sending the term signal to daemons in host: 10.35.23.97
cd /tmp/apache-activemq-5.4.2/bin/; ./activemq stop
[REMOTE Msg] INFO: Using default configuration
(you can configure options in one of these file: /etc/default/activemq /root/.activemqrc)

INFO: Invoke the following command to create a configuration file
./activemq setup [ /etc/default/activemq | /root/.activemqrc ]

INFO: Using java '/tmp/jdk1.6.0_33//bin/java'
INFO: Waiting at least 30 seconds for regular process termination of pid '4490' :
Java Runtime: Sun Microsystems Inc. 1.6.0_33 /tmp/jdk1.6.0_33/jre
Heap sizes: current=60672k free=60029k max=901120k
JVM args: -Dactivemq.classpath=/tmp/apache-activemq-5.4.2/conf; -Dactivemq.home=/tmp/apache-activemq-5.4.2 -Dactivemq.base=/tmp/apache-activemq-5.4.2
ACTIVEMQ_HOME: /tmp/apache-activemq-5.4.2
ACTIVEMQ_BASE: /tmp/apache-activemq-5.4.2
Connecting to pid: 4490
[REMOTE Msg] Stopping broker: localhost
[REMOTE Msg] .[REMOTE Msg] . FINISHED
[INFO] Hadoop or Twistert startup time plus program execution time = 131.236 Seconds
[INFO] VM termination and Chef deregistering.....
knife openstack server delete 943d9ab4-1496-4bf4-b4b3-d115b3f3804a -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens --insecure -P -y
knife node delete os-5042027228808751 -y
knife client delete os-5042027228808751 -y
knife openstack server delete ddcf835d-d1ac-4545-9b8d-30fdf3b19c54 -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens --insecure -P -y
knife node delete os-9156776498168185 -y
knife client delete os-9156776498168185 -y
knife openstack server delete b769470a-d853-4841-b06a-a069fcf7e725 -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens --insecure -P -y
knife node delete os-320912645432322 -y
knife client delete os-320912645432322 -y
knife openstack server delete 4610aa05-e33e-4ad1-a197-584f1e4893ee -A taklwu -K qSEYyEqxDaTn --openstack-api-endpoint https://s77r.idp.sdsc.futuregrid.org:5000/v2.0/tokens --insecure -P -y
knife node delete os-17917431383688576 -y
knife client delete os-17917431383688576 -y
[INFO] VM termination and Chef deregister time = 32.166 Seconds
MasterNode Hostname=943d9ab4-1496-4bf4-b4b3-d115b3f3804a
MasterNode Public IP=198.202.121.21
MasterNode Private IP=10.35.23.77
MasterNode Instance Name=os-5042027228808751

[INFO] -------------------------------------------
[INFO] Job baf7f9d2-311b-466f-b69f-8f2daab6b7c8 has been finished
[INFO] Please check program output at local path /var/www/salsadpi/salsaDPI_output/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/output/
[INFO] -------------------------------------------

Output Dir = salsaDPI_output/baf7f9d2-311b-466f-b69f-8f2daab6b7c8/output/

Job Execution Time = 529.995
Job Finished Time = 1386016907456
Job Finished