User Tools

Site Tools


compute_canada_hacks

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
compute_canada_hacks [2024/02/19 11:54] yanancompute_canada_hacks [2024/05/07 15:55] (current) yanan
Line 1: Line 1:
 +**Preparing your Compute Canada environment**
 +
 +Read this tutorial [[https://github.com/KWLAB/ComputeCanadaWiki|ComputeCanadaWiki]]
 +
 +Official documentation [[https://docs.alliancecan.ca/wiki/Tutoriel_Apprentissage_machine/en#Step_3:_Preparing_your_virtual_environment|Preparing virtual environments]]
 +
 +Globus: file transfer management
 +[[https://docs.alliancecan.ca/wiki/Globus#Personal_Computershttps://docs.alliancecan.ca/wiki/Transferring_data|GlobusSetUp]]
 +
 **Remotely link a port at Compute Canada to your local port** **Remotely link a port at Compute Canada to your local port**
  
-Example: Visualize the training results remotely at your browser. Log in Compute Canada with -L flag +//Example: Visualize the training results remotely at your browser. By default, ssh set up 1-to-1 port number connection 
 +// 
 + 
 +Log in Compute Canada with -L flag  
    
-<code> ssh -L 16006:127.0.0.1:6006 username@graham.computecanada.ca</code> +<code> >> ssh -L 16006:127.0.0.1:6006 username@graham.computecanada.ca</code> 
  
 Once you log in Compute Canada and use 6006 port for the training curve Once you log in Compute Canada and use 6006 port for the training curve
Line 9: Line 22:
 <code> [username@gra-login2 jobs]$  tensorboard --logdir outputs/Astrocytes/WT/log/ --port=6006 </code>  <code> [username@gra-login2 jobs]$  tensorboard --logdir outputs/Astrocytes/WT/log/ --port=6006 </code> 
  
-Your tensorboard curves will be able to view at any browser by opening [[127.0.0.1:16006|127.0.0.1:16006]]+Your tensorboard curves will be able to view at any browser by opening [[http://127.0.0.1:16006|127.0.0.1:16006]] 
 + 
 + 
 + 
 + 
 +**Multifactor authetication** 
 + 
 +Update : April 15, 2024 
 + 
 +Download Duo Mobile on your Android/IOS phone. Scan the Compute Canada login QR code. 
 + The second factor code is the 6 digit code in the Duo Mobile. 
 + 
 +**Job Arrays** 
 + 
 +Update : April 26, 2024 
 + 
 +Submit a sequence of tasks with only varying variable (i.e grid search). The job array allows you to submit a batch of tasks at once.  
 +[[https://docs.alliancecan.ca/wiki/Job_arrays|Job arrays]]
compute_canada_hacks.1708361650.txt.gz · Last modified: 2024/02/19 11:54 by yanan

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki