Linux Command Line: File navigation and management
Storage Systems: Home, scratch, temporary storage
Software Management: Module system mastery
Job Scheduling: Slurm job script creation
Best Practices: Troubleshooting and optimization
Key Concepts ✅
Resource Planning: Right-sizing requests
Data Management: Organizing research data
Reproducibility: Version-controlled workflows
Collaboration: Sharing environments
Problem Solving: Debugging HPC issues
Security: Protecting credentials and data
Essential Commands Recap
Category
Command
Purpose
Connection
ssh user@system
Connect to HPC system
Navigation
cd $HOME, cd $SCRATCH
Change directories
Files
ls, cp, mv, rm
List, copy, move, remove
Storage
quota -s, du -hs
Check disk usage
Modules
module load, module list
Manage software
Jobs
sbatch, squeue, scancel
Submit, monitor, cancel
Monitoring
sacct -j JOBID
Check job accounting
Your HPC Workflow
flowchart TD
A[Connect to Aire] --> B[Navigate to project]
B --> C[Load modules]
C --> D[Prepare data in scratch]
D --> E[Write job script]
E --> F[Submit with sbatch]
F --> G[Monitor with squeue]
G --> H[Job completes]
H --> I[Check with sacct]
I --> J[Copy results to research storage]
J --> K[Clean up scratch]