Saideep Gona
July 10, 2023
suppressMessages(library(tidyverse))
suppressMessages(library(glue))
PRE = "/Users/saideepgona/Library/CloudStorage/Box-Box/imlab-data/data-Github/Daily-Blog-Sai"
## COPY THE DATE AND SLUG fields FROM THE HEADER
SLUG="guide_to_running_pytorch_training" ## copy the slug from the header
bDATE='2023-07-10' ## copy the date from the blog's header here
DATA = glue("{PRE}/{bDATE}-{SLUG}")
if(!file.exists(DATA)) system(glue::glue("mkdir {DATA}"))
WORK=DATAHere I compiled a guide on how to run distributed training using pytorch DDP on ALCF Polaris
---
title: "guide_to_running_pytorch_training"
author: "Saideep Gona"
date: "2023-07-10"
format:
html:
code-fold: true
code-summary: "Show the code"
execute:
freeze: true
warning: false
---
```{r}
#| label: Set up box storage directory
suppressMessages(library(tidyverse))
suppressMessages(library(glue))
PRE = "/Users/saideepgona/Library/CloudStorage/Box-Box/imlab-data/data-Github/Daily-Blog-Sai"
## COPY THE DATE AND SLUG fields FROM THE HEADER
SLUG="guide_to_running_pytorch_training" ## copy the slug from the header
bDATE='2023-07-10' ## copy the date from the blog's header here
DATA = glue("{PRE}/{bDATE}-{SLUG}")
if(!file.exists(DATA)) system(glue::glue("mkdir {DATA}"))
WORK=DATA
```
# Context
Here I compiled a guide on how to run distributed training using pytorch DDP on ALCF Polaris
## Set up
### Clone github repo
### Prepare training data
### Decide model starting point
### Create PBS submission script
## Run training session
### wandb log directory
### checkpoint storage
## Results from training
## Restarting training run
## Running inference using trained models