-
π» Computational scientist at Argonne National Laboratory (ALCF)
-
π§ͺ Interested in {AI, HPC} for science1
- π working on scaling large (language, vision, multi-modal) models2 across thousands of GPUs
[!TIP]
[!TIP]
<script> /** Developed by Prashant Shrestha + https://prashant.me */ var lastfmData = { baseURL: "https://ws.audioscrobbler.com/2.0/?method=user.getrecenttracks&user=", // Your Last.fm Username user: "saforem2", // Your API key api_key: "1dbc15037c1fe71ce06acbb3f73adc75", additional: "&format=json&limit=1" }; var getSetLastFM = function() { $.ajax({ type: "GET", url: lastfmData.baseURL + lastfmData.user + "&api_key=" + lastfmData.api_key + lastfmData.additional, dataType: "json", success: function(resp) { var recentTrack = resp.recenttracks.track[0]; var formatted = "" + recentTrack.name; $("a#tracktitle") .html(formatted) .attr("href", recentTrack.url) .attr("title", recentTrack.name + " by " + recentTrack.artist["#text"]) .attr("target", "_blank"); var artistFormatted = "
" + recentTrack.artist["#text"]; $("a#trackartist") .html(artistFormatted) .attr("title", "Artist : " + recentTrack.artist["#text"]); $("img#trackart").attr("src", recentTrack.image[2]["#text"]); }, error: function(resp) { $("a#tracktitle").html( "
" + "Silence!" ); $("img#trackart").attr("src", "π§π»βπ»"); var artistFormatted = "Sam Foreman"; $("a#trackartist") .html(artistFormatted) .attr("href", "https://samforeman.me"); } }); }; // Get the new one. getSetLastFM(); // Start the countdown. setInterval(getSetLastFM, 10 * 1000); </script>
-
π If youβre curious
-
π How I got here
My current research focuses on using deep generative modeling to help build better sampling algorithms in lattice gauge theory. In particular, Iβm interested in building gauge equivariant neural network architectures and using inductive priors to incorporate physical symmetries into machine learning models.
I received my PhD in Physics from the University of Iowa in 2019 and my thesis was on Learning Better Physics: A Machine Learning Approach to Lattice Gauge Theory.
Prior to this, I completed two bachelors degrees (Engineering Physics and Applied Mathematics, 2015) at The University of Illinois at Urbana-Champaign. My undergraduate dissertation was titled Energy Storage in Quantum Resonators and was supervised by Professor Alfred HΓΌbler within the Center for Complex Systems Research at UIUC4.
[NOTE]: You can find a full list of my publications on my Google Scholar.
-
Intro to HPC Bootcamp: Engaging New Communities Through Energy Justice Projects
Journal of Computational Science, 2024 -
Thorough Characterization and Analysis of Large Transformer Model Training At-Scale
Proc. ACM Meas. Anal. Comput. Syst. 03/2024 -
MLMC: Machine Learning Monte Carlo for Lattice Gauge Theory
S. Foreman et al.Β Lattice, 2023 (Proceedings), 12/2023 -
Protein Generation via Genome-scale Language Models with Bio-physical Scoring
@ SCβ23, 11/2023 -
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery [β¦]
@ NeurIPS 2023 AI For Science Workshop, 10/2023 -
Comprehensive Performance Study of LLMs on Novel AI Accelerators
M. Emani, S. Foreman, et al., IPDPS 2024, 10/2023 -
Exploratory Analysis of Climate Data with
ClimRR
S. Foreman, Intro to HPC Bootcamp @ NERSC, 08/2023 -
π GenSLMs: Genome-scale language models reveal SARS-Cov-2 evolutionary dynamics
@ SCβ22 10/2022 -
Lattice QCD and Particle Physics
A.S. Kronfeld et al., 07/2022 -
Applications of ML to Lattice QFT
D. Boyda, S. CalΓ, S. Foreman, et al., [arXiv:2202.05838], 02/2022 -
LeapFrogLayers: Trainable Framework for Effective Sampling
S. Foreman, X.Y. Jin, J.C. Osborn, Lattice, 2021 -
HMC with Normalizing Flows [slides]
S. Foreman et al., Lattice, 2021 -
Deep Learning Hamiltonian Monte Carlo [+ poster]
S. Foreman, X.Y. Jin, & J.C. Osborn, @ SimDL Workshop @ ICLR, 2021 -
Machine Learning and Neural Networks for Field Theory
S. Foreman, X.Y. Jin, & J.C. Osborn, SnowMass, 2020 -
Examples of renormalization group transformations for image sets
S. Foreman et al., Physical Review E., 2018 -
RG inspired Machine Learning for lattice field theory
S. Foreman et al., arXiv:1710.02079, 2017 -
Large Energy Density in Three-Plate Nanocapacitors due to Coulomb Blockade
S. Foreman et al., J. Appl. Phys, 2018
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://samforeman.me/talks/llms-on-polaris/#/section" title="LLMs on Polaris" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/parallel-training-slides" title="Parallel Training Techniques" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/llm-workshop-talk" title="LLMs from Scratch" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">LLMs from Scratch @ LLM Tutorial Workshop [02/2024]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/LLM-tutorial" title="Creating Small(-ish) LLMs" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Creating Small(-ish) LLMs @ LLM Tutorial Workshop (1) [11/2023]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/oneapi-talk" title="Exascale Science on Aurora" width="100%" align="center" height="500" frameborder="0" style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/llm-lunch-talk/#/section" title="LLMs on Polaris" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">LLM Lunch Talk @ ALCF Hands On HPC Workshop [10/2023]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/scaling4science/#/section" title="Scaling LLMs for Science and Ongoing Collaborations" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/lattice23/#/title-slide" title="MLMC: Machine Learning Monte Carlo" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">MLMC: Machine Learning Monte Carlo @ Lattice 2023 [07/2023]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/lqcd-pasc23/" title="Generative Modeling and Efficient Sampling" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Generative Modeling and Efficient Sampling @ PASC23 [07/2023]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/deep-fridays/" title="Efficient Sampling for LGT" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Efficient Sampling for LGT @ Deep Fridays @ U. Bologna [04/2023]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/ai4sci-large-scale-training/#" title="Large Scale Training" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/hparam-management-sdl2022" title="Hyperparameter Management" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Hyperparameter Management @ ALCF SDL Workshop [10/2022]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/ATPESC-StatisticalLearning/#/" title="Statistical Learning" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Statistical Learning @ ATPESC 2022 [08/2022]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/anl-job-talk" title="Scientific Data Science" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Scientific Data Science: An Emerging Symbiosis @ ANL (05/2022)
Your browser does not support iframes.
</iframe>
[!TIP]
Machine Learning in HEP @ UNC Greensboro [03/2022]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/physicsSeminar" title="Machine Learning in HEP" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border:none;border-radius:0.25rem;">
- Machine Learning in HEP, at UNC Greensboro, March 2022
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/l2hmc-dwq25/" title="Accelerated Sampling Methods for LGT" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Accelerated Sampling Methods for LGT, @ DWQ @ 25 [BNL] [12/2021]
Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://saforem2.github.io/l2hmc_talk_ect2021" title="Training Topological Samplers for LGT" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
l2hmc-qcd @ MIT Lattice Group Seminar [2021]
l2hmc-qcd at the MIT Lattice Group Seminar, 2021
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://bit.ly/mainz21" title="Deep Learning HMC for Improved Gauge Generation" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Your browser does not support iframes.
</iframe>
[!TIP]
<iframe loading="lazy" allow="picture-in-picture" src="https://slides.com/samforeman/l2hmc-qcd/embed" title="Machine Learning for Lattice QCD" width="100%" align="center" height="500" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen style="border-radius:0.25rem;border:none;align:center;">Machine Learning for Lattice QCD @ U. Iowa [2020]
Your browser does not support iframes.
</iframe>
[!TIP]
[!TIP]
π
saforem2/
-
Organizer for:
-
SC24 Workshop: High Performance Python for Science at Scale (HPPSS), November 2024
-
SC23 Workshop: High Performance Python for Science at Scale (HPPSS), November 2023
-
Machine Learning and Quantum Computing for Earth Sciences at 17th U. S. National Congress on Computational Mechanics, July 2023
-
TableΒ 1: π Experience
Position | @ | Start | End |
---|---|---|---|
Assistant Computational Scientist | ALCF | 2022 | β |
Postdoc | ALCF | 2019 | 2022 |
Graduate Researcher | ANL | 2018 | 2019 |
TableΒ 2: π Education
Degree | In | @ | End |
---|---|---|---|
PhD | Physics | University of Iowa | 2019 |
B.Sc | Physics | UIUC | 2015 |
B.Sc | Math | UIUC | 2015 |
[updated @ 12:01:03 on 07/19/2024]
Footnotes
-
So far, for: {Lattice QCD, Quantum Mechanics, Biology (Protein Generation, Drug Discovery), and Climate Modeling / Weather Forecasting} β©
-
Mostly trying to get supercomputers to stop yelling at each other π« β©
-
If this sounds like something youβd be interested in doing, please feel free to reach out to me! β©