Skip to content

Latest commit

 

History

History
113 lines (74 loc) · 6.2 KB

README.md

File metadata and controls

113 lines (74 loc) · 6.2 KB

TriScale_logo

A Framework Supporting Replicable Performance Evaluations in Networking

paper   code   tutorial   group

Tell us about your experience!
If you followed one of our tutorials on TriScale, we would love to hear what you thought about it!
🙏    Please fill out this short survey (5min max)

👉    TriScale_survey

Tutorial

CC BY 4.0

This page gathers tutorial materials related to TriScale. You will find here:

  • Slides and recordings from live tutorial sessions, which are more "lecture-style;"
  • Jupyter notebooks that combine documentation with example code snippets as well as some hands-on exercises.

If you are not familiar with Jupyter notebooks, you can get started with some basics by clicking launch binder button below (it may take a few minutes to load). It will take you to a live demo of Jupyter notebooks covering everything you need to know to follow the TriScale tutorials.
Binder

As an alternative, you can find online many tutorials to get you started (eg the official Jupyter tutorial).


Hands-on notebooks

There are two sets of notebooks covering tutorial materials for TriScale. One is intended for self-study, one for the live tutorial sessions. They cover the same content, but the second set contains less documentation and discussions (since these happen live!).

We recommend that you run the tutorial notebooks online, using Binder, by simply clicking the launch binder buttons listed below (it may take a few minutes to load the first time).

Alternatively, you can of course run them locally after cloning this repo and installing the corresponding dependencies (see instructions).

Experiment sizing

This notebook presents TriScale's experiment_sizing function, which implement a methodology to define the minimal number of runs required to estimate a certain performance objective with a given level of confidence.

Version
Live session Binder
Self-study Binder

Data analysis

This notebook presents TriScale's data analysis functions, leading to the computation of variability scores, which serve to quantify replicability.

Version
Live session Binder
Self-study Binder

Seasonal components

This notebook presents the importance of accounting for seasonal components in the data analysis.

Version
Live session Binder
Self-study Binder

Slides and recordings

Please note that the slides linked below are no scripts or lecture notes but are really designed as support for live presentations: they are not always self-explanatory!

To discover TriScale, we advise starting with tutorial recordings (below) followed by self-study notebooks (above).

Tutorial: Supporting Replicable Networking Experiments with TriScale
4th CPS-IoTBench Workshop, Virtual (May 2021)
video

IoTBench: Reproducibility challenge in wireless networking research
5th CROSS Symposium, Virtual (October 2020)
slides

Confidence in experimental evaluations:
Time to do better than "Believe me, it’s true!"

EWSN Conference, Lyon, France (February 2020)
slides

Reusing this material

All the tutorial material listed on this page is licensed under a Creative Commons Attribution 4.0 International License. You are more than welcome to adapt and/or reuse any of it. If you do so,

  • Please give appropriate credit by indicated the source (this repository);
  • Please drop me a line about it, I would love to here in which context this was useful for you. 🙂