top of page

AI Reproducibility Minute: Implementation Factors

Kevin Coakley
Dec 1, 2022
1 min read

Updated: May 3, 2024

researcher and practitioner survey[s] shows that 83.8% of participants are unaware of or unsure about any implementation-level variance.”



Even if you use the same dataset and software, machine learning (ML) results can vary when run on different hardware and software versions. In order to ensure your ML results can be reproduced by others, consider documenting the following factors:

  • Initialization seeds - note the seeds used

  • Parallel execution - note the number of threads used

  • Processing unit - note which processors were used

  • Software - include the exact version of the operating system and the complete software stack used.

Even better, include a link to the container. Other factors to consider:

Compiler settings

  1. Auto-selection of primitive ops

  2. Floating-point operations

  3. Rounding errors

9 Comments


tomi3e6e
Sep 06

Me pareció muy interesante este artículo, especialmente por la forma sencilla de explicar temas relacionados con los sueños y sus posibles significados. MiCábala parece un recurso interesante para quienes desean conocer más sobre este tema.


Like

Philips Marvel
Aug 23

Trump threatens 51 Lottery     new tariffs on European allies over Greenland until deal reached, as thousands protest


Like

Philips Marvel
Aug 23

Trump threatens BG678 Game      new tariffs on European allies over Greenland until deal reached, as thousands protest


Like

taylor_375
Jul 05

You've explained this better than most of the longer guides I've seen floating around. The practical tips are the kind you can apply today rather than file away for someday. For a slightly different angle on the same idea, there's a bit more waiting at https://pathsinc.org/media/pgs/uncx_disperser__why_bulk_token_distribution_expands_uncx_beyond_liquidity_locking.html.

Like

jordan_9837
Jun 25

Great breakdown — it answered a couple of questions I'd been sitting with for a while. What stood out to me was how you tied the smaller details back to the bigger picture. I touched on the same subject from a different perspective at ube-swap.com a little while back.

Like

Join our mailing list for updates on activities and events

SDSClogo-plusname-red.jpeg
ncstate-type-2x2-red.png
ncsa-logo.png
nsf logo.jpg

This work is supported through the National Science Foundation award # 2226453.

bottom of page