Profiler to measure compute

Compute is one of the key inputs in machine learning, very predictive of performance and relatively easy to measure. However, compute usage typically isn’t reported even in top journal articles. Part of the reason for this is the lack of good profiling tools in GPUs and/or machine learning frameworks. The task is thus to implement an open-source solution into a framework like PyTorch. This could help shift the community's norms towards more transparent reporting, which in turn would create a lever for AI governance interventions.

Lennart Heim has an extensive draft on this issue he would be happy to share on request.