Follow-up on analog info

[maljoras]

Description and motivation

#316 introduced an analog info functionality. Going forward, we might want to enhance it further by adding the following aspects:

• Add some more summary info like remaining digital-MACs, total number of analog tile mat-vecs
• User-definable "columns" to select only some of the columns to display
• Improve on layout, e.g. the (- - - ) first entry of the tile section is a little confusing
• Count also the peripheral digital ops (e.g noise management, bound management)
• Currently only forward pass is counted, but backward / update would be interesting to add for analog training
• Add other specifics for analog training with analog optimizers (tiki-taka / mixed precision) which need additional tiles internally and additional digital ops

[kaoutar55]

Hi @IHIaadj will you be able to add these enhacements.

[kaoutar55]

@IHIaadj can you please let us know if you are interested in incorporating some of this feedback to analog info.

[anissbslh]

Hi,
we are working on these new enhancements

For now, we added:

• An improved layout
• Display of total digital MACs
• Display of total analog tile matrix-vector multiplications (Mat-Vecs)
• User-selectable columns for a customizable display

Regarding the remaining features, I've been wondering:

Count also the peripheral digital ops (e.g noise management, bound management)

• How can these operations be accurately estimated?

Add other specifics for analog training with analog optimizers (tiki-taka / mixed precision) which need additional tiles internally and additional digital ops

• How should the additional digital operations and tiles be calculated in this context?

[IHIaadj]

@anissbslh any progress on this ?
Can you start by creating the pull request with the added enhancements?

[PabloCarmona]

Hey @anissbslh! Can you open a working/draft PR to start looking at your advancements on this from your fork? Thank you so much for taking care on this feature to help evolving the kit!