Distributed Training on Edge Devices: Communication compression

(2/3) An Edgify.ai Research Team Publication

Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post

Gradient quantization (GQ)

Gradient Sparsification (GS)

Image for post
Image for post

The Experiments

Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post

Communication Effectiveness

Image for post
Image for post
Image for post
Image for post

Conclusion

Image for post
Image for post
From left to right: Nadav, Itay, Aviv, Neta, Daniel, Tomer, Liron
Image for post
Image for post

Written by

A foundational shift in the world of AI training. Deep Learning and Machine Learning training directly on edge devices.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store