PT-Logo
Forgot your password?
BenchmarkXPRT Blog banner

Tag Archives: INT8

Understanding the basics of AIXPRT precision settings

A few weeks ago, we discussed one of AIXPRT’s key configuration variables, batch size. Today, we’re discussing another key variable: the level of precision. In the context of machine learning (ML) inference, the level of precision refers to the computer number format (FP32, FP16, or INT8) representing the weights (parameters) a network model uses when [...]

Check out the other XPRTs: