Series: Machine Learning Concepts

In Machine Learning Concepts – Part 6 – Model Training we briefly glossed over hyperparameters in large language models. In this article we will continue to explore hyperparameters in large language models including what they are, how they are used, and finally look at common techniques for hyperparameter tuning Hyperparameters You can think of hyperparameters as being the knobs and…

We briefly discussed model evaluation previously in our articles on problem definition and data collection, as well as model training. Today’s article will provide additional detail and instruction on model evaluation including how to choose the right metrics, how to calculate them, and how to gain insights from those metrics. 1. The Test Set Remember the different data sets that…