Overfitting & Underfitting (மனப்பாடம் vs புரியாமல் இருப்பது / Memorization vs Confusion)

Let's memorize the old question papers! (பழைய கொஸ்டின் பேப்பரை மனப்பாடம் பண்ணுவோமா!)

Technical Meaning: மிகைப்பொருத்தம் மற்றும் குறைப்பொருத்தம் (Migaipporutham & Kuraipporutham) - When a model memorizes data instead of understanding it.

The Core Idea

When training an AI, there is a delicate balance. If a model Overfits, it memorizes the training data perfectly but fails completely on new, unseen data. If it Underfits, it hasn't learned enough and performs poorly on everything. The goal is to find the "Goldilocks zone" where the model generalizes perfectly.

The Origin Story

Early machine learning researchers noticed a weird phenomenon: the longer they trained a model, the better it got on the training data, but suddenly it started getting worse on the test data! They realized the model was basically cheating—instead of learning the actual underlying logic, it was just memorizing the answers. This led to techniques like Regularization and Dropout to prevent overfitting.

The Tamil Analogy

Think about studying for the TNPSC Group 1 Exams.

• Overfitting: You buy the previous 10 years' question papers and memorize the exact answers word-for-word. In mock exams, you score 100%. But in the real exam, when they slightly change the wording of a question, you completely fail because you didn't understand the concept. You just memorized the data.
• Underfitting: You just glance at the syllabus the night before the exam. You don't know enough to answer anything correctly.
• The Sweet Spot (Generalization): You study the core concepts and understand the logic. You might get 90% in the mock exams (not 100%), but in the real exam, you can adapt to any twist in the questions and pass!

Try It Yourself